Endoscope system and method of operation thereof

Abstract

An endoscope system and a method of operation thereof are provided, which enable confirmation of differences in a plurality of observation image still images before storage, when the still images are stored. During still image display, which is started by freeze processing, a first storage candidate image corresponding to a still image of a first observation image and a second storage candidate image corresponding to a still image of a second observation image are selected from a still image group as candidates for storage in a still image storage memory (67). The first storage candidate image and the second storage candidate image are automatically switched at a still image switching period faster than a dynamic image switching period and displayed on a display (18).

Description

Technical Field

[0001] This invention relates to an endoscope system and its working method for saving static images of multiple observation images while switching between displaying multiple observation images. Background Technology

[0002] In recent years, endoscopic systems, which include a light source, an endoscope, and a processor, have been widely used in the medical field. In an endoscopic system, illumination light is shone from the endoscope onto the object being observed, and the endoscope's camera element captures an RGB image signal of the object illuminated by that light. The image of the object is then displayed on a monitor.

[0003] Furthermore, in recent years, depending on the diagnostic purpose, multiple observation images with different content are simultaneously displayed or switched on the display. For example, in Patent Document 1, when switching between a first observation image emphasizing superficial blood vessels and a second observation image emphasizing deep blood vessels on the display, the difference between the first and second observation images can be discerned by making the background mucosa of the first and second observation images have the same hue.

[0004] Previous technical documents

[0005] Patent documents

[0006] Patent Document 1: International Publication No. 2019 / 163540

[0007] Patent Document 2: Japanese Patent No. 5587932 Summary of the Invention

[0008] The technical problem to be solved by the invention

[0009] As described above, when multiple observation images with different content are displayed simultaneously or switched on the monitor, it is also necessary to save static images of these multiple observation images in a static image storage memory for subsequent diagnosis. When saving static images of multiple observation images, it is preferable that the user confirms the content of these static images before saving them in the static image storage memory.

[0010] Relatedly, Patent Document 2 describes a method for storing three static images—one for oxygen saturation observation, one for general observation, and one for vascular emphasis observation—as multiple observation images, which are then switched sequentially and continuously displayed on a monitor at regular intervals. However, depending on the display time of the three static images, it is sometimes difficult to grasp the differences in the content of these static images.

[0011] The purpose of this invention is to provide an endoscope system and its working method that can identify the differences between static images of multiple observation images before saving them.

[0012] means for solving technical problems

[0013] The endoscope system of the present invention comprises: a display for displaying a first observation image or a second observation image different from the first observation image; a freeze-frame processing operation unit for performing freeze-frame processing for acquiring a static image of the first observation image or a static image of the second observation image; and an image processing processor, wherein the image processing processor performs the following processing: during dynamic image display, automatically switching the first observation image and the second observation image on the display at a dynamic image switching cycle; during static image display initiated by freeze-frame processing, selecting a first storage candidate image corresponding to the static image of the first observation image and a second storage candidate image corresponding to the static image of the second observation image from a static image group containing the static image of the first observation image and the static image of the second observation image as candidates to be stored in a static image storage memory, and automatically switching the first storage candidate image and the second storage candidate image on the display at a static image switching cycle, such that the static image switching cycle is faster than the dynamic image switching cycle.

[0014] The preferred image processing processor performs the following processing: Among the static images of the first observation image included in the static image group, the static image with the least jitter (the first observation image with the least jitter) is selected as the first candidate image to be saved; and among the static images of the second observation image included in the static image group, the static image with the least positional deviation relative to the static image with the least jitter (the first observation image with the least positional deviation) is selected as the second candidate image to be saved. The preferred image processing processor performs alignment processing to align the static image with the static image with the least positional deviation with the static image with the least positional deviation.

[0015] The preferred image processing processor performs the following processing: Among the static images of the second observation image included in the static image group, the static image with the least jitter (the second observation image with the least jitter) is selected as the second candidate image for saving. Furthermore, among the static images of the first observation image included in the static image group, the static image with the least positional deviation relative to the static image with the least jitter (the second observation image with the least jitter) is selected as the first candidate image for saving. The preferred image processing processor performs alignment processing to align the static image with the static image with the least positional deviation (the first observation image with the least jitter) with the static image with the least jitter (the second observation image with the least jitter).

[0016] Preferably, during the static image switching cycle, the number of times the first candidate image and the second candidate image are switched between are 3 times per second or less. Preferably, the image processing processor uses a user interface to set at least one of the dynamic image switching cycle and the static image switching cycle. Preferably, the image processing processor performs the following processing: when the first observation image is displayed on the screen at the start of freeze-frame processing, during the static image display period, after the static image of the first candidate image is displayed on the screen, the first candidate image and the second candidate image are automatically switched on the screen according to the static image switching cycle.

[0017] Preferably, in addition to the freeze-frame processing operation unit, a save-frame processing operation unit is also provided. This save-frame processing operation unit is used to perform still image save-frame processing, which saves the first save-frame candidate image and the second save-frame candidate image to the still image save memory. The image processing processor performs the following processing: freeze-frame processing is performed at least when the freeze-frame processing operation unit is operated, and during freeze-frame processing, still image save-frame processing is performed by operating the save-frame processing operation unit. Preferably, freeze-frame processing continues even if the operation of the freeze-frame processing operation unit is released during the freeze-frame setting time that begins according to the operation of the freeze-frame processing operation unit.

[0018] Preferably, the device includes: a light source unit that emits a first illumination light having first spectral information and a second illumination light having second spectral information different from the first spectral information; and a light source processor that performs the following processing: automatically switching between the first illumination light and the second illumination light, obtaining a first observation image by photographing an object illuminated by the first illumination light, and obtaining a second observation image by photographing an object illuminated by the second illumination light.

[0019] The preferred image processing processor performs the following processing: acquiring an image for generating an observation image, assigning the first color signal of the image for generating the observation image to the luminance information to generate a first observation image, and assigning the second color signal of the image for generating the observation image to the luminance information to generate a second observation image.

[0020] Preferably, the first observation image and the second observation image show the same observation object, and at least a portion of the background mucosa has the same hue, and the first spectral information of the first observation image is different from the second spectral information of the second observation image.

[0021] The endoscopic system of the present invention comprises: a display for displaying a first observation image or a second observation image different from the first observation image; a freeze-frame processing operation unit for performing freeze-frame processing to acquire a static image of the first observation image or a static image of the second observation image; and an image processing processor for performing the following processing: acquiring an image for generating an observation image, generating either a first color signal image or a second color signal image as the first observation image and using the other as the second observation image, wherein the first color signal image is obtained by assigning a first color signal of the image for generating the observation image to luminance information, and the second color signal image is obtained by assigning a second color signal of the image for generating the observation image to luminance information, and in a dynamic image... During the display period, the first observation image and the second observation image are automatically switched and displayed on the display at a dynamic image switching cycle. During the static image display period that begins with freeze-frame processing, from the static image group containing the static image of the first observation image and the static image of the second observation image, a first candidate image for saving corresponding to the static image of the first observation image with the least jitter and a second candidate image for saving corresponding to the static image of the second observation image generated from the static image generated from the same observation image as the first candidate image for saving are selected as candidates for saving in the static image storage memory. The first candidate image for saving and the second candidate image for saving are automatically switched and displayed on the display at a static image switching cycle, so that the static image switching cycle is faster than the dynamic image switching cycle.

[0022] The present invention discloses an endoscope system operating method, wherein the endoscope comprises: a display for displaying a first observation image or a second observation image different from the first observation image; a freeze-frame processing operation unit for performing freeze-frame processing for acquiring a static image of the first observation image or a static image of the second observation image; and an image processing processor, wherein in the endoscope system operating method, the image processing processor performs the following processing: during dynamic image display, automatically switching the first observation image and the second observation image on the display at a dynamic image switching cycle; during static image display initiated by freeze-frame processing, selecting a first candidate image for storage corresponding to the static image of the first observation image and a second candidate image for storage corresponding to the static image of the second observation image from a static image group containing the static image of the first observation image and the static image of the second observation image as candidates for storage in a static image storage memory, and automatically switching the first candidate image for storage and the second candidate image for storage on the display at a static image switching cycle, such that the static image switching cycle is faster than the dynamic image switching cycle.

[0023] Invention Effects

[0024] According to the present invention, when saving still images of multiple observation images, it is possible to confirm the differences between the still images of these multiple observation images before saving. Attached Figure Description

[0025] Figure 1 This is an external view of the endoscope system according to the first embodiment.

[0026] Figure 2 This is a block diagram illustrating the function of the endoscope system of the first embodiment.

[0027] Figure 3 It is a graph representing the emission spectra of violet light (V), blue light (B), green light (G), and red light (R).

[0028] Figure 4 It is a graph representing the emission spectrum of the first illumination light, which includes violet light (V), green light (G), and red light (R).

[0029] Figure 5 It is a graph representing the emission spectrum of the second illumination light, which contains green light G and red light R.

[0030] Figure 6 It is an image representing the first observed image.

[0031] Figure 7 This is an image representing the second observed image.

[0032] Figure 8 This is an explanatory diagram showing the switching display of the first and second color observation images.

[0033] Figure 9 This is an explanatory diagram showing the periods during which dynamic images are displayed and static images are displayed.

[0034] Figure 10 This is an explanatory diagram representing a group of static images.

[0035] Figure 11 This is an explanatory diagram representing the static image of the first observation image with the least jitter and the static image of the second observation image with the least positional deviation.

[0036] Figure 12 This is an explanatory diagram showing the switching display of a static image of the first observation image with the least jitter and a static image of the second observation image with the least positional deviation.

[0037] Figure 13 This is an explanatory diagram showing the switching cycle of dynamic images and the switching cycle of static images.

[0038] Figure 14 This is an image representing the switching cycle setting menu.

[0039] Figure 15 This is a flowchart illustrating the process of freeze-frame processing and still image saving.

[0040] Figure 16 This is a top view showing a portion of the operating section of an endoscope according to another embodiment.

[0041] Figure 17 This is a block diagram illustrating the function of an endoscope system of another manner in the first embodiment.

[0042] Figure 18 This is a block diagram illustrating the function of the endoscope system in the second embodiment.

[0043] Figure 19 This is an explanatory diagram illustrating the generation process of the first observed image.

[0044] Figure 20 This is an explanatory diagram illustrating the generation process of the second observed image.

[0045] Figure 21 This is an explanatory diagram representing either Mode 1A or Mode 2A when analyzing and processing modes.

[0046] Figure 22 This is an explanatory diagram representing mode 1B when analyzing and processing modes.

[0047] Figure 23 This is an explanatory diagram of mode 2B when representing the analysis and processing mode.

[0048] Figure 24 This is an explanatory diagram of mode 2C when representing the analysis and processing mode.

[0049] Figure 25 This is an explanatory diagram representing the 2D mode when the analysis and processing mode is being used.

[0050] Figure 26 This is an explanatory diagram showing the first and second camera shooting periods.

[0051] Figure 27 This is an explanatory diagram that shows the lighting control, analysis and processing, and image display in the analysis and processing mode in chronological order. Detailed Implementation

[0052] [First Implementation]

[0053] like Figure 1As shown, the endoscope system 10 of the first embodiment includes an endoscope 12, a light source device 14, a processor device 16, a display 18, and a user interface 19. The endoscope 12 is optically connected to the light source device 14 and electrically connected to the processor device 16. The endoscope 12 includes: an insertion portion 12a that is inserted into the patient's body; an operation portion 12b provided at the base of the insertion portion 12a; and a bending portion 12c and a front end portion 12d provided at the front end of the insertion portion 12a. By operating the bend knob 12e of the operation portion 12b, the bending portion 12c bends. With this bending action, the front end portion 12d moves in the desired direction. In addition to the keyboard shown, the user interface 19 also includes a mouse, etc.

[0054] In addition to the bend button 12e, the operation unit 12b also includes a mode switch SW13a and a freeze-frame operation unit 13b. The mode switch SW13a is used to switch between normal observation mode, first special observation mode, second special observation mode, and multiple observation modes. Normal observation mode displays a normal image on the display 18. First special observation mode displays a first observation image emphasizing superficial blood vessels on the display 18. Second special observation mode displays a second observation image emphasizing deep blood vessels on the display 18. Multiple observation mode automatically switches between the first and second observation images for display on the display 18. Furthermore, in addition to the mode switch SW13a, a foot switch can also be used as the mode switching unit for switching modes.

[0055] The freeze-frame processing operation unit 13b is used to perform freeze-frame processing. Furthermore, the freeze-frame processing operation unit 13b also functions as a save-processing operation unit for performing still image saving. The freeze-frame processing is performed at least when the freeze-frame processing operation unit 13b is operated. During this freeze-frame processing, still image saving is performed by further operating the freeze-frame processing operation unit 13b, which functions as a save-processing operation unit. Once the still image saving is complete, the freeze-frame processing, i.e., the static state of the observed image, is released. Details regarding the freeze-frame processing and still image saving will be described later. Furthermore, it is preferable that, during the freeze-frame setting time initiated by the operation of the freeze-frame processing operation unit 13b, freeze-frame processing continues even if the operation of the freeze-frame processing operation unit 13b is released. The freeze-frame setting time can be preset via the user interface 19 operated by a service personnel or similar entity.

[0056] The processor device 16 is electrically connected to the display 18 and the user interface 19. The display 18 outputs displayed image information, etc. The user interface 19 functions as a UI (User Interface) for accepting input operations such as function settings. In addition, an external recording unit (not shown) for recording image information, etc., can be connected to the processor device 16.

[0057] like Figure 2 As shown, the light source device 14 includes a light source unit 20, a light source processor 21, and a light path junction unit 23. The light source unit 20 includes a V-LED (Violet Light Emitting Diode) 20a, a B-LED (Blue Light Emitting Diode) 20b, a G-LED (Green Light Emitting Diode) 20c, and an R-LED (Red Light Emitting Diode) 20d. The light source processor 21 controls the driving of the LEDs 20a to 20d. The light path junction unit 23 combines the light paths of the four colors emitted from the LEDs 20a to 20d. The light combined by the light path junction unit 23 is transmitted to the subject body via a light guide 41 inserted into the insertion part 12a and an illumination lens 45. Alternatively, an LD (Laser Diode) can be used instead of an LED.

[0058] like Figure 3 As shown, V-LED20a produces violet light V with a center wavelength of 405±10nm and a wavelength range of 380~420nm. B-LED20b produces blue light B with a center wavelength of 460±10nm and a wavelength range of 420~500nm. G-LED20c produces green light G with a wavelength range of 480~600nm. R-LED20d produces red light R with a center wavelength of 620~630nm and a wavelength range of 600~650nm.

[0059] In normal observation mode, the light source processor 21 controls each LED 20a to 20d in a normal light mode emitting violet light V, blue light B, green light G, and red light R with an intensity ratio of Vc:Bc:Gc:Rc. Furthermore, in a first special observation mode, the light source processor 21 controls each LED 20a to 20d in a first illumination light mode emitting violet light V, blue light B, green light G, and red light R as first spectral information with an intensity ratio of Vs1:Bs1:Gs1:Rs1. Preferably, the first illumination light can emphasize superficial blood vessels and accurately reproduce the color of the background mucosa. Therefore, for example, as... Figure 4As shown, it is preferable that Vs1 is at least greater than the other Bs1, Gs1, and Rs1. Bs1 can be set to "0". The first illumination light at this time contains violet, green, and red light, thus it can emphasize superficial blood vessels as described above and accurately reproduce the color of the background mucosa, and can also emphasize glandular structures and various structures such as ridges and depressions. Furthermore, the spectrum of the second illumination light described later (refer to...) Figure 5 Compared to ), it is preferable to set Gs1 < Gs2 and Rs1 < Rs2.

[0060] Furthermore, in this specification, the light intensity ratio includes the case where the ratio of at least one semiconductor light source is 0 (zero). Therefore, it includes the case where any one or more of the semiconductor light sources are not turned on. For example, if the light intensity ratio between violet light V, blue light B, green light G, and red light R is 1∶0∶0∶0, the light intensity ratio is also present even if only one semiconductor light source is turned on and the other three are not turned on.

[0061] Furthermore, in the second special observation mode, the light source processor 21 controls each LED 20a to 20d to emit a second illumination light in a manner that serves as second spectral information, emitting a second illumination light with an intensity ratio of Vs²:Bs²:Gs²:Rs². Preferably, the second illumination light can emphasize deep blood vessels and accurately reproduce the color of the background mucosa. Therefore, for example, as Figure 5 As shown, it is preferred that Gs2 and Rs2 > 0. Vs1 and Bs1 are preferably less than Gs2 and Rs2. At this time, the second illumination light contains green light and red light, so it can emphasize deep blood vessels and accurately reproduce the color of the background mucosa.

[0062] When set to multi-observation mode, the light source is controlled by processor 21 as follows: a first illumination light and a second illumination light are emitted during illumination periods of two or more frames, and the first and second illumination lights are automatically switched. The first observation image obtained when the first illumination light is emitted and the second observation image obtained when the second illumination light is emitted are generated in such a way that at least a portion of the background mucosa in each image has the same hue. Here, "same hue of the background mucosa" means that, apart from the background mucosa in the first observation image and the background mucosa in the second observation image having exactly the same hue, the color difference between the background mucosa in the first observation image and the background mucosa in the second observation image is within a specified range. Furthermore, in the first and second observation images, not only can only a portion of the background mucosa be made the same, but the hues of the remaining portion can also be made the same. Additionally, the background mucosa refers to the area of ​​the observed object that does not contain structures such as blood vessels and glandular ducts for identification or imaging.

[0063] Furthermore, a "frame" refers to a unit used to control the imaging sensor 48 in capturing images of the observed object. For example, "1 frame" refers to a period that includes at least an exposure period for exposing the imaging sensor 48 with light from the observed object and a readout period for reading out the image signal. In this embodiment, the light emission period is set in correspondence with the "frame" as the imaging unit.

[0064] Furthermore, the light source processor 21 controls the amount of light emitted from each LED 20a to 20d based on the brightness information sent from the brightness information calculation unit 54 of the processor device 16.

[0065] like Figure 2 As shown, the light guide 41 is built into the endoscope 12 and the universal plug (the plug connecting the endoscope 12, the light source device 14, and the processor device 16), and propagates the light combined through the optical path junction 23 to the front end portion 12d of the endoscope 12. Furthermore, multimode optical fiber can be used as the light guide 41. As an example, a thin-diameter optical fiber cable with a diameter of φ0.3 to 0.5 mm, including a core diameter of 105 μm, a cladding diameter of 125 μm, and a protective layer forming the outer sheath, can be used.

[0066] An illumination optical system 30a and a camera optical system 30b are provided at the anterior end portion 12d of the endoscope 12. The illumination optical system 30a has an illumination lens 45 through which light from the light guide 41 illuminates the object being observed. The camera optical system 30b has an objective lens 46 and a camera sensor 48. Reflected light from the object being observed enters the camera sensor 48 through the objective lens 46. Thus, the reflected image of the object being observed is imaged onto the camera sensor 48.

[0067] The camera sensor 48 is a color camera sensor that captures the reflected image of the subject and outputs an image signal. This camera sensor 48 is preferably a CCD (Charge Coupled Device) camera sensor or a CMOS (Complementary Metal-Oxide Semiconductor) camera sensor, etc. The camera sensor 48 used in this invention is a color camera sensor for obtaining RGB image signals of the three colors: R (red), G (green), and B (blue). Specifically, it is a so-called RGB camera sensor equipped with R pixels (with R filters), G pixels (with G filters), and B pixels (with B filters).

[0068] Furthermore, the image sensor 48 can be a so-called complementary color image sensor, which replaces the RGB color image sensor and has complementary color filters for C (blue), M (magenta), Y (yellow), and G (green). When using a complementary color image sensor, the output image signal consists of four colors: CMYG. Therefore, a complementary color-to-primary color conversion is required to convert the four-color image signal of CMYG into an image signal of three colors: RGB. Alternatively, the image sensor 48 can also be a monochrome image sensor without color filters. In this case, the light source processor 21 turns on the blue light B, green light G, and red light R in a time-division manner, and synchronization processing is required during the processing of the image signal.

[0069] The image signal output from the camera sensor 48 is sent to the CDS / AGC circuit 50. The CDS / AGC circuit 50 performs Correlated Double Sampling (CDS) or Automatic Gain Control (AGC) on the image signal, which is an analog signal. The image signal after passing through the CDS / AGC circuit 50 is converted into a digital image signal by an A / D converter (A / D (Analog / Digital) converter) 52. The A / D converted digital image signal is input to the processor device 16.

[0070] In the processor device 16, programs related to various processes such as freeze-frame processing and still image saving processing are assembled in a program memory (not shown). By executing the program through a central control unit 59 composed of an image processing processor, the processor device 16 realizes the functions of an image acquisition unit 53, a brightness information calculation unit 54, a DSP (Digital Signal Processor) 56, a noise removal unit 58, a signal switching unit 60, a normal viewing image processing unit 62, a first special viewing image processing unit 63, a second special viewing image processing unit 64, a display control unit 66, a still image saving memory 67, and a still image association processing unit 68.

[0071] The image acquisition unit 53 acquires an observation image obtained by photographing the object being observed through the endoscope 12. Specifically, as the observation image, a digital color image signal from the endoscope 12 is input to the image acquisition unit 53. The color image signal is an RGB image signal composed of an R image signal output from the R pixel of the image sensor 48, a G image signal output from the G pixel of the image sensor 48, and a B image signal output from the B pixel of the image sensor 48. The brightness information calculation unit 54 calculates brightness information representing the brightness of the object being observed based on the RGB image signal input from the image acquisition unit 53. The calculated brightness information is sent to the light source processor 21 for controlling the amount of illumination light emitted.

[0072] The DSP56 performs various signal processing operations on the received image signal, including defect correction, offset processing, gain correction, linear matrix processing, gamma conversion, and demosaicing. In defect correction, the signals of defective pixels in the camera sensor 48 are corrected. In offset processing, dark current components are removed from the defect-corrected RGB image signal, and an accurate zero level is set. In gain correction, the signal level is adjusted by multiplying the offset-processed RGB image signal by a specific gain. Linear matrix processing is then applied to the gain-corrected RGB image signal to improve color reproducibility. Subsequently, gamma conversion is performed to adjust brightness and chroma. Demosaicing (also known as isotropic processing or synchronization processing) is then applied to the linear matrix-processed RGB image signal, generating signals for insufficient colors in each pixel through interpolation. Through this demosaicing process, all pixels have signals for each of the RGB colors.

[0073] The noise removal unit 58 removes noise from the RGB image signal by performing noise removal processing (e.g., moving average or median filtering) on ​​the RGB image signal that has already undergone gamma correction in the DSP 56. The noise-removed RGB image signal is then sent to the signal switching unit 60.

[0074] When the mode switch SW13a is set to the normal viewing mode, the signal switching unit 60 sends the RGB image signal to the normal viewing image processing unit 62. Furthermore, when set to the first special viewing mode, the RGB image signal is sent to the first special viewing image processing unit 63. Furthermore, when set to the second special viewing mode, the RGB image signal is sent to the second special viewing image processing unit 64. Furthermore, when set to the multi-viewing mode, the RGB image signal obtained by illumination and imaging with the first illumination light is sent to the first special viewing image processing unit 63, and the RGB image signal obtained by illumination and imaging with the second illumination light is sent to the second special viewing image processing unit 64.

[0075] The normal viewing image processing unit 62 performs normal image processing on the RGB image signal obtained in normal viewing mode. Normal image processing includes normal image structure emphasis processing, etc. In the normal viewing image processing unit 62, normal image parameters are set for multiplying the RGB image signal in order to perform normal image processing. The RGB image signal that has undergone normal image processing is input from the normal viewing image processing unit 62 to the display control unit 66 as a normal image.

[0076] The first special observation image processing unit 63 generates a first observation image based on the RGB image signal of the first observation image obtained during illumination and imaging with the first illumination light, and performs image processing such as chroma enhancement processing, hue enhancement processing, and structure enhancement processing (image processing for the first observation image). The first observation image contains a large number of superficial blood vessels and accurately reproduces the color of the background mucosa. Furthermore, in order to display the first observation image on the display 18 as much as possible, the first special observation image processing unit 63 does not perform superficial blood vessel enhancement processing, but depending on the processing load, superficial blood vessel enhancement processing may be performed.

[0077] The second special observation image processing unit 64 generates a second observation image based on the second RGB image signal of the second observation image obtained during illumination and imaging with the second illumination light, and performs image processing such as chroma enhancement processing, hue enhancement processing, and structure enhancement processing (image processing for the second observation image). The second image contains a large number of deep blood vessels and accurately reproduces the color of the background mucosa. Furthermore, in the multi-observation mode, at least a portion of the background mucosa has the same hue in both the first and second observation images.

[0078] The display control unit 66 controls the display of a normal image, a first observation image, or a second observation image input from the normal observation image processing unit 62, the first special observation image processing unit 63, and the second special observation image processing unit 64 as an image that can be displayed on the display 18. Details regarding the display control unit will be described later.

[0079] The still image association processing unit 68 performs freeze-frame processing to acquire still images corresponding to each viewing mode and still image saving processing to save the still images acquired through freeze-frame processing to the still image saving memory 67. In the case of a normal viewing mode, a still image of a normal image is acquired through freeze-frame processing, and the acquired still image of a normal image is saved to the still image saving memory 67 through still image saving processing. In the case of a first special viewing mode, a still image of a first viewing image is acquired through freeze-frame processing, and the acquired still image of a first image is saved to the still image saving memory 67 through still image saving processing. In the case of a second special viewing mode, a still image of a second viewing image is acquired through freeze-frame processing, and the acquired still image of a second image is saved to the still image saving memory 67 through still image saving processing. Details regarding freeze-frame processing and still image saving processing in multiple viewing modes will be described later.

[0080] The following is a detailed description of the display control unit 66. Based on the control of the display control unit 66, an image corresponding to each viewing mode is displayed. In the normal viewing mode, a normal image is displayed on the display 18. Furthermore, in the first special viewing mode, such as... Figure 6 As shown, a first observation image representing the background mucosa and superficial blood vessels in the observed object is displayed. Furthermore, in the second special observation mode, as... Figure 7 As shown, the second observation image represents the background mucosa and deep blood vessels in the observed object.

[0081] Furthermore, in the case of multiple observation modes, such as Figure 8 As shown, the first and second observation images are switched in color and displayed on the display 18 in conjunction with the emission periods of the first and second illumination lights. That is, when the emission period of the first illumination light is 2 frames and the emission period of the second illumination light is 3 frames, the first observation image is displayed continuously for 2 frames and the second observation image is displayed continuously for 3 frames.

[0082] As described above, in the multi-observation mode, the two observation images (first and second) can be automatically switched for display without requiring a user-based mode switching operation (SW13a). By automatically switching the display, the same object is displayed in both the first and second observation images as long as the object being observed does not move or the tip 12d of the endoscope 12 does not move. However, even though the object is the same in both the first and second observation images, its appearance differs depending on the spectral information. Specifically, superficial blood vessels are more visually recognizable in the first observation image with the first spectral information, while deep blood vessels are more visually recognizable in the second observation image with the second spectral information. Therefore, by switching between the first and second observation images, the visual recognition of multiple blood vessels at different depths can be improved.

[0083] Furthermore, the first and second observation images are obtained using illumination light containing red, green, and blue bands, respectively, thus reproducing the hue of the background mucosa. Therefore, the first and second observation images displayed in the multi-observation mode generate images with background mucosa hues almost identical to the normal images, preventing any sense of incongruity for the user. As a result, users can learn the multi-observation mode in a relatively short time. Moreover, by switching between the first and second observation images, it is possible to understand how blood vessels rise from deep vessels to superficial vessels. Furthermore, since the background mucosa hue is the same in both the first and second observation images, switching images allows for the emphasis on highlighting only the differences in the blood vessels.

[0084] Next, the freeze-frame processing and still image saving processing in multi-view mode will be explained. In multi-view mode, such as... Figure 9 As shown, the period during which the first observation image or the second observation image is displayed on the display 18 is divided into a dynamic image display period and a static image display period that begins through freeze-frame processing. During the dynamic image display period, the first observation image and the second observation image are automatically switched on the display 18 according to the dynamic image switching cycle. The dynamic image display period is a period during which freeze-frame processing or static image saving processing is not performed, or a period that resumes after the static image display period ends.

[0085] During still image display, from a group of still images containing the first observation image and the second observation image, a first candidate image for saving and a second candidate image for saving are selected as candidates for saving in the still image storage memory 67, and the first and second candidate images for saving are automatically switched and displayed on the display 18 during a still image switching cycle. Furthermore, when the first observation image is displayed on the display 18 at the start of freeze-frame processing, during still image display, after the first candidate image for saving is displayed on the display, the first and second candidate images for saving are automatically switched and displayed on the display 18 during a still image switching cycle.

[0086] As a group of still images, specifically, it can be any of the groups of still images acquired during the display of moving images or the groups of still images acquired during the display of still images. For example, such as Figure 10 As shown, during the display of a still image, when a light emission cycle consisting of 3 frames of first illumination light and 2 frames of second illumination light is repeatedly performed, in each light emission cycle, as a still image group, 3 frames of first observation images and 2 frames of second observation images can be obtained. Furthermore, the still image group is not limited to the first or second observation images obtained from one light emission cycle; it can also be the first or second observation images obtained from multiple light emission cycles. Moreover, the still image display period is preferably a predetermined time during which the user can fully grasp the image content of the still image.

[0087] Then, from the set of still images obtained during the display of dynamic images or static images, a first candidate image and a second candidate image are selected as candidates to be saved in the still image storage memory 67. Specifically, among the still images of the first observation image included in the still image set, the still image with the least jitter (the first observation image with the least jitter) is selected as the first candidate image to be saved, and among the still images of the second observation image included in the still image set, the still image with the least positional deviation relative to the still image with the least jitter (the first observation image with the least positional deviation) is selected as the second candidate image to be saved. Furthermore, the still image with the least jitter (the first observation image with the least positional deviation) and the still image with the least positional deviation are preferably aligned using the "positional deviation" related index value described later.

[0088] Alternatively, the following method can be used: among the static images of the second observation image included in the static image group, the static image with the least jitter (the second observation image with the least jitter) is selected as the second candidate image for saving; and among the static images of the first observation image included in the static image group, the static image with the least positional deviation relative to the static image with the least jitter (the second observation image with the least jitter) is selected as the first candidate image for saving. In this case, it is preferable to perform alignment processing to align the static image with the static image with the least positional deviation (the first observation image with the least jitter) with the static image with the least jitter (the second observation image with the least jitter).

[0089] Furthermore, "jitter" refers to the phenomenon of reduced clarity of the observed object caused by 12d movement of the object being observed or the tip of the endoscope. The index value related to "jitter" is preferably calculated based on the spatial frequency of the image, etc., and when selecting the static image of the first observation image with the least jitter, the index value related to "jitter" is preferably used. Additionally, the index value related to "positional deviation" is preferably calculated based on the motion vector of the static image of the first observation image with the least jitter and the static image of the second observation image compared to the static image of the first observation image with the least jitter, and the static image with the least positional deviation is preferably selected using the index value related to "positional deviation".

[0090] For example, such as Figure 11 As shown, when the still image group consists of still images P1a, P1b, and P1c (3 frames of the first observation image) and still images P2a and P2b (2 frames of the second observation image), the first observation image P1b is selected as the still image with the least jitter from the still images of the first observation images P1a, P1b, and P1c. Then, from the still images of the second observation images P2a and P2b, the second observation image P2a is selected as the still image with the smallest positional deviation relative to the first observation image P1b.

[0091] Then, during the static image display, as in the case where the first saved candidate image and the second saved candidate image are automatically switched on the display 18 according to the static image switching cycle, the static image with the smallest jitter (first observation image) and the second observation image with the smallest positional deviation are automatically switched on the display 18 according to the static image switching cycle. For example, as Figure 11 As shown, when the first observation image P1b is selected as the static image with the least jitter and the second observation image P2a is selected as the static image with the least positional deviation, as follows: Figure 12 As shown, the first observation image P1b and the second observation image P2a are automatically switched on the display 18 according to the static image switching cycle. After the user confirms the first observation image P1b and the second observation image P2a on the display 18, the user performs static image saving processing by pressing the freeze processing operation unit 13b, and the first observation image P1b and the second observation image P2a are saved in the static image saving memory 67.

[0092] Here, it is preferable to make the still image switching cycle faster than the dynamic image switching cycle. This is so that the user can confirm the difference between the first and second candidate images to be saved in the still image storage memory 67, and the still image switching cycle is faster than the dynamic image switching cycle. The dynamic image switching cycle is expressed as the number of times the first observation image and the second observation image are switched and displayed on the display 18 per second (times / second). The still image switching cycle is expressed as the number of times the first and second candidate images are switched and displayed on the display 18 per second (times / second).

[0093] For example, such as Figure 13 As shown, by setting the dynamic image switching cycle to 1 time / second and the static image switching cycle to 3 times / second, the difference between the first and second saved candidate images can be reliably confirmed during static image display. The static image switching frequency is preferably 3 times / second or less; exceeding 3 times / second may cause photosensitivity issues. Further details are available at "https: / / www.jstage.jst.go.jp / article / jsmbe1987 / 18 / 1 / 18_1_21 / _pdf" (Special Issue: Health and Safety in the Ubiquitous Image Society, titled "The Effects of Visual Stimulation on Organisms: Brain Waves, Research on Intrabrain Imaging" (BME Vol.18, No.1, 2004)).

[0094] The switching cycles for dynamic and static images can be appropriately changed in the static image association processing unit 68. If a change operation for the dynamic and static image switching cycles is received through the user interface 19, the static image association processing unit 68 will... Figure 14 The switching cycle setting menu is displayed on monitor 18. The still image switching cycle can be changed, for example, in increments of 0.5 times / second, between 1 time / second and 3 times / second. Each switching cycle is assigned to a slider 80a.

[0095] When changing the static image switching cycle, the user interface 19 is operated, and the slider 81a is moved to the position on the slider 80a indicating the desired switching cycle, thereby changing the static image switching cycle. For the dynamic image switching cycle, the user interface 19 is also operated, and the slider 8b is moved to the position on the slider 80b (e.g., capable of changing in 0.5 times / second increments within a switching cycle of 1 to 3 times / second), indicating the desired switching cycle, thereby changing the dynamic image switching period. Furthermore, it is preferable that the static image switching cycle is faster than the dynamic image switching cycle; therefore, the static image switching cycle or the dynamic image switching cycle is changed in a manner that maintains the relationship that the static image switching cycle is greater than the dynamic image switching cycle.

[0096] Next, along Figure 15 The flowchart shown illustrates a series of processes for freeze-frame processing and still image saving in multi-view mode. During dynamic image display, the first and second view images are automatically switched on the display 18 according to the dynamic image switching cycle. Freeze-frame processing is performed by half-pressing the freeze-frame processing operation unit 13b. This switches to still image display mode.

[0097] During still image display, firstly, a first candidate image and a second candidate image are selected from a group of still images containing the first observation image and the second observation image to be saved in the still image storage memory 67. If the first candidate image and the second candidate image are selected, they are automatically switched on the display 18 during the still image switching cycle. By making the still image switching cycle faster than the dynamic image switching cycle, the differences between the first candidate observation image and the second candidate observation image can be further understood.

[0098] When the user agrees to save the first and second candidate images displayed on the display 18 as still images, the still image saving process is performed by pressing the freeze-frame operation unit 13b. Thus, the first and second candidate images are saved in the still image saving memory 67. On the other hand, when the user does not agree to save the first and second candidate images displayed on the display 18 as still images, the freeze-frame operation unit 13b is not operated and the images are directly placed. Alternatively, the user interface 19 is operated to prevent the first and second candidate images from being saved. Then, if the static image display period of the specified time ends, the dynamic image display period is resumed.

[0099] Furthermore, in this embodiment, freeze-frame processing and still image saving processing are performed by a single freeze-frame processing operation unit 13b, but if... Figure 16 As shown, the freeze-frame processing unit 13b can perform freeze-frame processing alone, while the still image saving processing can be performed by the saving processing unit 13c, which is separate from the freeze-frame processing unit 13b.

[0100] Furthermore, in the first embodiment, a normal observation image processing unit 62, a first special observation image processing unit 63, and a second special observation image processing unit 64 are provided. The signal switching unit 60 determines which processing unit will perform the processing based on the observation mode. However, processing can also be performed using other methods. For example, the normal observation image processing unit 62, the first special observation image processing unit 63, and the second special observation image processing unit 64 can be replaced, such as... Figure 17 As shown, a specific image processing unit 80 is set up to combine these processing units 62, 63, and 64, and performs image processing corresponding to each observation mode using parameters corresponding to the observation mode.

[0101] For example, in the case of normal observation mode, image processing is performed in a specific image processing unit 80 using parameters for a normal image, thereby generating a normal image. In the case of the first special observation mode, a first observation image is generated in the specific image processing unit 80 using parameters for a first observation image. In the case of the second special observation mode, a second observation image is generated in the specific image processing unit 80 using parameters for a second observation image. In the case of multiple observation modes, in conjunction with the switching between the first illumination light and the second illumination light, the parameters for the first observation image and the parameters for the second observation image are switched in the specific image processing unit 80, thereby generating the first observation image and the second observation image respectively.

[0102] [Second Implementation]

[0103] In the first embodiment, to acquire two types of observation images, a first illumination light for acquiring the first observation image and a second illumination light for acquiring the second observation image are switched during illumination. However, in the second embodiment, a first observation image with first spectral information and a second observation image with second spectral information different from the first spectral information are acquired from an observation image generation image obtained using a specific light source. The first and second observation images in the second embodiment are generated from an observation image generation image of a single frame, thus ensuring that the observed object is the same and that there is no positional deviation between images.

[0104] In the endoscope system 100 of the second embodiment, such as Figure 18 As shown, in the processor device 16, a special observation image processing unit 102 and a multi-observation image processing unit 104 are provided instead of the first special observation image processing unit 63 and the second special observation image processing unit 64, and a special observation mode and a multi-observation mode are provided instead of the first special observation mode and the second special observation mode. Otherwise, it is basically the same as the first embodiment.

[0105] In the second embodiment, the special observation mode is a mode that displays a special observation image emphasizing blood vessels at a specific depth on the display 18. The multiple observation mode is a mode that generates a first observation image emphasizing superficial blood vessels and a second observation image emphasizing deep blood vessels from an observation image, and automatically switches between the first observation image and the second observation image to display on the display 18.

[0106] In the second embodiment, in special observation mode or multiple observation mode, the light source processor 21 controls each LED 20a to 20d to emit special light in a light intensity ratio of Vs:Bs:Gs:Rs, where the light intensity ratio of violet light V, blue light B, green light G, and red light R is Vs:Bs:Gs:Rs. Preferably, the special light can emphasize blood vessels at a specific depth and accurately reproduce the color of the background mucosa.

[0107] In the second embodiment, when the mode switch SW13a is set to the normal viewing mode, the signal switching unit 60 sends the RGB image signal after noise removal unit 58 to the normal viewing image processing unit 62. Furthermore, when not set to the special viewing mode, the RGB image signal after noise removal unit 58 is sent to the special viewing image processing unit 63. And, when set to the multi-viewing mode, the RGB image signal after noise removal unit 58 is sent to the multi-viewing image processing unit 104.

[0108] The special observation image processing unit 63 receives the Rs image signal, Gs image signal, and Bs image signal obtained in the special observation mode. Special observation mode image processing is performed on the input Rs image signal, Gs image signal, and Bs image signal. In the special observation image processing unit 63, special observation mode parameters are set for multiplying the Rs image signal, Gs image signal, and Bs image signal for special observation mode image processing. The special observation mode image processing includes special observation mode structure emphasis processing, etc. The RGB image signal that has undergone special observation image processing is input from the special observation image processing unit 63 to the display control unit 66 as a special observation image.

[0109] The multi-view image processing unit 104 is input with Rs image signal, Gs image signal, and Bs image signal obtained in multi-view mode. Multi-view mode image processing is performed on the input Rs image signal, Gs image signal, and Bs image signal. Multi-view mode image processing generates multiple observation images emphasizing blood vessels at different depths from a single frame of observation image. In this embodiment, a first observation image emphasizing superficial blood vessels and a second observation image emphasizing deep blood vessels are generated as multiple observation images. Details of multi-view mode image processing will be described later. The first and second observation images are input from the multi-view image processing unit 104 to the display control unit 66. Furthermore, in the multi-view image processing unit 104, multi-view mode parameters are also set for multiplying the Rs image signal, Gs image signal, and Bs image signal for multi-view mode image processing.

[0110] Next, image processing for multiple observation modes will be described. In image processing for multiple observation modes, either a first color signal image or a second color signal image is generated as the first observation image, and the other is used as the second observation image. The first color signal image is obtained by assigning the first color signal of the image used to generate the observation image to the luminance information, and the second color signal image is obtained by assigning the second color signal of the image used to generate the observation image to the luminance information. In this embodiment, the first color signal image is used as the first observation image and the second color signal image is used as the second observation image, but the reverse is also possible.

[0111] like Figure 19As shown, in the first observation image generation process, the Bs image signal, Gs image signal, and Rs image signal obtained in the multi-observation mode are converted into a luminance signal Y and chrominance signals Cr and Cb by luminance signal conversion processing. Next, luminance signal allocation processing is performed to allocate the luminance signal Y (luminance information) to the Bs image signal (the first color signal (blue signal) of the observation image), converting the luminance signal Y into a luminance signal Ym. As described later, the Bs image signal contains information about superficial blood vessels; therefore, for the first observation image, it can be set as an image emphasizing superficial blood vessels as first specific information contained in areas other than the background mucosa. Furthermore, the first observation image is generated based on the Gs image signal and Rs image signal, which contain components of green light G and red light R from a special light source, thus accurately representing the hue of the background mucosa.

[0112] Next, a color difference signal correction process is performed to correct the deviations in the color difference signals Cr and Cb that arise during the conversion of the luminance signal Y to the luminance signal Ym. Specifically, the color difference signal Cr is multiplied by the converted color difference signal Ym / Y. Similarly, the color difference signal Cb is multiplied by the converted color difference signal Ym / Y. Thus, by correcting the deviations in the color difference signals Cr and Cb, chroma deviations can be corrected based on changes in luminance while maintaining hue (chroma decreases when luminance decreases and increases when luminance increases). Then, the luminance signal Ym, the color difference signal Cr×Ym / Y, and the color difference signal Cb×Ym / Y are converted into B1, G1, and R1 image signals, respectively. These B1, G1, and R1 image signals correspond to the first color signal image and become the first observation image.

[0113] like Figure 20 As shown, in the second observation image generation process, which generates the second observation image, the same process as the first observation image generation process is used. The Bs, Gs, and Rs image signals obtained in the multi-observation mode are converted into a luminance signal Y and chrominance signals Cr and Cb through luminance-chrominance signal conversion. Next, a luminance signal allocation process is performed, assigning the luminance signal Y (luminance information) to the Gs image signal (the second color signal (green signal) of the observation image), converting the luminance signal Y into a luminance signal Yn. As described later, the Gs image signal contains information about deep blood vessels; therefore, for the second observation image, it can be set as an image emphasizing deep blood vessels as a second specific information contained in areas other than the background mucosa. Furthermore, since the second observation image is generated based on the Gs and Rs image signals containing components of green light G and red light R from a special light source, it can also accurately represent the hue of the background mucosa.

[0114] Furthermore, the second color signal of the observed image is a color signal having a wavelength component that is longer than the first color signal of the observed image. In this embodiment, the first color signal is set to a blue signal and the second color signal is set to a green signal, but it is not limited to this. For example, the first color signal may be set to a green signal and the second color signal may be set to a red signal, such as the Rs image signal.

[0115] Next, a color difference signal correction process is performed to correct the deviations in the color difference signals Cr and Cb that arise during the conversion of the luminance signal Y to the luminance signal Yn. Specifically, the color difference signal Cr is multiplied by the converted color difference signal Yn / Y. Similarly, the color difference signal Cb is multiplied by the converted color difference signal Yn / Y. This corrects the deviations in the color difference signals Cr and Cb. Then, the luminance signal Yn, the color difference signal Cr×Yn / Y, and the color difference signal Cb×Yn / Y are converted into B2 image signals, G2 image signals, and R2 image signals, respectively. These B2 image signals, G2 image signals, and R2 image signals correspond to the second color signal image, becoming the second observation image.

[0116] The still image saving process of the second embodiment is performed as follows. From the group of still images obtained during still image display, a first candidate image for saving that corresponds to the still image of the first observation image with the least jitter and a second candidate image for saving that corresponds to the still image of the second observation image generated from the same observation image as the first candidate image for saving are selected as candidates for saving in the still image saving memory 67. In addition, the first observation image and the second observation image are images generated from the observation image generation image of 1 frame, so if the jitter of the first observation image is the least, the jitter of the second observation image is also the least. The method for selecting the first observation image with the least jitter is the same as in the first embodiment.

[0117] In addition, in this embodiment, the signal assigned to the Bs image signal, Gs image signal, or composite signal is used as the luminance signal Y, but it can also be assigned to other luminance information. For example, when the first observation image is composed of lightness, chroma, and hue, the Bs image signal or Gs image signal can also be assigned to the lightness corresponding to the luminance information.

[0118] Furthermore, in multiple observation modes, when automatically switching between the first illumination light and the second illumination light to emit light, the light source processor 21 can emit the first illumination light in the first emission mode and the second illumination light in the second emission mode. Specifically, the first emission mode is preferably either mode 1A or mode 1B, such as... Figure 21 As shown, in the first A mode, the number of frames during the first illumination period is the same in each first illumination period, such as... Figure 22As shown, in the first B mode, the number of frames during the first illumination period is different in each first illumination period.

[0119] The second luminous mode is preferably any one of mode 2A, mode 2B, mode 2C, and mode 2D, such as... Figure 21 As shown, in the second A mode, the number of frames during the second illumination period is the same in each second illumination period, and the emission spectrum of the second illumination light is the same in each second illumination period, such as... Figure 23 As shown, in the second B mode, the number of frames during the second illumination period is the same in each second illumination period, and the emission spectrum of the second illumination light is different in each second illumination period, such as... Figure 24 As shown, in the second C mode, the number of frames during the second illumination period is different in each second illumination period, and the emission spectrum of the second illumination light is the same in each second illumination period, such as... Figure 25 As shown, in the second D mode, the number of frames during the second illumination period is different in each second illumination period, and the emission spectrum of the second illumination light is different in each second illumination period. Additionally, the emission spectrum of the first illumination light may be the same or different in each first illumination period.

[0120] Here, it is preferable that the first illumination period is longer than the second illumination period, and more preferably that the first illumination period is two frames or more. For example, in Figure 21 In the case where the first illumination mode is set to mode 1A and the second illumination mode is set to mode 2A (the number of frames during the second illumination period is the same, and the emission spectrum of the second illumination light is the same), the first illumination period is set to 2 frames, and the second illumination period is set to 1 frame. The first illumination light is used to generate a display image displayed on the display 18, so it is preferable to obtain a bright image by illuminating the observed object with the first illumination light.

[0121] For example, the first illumination light is preferably white light. On the other hand, the second illumination light is used for analysis processing, so it is preferable to obtain an image suitable for analysis processing by illuminating the observed object with the second illumination light. For example, when performing analysis processing based on the shape information of multiple blood vessels with different vessel depths, it is preferable to use violet light V, blue light B, green light G, and red light R as the second illumination light. In this case, when the second emission mode is set to mode 2A (the number of frames during the second illumination is the same, and the emission spectrum of the second illumination light is the same) or mode 2C (the number of frames during the second illumination is different, and the emission spectrum of the second illumination light is the same), it is preferable to use any one of violet light V, blue light B, green light G, and red light R. On the other hand, when the second emission mode is set to mode 2B (the number of frames during the second illumination period is the same, but the emission spectrum of the second illumination light is different) or mode 2D (the number of frames during the second illumination period is different, and the emission spectrum of the second illumination light is different), it is preferable to switch at least two of the following lights—violet light V, blue light B, green light G, and red light R—in a specific order during the second illumination period. In the following description, the three lights—violet light V, green light G, and red light R—are emitted sequentially.

[0122] In camera control performed in multi-view mode, such as Figure 26 As shown, during the first illumination period, signal readout is performed while the image sensor 44 is exposed to the first illumination light, thereby outputting a first image signal from the image sensor 44. The period during which the first image signal is output is defined as the first imaging period. The first image signal includes a B1 image signal output from a B pixel, a G1 image signal output from a G pixel, and an R1 image signal output from an R pixel. Furthermore, during the second illumination period, the image processor 45 performs signal readout while the image sensor 44 is exposed to the second illumination light, thereby outputting a second image signal from the image sensor 44. The period during which the second image signal is output is defined as the second imaging period. The second image signal includes a B2 image signal output from a B pixel, a G2 image signal output from a G pixel, and an R2 image signal output from an R pixel.

[0123] In multi-view mode, the analysis processing unit (not shown) within the processor device performs image processing for normal viewing on the input one-frame quantity of R1, G1, and B1 image signals. The R1, G1, and B1 image signals after normal viewing image processing are used as display images. Furthermore, the analysis processing unit analyzes the input specific-frame quantity of R2, G2, and B2 image signals. Finally, the analysis processing unit performs display control processing to display the analysis results, which are the results of the analysis processing, on the display images.

[0124] For example, when the first illumination mode is set to mode 1A and the second illumination mode is set to mode 2B (the number of frames during the second illumination period is the same, but the emission spectrum of the second illumination light is different), if the observed object is illuminated with two frames of white light W as the first illumination light, and during the illumination period of the white light W, the observed object is illuminated with one frame each of violet light V, green light G, and red light R as the second illumination light, then... Figure 27 As shown, an image for display is obtained by performing image processing for normally observed images on the first image signal obtained by illumination with white light.

[0125] On the other hand, the second image signal (R2 image signal, G2 image signal, B2 image signal) obtained by illumination with violet light V is analyzed to obtain analysis result V. Similarly, the second image signal (R2 image signal, G2 image signal, B2 image signal) obtained by illumination with green light G is analyzed to obtain analysis result G. Furthermore, the second image signal (R2 image signal, G2 image signal, B2 image signal) obtained by illumination with red light R is analyzed to obtain analysis result R. After the analysis processing related to red light R is completed, these analysis results V, G, and R are displayed on the display image as a summarized analysis result T. In addition, analysis results V, G, and R can be displayed individually on the display image, or analysis results obtained by combining at least two of the analysis results V, G, and R can be displayed on the display image.

[0126] Additionally, the analysis processing includes, for example, blood vessel extraction processing that extracts shape information of blood vessels, index value calculation processing that calculates index values ​​related to blood vessels based on the extracted shape information of blood vessels, and overlay display control processing for overlaying the calculated index values ​​onto a display image. A display image showing the analysis processing results, along with the accompanying analysis results, is input to the display control unit 66.

[0127] In the first and second embodiments described above, the hardware structure of the processing unit included in the processor device 16, such as the image acquisition unit 53, brightness information calculation unit 54, DSP 56, noise removal unit 58, normal viewing image processing unit 62, first special viewing image processing unit 63, second special viewing image processing unit 64, still image storage memory 67, still image association processing unit 68, display control unit 66, display period setting unit 66a, still image association processing unit 68, specific image processing unit 80, special viewing image processing unit 102, and multi-viewing image processing unit 104, is various processors as shown below. Among these various processors, there are general-purpose processors that execute software (programs) and function as various processing units, such as CPUs (Central Processing Units), FPGAs (Field Programmable Gate Arrays), and other processors whose circuit structure can be changed after manufacturing, such as programmable logic devices (PLDs), and processors with circuit structures specifically designed for performing various processes, such as dedicated circuits.

[0128] A processing unit can be composed of one of these various processors, or it can be composed of a combination of two or more processors of the same or different types (e.g., multiple FPGAs or a combination of a CPU and an FPGA). Furthermore, a single processor can also constitute multiple processing units. Examples of a single processor constituting multiple processing units include: first, computers such as client and server computers, where a single processor is composed of a combination of one or more CPUs and software, and this processor functions as multiple processing units; second, systems-on-chips (SoCs), where a processor that implements the overall functionality of a system containing multiple processing units is used through a single integrated circuit (IC) chip. Thus, various processing units are constructed as hardware structures using one or more of the aforementioned processors.

[0129] Furthermore, the hardware structure of these various processors, more specifically, is a circuit composed of combined semiconductor components and other circuit elements. And the hardware structure of the storage section is a storage device such as an HDD (hard disk drive) or an SSD (solid state drive).

[0130] In addition to being applicable to endoscope systems, the present invention can also be applied to various medical image processing devices other than the processor device assembled in capsule endoscope systems.

[0131] Symbol Explanation

[0132] 10-Endoscope system, 12-Endoscope, 12a-Insertion section, 12b-Operating section, 12c-Bend section, 12d-Front end, 12e-Angle knob, 13a-Mode switch SW, 13b-Freeze processing operation unit, 13c-Save processing operation unit, 14-Light source device, 16-Processor device, 18-Display, 19-User interface, 20-Light source unit, 20a-V-LED, 20b-B-LED, 20c-G-LED, 20d-R-LED, 21-Light source processor, 23-Optical path junction, 30a-Illumination optical system, 30b-Camera optical system, 41-Light guide, 45-Illumination lens, 46-Objective lens, 48 - Camera sensor, 50-CDS / AGC circuit, 52-A / D converter, 53-Image acquisition unit, 54-Brightness information calculation unit, 56-DSP, 58-Noise removal unit, 59-Central control unit, 60-Signal switching unit, 62-Normal observation image processing unit, 63-First special observation image processing unit, 64-Second special observation image processing unit, 66-Display control unit, 67-Still image storage memory, 68-Still image association processing unit, 80-Image processing unit, 80a-Slide bar, 80b-Slide bar, 81a-Slider, 81b-Slider, 100-Endoscope system, 102-Special observation image processing unit, 104-Multi-observation image processing unit.

Claims

1. An endoscope system comprising: A display shows either a first observation image or a second observation image that is different from the first observation image; A freeze-frame processing unit performs freeze-frame processing to acquire a still image of the first observation image or the second observation image; and Image processing processor The image processing processor performs the following processing: During dynamic image display, the first observation image and the second observation image are automatically switched on the display according to the dynamic image switching cycle. During the still image display that begins with the freeze-frame process, a first candidate image for saving and a second candidate image for saving, corresponding to the still image of the first observation image and the still image of the second observation image, are selected from a group of still images containing the still image of the first observation image and the still image of the second observation image, respectively, as candidates for saving in the still image saving memory. The first candidate image and the second candidate image are automatically switched on the display during the still image switching cycle. The dynamic image switching cycle is expressed as the number of times the first observation image and the second observation image are switched and displayed on the display within 1 second, and the static image switching cycle is expressed as the number of times the first saved candidate image and the second saved candidate image are switched and displayed on the display within 1 second. The static image switching period is made longer than the dynamic image switching period. To maintain the relationship that the static image switching period is greater than the dynamic image switching period, a user interface is used to set at least one of the dynamic image switching period and the static image switching period.

2. The endoscope system according to claim 1, wherein, The image processing processor performs the following processing: Among the static images of the first observation image included in the static image group, the static image with the least jitter is selected as the first candidate image to be saved. And among the static images of the second observation image included in the static image group, the static image with the least positional deviation relative to the static image with the least jitter is selected as the second candidate image to be saved.

3. The endoscope system according to claim 2, wherein, The image processing uses a processor to perform alignment processing to align the static image of the first observation image with the minimum jitter with the static image of the second observation image with the minimum positional deviation.

4. The endoscope system according to claim 1, wherein, The image processing processor performs the following processing: Among the static images of the second observation image included in the static image group, the static image with the least jitter is selected as the second candidate image for saving. And among the static images of the first observation image included in the static image group, the static image with the least positional deviation relative to the static image with the least jitter is selected as the first candidate image for saving.

5. The endoscopic system according to claim 4, wherein, The image processing uses a processor to perform alignment processing to align the static image of the first observation image with the smallest position deviation with the static image of the second observation image with the smallest jitter.

6. The endoscopic system according to any one of claims 1 to 5, wherein, During the static image switching cycle, the number of times the static image of the first saved candidate image and the static image of the second saved candidate image are switched and displayed is less than 3 times per second.

7. The endoscopic system according to any one of claims 1 to 5, wherein, The image processing processor performs the following processing: When the first observation image is displayed on the display at the start of the freeze-frame process, during the static image display period, after the static image of the first save candidate image is displayed on the display, the first save candidate image and the second save candidate image are automatically switched on the display at a static image switching cycle.

8. The endoscopic system according to any one of claims 1 to 5, wherein, In addition to the freeze-frame processing unit, there is also a save processing unit, which is used to perform static image save processing, saving the first save candidate image and the second save candidate image to the static image save memory. The image processing processor performs the following processing: The freeze-frame processing is performed at least when the freeze-frame processing operation component is operated, and during the freeze-frame processing, the still image saving process is performed by operating the save-frame processing operation component.

9. The endoscope system according to any one of claims 1 to 5, wherein, During the freeze-time period initiated by the freeze-time processing operation component, the freeze-time processing continues even if the operation of the freeze-time processing operation component is deactivated.

10. The endoscopic system according to any one of claims 1 to 5, wherein, The endoscope system has: The light source unit emits a first illumination light having first spectral information and a second illumination light having second spectral information different from the first spectral information; and Light source processor, The light source is processed by a processor as follows: Automatically switch between the first illumination light and the second illumination light. The first observation image is obtained by photographing the object being observed, which is illuminated by the first illumination light. The second observation image is obtained by photographing the object being observed illuminated by the second illumination light.

11. The endoscope system according to any one of claims 1 to 5, wherein, The image processing processor performs the following processing: Obtain the image to generate the observed image. The observation image generation uses the first color signal of the image to assign to the luminance information to generate the first observation image, and the observation image generation uses the second color signal of the image to assign to the luminance information to generate the second observation image.

12. The endoscope system according to claim 1, wherein, The first and second observation images show the same object, and at least a portion of the background mucosa has the same hue. The first spectral information of the first observation image is different from the second spectral information of the second observation image.

13. The endoscope system according to claim 1, wherein, By operating the freeze-frame processing unit, the first candidate image and the second candidate image are saved in the static image storage memory. If the static image display period of a predetermined time ends when the freeze-frame processing unit is not operated, the display will resume during the dynamic image display period.

14. An endoscope system comprising: A display shows either a first observation image or a second observation image that is different from the first observation image; A freeze-frame processing unit performs freeze-frame processing to acquire a still image of the first observation image or the second observation image; and Image processing processor The image processing processor performs the following processing: Obtain the image to generate the observed image. Either a first color signal image or a second color signal image is generated as the first observation image, and the other is used as the second observation image. The first color signal image is obtained by assigning the first color signal of the image used to generate the observation image to luminance information, and the second color signal image is obtained by assigning the second color signal of the image used to generate the observation image to luminance information. During dynamic image display, the first observation image and the second observation image are automatically switched on the display according to the dynamic image switching cycle. During the still image display that begins with the freeze-frame process, from a group of still images containing the first observation image and the second observation image, a first candidate image for saving corresponding to the still image with the least jitter of the first observation image and a second candidate image for saving corresponding to the still image of the second observation image generated from an image generated from the same observation image as the first candidate image for saving are selected as candidates for saving in the still image storage memory. The first candidate image and the second candidate image for saving are automatically switched on the display during the still image switching cycle. The dynamic image switching cycle is expressed as the number of times the first observation image and the second observation image are switched and displayed on the display within 1 second, and the static image switching cycle is expressed as the number of times the first saved candidate image and the second saved candidate image are switched and displayed on the display within 1 second. The static image switching period is made longer than the dynamic image switching period. To maintain the relationship that the static image switching period is greater than the dynamic image switching period, a user interface is used to set at least one of the dynamic image switching period and the static image switching period.

15. A method of operating an endoscope system, the endoscope system comprising: A display shows either a first observation image or a second observation image that is different from the first observation image; A freeze-frame processing unit performs freeze-frame processing to acquire a still image of the first observation image or the second observation image; and Image processing processor In the working method of the endoscopic system, The image processing processor performs the following processing: During dynamic image display, the first observation image and the second observation image are automatically switched on the display according to the dynamic image switching cycle. During the still image display initiated by the freeze-frame process, a first candidate image for saving and a second candidate image for saving, corresponding to the still image of the first observation image and the still image of the second observation image, are selected from a group of still images containing the still image of the first observation image and the still image of the second observation image, respectively, as candidates for saving in the still image storage memory. The first candidate image and the second candidate image are automatically switched on the display during the still image switching cycle. The dynamic image switching cycle is expressed as the number of times the first observation image and the second observation image are switched and displayed on the display within 1 second, and the static image switching cycle is expressed as the number of times the first saved candidate image and the second saved candidate image are switched and displayed on the display within 1 second. The static image switching period is made longer than the dynamic image switching period. To maintain the relationship that the static image switching period is greater than the dynamic image switching period, a user interface is used to set at least one of the dynamic image switching period and the static image switching period.

Images