Endoscopy system

Abstract

To provide an endoscope system that can automatically generate a display image by placing an image being captured during imaging and a cropped image extracted from a still image taken before the image being captured side by side. [Solution] The processor of the endoscope system is capable of switching between an imaging mode and a comparison mode. In imaging mode, a first image captured by the endoscope during imaging mode is placed at a first image position, and a first display image is captured as a still image by a predetermined operation and stored in the processor's memory. In comparison mode, the still image stored in the memory is read into the processor's image processing unit to extract a first cropped image from the first image position, and further, a second image captured by the endoscope during comparison mode is placed at a second image position, and the first cropped image is placed at a third image position adjacent to the second image position, and the image processing unit generates a second display image.

Description

[Technical Field]

[0001] The present invention relates to an endoscope system. [Background Art]

[0002] Patent Literature 1 discloses an endoscope system including an endoscope processor capable of generating processor images generated in a twin mode (simultaneous display mode). In the processor image generated in the twin mode, a first scope image obtained by an endoscope scope is displayed on the left half, and a first special image obtained by performing special image processing on the first scope image is displayed on the right half. [Prior Art Literature] [Patent Literature]

[0003] [Patent Literature 1] Japanese Unexamined Patent Application Publication No. 2016-30084 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] When a therapeutic procedure such as laser surgery is performed on a living tissue that is an affected area using an endoscope system, the image of the living tissue obtained by the endoscope changes before and after the therapeutic procedure. Therefore, when performing a therapeutic procedure using an endoscope system, the therapeutic procedure is sometimes performed while displaying both a live image captured by the endoscope during the therapeutic procedure and a pre-procedure image showing the living tissue captured by the endoscope before the procedure on a screen such as a monitor for comparison. When displaying a pre-procedure image showing a living tissue together with a live image using a conventional endoscope system, first, a display image including the image of the living tissue displayed on the screen is acquired as a still image by performing an imaging operation before the therapeutic procedure. After that, an operator manually performs image editing work such as trimming on the acquired still image to extract the pre-procedure image (that is, a trimmed image) and display it so that it can be compared with the live image. In conventional endoscopic treatment procedures, when comparing live images with pre-treatment images, the need for manual extraction of pre-treatment images by the operator hinders the smooth execution of the treatment procedure.

[0005] Therefore, the present invention aims to provide an endoscope system that can automatically generate a display image in which an image being captured during imaging and a cropped image extracted from a still image taken before the image being captured are placed adjacent to each other. [Means for solving the problem]

[0006] One aspect of this disclosure is an endoscope for imaging biological tissue, A processor connected to the endoscope, An image processing unit that processes the image captured by the endoscope to generate a display image, A storage unit capable of storing the aforementioned display image, A processor having, A display unit that displays the display image generated by the image processing unit, This is an endoscope system having the following: The processor of the endoscope system can operate by switching between an imaging mode and a comparison mode through a predetermined operation. The aforementioned shooting mode is a first display image based on first setting information, wherein the image processing unit generates a first display image in which the first image captured by the endoscope during the shooting mode is placed at a first image position. The aforementioned shooting mode captures the first display image as a still image by a predetermined operation and stores it in the storage unit. The comparison mode, based on the first setting information, causes the still image stored in the storage unit to be read by the image processing unit and the first cropped image to be extracted from the first image position. The comparison mode is a second display image based on second setting information, wherein the second image captured by the endoscope during the comparison mode is placed at a second image position, and the first trimmed image is placed at a third image position adjacent to the second image position, causing the image processing unit to generate a second display image.

[0007] The display unit may have a display screen that extends in the first direction. The second image position and the third image position may be adjacent to each other so as to be aligned along the first direction.

[0008] The position and size of the first captured image in the first display image may be the same as the position and size of the second captured image in the second display image.

[0009] The comparison mode may cause the image processing unit to adjust the brightness of the first cropped image to match the brightness of the second captured image.

[0010] The endoscope may further include a light source device connected to the processor that emits illumination light onto the biological tissue being imaged by the endoscope. The comparison mode may cause the processor to adjust the illumination light emitted from the light source device so that the brightness of the second captured image matches the brightness of the first cropped image.

[0011] In the comparison mode, the second display image may be captured as a still image by a predetermined operation and stored in the storage unit. The comparison mode may also involve causing the image processing unit to read the still image stored in the storage unit based on the second setting information and extract a second cropped image from the second image position. In the comparison mode, when the image processing unit generates the second display image, the second cropped image may be placed at the third image position.

[0012] Another aspect of this disclosure relates to an endoscope for imaging biological tissue, A processor connected to the endoscope, an image processing unit that performs image processing on a captured image captured by the endoscope to generate a display image; a storage unit capable of storing the display image; a processor comprising: a display unit that displays the display image generated by the image processing unit; is an endoscope system comprising: In the endoscope system, when causing the image processing unit to generate the display image, the processor arranges the captured image at a first image position in the display image based on setting information, the processor captures the display image as a still image by a predetermined operation and stores the still image in the storage unit, the processor, based on the setting information, causes the image processing unit to read the still image stored in the storage unit and extract a trimmed image from the first image position, when causing the image processing unit to generate the display image, the processor arranges the trimmed image at a second image position adjacent to the first image position. Effects of the Invention

[0013] According to the above endoscope system, it is possible to automatically generate a display image in which a captured image during imaging and a trimmed image extracted from a still image captured before the captured image are arranged adjacent to each other. Brief Description of the Drawings

[0014] [Figure 1] (A) is a block diagram of an endoscope system according to an embodiment. (B) is a block diagram showing an example of information data stored in a storage unit according to an embodiment. [Figure 2] It is a schematic diagram of a first display image generated in an imaging mode according to an embodiment. [Figure 3] It is a schematic diagram of a second display image generated in a comparison mode according to an embodiment. [Figure 4]It is a flowchart for generating a second display image in the comparison mode according to the embodiment. [Figure 5] It is a schematic diagram showing a still image and a trimmed image according to the embodiment. [Figure 6] It is a schematic diagram of a second display image generated in the comparison mode according to a modification. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments according to the present disclosure will be described with reference to the drawings. The scale of the drawings is not necessarily accurate, and some features may be exaggerated or omitted. An endoscope system according to the present disclosure has a function of displaying a captured image of a living tissue in a lumen on a screen.

[0016] In the following description, when a display device such as a monitor has a flat display screen along a vertical direction and a horizontal direction, the horizontal direction is defined as the X direction (that is, the screen width direction). The vertical direction is defined as the Y direction (that is, the screen height direction). When the display screen is viewed from the front, the direction from the left side in the screen toward the right side in the screen is referred to as the +X direction. In this case, the direction from the right side in the screen toward the left side in the screen is referred to as the -X direction. In this case, the direction from the lower side in the screen toward the upper side in the screen is referred to as the +Y direction. In this case, the direction from the upper side in the screen toward the lower side in the screen is referred to as the -Y direction.

[0017] An endoscope system 20 according to the embodiment includes an endoscope 22, a light source device 24, a processor 30, and a monitor 26, as shown in FIG. 1(A). The endoscope 22 is insertable into and enters the lumen. The endoscope 22 is capable of imaging biological tissue within the lumen. The endoscope 22 outputs the image of the captured biological tissue as an image signal. The captured image includes a first image PR1, a second image PR2, and a third image PR3, which will be described later. The endoscope 22 has an illumination window corresponding to the light source device 24. The endoscope 22 further has one or more treatment instruments. The treatment instruments include forceps, syringes, high-power laser light emitters, etc. By having treatment instruments, the endoscope 22 is configured to perform treatment procedures such as drug administration and / or laser surgery on the biological tissue being imaged. Here, "imaging" refers to forming an optical image of the subject onto the optical elements in the endoscope 22.

[0018] The light source device 24 is connected to the endoscope 22 and can emit illumination light. The illumination light emitted from the light source device 24 is irradiated through the illumination window onto the biological tissue being imaged by the endoscope 22. The output of the illumination light from the light source device 24 is adjustable.

[0019] The processor 30 is communicated with the endoscope 22 and the light source device 24. The processor 30 can process and store images captured by the endoscope 22. The processor 30 can also control the operation of the light source device 24. The processor 30 will be described in more detail later.

[0020] The monitor 26 is connected to the processor 30 in a communicative manner. The monitor 26 has a display screen 27. The display screen 27 is capable of displaying planar images along the vertical and horizontal directions. The horizontal length of the display screen 27 is longer than the vertical length. In other words, the display screen 27 extends more horizontally than vertically. The monitor 26 displays images processed by the processor 30 on the display screen 27. The monitor 26 is an example of a display unit.

[0021] <Processor 30> As shown in Figure 1(A), the processor 30 includes an interface 32, a control unit 40, an image processing unit 42, and a storage unit 44. The processor 30 further includes an operation unit (not shown) that receives external input. The operation unit of the processor 30 is, for example, a keyboard, a mouse, and / or a touch panel. Interface 32 enables connection to external devices around the processor 30 via cables with communication capabilities. The external devices around the processor 30 include the endoscope 22, the light source device 24, the monitor 26, and the control unit.

[0022] The control unit 40 comprehensively controls the operation of the endoscope system 20. The control unit 40 comprises a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory). The ROM has the function of storing control programs and the like that executed by the CPU. The RAM has the function of storing parameters and the like that used in the control programs and the like that executed by the CPU. The control unit 40 is connected to the interface 32. The control unit 40 can control the operation of external devices around the processor 30 via the interface 32. The operation of the control unit 40 will be described in detail later.

[0023] The storage unit 44 is a storage device such as an HDD (Hard Disk Drive). As shown in Figure 1(B), the storage unit 44 can store information related to the endoscope system 20. The information related to the endoscope system 20 includes setting information and display frames. The setting information and display frames correspond to multiple operating modes pre-set in the processor 30, respectively. The setting information includes first setting information and second setting information. The display frames include background images corresponding to each of the multiple operating modes. The display frames include a first display frame and a second display frame. Details of the various operating modes, setting information, and display frames will be described later. The information relating to the endoscope system 20 further includes image data obtained by a predetermined operation on the endoscope system 20. The image data includes a display image generated by the image processing unit 42. The image data further includes a first still image PS1 and a second still image PS2, which will be described later. The information relating to the endoscopy system 20 further includes information objects corresponding to the patient. The information objects include a basic object BT, a first information object BT1, and a second information object BT2. The basic object BT shows information such as the patient's name, ID (IDentification) number, age, gender, and attending physician. The information shown by the basic object BT may also include the names of the patient's medical conditions and medical history. The first information object BT1 and the second information object BT2 will be described in detail later.

[0024] The image processing unit 42 processes the images captured by the endoscope 22 to generate a display image. Specifically, the image processing unit 42 generates a video signal by applying predetermined image processing to the image signal of the captured image output from the endoscope 22. The image processing unit 42 reads setting information corresponding to the operating mode of the processor 30 from the storage unit 44 and displays the generated video signal as a video at a predetermined position within the corresponding display frame. Based on the read setting information, the image processing unit 42 displays character information indicating various information at a predetermined position within the corresponding display frame. The display image is a display frame on which the video is placed. In other words, the display image is a Picture in Picture. The display image includes a first display image PD1 and a second display image PD2, which will be described later. The first display image PD1 corresponds to the first display frame. The second display image PD2 corresponds to the second display frame. Image processing by the image processing unit 42 includes, for example, color correction, matrix calculation, gradation processing, white balance correction, and the like. The image processing unit 42 may consist of a control unit 40 that enables image processing operations by executing a control program on the CPU.

[0025] The endoscope system 20 is configured to display both an image of the biological tissue being imaged during a procedure and a still image of the biological tissue taken before the procedure on the display screen 27 of the monitor 26, side by side, when the operator performs a treatment procedure using the endoscope system 20. Specifically, the endoscope system 20 can be operated by switching the operating mode of the processor 30 through a predetermined operation by the operator via the endoscope 22 or the operating unit of the processor 30. The operating modes of the processor 30 include an imaging mode MD1 and a comparison mode MD2. In other words, the processor 30 can be operated by switching between imaging mode MD1 and comparison mode MD2 through a predetermined operation. Imaging mode MD1 corresponds to first setting information and a first display frame. Comparison mode MD2 corresponds to second setting information and a second display frame.

[0026] <Shooting Mode MD1> When the processor 30 is in shooting mode MD1, the first display image PD1 is displayed on the display screen 27 of the monitor 26, as shown in Figure 2. The first display image PD1 includes only the first captured image PR1 as an image showing biological tissue captured by the endoscope 22. The first captured image PR1 is an image generated by the image processing unit 42 by processing the image signal captured by the endoscope 22 during shooting mode MD1 and output to the processor 30. The first captured image PR1 includes video. Thus, shooting mode MD1 causes the image processing unit 42 to generate the first display image PD1. The first display image PD1 is generated by the image processing unit 42 based on the first display frame, the first setting information, and the first captured image PR1. A first group of objects, consisting of multiple objects, is displayed within the first display image PD1. The first group of objects includes the first captured image PR1, a basic object BT, a time object TS, and a first information object BT1.

[0027] The first display frame indicates the background image displayed within the display screen 27 in shooting mode MD1. The length of the first display frame displayed within the display screen 27 in the screen width direction is the screen width W27. The length of the first display frame displayed within the display screen 27 in the screen height direction is the screen height H27. In other words, the length of the first display image PD1 in the screen width direction is the screen width W27. The length of the first display image PD1 in the screen height direction is the screen height H27.

[0028] The first setting information includes information indicating the placement position of the first group of objects displayed in the first display image PD1 within the first display frame. Specifically, the first setting information includes information indicating the first image position LC1. The first image position LC1 indicates the position and size of the first captured image PR1 within the first display frame. As shown in Figure 2, the first image position LC1 is set to the left of the center line in the screen width direction of the first display frame. The first captured image PR1 placed at the first image position LC1 is displayed in the first display image PD1 as an image whose length in the screen width direction is the image width WR and whose length in the screen height direction is the image height HR. Preferably, the image width WR of the first captured image PR1 is less than half the screen width W27 of the first display image PD1.

[0029] The first configuration information further includes information indicating the placement positions of the basic object BT, the time object TS, and the first information object BT1 within the first display frame. The time object TS indicates the time information when the endoscope system 20 is operating. The first information object BT1 indicates information about comments entered by an operator using the endoscope system 20 in shooting mode MD1 on the control panel of the processor 30 during the operation. The time object TS is displayed above the first image PR1 in the first display image PD1. The first information object BT1 is displayed to the right of the first image PR1 in the first display image PD1. The basic object BT is displayed to the right of the time object TS and above the first information object BT1 in the first display image PD1.

[0030] When the processor 30 is in shooting mode MD1, the control unit 40 can capture the first display image PD1 as a first still image PS1 by a predetermined operation performed by the operator and store it in the storage unit 44. The first still image PS1 is a still image showing the first display image PD1 generated by the image processing unit 42 at a first time T1 when the predetermined operation is received in shooting mode MD1. In other words, shooting mode MD1 captures the first display image PD1 as a first still image PS1 by a predetermined operation and stores it in the storage unit 44. Here, "capture" refers to taking a so-called screenshot of the display image displayed on the display screen 27. At this time, the memory unit 44 stores first time information TS1 indicating a first time T1 in association with the first still image PS1, in conjunction with the capture of the first still image PS1. At this time, the memory unit 44 further stores comment information indicated by the first information object BT1 in association with the first still image PS1, in conjunction with the capture of the first still image PS1.

[0031] <Contrast Mode MD2> When the processor 30 is in comparison mode MD2, the second display image PD2 is displayed on the display screen 27 of the monitor 26, as shown in Figure 3. The second display image PD2 includes the second captured image PR2 and the first trimmed image PT1, as images showing biological tissue captured by the endoscope 22. The second captured image PR2 is an image obtained by the image processing unit 42 by processing the image signal captured by the endoscope 22 during comparison mode MD2 and output to the processor 30. The second captured image PR2 includes video. The first trimmed image PT1 is a still image extracted in comparison mode MD2 by the image processing unit 42 reading the first still image PS1 from the storage unit 44. The first trimmed image PT1 will be described in detail later. In this way, comparison mode MD2 causes the image processing unit 42 to generate the second display image PD2. The second display image PD2 is generated by the image processing unit 42 based on the second display frame, the second setting information, the second captured image PR2, and the first trimmed image PT1. A second group of objects, consisting of multiple objects, is displayed within the second display image PD2. The second group of objects includes the second captured image PR2, a basic object BT, a time object TS, and a second information object BT2. The second group of objects further includes an object indicating the first time information TS1, the first trimmed image PT1, and the first information object BT1. The comment information shown in the first time information TS1 and the first information object BT1 is read from the storage unit 44 by the image processing unit 42 in comparison mode MD2, along with the first still image PS1.

[0032] The second display frame shows the background image displayed within the display screen 27 in contrast mode MD2. The size of the second display frame displayed within the display screen 27 is the same as the first display frame corresponding to shooting mode MD1. In other words, the length of the second display image PD2 in the screen width direction is the screen width W27. The length of the second display image PD2 in the screen height direction is the screen height H27. The second display frame may have a different color from the first display frame. In this case, the operator can confirm the operating mode of the endoscope system 20 by identifying the color of the background image displayed on the display screen 27.

[0033] The second setting information includes information indicating the placement position of the second group of objects displayed in the second display image PD2 within the second display frame. Specifically, the second setting information includes information indicating the second image position LC2. The second image position LC2 indicates the position and size of the second captured image PR2 within the second display frame. As shown in Figure 3, the second image position LC2 is set to the left of the center line in the screen width direction of the second display frame. The second captured image PR2 placed at the second image position LC2 is displayed in the second display image PD2 as an image whose length in the screen width direction is the image width WR and whose length in the screen height direction is the image height HR. In other words, the size of the second captured image PR2 in the second display image PD2 is the same as the size of the first captured image PR1 in the first display image PD1. Preferably, the position of the second captured image PR2 in the second display image PD2 is the same as the position of the first captured image PR1 in the first display image PD1.

[0034] The second configuration information further includes information indicating the placement positions of the basic object BT, the time object TS, and the second information object BT2 within the second display frame. The basic object BT and the time object TS are as described above. The second information object BT2 indicates information about comments entered by an operator using the endoscope system 20 in comparison mode MD2 on the control panel of the processor 30 during the operation. The time object TS is displayed above the second image PR2 in the second display image PD2. The second information object BT2 is displayed below the second image PR2 in the second display image PD2. The basic object BT is displayed to the right of the time object TS in the second display image PD2. Preferably, the positions of the time object TS and the basic object BT in the second display image PD2 are the same as the positions of the time object TS and the basic object BT in the first display image PD1.

[0035] The second setting information further includes information indicating the third image position LC3. The third image position LC3 indicates the position and size of the first trimmed image PT1 within the second display frame. As shown in Figure 3, the third image position LC3 is set to the right of the center line in the screen width direction of the second display frame. In other words, the third image position LC3 is adjacent to the second image position LC2. The first trimmed image PT1 placed at the third image position LC3 is displayed in the second display image PD2 as an image whose length in the screen width direction is the image width WR and whose length in the screen height direction is the image height HR. In other words, in the second display image PD2, the size of the first trimmed image PT1 is the same as the size of the second captured image PR2. In the second display image PD2, it is preferable that the position of the first cropped image PT1 in the screen height direction is the same as that of the second captured image PR2. In other words, in the second display image PD2, it is preferable that the second captured image PR2 and the first cropped image PT1 are displayed adjacent to each other along the screen width direction. In the second display image PD2, the second captured image PR2 and the first cropped image PT1 may be displayed with a gap between them.

[0036] The second configuration information further includes information indicating the placement of the object representing the first time information TS1 and the first information object BT1 within the second display frame. The object representing the first time information TS1 is displayed below the first cropped image PT1 in the second display image PD2. The first information object BT1 is displayed below the object representing the first time information TS1 in the second display image PD2.

[0037] <How to generate the displayed image> Next, we will explain a method for generating a display image using the endoscope system 20, which shows an image of the biological tissue being imaged in comparison mode MD2 in preparation for performing a treatment procedure, alongside a still image of the biological tissue that was previously stored in a state prior to the performance of the treatment procedure. Figure 4 is a flowchart showing the operation of the endoscope system 20.

[0038] When a worker performs a treatment procedure using the endoscope system 20, the worker first starts the endoscope system 20 and sets the operating mode to the shooting mode MD1 (step S20). At this time, the image processing unit 42 reads the first setting information and the first display frame from the storage unit 44 (step S22).

[0039] Next, the operator inserts and advances the endoscope 22 into the lumen of the patient's body towards the affected area (step S30). At this time, the operator operates the light source device 24 to emit illumination light into the lumen while advancing the endoscope 22. At this time, the image processing unit 42 generates the first display image PD1 shown in Figure 2 based on the first setting information, the first display frame, and the first captured image PR1 generated during the shooting mode MD1 (step S32).

[0040] When the endoscope 22 reaches the affected area in the patient's lumen, the operator performs a predetermined operation at a first time T1 to capture a first display image PD1 as a first still image PS1 and store it in the storage unit 44 (step S40). At this time, the storage unit 44 stores the first time information TS1 and the comment information shown in the first information object BT1 in association with the first still image PS1.

[0041] Next, the operator switches the operating mode of the endoscope system 20 to comparison mode MD2 in preparation for performing the treatment (step S50). At this time, the image processing unit 42 reads the second setting information and the second display frame from the storage unit 44. At this time, the image processing unit 42 further reads the first setting information and the first still image PS1 from the storage unit 44. At this time, along with the first still image PS1, the image processing unit 42 reads the first time information TS1 associated with the first still image PS1 and the comment information shown in the first information object BT1 (step S52).

[0042] Next, as shown in Figure 5, the image processing unit 42 automatically extracts the first cropped image PT1 from the first still image PS1 based on the first setting information it has read (step S60). Specifically, the image processing unit 42 automatically crops only a portion of the image from the first still image PS1 that shows the first captured image PR1 taken at the first time T1, based on the information indicating the first image position LC1 included in the first setting information. The portion of the image cropped from the first still image PS1 based on the information indicating the first image position LC1 is the first cropped image PT1. In this way, the comparison mode MD2 automatically extracts the first cropped image PT1 from the first still image PS1 using the image processing unit 42 based on the first setting information.

[0043] Next, the image processing unit 42 automatically generates a second display image PD2 based on the second display frame, the second setting information, and the second captured image PR2 and the first trimmed image PT1 generated during shooting mode MD1 (step S70). Specifically, when generating the second display image PD2, the image processing unit 42 automatically places the second captured image PR2 at the second image position LC2 within the second display image PD2 based on the second display frame, the second setting information, and the second captured image PR2. At this time, the image processing unit 42 automatically places the first trimmed image PT1 at the third image position LC3 within the second display image PD2 based on the second display frame, the second setting information, and the first trimmed image PT1. The operator performs a treatment on the biological tissue while comparing the image of the biological tissue being captured in real time with the image of the biological tissue before the treatment, based on the second captured image PR2 and the first trimmed image PT1 within the generated second display image PD2. The time when the second captured image PR2 is captured, after the first time T1 when the first still image PS1 was captured, is called the second time T2. The information indicating the second time T2 is called the second time information TS2. At this time, the time object TS of the second display image PD2 indicates the second time T2.

[0044] When a worker emits high-power laser light into biological tissue as part of a treatment procedure, the overall brightness of the area around the biological tissue where the treatment was performed may differ from the overall brightness of the area around the biological tissue at a first time T1, before the treatment procedure was performed. In this case, if the image signal output from the endoscope 22 is processed in the same way as in the MD1 acquisition mode, the overall brightness of the second acquired image PR2 will differ from the overall brightness of the first acquired image PR1, which is displayed as the first trimmed image PT1. When generating the second captured image PR2, the image processing unit 42 calculates the overall brightness of the second captured image PR2 and compares it with the overall brightness of the first captured image PR1, which is the first trimmed image PT1. Based on this, the image processing unit 42 determines whether the difference in overall brightness between the second captured image PR2 and the first trimmed image PT1 exceeds a predetermined threshold. In other words, the image processing unit 42 determines whether there is a difference in brightness between the second captured image PR2 and the first trimmed image PT1 based on the overall brightness of each image. If the difference in overall brightness between the second captured image PR2 and the first trimmed image PT1 exceeds a predetermined threshold, the image processing unit 42 may adjust the overall brightness of the second captured image PR2 when generating it. In this case, the image processing unit 42 adjusts the overall brightness of the second captured image PR2 so that it falls within a predetermined threshold range relative to the overall brightness of the first trimmed image PT1.

[0045] Furthermore, if the overall brightness difference between the second captured image PR2 and the first trimmed image PT1 exceeds a predetermined threshold, the image processing unit 42 may adjust the overall brightness of the first trimmed image PT1 and display it in the second display image PD2. In this case, the image processing unit 42 adjusts the overall brightness of the first trimmed image PT1 so that it falls within a predetermined threshold range relative to the overall brightness of the second captured image PR2. Thus, the contrast mode MD2 may cause the image processing unit 42 to adjust the brightness of the other of the second captured image PR2 or the first trimmed image PT1 so that the brightness of the other of the two is within a predetermined threshold range.

[0046] Furthermore, if the overall brightness difference between the second captured image PR2 and the first trimmed image PT1 exceeds a predetermined threshold, the control unit 40 of the processor 30 may control the light source device 24 to adjust the illumination light emitted from the light source device 24. In this case, the control unit 40 adjusts the illumination light emitted from the light source device 24 so that the brightness of the second captured image PR2 falls within a predetermined threshold range relative to the brightness of the first trimmed image PT1. In other words, the contrast mode MD2 may cause the processor 30 to adjust the illumination light emitted from the light source device 24 so that the brightness of the second captured image PR2 falls within a predetermined threshold range relative to the brightness of the first trimmed image PT1.

[0047] The image processing unit 42 determines whether there is a difference in brightness between the second captured image PR2 and the first trimmed image PT1 based on the overall brightness of each of the second captured image PR2 and the first trimmed image PT1. However, the image processing unit 42 may also determine whether there is a difference in brightness between the second captured image PR2 and the first trimmed image PT1 based on the brightness of a region specified within the second captured image PR2 or the first trimmed image PT1 by the operator.

[0048] Furthermore, when the first display image PD1 is captured as the first still image PS1 before the second time T2, the storage unit 44 may store multiple first still images PS1 due to the operator's actions. In this case, when generating the second display image PD2 in comparison mode MD2, the image processing unit 42 automatically selects the most recent first still image PS1 from among the multiple first still images PS1 stored in the storage unit 44 and extracts the first trimmed image PT1. If multiple first still images PS1 are stored in the memory unit 44, the image processing unit 42 may extract a first trimmed image PT1 from the first still image PS1 selected by the operator.

[0049] (Mechanism of Action and Effects) Next, the operation and effects of the endoscopic system 20 of the embodiment will be described. In comparison mode MD2, the endoscope system 20 reads the first still image PS1 stored in the memory unit 44 into the image processing unit 42 based on the first setting information and automatically extracts the first trimmed image PT1 from the first image position LC1 in the first still image PS1. Subsequently, when the endoscope system 20 generates the second display image PD2, it automatically places the second captured image PR2 at the second image position LC2 in the second display image PD2 based on the second setting information. At this time, the endoscope system 20 automatically places the first trimmed image PT1 at the third image position LC3 in the second display image PD2 based on the second setting information. Therefore, the endoscope system 20 can automatically generate a second display image PD2 in which the second imaging image PR2 and the first trimmed image PT1 showing the first imaging image PR1 extracted from the first still image PS1 are placed adjacent to each other. As a result, when a worker using the endoscope system 20 performs a treatment procedure using comparison images showing biological tissue at the first time point T1 and the second time point T2, comparison images can be automatically generated, allowing the treatment procedure to be performed smoothly.

[0050] In the display screen 27 extending in the width direction, the third image position LC3 and the second image position LC2 are adjacent to each other so as to be aligned along the width direction of the screen. Therefore, the endoscope system 20 can improve the visibility of the second captured image PR2 and the first trimmed image PT1 in comparison mode.

[0051] The position of the second image PR2 in the second display image PD2 is the same as the position of the first image PR1 in the first display image PD1. Therefore, with the endoscope system 20, when switching from the shooting mode MD1 to the comparison mode MD2 while visually observing the first image PR1, the unnatural appearance of the screen displayed on the display unit can be reduced.

[0052] In contrast mode MD2, the image processing unit 42 may adjust the brightness of the second image PR2 or the first cropped image PT1 so that its brightness falls within a predetermined threshold range relative to either the second image PR2 or the first cropped image PT1. Alternatively, in contrast mode MD2, the processor 30 may adjust the illumination light emitted from the light source device 24 so that the brightness of the second image PR2 falls within a predetermined threshold range relative to the brightness of the first cropped image PT1. In this case, when the endoscope system 20 compares the second image and the first cropped image, it can reduce the sense of incongruity caused by the difference in brightness between the second image PR2 and the first cropped image PT1.

[0053] As described above, an example of an embodiment of the present invention has been explained, but the present invention is not limited to the above embodiment, and various modifications, changes, and improvements are possible within the scope of the technical idea of ​​the present invention.

[0054] In this embodiment, the first trimmed image PT1, which is placed within the second display image PD2, is extracted from the first still image PS1, which is captured in shooting mode MD1. However, the endoscope system 20 according to this disclosure may be configured such that, when in comparison mode MD2, the operator can capture the second display image PD2 as a second still image PS2 (not shown) and store it in the storage unit 44. The second still image PS2 is a still image showing the second display image PD2 generated by the image processing unit 42 at a second time T2 when the predetermined operation is received in comparison mode MD2. In this case, the memory unit 44 stores second time information TS2 indicating a second time T2 in association with the second still image PS2 when the second still image PS2 is captured. At this time, the memory unit 44 also stores comment information indicated by a second information object BT2 in association with the second still image PS2 when the second still image PS2 is captured. In this case, the image processing unit 42 automatically crops only the portion of the second image captured image PR2, which was captured at the second time T2, from the second still image PS2, based on the information indicating the second image position LC2 included in the second setting information. In this case, as shown in Figure 6, the endoscope system 20 acquires the third image PR3 with the endoscope 22 at a third time T3, which is later than the second time T2. At this time, the image processing unit 42 automatically generates the second display image PD2 based on the second display frame, the second setting information, the second image PR2, and the second trimmed image PT2. Specifically, when generating the second display image PD2, the image processing unit 42 automatically places the third image PR3 at the second image position LC2 within the second display image PD2 based on the second display frame, the second setting information, and the third image PR3. At this time, the image processing unit 42 automatically places the second trimmed image PT2 at the third image position LC3 within the second display image PD2 based on the second display frame, the second setting information, and the second trimmed image PT2. At this time, the time object TS of the second display image PD2 indicates the third time T3. In this case, the endoscope system 20 can automatically generate a second display image PD2 in which the third imaging image PR3 and the second trimmed image PT2 showing the second imaging image PR2 extracted from the second still image PS2 are placed adjacent to each other. Furthermore, if the endoscope system according to this disclosure is configured to capture a second display image PD2 as a second still image PS2 in comparison mode MD2 and store it in the storage unit 44, then the operating modes do not need to include the shooting mode MD1.

[0055] The display screen 27 of the monitor 26 in the embodiment extends horizontally (i.e., in the screen width direction). However, the extension direction of the display screen according to this disclosure is not limited to the screen width direction. The extension direction of the display screen according to this disclosure may be in the screen height direction. In this case, it is preferable that the captured image and the cropped image displayed in comparison mode are placed within the display image and arranged adjacent to each other in the screen height direction.

[0056] In this embodiment, the storage unit 44 is assumed to be a storage device such as an HDD of the processor 30. However, the storage unit according to this disclosure may also include an external storage device connected to the processor 30 via an interface 32. In this case, the external storage device may be configured to store only data indicating information objects corresponding to the patient and image data obtained in each operating mode of the endoscopy system 20. Such an endoscopy system 20 allows for efficient management of electronic data related to the operation of the endoscopy system 20. [Explanation of Symbols]

[0057] 20 Endoscopy Systems 22 Endoscopes 24 Light source device 26 monitors 27 Display screen 30 processors 32 Interfaces 40 Control Unit 42 Image Processing Unit 44 Storage section MD1 shooting mode PD1 First display image PR1 First acquired image LC1 First image position BT1 First information object BT Basic Objects HR Image Height WR Image Width T1 First period PS1 First still image PT1 First cropped image MD2 comparison mode T2 Second Period PD2 Second display image PR2 Second acquired image LC2 Second image position BT2 Second Information Object LC3 Third image position T3 Third Time PS2 Second still image PT2 Second cropped image

Claims

1. An endoscope for imaging biological tissue, A processor connected to the endoscope, An image processing unit that processes the image captured by the endoscope to generate a display image, A storage unit capable of storing the aforementioned display image, A processor having, A display unit that displays the display image generated by the image processing unit, An endoscopic system having, The processor can operate by switching between shooting mode and contrast mode through a predetermined operation. The aforementioned shooting mode is a first display image based on first setting information, wherein the image processing unit generates a first display image in which the first image captured by the endoscope during the shooting mode is placed at a first image position. The aforementioned shooting mode captures the first display image as a still image by a predetermined operation and stores it in the storage unit. The comparison mode, based on the first setting information, causes the still image stored in the storage unit to be read by the image processing unit and the first cropped image to be extracted from the first image position. The comparison mode is a second display image based on second setting information, wherein the second image captured by the endoscope during the comparison mode is placed at a second image position, and the first trimmed image is placed at a third image position adjacent to the second image position, causing the image processing unit to generate a second display image. Endoscopic system.

2. The display unit has a display screen that extends in a first direction, The endoscope system according to claim 1, wherein the second image position and the third image position are adjacent to each other so as to be aligned along the first direction.

3. The endoscopic system according to claim 2, wherein the position and size of the second image in the second display image are the same as the position and size of the first image in the first display image.

4. The endoscope system according to any one of claims 1 to 3, wherein the comparison mode causes the image processing unit to adjust the brightness of the other of the second captured image or the first trimmed image so that the brightness of the other of the two

5. The device further comprises a light source connected to the processor and emitting illumination light onto the biological tissue being imaged by the endoscope, The endoscope system according to any one of claims 1 to 3, wherein the comparison mode causes the processor to adjust the illumination light emitted from the light source device so that the brightness of the second image is within a predetermined threshold range with respect to the brightness of the first cropped image.

6. The comparison mode involves capturing the second display image as a still image by a predetermined operation and storing it in the storage unit. The comparison mode, based on the second setting information, causes the still image stored in the storage unit to be read by the image processing unit and a second cropped image to be extracted from the second image position. The comparison mode causes the image processing unit to generate the second display image, and to place the second cropped image at the third image position. The endoscopic system according to any one of claims 1 to 3.

7. An endoscope for imaging biological tissue, A processor connected to the endoscope, An image processing unit that processes the image captured by the endoscope to generate a display image, A storage unit capable of storing the aforementioned display image, A processor having, A display unit that displays the display image generated by the image processing unit, An endoscopic system having, When the processor causes the image processing unit to generate the display image, it causes the captured image to be placed at a first image position within the display image based on the setting information. The processor captures the display image as a still image by performing a predetermined operation and stores it in the storage unit. Based on the setting information, the processor causes the image processing unit to read the still image stored in the storage unit and extract a cropped image from the first image position. When the processor causes the image processing unit to generate the display image, it causes the cropped image to be placed at a second image position adjacent to the first image position. Endoscopic system.

Images