Endoscopy Information Management System

Abstract

To provide an endoscope information management system that enables a part or the whole of a series of operations related to an endoscope examination to be carried out smoothly.SOLUTION: An image selection support unit 223 automatically selects an endoscope image to be used in a report out of a plurality of endoscope images using a recognition result acquired by recognizing a part of a subject shown in the endoscope images. The recognition result is acquired from an imaging position recognition part 61 in an endoscope device 21 or an imaging position recognition part 231 in an endoscope information management system 10.SELECTED DRAWING: Figure 13

Description

[Technical Field]

[0001] The present invention relates to an endoscope information management system that manages information related to an endoscope. [Background technology]

[0002] Examinations and surgeries using endoscopes have become widespread in the medical field. Known devices or systems for managing information related to endoscopes include an image management device for managing endoscopic images (Patent Document 1), a diagnosis support device for supporting diagnoses (Patent Document 2), a report creation support system for supporting report creation (Patent Document 3), a cleaning management system for managing endoscope cleaning (Patent Document 4), and a repair information management system for managing information related to endoscope repairs (Patent Document 5). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-053723 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-157384 [Patent Document 3] Japanese Patent Application Laid-Open No. 2011-072663 [Patent Document 4] Japanese Patent Application Laid-Open No. 2015-195867 [Patent Document 5] Japanese Patent Application Laid-Open No. 2015-099503 Summary of the Invention [Problem to be solved by the invention]

[0004] When performing an examination using an endoscope, various related tasks occur in addition to observing or photographing the subject. For example, before the examination, there is work related to preparation for conducting the examination according to the order. During the examination, in addition to observing or photographing the subject for the examination, there may be tasks such as collecting samples for a biopsy or performing endoscopic surgery, if necessary. Furthermore, after the examination, the doctor may have tasks such as creating a report using endoscopic images. After the examination, the doctor or other medical staff may have tasks such as attaching labels to containers for storing samples or cleaning the endoscope used for the examination.

[0005] The above-mentioned endoscopic examinations and the tasks associated with endoscopic examinations are closely related to each other. Each task is performed using equipment appropriate for that task. For example, an endoscopic examination is performed using an endoscopic device that includes an endoscope, a light source device, and a processor device. On the other hand, for example, a report is created using a report creation device separate from the endoscopic device. Similarly, a cleaning and disinfecting device separate from the endoscopic device is used to clean the endoscope. The same is true for other related tasks.

[0006] Therefore, if the devices that perform each task are not closely connected, it will be inconvenient to perform each task. Therefore, it is desirable that some or all of the devices that perform endoscopic examinations and tasks related to endoscopic examinations be closely connected.

[0007] The present invention aims to provide an endoscopic information management system that enables smooth execution of some or all of the tasks related to endoscopic examinations by comprehensively managing information related to endoscopic examinations. [Means for solving the problem]

[0008] The present invention is an endoscope information management system connected to an endoscope device, and a photographing position recognition unit in the endoscope information management system recognizes the part of the subject appearing in the endoscope image, and uses the recognition result to select a report from among a plurality of endoscope images. Creation screenand an image selection support unit that automatically selects an endoscopic image to be used in the endoscope system. The recognition result is obtained from a photographing position recognition unit in the endoscope system or a photographing position recognition unit in the endoscope information management system. Then, press the Confirm button to confirm the input contents on the report creation screen, and creation of the report creation screen will be completed. It is preferable to have a patient information acquisition unit that acquires patient information to be used on the report creation screen from a patient information database.

[0009] The recognition result is sent from the imaging position recognition unit in the endoscope device. In real time The recognition result is preferably acquired from the imaging position recognition unit in the endoscope information management system. After the examination It is preferable to obtain

[0010] The image selection support unit Using recognition processing, Report Creation screen In in advance It is preferable to select an endoscopic image of a portion that is designated for use. A schematic diagram is automatically selected using an image selection support unit. and automatically insert the schematic diagram into the report creation screen. It is preferable.

[0011] The image selection support unit may be configured to select an endoscope image from a classification unit, and the ...

[0012] The image selection support unit preferably selects an endoscopic image in which a procedure has been recognized. The procedure is preferably recognized by a procedure recognition unit of the endoscopic device. The procedure is preferably recognized by a procedure recognition unit in the endoscopic information management system. The image selection support unit preferably selects an endoscopic image in which a lesion has been recognized. The lesion is preferably recognized by a lesion recognition unit in the endoscopic information management system. [Effects of the Invention]

[0013] According to the endoscopy-related business system of the present invention, part or all of a series of business operations relating to endoscopic examinations can be smoothly carried out. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is an explanatory diagram showing a medical system for endoscopic examination. [Figure 2] FIG. 1 is a perspective view of an endoscope device. [Figure 3] FIG. 2 is a block diagram of a processor device. [Figure 4] FIG. 2 is a block diagram of a first recognition processing unit. [Figure 5] FIG. 1 is a block diagram of a label printer. [Figure 6] FIG. 1 is a perspective view of a cleaning and disinfecting apparatus. [Figure 7] FIG. 1 is a block diagram of a cleaning and disinfecting apparatus. [Figure 8] FIG. 2 is a block diagram of a report creation device. [Figure 9] 1 is a block diagram showing the configuration of an endoscope information management system. [Figure 10] FIG. 2 is a block diagram of a test information management unit. [Figure 11] FIG. 4 is a block diagram of a cleaning information management unit. [Figure 12] FIG. 2 is a block diagram of a label output management unit. [Figure 13] FIG. 2 is a block diagram of a report creation support unit. [Figure 14] 10 is a flowchart of a preparation support operation for supporting preparation for an endoscopic examination. [Figure 15] This is a pre-examination screen that is displayed before the start of an endoscopic examination. [Figure 16] 10 is a flowchart showing the operations for starting an endoscopic examination. [Figure 17] 10 is a flowchart showing operations during an endoscopic examination. [Figure 18] This is an examination screen displayed during an endoscopic examination. [Figure 19] This is a sample label. [Figure 20] 10 is a flowchart showing the operation when performing bedside washing. [Figure 21] 10 is a cleaning information input screen displayed when bedside cleaning is performed. [Figure 22] 1 is a flowchart of the main cleaning. [Figure 23] 10 is a display screen of a cleaning and disinfecting apparatus. [Figure 24] 10 is a flowchart showing a report creation support operation. [Figure 25] This is a report creation screen. [Figure 26] This is the key image display section. [Figure 27] This is the information input section. DETAILED DESCRIPTION OF THE INVENTION

[0015] [Endoscopy-related business system] As shown in Figure 1, the endoscopy-related work system 10 is a system used for performing examination, observation, surgery, etc. (hereinafter referred to as endoscopic examination) of a subject using an endoscope 42 (see Figure 2), and for performing work related to endoscopic examination. Work related to endoscopic examination (hereinafter referred to as related work) refers to medical and other work other than endoscopic examination that is required during, before, or after endoscopic examination. In other words, related work is work that accompanies endoscopic examination, such as printing labels to be affixed to biopsy containers, cleaning and disinfecting the endoscope 42, and creating reports.

[0016] The endoscopy-related business system 10 includes an endoscope device 21, a label printer 22, a cleaning / disinfecting device 23, a report creation device 24, and an endoscope information management system 31. Of these, the label printer 22, the cleaning / disinfecting device 23, and the report creation device 24 are related business devices 26. The related business devices 26 may include devices for performing related business in addition to the label printer 22, the cleaning / disinfecting device 23, and the report creation device 24. Furthermore, the related business devices 26 may not include the label printer 22, the cleaning / disinfecting device 23, and / or the report creation device 24 if they are not required.

[0017] (1) Configuration of the endoscope device As shown in FIG. 2 , the endoscopic device 21 includes an endoscope 42, a light source device 44, a processor device 46, a monitor 48, and a console 49. The endoscope 42 captures an image of an object. The light source device 44 generates illumination light. The processor device 46 controls the endoscopic device 21 and performs image processing, etc. The monitor 48 is a display unit that displays endoscopic images. The console 49 is an input device for inputting settings to the processor device 46, etc. The console 49 includes a device for inputting or reading information necessary for endoscopic examination, such as the ID (identification) of a doctor who will perform an endoscopic examination using the endoscopic device 21 and the ID of a patient who is the subject of the endoscopic examination. For example, if the doctor's ID and the patient's ID are input using barcodes, the console 49 includes a barcode reader. If a card equipped with an IC (integrated circuit) chip (a so-called IC card) is used, the console 49 includes a card reader.

[0018] The endoscope 42 has an insertion section 42a to be inserted into the subject, an operating section 42b provided at the proximal end of the insertion section 42a, a bending section 42c provided at the distal end of the insertion section 42a, and a distal end section 42d. The bending section 42c is bent by operating an angle knob 42e of the operating section 42b. As a result, the distal end section 42d is oriented in a desired direction. In addition to the angle knob 42e, the operating section 42b also has buttons, dials, switches, etc. used for various operations such as switching observation modes, zooming, freezing, taking still images, and supplying air or water. The endoscope 42 also has an insertion port 42f for a treatment tool. The insertion port 42f communicates with a treatment tool outlet (not shown) provided at the distal end section 42d via a treatment tool channel (not shown) provided inside the endoscope 42. Therefore, when a treatment tool is inserted through the insertion opening 42f, the tip of the treatment tool can protrude toward the subject from the treatment tool outlet of the tip portion 42d. The treatment tool is, for example, forceps (biopsy forceps), a snare, a scalpel (high-frequency scalpel), or the like.

[0019] The light source device 44 includes a light source unit (not shown) that emits illumination light and a light source control unit (not shown) that controls the operation of the light source unit. The light source unit emits illumination light to illuminate a subject or excitation light used to emit the illumination light. The light source unit includes a light source such as a laser diode (hereinafter referred to as LD), an LED (Light Emitting Diode), a xenon lamp, or a halogen lamp, and emits at least white illumination light or excitation light used to emit white illumination light. The white light includes so-called pseudo-white light, which is substantially equivalent to white when imaging a subject using the endoscope 42. The light source unit may include, as necessary, a phosphor that emits light when irradiated with excitation light, or an optical filter that adjusts the wavelength band, spectrum, or light intensity of the illumination light or excitation light. In addition, the light source unit can emit light having a specific wavelength band required for capturing an image used to calculate biometric information such as the oxygen saturation of hemoglobin contained in the subject. The light source control unit controls the timing of turning on, turning off, or blocking each light source constituting the light source unit, as well as the light emission amount, etc. As a result, the light source unit can emit multiple types of illumination light with different spectra. The light source control unit also controls the light source unit in accordance with the timing of shooting.

[0020] As shown in FIG. 3, the processor device 46 includes a connection detection unit 51, an image acquisition unit 52, an image processing unit 53, a display control unit 54, a notification unit 55, a control unit 56, and a communication unit 57.

[0021] The connection detection unit 51 detects the connection of the endoscope 42 to the processor device 46 and / or the light source device 44. In addition to detecting that the endoscope 42 has been connected, the connection detection unit 51 also acquires identification information for identifying the connected endoscope 42. That is, the connection detection unit 51 functions as an identification unit for identifying the endoscope 42. The identification information for identifying the endoscope 42 is information for identifying the model of the endoscope 42 (such as the model number) and / or information for identifying an individual endoscope 42 when there are multiple endoscopes 42 of the same model (such as a serial number). In this embodiment, the connection detection unit 51 is a sensor that detects the connection of the endoscope 42 and acquires the identification information of the connected endoscope 42 by communicating with the endoscope 42 connected to the processor device 46 via wired or wireless communication.

[0022] The image acquisition unit 52 acquires an image (including a signal used to generate an image) from the endoscope 42. The image acquisition unit 52 has, for example, a DSP (Digital Signal Processor), a noise reduction unit, and a conversion unit (none of which are shown), and uses these to perform various processes on the acquired image as needed.

[0023] The DSP performs various processes on the acquired image as needed, such as defect correction, offset processing, gain correction, linear matrix processing, gamma conversion, demosaic processing, and YC conversion.

[0024] Defect correction corrects the pixel values ​​of pixels corresponding to defective pixels in the image sensor. Offset reduces dark current components from the defect-corrected image and sets an accurate zero level. Gain correction adjusts the signal level of each image by multiplying the offset-processed image by a gain. Linear matrix processing improves the color reproducibility of the offset-processed image, and gamma conversion adjusts the brightness and saturation of the image after linear matrix processing. Demosaicing (also known as isotropy or synchronization) interpolates missing pixel values ​​and is performed on images after gamma conversion. Missing pixels are pixels that have no pixel value due to the color filter arrangement (because pixels of other colors are arranged on the image sensor). For example, demosaicing generates a B pixel value at the position of a G pixel and an R pixel by interpolating using the pixel value of a B pixel. The same applies to other colors. YC conversion converts the demosaiced image into a luminance channel Y and a color-difference channel Cb and chrominance channel Cr.

[0025] The noise reduction unit performs noise reduction processing on the luminance channel Y, the chrominance channel Cb, and the chrominance channel Cr using, for example, a moving average method or a median filter method. The conversion unit reconverts the luminance channel Y, the chrominance channel Cb, and the chrominance channel Cr after the noise reduction processing into images of each color of BGR again.

[0026] The image processing unit 53 uses the images acquired by the image acquisition unit 52 to generate images to be displayed on the monitor 48 and / or images to be used for diagnosis, etc. The image processing unit 53 may perform image processing on the images acquired by the image acquisition unit 52 or endoscopic images depending on the settings of the observation mode, etc. The image processing unit 53 may also output the images acquired by the image acquisition unit 52 as is without performing image processing, etc. The images acquired by the image acquisition unit 52 are endoscopic images because they are images captured using the endoscope 42. The images generated by the image processing unit 53 are so-called endoscopic images because they are images provided to the user by the endoscopic device 21. Therefore, hereinafter, unless otherwise specified, the images acquired by the image acquisition unit 52 and / or the images generated by the image processing unit 53 will be referred to as endoscopic images. Endoscopic images may be moving or still images.

[0027] The image processing unit 53 also includes a first recognition processing unit 60. The first recognition processing unit 60 performs recognition processing using the endoscopic image. Specifically, as shown in Fig. 4, the first recognition processing unit 60 includes various recognition processing units such as an imaging position recognition unit 61, a treatment recognition unit 62, an image quality recognition unit 63, and an unimaged portion recognition unit 64.

[0028] The photographing position recognition unit 61 recognizes the photographing position using one or more endoscopic images. The photographing position is a position within the subject photographed by the endoscope 42. The photographing position recognition unit 61 recognizes, for example, at least the part of the subject using the endoscopic image as the photographing position. The part of the subject is the esophagus, stomach, or, for example, the duodenum in the upper digestive tract. The photographing position recognition unit 61 can also recognize more detailed positions. For example, when the part being observed is the stomach, the photographing position recognition unit 61 can recognize the cardia, fundus, body, angle, antrum, anterior pylorus, and / or pylorus. In this embodiment, the photographing position recognition unit 61 recognizes the part of the subject, but does not recognize the detailed position. This is because the photographing position recognition process is performed in real time.

[0029] The treatment recognition unit 62 recognizes treatment on the subject using one or more endoscopic images. Recognizing a treatment means recognizing whether or not a treatment is being performed and / or the type of treatment. Treatment on the subject includes collection of a specimen such as tissue for a biopsy (hereinafter referred to as biopsy), incision, excision, hemostasis, removal of residue, or other operations on the subject. Recognizing whether or not a treatment is being performed includes recognizing a state in which a treatment has already been performed, as well as a state in which a treatment is being performed, and a state in which a treatment is about to be performed. Recognizing the type of treatment means recognizing a treatment by distinguishing between biopsy, incision, excision, hemostasis, removal of residue, etc.

[0030] The treatment recognition unit 62 recognizes the treatment performed on the subject by recognizing the treatment tool shown in the endoscopic image. The treatment recognition unit 62 can also recognize the treatment performed on the subject by recognizing treatment scars or bleeding (or the cessation of bleeding) on ​​the subject shown in the endoscopic image. The treatment recognition unit 62 can also recognize the presence or absence of treatment and / or the type of treatment using information other than one or more endoscopic images. For example, if the endoscope 42 has a mechanism for detecting the insertion of a treatment tool, the detection result can be used alone or in combination with the endoscopic image to recognize the treatment. In this embodiment, the treatment recognition unit 62 recognizes the presence or absence of a biopsy by recognizing the forceps used for the biopsy (biopsy forceps) using one or more endoscopic images. Therefore, the treatment recognition unit 62 in this embodiment functions as a biopsy recognition unit that recognizes the presence or absence of a biopsy.

[0031] The treatment recognition unit 62 also recognizes or counts the number of treatments. This is to distinguish between each treatment when multiple treatments are recognized. The treatment recognition unit 62 also recognizes the location where the treatment was performed. The recognition result of the imaging location recognition unit 61 can be used to recognize the location where the treatment was performed. For example, if biopsies were performed at two locations, the treatment recognition unit 62 of this embodiment recognizes that two biopsies were performed, and also recognizes the location and order in which each biopsy was performed.

[0032] The image quality recognition unit 63 recognizes the image quality of an endoscopic image using one or more endoscopic images. Recognizing the image quality means recognizing whether the endoscopic image is blurred or cloudy, and / or whether there is a factor that deteriorates the image of the subject, such as residue or residual liquid on the subject. Blurring or cloudiness of the endoscopic image is a factor on the endoscope 42 side (the side that captures the image, not the subject). Residue or residual liquid is a factor on the subject side (not the endoscope 42).

[0033] The unphotographed portion recognition unit 64 recognizes unphotographed portions of the subject using one or more endoscopic images. An unphotographed portion refers to a portion of the subject that is not photographed due to the position and orientation of the tip 42d relative to the subject and the timing of photography. For example, an unphotographed portion of a subject, such as a lumen, may be generated due to the protrusion of the subject or folds (pleats) generated by peristaltic movement. Unphotographed portions in an endoscopic image can be recognized, for example, by the global or local shape of the subject. Furthermore, the unphotographed portion recognition unit 64 can track unphotographed portions by recognizing each unphotographed portion in multiple endoscopic images. That is, the unphotographed portion recognition unit 64 can recognize that the photographing position (the position of the tip 42d relative to the unphotographed portion) of a certain endoscopic image has moved (or is likely to move) to a position where the unphotographed portion cannot be properly photographed without being photographed again. In this embodiment, the unphotographed portion recognition unit 64 recognizes and tracks unphotographed portions.

[0034] The first recognition processing unit 60 and the above-mentioned components constituting the first recognition processing unit 60 are, for example, artificial intelligence (AI) with a learning function. Specifically, the components constituting the first recognition processing unit 60 are AI trained using machine learning algorithms such as neural networks (NNs), convolutional neural networks (CNNs), adaboost, and random forests, or deep learning. Furthermore, since the first recognition processing unit 60 is trained to perform recognition processing using specific images, even if it can perform recognition processing using other images, the accuracy of the recognition processing results may be low. "Having a learning function" refers to being able to learn, including having already learned. Note that, instead of being configured with AI, some or all of the components constituting the first recognition processing unit 60 may be configured to calculate feature amounts from images and perform detection, etc., using the calculated feature amounts.

[0035] In addition to the first recognition processing unit 60, the image processing unit 53 also has a biometric information calculation unit 71. The biometric information calculation unit 71 calculates biometric information using one or more endoscopic images. The biometric information refers to quantities based on the shape, color, or other characteristics of a living subject, such as oxygen saturation, blood vessel density, length, size (area or volume), or the number or range of parts with specific characteristics. The biometric information calculation unit 71 is activated as needed, depending on the setting of the observation mode, etc.

[0036] The display control unit 54 converts the endoscopic image output by the image processing unit 53 into a format suitable for display and outputs it to the monitor 48. As a result, the monitor 48 displays the endoscopic image at least during the endoscopic examination. In addition, the display control unit 54 generates screens to be used for observation or operation at each stage: before the endoscopic examination (before the period during which the subject is photographed begins), during the endoscopic examination (the period during which the subject is photographed), and after the endoscopic examination (after the period during which the subject is photographed ends), and displays them on the monitor 48. At this time, the display control unit 54 can acquire information from the notification unit 55 or the communication unit 57 and display that information or information based on that information on the monitor 48. Specifically, before the endoscopic examination, the display control unit 54 displays a pre-examination screen 251 (see FIG. 15 ) acquired via the communication unit 57 on the monitor 48. During the endoscopic examination, the display control unit 54 may display, in addition to the endoscopic image, warning messages and the like input by the notification unit 55 and / or information related to the examination acquired via the communication unit 57 on the monitor 48. For example, this is the examination-in-progress screen 301 (see FIG. 18). After the endoscopic examination, the display control unit 54 displays, for example, a primary cleaning information input screen 401 (see FIG. 21) on the monitor 48.

[0037] The notification unit 55 issues a notification, a warning, or the like. The notification unit 55 has, for example, a speaker 72, and can issue a notification, a warning, or the like by emitting a sound or voice from the speaker 72. Furthermore, the notification unit 55 can issue a notification, a warning, or the like using the display on the monitor 48 via the display control unit 54 by inputting a display instruction (including an instruction to change the display) of a message or the like indicating the notification, warning, or the like to the display control unit 54. In addition, the notification unit 55 can include a lamp, or the like, and can issue a notification, a warning, or the like by turning the lamp on or off or changing its color, or the like.

[0038] Specifically, before an endoscopic examination, if the endoscope 42 whose connection is detected by the connection detection unit 51 (hereinafter referred to as the connected endoscope) is different from the endoscope 42 to be used, the notification unit 55 issues a warning to that effect. Furthermore, if the connected endoscope 42 has not been cleaned and disinfected and / or a predetermined time has passed since the completion of cleaning and disinfection, the notification unit 55 issues a warning to that effect. In addition, if the ID of the doctor and / or patient entered from the console 49 is different from that of the doctor and / or patient to be using the endoscopic device 21, a warning to that effect is issued.

[0039] During an endoscopic examination, the notification unit 55 notifies some or all of information relating to contraindications (contraindication information), such as "biopsy prohibited." In this embodiment, the notification unit 55 notifies the contraindication information by displaying it on the monitor 48. During an endoscopic examination, the notification unit 55 also issues a warning based on the results of various recognition processes performed by the first recognition processing unit 60. Specifically, when the image quality recognition unit 63 recognizes a deterioration in the image quality of the endoscopic image, the notification unit 55 issues a warning indicating the deterioration in image quality or a warning urging the user to improve the image quality (for example, a display urging the user to clean the distal end portion 42d). Furthermore, when the unphotographed portion recognition unit 64 recognizes the possibility that an unphotographed portion will not be photographed, the notification unit 55 issues a warning to that effect.

[0040] After an endoscopic examination, the notification unit 55 may issue a notification or warning indicating that the primary cleaning of the endoscope 42 at the bedside (so-called bedside cleaning) has not been completed or has not started, and / or a notification or warning urging the primary cleaning to be performed.

[0041] The control unit 56 comprehensively controls each unit of the processor device 46, as well as the endoscope 42 and the light source device 44. For example, the control unit 56 controls the synchronization of the emission of illumination light and the timing of imaging. The control unit 56 also includes a timer 73 that measures various times (including the time of day) related to the endoscopic examination. Therefore, the control unit 56 can measure the start and end times of the endoscopic examination and / or the time it takes to reach a specific site (for example, the time it takes to reach the ileocecal junction). The timer 73 can measure various times related to the endoscopic examination based on information input using the console 49 or the like. The timer 73 can also use various recognition results (for example, the recognition result of the imaging position) from the first recognition processing unit 60 to measure various times related to the endoscopic examination.

[0042] The communication unit 57 communicates with the endoscope information management system 31 via wired or wireless communication to transmit or receive information. In this embodiment, the communication unit 57 includes an information acquisition unit 74 and an information output unit 75.

[0043] The information acquisition unit 74 acquires information that can be used in the endoscopic examination to be performed from the endoscopic information management system 31. Specifically, before the endoscopic examination, the information acquisition unit 74 acquires, from the endoscopic information management system 31, the results of past endoscopic examinations, etc. (including, for example, pathological examinations), images acquired in past endoscopic examinations, etc., reports created in past endoscopic examinations, etc., and / or information about the patient on whom the endoscopic examination will be performed (information about contraindications, etc.). The display control unit 54 acquires this information via the information acquisition unit 74 and displays it on the monitor 48 as necessary.

[0044] The information output unit 75 outputs some or all of the information related to the endoscopic examination that has been performed (endoscopic examination currently being performed) to at least the endoscope information management system 31. The information output by the information output unit 75 includes, for example, an endoscopic image, the results of the recognition processing performed by each unit of the first recognition processing unit 60, the biometric information calculated by the biometric information calculation unit 71, and / or various times measured by the timing unit 73. The endoscopic image etc. output by the information output unit 75 is registered in the endoscope information management system 31.

[0045] In addition, the communication unit 57 can communicate with the endoscope information management system 31, as well as the endoscope 42 or light source device 44 that constitutes the endoscope device 21, the related business device 26, and / or other devices, and can send or receive some or all of the various information described above.

[0046] (2) Label printer configuration In the endoscopy-related business system 10, the label printer 22 is a printer used to create (print, etc.) identification labels (hereinafter referred to as biopsy labels 350; see FIG. 19 ) to be affixed to containers containing tissue (specimens) collected for biopsy. The label printer 22 is connected to the endoscopy information management system 31 directly or indirectly via a wired or wireless connection. As shown in FIG. 5 , the label printer 22 includes a communication unit 92, a biopsy information acquisition unit 93, and an output unit 94.

[0047] The communication unit 92 is an interface that connects directly or indirectly to the endoscope information management system 31 via a wired or wireless connection. When a biopsy is performed during an endoscopic examination, the biopsy information acquisition unit 93 communicates with the endoscope information management system 31 using the communication unit 92, thereby automatically acquiring information related to the biopsy via the endoscope information management system 31 (or directly from the processor device 46 or the like based on an instruction from the endoscope information management system 31). The information related to the biopsy includes information related to the patient on whom the biopsy was performed (such as name and / or ID), information identifying each biopsy if multiple biopsies are performed (such as a number identifying the order), information related to the location where the biopsy was performed (such as the extraction site), etc.

[0048] Output unit 94 is a mechanism for printing on labels and has a configuration similar to that of a general printer. Output unit 94 automatically outputs biopsy label 350 (see FIG. 19) by printing some or all of the biopsy-related information acquired by biopsy information acquisition unit 93 in a predetermined arrangement. Biopsy label 350 is, for example, a sticker.

[0049] In this embodiment, the label printer 22 acquires information related to biopsy via the endoscope information management system 31. The acquisition of information related to biopsy and the printing of biopsy labels are performed during endoscopic examination. That is, when a biopsy is performed during endoscopic examination, the label printer 22 automatically outputs the biopsy label 350 in real time.

[0050] (3) Configuration of the cleaning and disinfection equipment The washer-disinfector 23 is an apparatus for cleaning and disinfecting endoscopes 42 used in endoscopic examinations. After use, the endoscope 42 is subjected to a simple primary cleaning and / or disinfection (so-called bedside cleaning) at the bedside to prevent clogging of the ducts due to drying of the endoscope 42, etc. In contrast, the cleaning and disinfection performed by the washer-disinfector 23 is so-called secondary cleaning or main cleaning. The main cleaning performed by the washer-disinfector 23 is cleaning and disinfection to enable the used endoscope 42 to be used again in endoscopic examinations.

[0051] 6, the cleaning disinfecting apparatus 23 has a main body 111 having a cleaning tank 110, a lid 112 provided so as to be freely opened and closed relative to the main body 111, a pedal 113 for opening and closing the lid 112, and a touch panel 115 which is a display and operation unit for inputting settings for cleaning and / or disinfection. In addition, the main body 111 is provided with casters 116. This allows the cleaning disinfecting apparatus 23 to be freely moved.

[0052] As shown in FIG. 7, the cleaning and disinfecting apparatus 23 includes a cleaning tank 110, a touch panel 115, a communication unit 121, an endoscope identifying unit 122, a washer identifying unit 123, and a control unit .

[0053] The communication unit 121 is connected to the endoscope information management system 31 directly or indirectly, by wire or wirelessly, and transmits or receives necessary information. If the endoscope 42 has a communication function, the communication unit 121 can automatically connect to an endoscope 42 that is located near (for example, at least within a communication range of) the cleaning and disinfecting apparatus 23. Furthermore, the communication unit 121 transmits information such as the results of cleaning and disinfection, identification information of the cleaned endoscope 42, and identification information of the staff member who cleaned it, to the endoscope information management system 31.

[0054] The endoscope identification unit 122 acquires information for identifying the endoscope 42 that is the target of cleaning and disinfection (hereinafter referred to as cleaning target information). The endoscope identification unit 122 can automatically acquire the cleaning target information from the endoscope 42 connected via the communication unit 121, for example. The endoscope identification unit 122 can also acquire the cleaning target information from information entered using the touch panel 115. In this embodiment, the endoscope 42 has the function of automatically connecting wirelessly to the communication unit 121 in the vicinity of the cleaning and disinfecting apparatus 23, and the endoscope identification unit 122 automatically acquires the cleaning target information. Then, instead of the user manually entering information using the touch panel 115, the endoscope identification unit 122 automatically inputs the acquired cleaning target information into the corresponding fields of a GUI (Graphical User Interface) displayed on the touch panel 115.

[0055] The washer identification unit 123 acquires information (hereinafter referred to as washer identification information) that identifies the staff member in charge of cleaning and disinfecting (hereinafter referred to as the washer). When the washer's ID is input using a barcode, the washer identification unit 123 is a barcode reader, and when the washer's ID is input using an IC card, the washer identification unit 123 is a card reader. The washer identification unit 123 can acquire the washer information by the washer inputting the washer information using the touch panel 115. Note that if the washer has, for example, a communication terminal or the like that automatically connects to the washer disinfection apparatus 23 via the communication unit 121, the washer identification unit 123 can automatically acquire the washer identification information from the communication terminal via the communication unit 121. In this embodiment, the washer identification unit 123 automatically acquires the washer information.

[0056] The control unit 124 comprehensively controls the cleaning and disinfecting apparatus 23. For example, when a command to start cleaning is input using the touch panel 115, the control unit 124 starts cleaning and disinfecting the endoscope 42 using the cleaning tank 110 in accordance with the conditions input using the touch panel 115.

[0057] (4) Configuration of the report creation device The report creation device 24 is a so-called computer connected to the endoscope information management system 31 by wire or wirelessly, and provides a user with an interface for creating a report related to an endoscopic examination. As shown in FIG. 8, the report creation device 24 includes a display 131 that displays a report creation screen 510 (see FIG. 25), an operation unit 132 that inputs operations for creating a report using the report creation screen 510, and a communication unit 133 that communicates with the endoscope information management system 31. The operation unit 132 is, for example, a pointing device such as a keyboard and a mouse. The report creation device 24 may also be a tablet terminal that integrates the display 131 and the operation unit 132. The report creation device 24 automatically or manually inputs the ID of the doctor who is the user, thereby identifying the user and logging in to the endoscope information management system 31.

[0058] (5) Configuration of the endoscope information management system The endoscope information management system 31 comprehensively manages a series of information related to endoscopic examinations and smoothly links the devices that make up the endoscope-related work system 10 by appropriately transmitting or receiving (including instructing transmission or reception) part or all of the series of information related to endoscopic examinations to the devices that make up the endoscope-related work system 10. As shown in Fig. 9, the endoscope information management system 31 includes an examination information management unit 151, a cleaning information management unit 152, a label output management unit 153, a report creation support unit 154, a database 156, an operation unit 157, a display 158, and a communication unit 159.

[0059] (5a) Test Information Management Department The examination information management unit 151 manages information used in particular in endoscopic examinations among various types of information (such as information about doctors and patients, endoscopic images, and recognition results) exchanged by each unit constituting the endoscopy-related business system 10. Specifically, as shown in Fig. 10, the examination information management unit 151 includes an examination order acquisition unit 171, an endoscope determination unit 172, an insertion path information acquisition unit 173, a contraindication information acquisition unit 174, an image acquisition unit 175, a report acquisition unit 176, a pre-examination screen generation unit 181, an endoscope connection monitoring unit 182, and a user monitoring unit 183.

[0060] The examination order acquisition unit 171 acquires an examination order related to an endoscopic examination. An examination order is a request for an endoscopic examination, and includes, for example, information on when, who, and what (which part and for what purpose) the endoscopic examination will be performed. The examination order can be directly input to the endoscopy information management system 31. In this case, the examination order acquisition unit 171 acquires the examination order through input by a doctor or other staff member. The examination order acquisition unit 171 can also acquire examination orders from other medical business systems (for example, systems that manage examination orders within the hospital, including other departments) that cooperate with the endoscopy-related business system 10.

[0061] The endoscope determination unit 172 determines the endoscopic device 21, particularly the endoscope 42, to be used for the examination order. Determining the endoscopic device 21 to be used refers to determining which endoscopic device 21 (processor device 46 and light source device 44) to use for the endoscopic examination based on the examination order when there are multiple endoscopic devices 21 in the hospital and managing the reservation. When there is only one endoscopic device 21 in the hospital, determining the use of the endoscopic device 21 for the examination order and managing the reservation. Reservation management refers to reserving use and managing the reservation so that duplicate reservations do not occur. Furthermore, determining the endoscope 42 to be used refers to determining which endoscope to use for the endoscopic examination based on the examination order and managing the reservation when there are multiple endoscopes 42 or multiple types of endoscopes 42 (for example, when there are a transnasal endoscope, an oral endoscope, and an endoscope for the lower gastrointestinal tract, etc.). When there is only one endoscope 42 (one model) in the hospital, determining the use of the endoscope 42 for the examination order and managing the reservation.

[0062] The endoscope determination unit 172 identifies the patient and region to be examined based on the examination order. The endoscope determination unit 172 also determines the endoscopic device 21 and / or endoscope 42 to be used based on the patient and region to be examined. In particular, the endoscope determination unit 172 references information related to past endoscopic examinations for the patient specified in the examination order. If the patient and region specified in the examination order are patients and regions previously examined by endoscopic examination, the endoscope determination unit 172 prioritizes the use of the endoscope 42 used in the previous endoscopic examination. If the endoscope 42 used in the previous endoscopic examination is being reserved for another examination order, the endoscope determination unit 172 prioritizes the use of at least the same model of endoscope 42. For example, if a transnasal endoscope was used in the previous endoscopic examination, and both an oral endoscope and a transnasal endoscope are available for use in the examination order for the second endoscopic examination, the transnasal endoscope is prioritized. If multiple models of transnasal endoscopes are available, the model used in the previous endoscopic examination is prioritized.

[0063] The insertion path information acquisition unit 173 refers to information related to past endoscopic examinations for the patient and region specified in the examination order, and acquires information related to the insertion path of the endoscope 42 when the patient and region specified in the examination order were previously examined endoscopically. For an endoscopic examination of the upper gastrointestinal tract, the insertion path is, for example, "nasal" or "oral," and with regard to nasal insertion, a distinction is made between "nasal (right)," which is insertion through the right nostril, and "nasal (left)," which is insertion through the left nostril.

[0064] The contraindication information acquisition unit 174 acquires information on contraindications for the patient and / or region specified by the test order (hereinafter referred to as contraindication information) by referring to information on tests already performed (such as the results and reports of diagnoses or tests) for the patient and / or region specified by the test order. The contraindication information includes, for example, information on allergies and information on whether biopsy is possible. In this embodiment, the contraindication information acquisition unit 174 acquires at least information on whether biopsy is possible (particularly whether biopsy is prohibited) for the patient or region.

[0065] The image acquiring unit 175 acquires images obtained by an endoscopic examination and / or other examinations performed in the past for a patient specified by the examination order, according to the settings. For example, when images acquired in past examinations are to be displayed on the pre-examination screen 251 and / or the during-examination screen 301, the image acquiring unit 175 acquires the images and inserts them on the pre-examination screen 251 and / or the during-examination screen 301. Furthermore, by connecting to a PACS (Picture Archiving and Communication Systems), the image acquiring unit 175 can acquire ultrasound images, radiological images such as X-ray images, MRI (Magnetic Resonance Imaging) images, etc., and insert them on the during-examination screen 301, etc.

[0066] The report acquisition unit 176 acquires reports created by past endoscopic examinations and / or other examinations, etc., for a patient specified by the examination order, according to the settings. For example, when images acquired in past examinations are to be displayed on the pre-examination screen 251 and / or the during-examination screen 301, the report acquisition unit 176 acquires the images and inserts them into the pre-examination screen 251 and / or the during-examination screen 301.

[0067] The pre-examination screen generating unit 181 generates a pre-examination screen 251 to be displayed on the monitor 48 of the endoscopic device 21 before the endoscopic examination. The endoscopic information management system 31 locks (prohibits other users from using) the endoscopic device 21 to be used by displaying the pre-examination screen 251 generated by the pre-examination screen generating unit 181 on the monitor 48 of the endoscopic device 21 to be used. The pre-examination screen generating unit 181 can be provided in the processor device 46. In this case, the endoscopic information management system 31 provides the processor device 46 with information necessary for generating the pre-examination screen 251.

[0068] The endoscope connection monitoring unit 182 monitors the connection of the endoscope 42 to the endoscopic device 21 for which reservation management is being performed. Specifically, the endoscope connection monitoring unit 182 acquires the detection result of the connection detection unit 51 from the processor device 46. Then, when an endoscope 42 different from the endoscope 42 determined by the endoscope determination unit 172 is connected to the endoscopic device 21 for which reservation management is being performed, a warning to that effect is issued using the notification unit 55 of the processor device 46. This is to support preparation for the endoscopic examination in accordance with the examination order.

[0069] The user monitoring unit 183 monitors doctors and patients who use the endoscopic device 21 for which reservations are managed by the endoscopy information management system 31. Specifically, the user monitoring unit 183 acquires the IDs of the doctor and patient input from the console 49 via the communication unit 57 of the processor device 46, and determines whether the doctor and patient match the examination order. If the doctor or patient is different, the user monitoring unit 183 issues a warning to that effect using the notification unit 55 of the processor device 46. This is to prevent misuse of the endoscopic device 21 for which reservations are managed.

[0070] (5b) Cleaning Information Management Department The cleaning information management unit 152 particularly manages information relating to the cleaning of the endoscope 42, among the various types of information exchanged by the units constituting the endoscope-related business system 10. Specifically, as shown in Fig. 11, the cleaning information management unit 152 includes a cleaning status monitoring unit 191, a primary cleaning management unit 192, and a main cleaning management unit 193.

[0071] The cleaning status monitoring unit 191 monitors the cleaning status of the endoscope 42 connected to the endoscopic device 21 whose reservations are managed by the endoscope information management system 31. Specifically, the cleaning status monitoring unit 191 acquires the detection result of the connection detection unit 51 of the processor device 46. The cleaning status monitoring unit 191 then monitors whether the connected endoscope 42 is an endoscope 42 that has been properly cleaned and whether a predetermined time has passed since cleaning was completed. If the connected endoscope 42 is an endoscope 42 that has been properly cleaned, such as an uncleaned endoscope 42, or if more than a predetermined time has passed since cleaning was completed, the connected endoscope 42 needs to be cleaned again. Therefore, the cleaning status monitoring unit 191 issues a warning to that effect using the notification unit 55 of the processor device 46.

[0072] The primary cleaning management unit 192 manages the primary cleaning performed after the endoscopy. Specifically, after the endoscopy is completed, the primary cleaning management unit 192 displays a primary cleaning information input screen 401 on the monitor 48 via the display control unit 54. The primary cleaning management unit 192 prompts the user to perform the primary cleaning by issuing a notification or warning using the notification unit 55 of the processor device 46, or by displaying the primary cleaning information input screen 401 on the monitor 48, as necessary. In addition, the primary cleaning management unit 192 acquires information related to the primary cleaning input from the primary cleaning information input screen 401 (such as the identification information of the person who performed the primary cleaning and status information indicating whether the cleaning was completed normally) and registers it in the database 156. In this way, the primary cleaning management unit 192 manages the primary cleaning. The information related to the primary cleaning includes the identification information of the person who performed the primary cleaning (the person who performed the primary cleaning), the date and time when the primary cleaning was performed, and status information indicating whether the primary cleaning was completed normally. Registration in the database 156 includes creating new records as well as merging information into existing records.

[0073] The main cleaning management unit 193 manages the main cleaning that is performed after the endoscopy is completed (more specifically, after the primary cleaning is completed). Specifically, it obtains information related to the main cleaning from the cleaning disinfection apparatus 23 and registers it in the database 156. In this way, the main cleaning management unit 193 manages the main cleaning. The information related to the main cleaning includes identification information of the person who performed the main cleaning (the cleaner), the date and time when the main cleaning was performed, and status information indicating whether the main cleaning was completed normally.

[0074] (5c) Label output management unit The label output management unit 153 manages information relating to the production of biopsy labels, among various types of information exchanged between the components of the endoscopy-related business system 10. Specifically, as shown in Fig. 12, the label output management unit 153 includes a biopsy monitoring unit 201 and a label printer control unit 203.

[0075] The biopsy monitoring unit 201 acquires the recognition results of the procedure recognition unit 62 (at least the recognition results related to biopsies among the recognition results of the procedure recognition unit 62) by communicating with the processor device 46 in substantially real time during the endoscopic examination. As a result, the biopsy monitoring unit 201 monitors whether or not a biopsy has been performed using the recognition results of the procedure recognition unit 62. Furthermore, when the procedure recognition unit 62 recognizes that a biopsy has been performed, the recognition results of the procedure recognition unit 62 include not only that a biopsy has been performed, but also the number of biopsies, the sites where the biopsies were performed, and the order in which the biopsies were performed. Therefore, when the biopsy monitoring unit 201 detects that a biopsy has been performed using the recognition results of the procedure recognition unit 62, it acquires information related to the performed biopsies (the number of biopsies, the sites where the biopsies were performed, the order in which the biopsies were performed, etc.).

[0076] When the biopsy monitoring unit 201 detects that a biopsy has been performed during an endoscopic examination, the label printer control unit 203 automatically controls the label printer 22 to create a biopsy label 350 to be affixed to a container containing a sample obtained by the biopsy. Specifically, the label printer control unit 203 inputs biopsy-related information acquired by the biopsy monitoring unit 201 to the biopsy information acquisition unit 93 and uses the output unit 94 to create a biopsy label 350. As a result, when a biopsy is performed during an endoscopic examination, the label printer 22 automatically creates a biopsy label 350. Note that in this embodiment, when the biopsy monitoring unit 201 detects a biopsy, the label printer control unit 203 sequentially creates a biopsy label 350 for the detected biopsy. However, the label printer control unit 203 can also automatically create a biopsy label 350 for one or more detected biopsies all at once after the endoscopic examination is completed. In either case, a doctor or staff member can automatically obtain the biopsy label 350 after the endoscopic examination is completed.

[0077] (5d) Report Writing Support Department The report creation support unit 154 manages information relating to report creation among various types of information exchanged by the units constituting the endoscopy-related business system 10. In this way, the report creation support unit 154 supports the creation of reports. Specifically, as shown in FIG. 13 , the report creation support unit 154 includes a report creation screen generator 220, a second recognition processing unit 222, an image selection support unit 223, a third recognition processing unit 224, and an item selection support unit 226.

[0078] The report creation screen generating unit 220 generates a report creation screen 510 in response to a request from the report creation device 24 connected to the endoscope information management system 31, and provides it to the report creation device 24. Specifically, when the report creation screen generating unit 220 receives a request to provide the report creation screen 510 from the report creation device 24, it collects information on a specific doctor, a specific patient, and a specific endoscopic examination (endoscopic images and other information, etc.), and generates and provides the report creation screen 510 by selecting and / or arranging the information.

[0079] The second recognition processing unit 222 performs one or more recognition processes on the endoscopic images used in the report creation screen 510 and / or the report. Specifically, the second recognition processing unit 222 includes a photographing position recognition unit 231, a treatment recognition unit 232, and a lesion recognition unit 233. The second recognition processing unit 222 and the above-mentioned units constituting the second recognition processing unit 222 are, for example, artificial intelligence (AI) having a learning function.

[0080] The photographing position recognition unit 231 recognizes at least the part of the subject appearing in the endoscopic image acquired in one endoscopic examination. The photographing position recognition unit 231 can recognize the photographing position in more detail. For example, when the part being observed is the stomach, the photographing position recognition unit 231 can recognize the cardia, fundus, body, angle, antrum, anterior pylorus, and / or pylorus. In this embodiment, the photographing position recognition unit 231 recognizes not only the part of the subject but also the photographing position in more detail. That is, the photographing position recognition unit 61 in the first recognition processing unit 60 of the processor device 46 performs relatively simple part recognition processing, whereas the photographing position recognition unit 231 in the second recognition processing unit 222 of the report creation support unit 154 performs relatively detailed photographing position recognition processing. This is because photographing position recognition during an endoscopic examination requires fast and lightweight (low computational load) recognition processing in real time, whereas detailed recognition results are required when creating a report, even if the processing load and / or processing time increases somewhat. The photographing position recognition unit 231 can acquire and use the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60. In this embodiment, the second recognition processing unit 222 can obtain information related to the photographed region as the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60 for the endoscopic image that is the target of the recognition processing. Therefore, the second recognition processing unit 222 can narrow the scope of the recognition processing for the region indicated by the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60 and perform recognition processing to identify the detailed photographing position. For example, if the photographed region is the stomach, the second recognition processing unit 222 can narrow down the scope of the recognition processing to the detailed position of the stomach (excluding the possibility of the esophagus or duodenum) and identify the detailed photographing position (such as identifying the photographing position as the cardia of the stomach). In this way, the photographing position recognition unit 231 can reduce the processing amount and / or processing time by using the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60.

[0081] The procedure recognition unit 232 recognizes procedures performed on a subject for endoscopic images acquired during an endoscopic examination. The types of procedures that the procedure recognition unit 232 can recognize are the same as those of the procedure recognition unit 62 of the first recognition processing unit 60. In this embodiment, the procedure recognition unit 62 of the first recognition processing unit 60 recognizes biopsy, while the procedure recognition unit 232 also recognizes procedures other than biopsy. This is because, while recognition processing during an endoscopic examination is preferably performed in real time and therefore minimal content is required, recognition of procedures other than biopsy is also required when creating a report. The procedure recognition unit 232 can acquire and use the recognition results of the procedure recognition unit 62 of the first recognition processing unit 60. In this embodiment, the procedure recognition unit 62 of the first recognition processing unit 60 recognizes biopsy, so the procedure recognition unit 232 uses the recognition results of the procedure recognition unit 62 of the first recognition processing unit 60 to recognize biopsy. Then, the procedure recognition unit 232 performs recognition processing for procedures other than biopsy. This is to eliminate duplicated recognition processing and reduce the amount and time of processing.

[0082] The lesion recognition unit 233 recognizes the presence or absence of a lesion in an endoscopic image acquired in one endoscopic examination. Recognizing the presence or absence of a lesion includes not only recognizing the presence or absence of a part that is definitely a lesion, but also recognizing the presence or absence of a part that may be a lesion (benign tumor, dysplasia, etc.) and / or recognizing a part that has characteristics that may be directly or indirectly related to a lesion (redness, etc.).

[0083] The image selection support unit 223 uses various recognition results from the second recognition processing unit 222 to automatically select endoscopic images (hereinafter referred to as key images) to be used in the report creation screen 510 and / or the report from a series of multiple endoscopic images acquired in one endoscopic examination. Specifically, the image selection support unit 223 uses the recognition results from the imaging position recognition unit 231 to select, as key images, endoscopic images of at least a portion designated for use in the report from the multiple endoscopic images acquired in the endoscopic examination. The portion designated for use in the report includes a portion that is essentially designated for use because it is a site where a lesion is likely to occur. For example, in an endoscopic examination of the upper gastrointestinal tract, this would be an endoscopic image of the pylorus. Furthermore, when the procedure recognition unit 232 recognizes a procedure, the image selection support unit 223 selects, as key images, some or all of the endoscopic images from the endoscopic images in which the procedure was recognized. Similarly, when the lesion recognition unit 233 recognizes a lesion, the image selection support unit 223 selects, as key images, some or all of the endoscopic images from the endoscopic images in which the lesion was recognized. The reason for selecting some of the endoscopic images in which a procedure or lesion is recognized is to minimize the number of images that can be used on the report creation screen 510 and / or the report. The image selection support unit 223 selects a schematic diagram to be used on the report creation screen 510 and / or the report by specifying the area photographed during the endoscopic examination using the recognition result of the imaging position recognition unit 231. For example, in the case of an endoscopic examination of the stomach, the image selection support unit 223 selects a schematic diagram of the stomach. The report creation screen generation unit 220 generates and provides the report creation screen 510 in which the schematic diagram selected by the image selection support unit 223 and one or more key images are automatically inserted.

[0084] The third recognition processing unit 224 performs discrimination processing on at least the endoscopic images used in the report. That is, the third recognition processing unit 224 performs discrimination processing on the key image selected by the image selection support unit 223. Discrimination processing refers to processing for recognizing symptoms (such as the type of lesion and / or the progression) of lesions and the like shown in the endoscopic images. For this reason, the third recognition processing unit 224 includes one or more discrimination units 236. The third recognition processing unit 224 includes one discrimination unit 236 for each key image. Note that, if a doctor selects a key image regardless of the selection by the image selection support unit 223, the third recognition processing unit 224 performs discrimination processing on the key image selected by the doctor. Similarly, if the doctor manually reselects the key image selected by the image selection support unit 223, the third recognition processing unit 224 performs discrimination processing on the key image selected by the doctor. The third recognition processing unit 224 and the above-mentioned units constituting the third recognition processing unit 224 are, for example, artificial intelligence (AI) having a learning function.

[0085] The item selection support unit 226 automatically selects items to be written in the report using at least the discrimination results of the third recognition processing unit 224. The report creation screen generation unit 220 generates and provides a report creation screen 510 in which the items to be written in the report have been automatically selected. In addition, the item selection support unit 226 can further select items to be written in the report using various recognition results of the second recognition processing unit 222.

[0086] (5e) Databases, etc. The database 156 provided in the endoscope information management system 31 includes, for example, a cleaning information management database for managing information related to the cleaning state and history of the endoscope 42, an endoscopic image database for managing endoscopic images, a patient information database for managing information related to patients, an examination information management database for managing information related to the examinations of each patient, a report management database for managing reports created for various examinations including endoscopic examinations, etc. In this embodiment, the endoscope information management system 31 is provided with the database 156, but if some or all of the various databases described above are in an external environment connected to the endoscope-related business system 10, the endoscope information management system 31 can use the database in the external environment instead of or in addition to the built-in database 156.

[0087] The operation unit 157 included in the endoscope information management system 31 is, for example, a keyboard, a mouse, and / or a touch panel, and the display 158 is a monitor or a touch panel. In this embodiment, the endoscope information management system 31 has the operation unit 157 and the display 158, but if an external terminal (such as a computer that accesses the endoscope information management system 31) is used as the operation unit 157 and the display 158, the endoscope information management system 31 may be configured without the operation unit 157 and / or the display 158. The communication unit 159 is a communication interface that connects, directly or indirectly, with each component of the endoscope-related business system 10 via a wired or wireless connection. Each component of the endoscope information management system 31 communicates with each component of the endoscope-related business system 10 using the communication unit 159 to send and receive various information.

[0088] The operation of the endoscope-related business system 10 configured as above, in particular the operation of the endoscope information management system 31, will be described below.

[0089] <Preparing for endoscopic examination> As shown in FIG. 14 , before an endoscopic examination, the endoscope information management system 31 acquires an examination order using the examination order acquisition unit 171 (step S101). When the examination order acquisition unit 171 acquires the examination order, the endoscope determination unit 172 determines the endoscopic device 21 (the processor device 46 and the light source device 44) and the endoscope 42 to be used in the endoscopic examination related to the examination order (step S102). In addition, the endoscope information management system 31 collects information such as contraindications about the patient (step S103). Specifically, the endoscope information management system 31 acquires information about the insertion path of the endoscope 42 in a previous examination of the patient using the insertion path information acquisition unit 173, and acquires contraindication information about the patient using the contraindication information acquisition unit 174. Thereafter, the endoscope information management system 31 generates a pre-examination screen 251 using the pre-examination screen generation unit 181 and displays it on the monitor 48 (step S104).

[0090] As shown in Fig. 15, the pre-examination screen 251 has a first display section 252 that displays information about the endoscopic examination to be performed and a second display section 253 that displays information about endoscopic examinations that have been performed in the past. The first display section 252 displays, for example, identification information 261 of the endoscope 42 to be used (model name "EGXXX" in Fig. 15), a patient name 262 ("Fuji Taro" in Fig. 15), a patient ID 263 ("1234567890" in Fig. 15), contraindication information 264 ("○×△" for allergies and "Biopsy Prohibited" for biopsy in Fig. 15), and a recommended insertion path 267 of the endoscope 42 for this endoscopic examination that is determined based on past insertion paths ("Nasal (Right)" in Fig. 15). The second display section 253 displays, for example, a report 268 of a past endoscopic examination of the patient and / or endoscopic images.

[0091] As described above, in the endoscopy-related business system 10, the endoscopy information management system 31 displays information necessary for an endoscopic examination and preparations for the endoscopic examination on the monitor 48 via the pre-examination screen 251. This allows the doctor or staff preparing for the endoscopic examination to smoothly prepare for the endoscopic examination without having to refer to other materials, data, etc. Furthermore, at the start of the endoscopic examination, the doctor can obtain, from the pre-examination screen 251, a list of points to note in the endoscopic examination and / or information on past endoscopic examinations, allowing the endoscopic examination to begin safely and smoothly.

[0092] 16, when an endoscope 42 is connected to the endoscopic device 21 in preparation for an endoscopic examination (step S201), the connection detection unit 51 detects this. Therefore, the endoscope connection monitoring unit 182 verifies whether the connected endoscope 42 is different from the endoscope 42 to be used that has been determined by the endoscope determination unit 172 (step S202). If the connected endoscope 42 is different from the endoscope 42 to be used, the endoscope connection monitoring unit 182 issues a warning to that effect using the notification unit 55 (step S210). This makes it possible to prevent an endoscope 42 that is not to be used from being used in an endoscopic examination, and as a result, the endoscopic examination can be performed safely.

[0093] Furthermore, when an endoscope 42 is connected to the endoscope device 21 (step S201), the endoscope information management system 31 uses the cleaning status monitoring unit 191 to check the cleaning status of the connected endoscope 42. If cleaning of the connected endoscope 42 has not been completed successfully (step S203: NO), or if the endoscope 42 is not removed within a predetermined time after cleaning has been completed (step S204: NO), the cleaning status monitoring unit 191 issues a warning to that effect using the notification unit 55 (step S210). This makes it possible to prevent an unclean endoscope 42 or an endoscope 42 that may be unclean from being used in an endoscopic examination, thereby enabling an endoscopic examination to be performed safely.

[0094] Furthermore, when information such as the identification information of the doctor and patient is input in preparation for the endoscopic examination (step S205), the endoscope information management system 31 collates the entered doctor and patient information using the user monitoring unit 183. If the doctor and patient are not the ones scheduled for the examination (step S206), the user monitoring unit 183 issues a warning to that effect using the notification unit 55 (step S210). This makes it possible to prevent an endoscopic examination from being performed by a doctor or patient other than the one scheduled, and as a result, the endoscopic examination can be carried out safely.

[0095] As described above, in the endoscopy-related business system 10, the endoscopic examination can be started (step S211) after various checks are performed by the endoscopy information management system 31. Therefore, the endoscopic examination can be started safely.

[0096] <Performing endoscopic examination> As shown in FIG. 17, when an endoscopic examination starts, the endoscopic device 21 acquires endoscopic images and displays the acquired endoscopic images on the monitor 48 via a during-examination screen 301 (step S301). As shown in FIG. 18, the during-examination screen 301 includes, for example, an endoscopic image display section 311 that displays sequentially acquired endoscopic images 321, a contraindication information display section 312 that displays information related to the safety of performing an endoscopic examination, such as a "biopsy prohibited" mark 322, and a reference information display section 313 that displays reference information, such as endoscopic images 323 acquired in a past endoscopic examination and / or reports 324 of the past endoscopic examination. The endoscopic images 323 acquired in a past endoscopic examination are acquired by the image acquisition section 175 and inserted into the during-examination screen 301. The reports 324 of the past endoscopic examinations are acquired by the report acquisition section 176 and inserted into the during-examination screen 301. Meanwhile, the photographing position recognition section 61 sequentially recognizes the photographing positions of the acquired and displayed endoscopic images 321 (step S310). Therefore, when the photographing position has changed (step S312: YES), the endoscope information management system 31 appropriately updates the reference information on the examination-in-progress screen 301. For example, when displaying an endoscopic image 323 acquired in a past endoscopic examination on the reference information display unit 313, the endoscopic image 323 acquired in the past endoscopic examination and displayed on the reference information display unit 313 is updated according to the recognized photographing position. More specifically, the past endoscopic image 323 photographed at a position corresponding to the photographed endoscopic image 321 is displayed on the reference information display unit 313. In this way, by recognizing the photographing position and automatically updating the reference information, the doctor can refer to appropriate reference information in real time, allowing the doctor to perform the endoscopic examination smoothly.

[0097] During an endoscopic examination, the procedure recognition unit 62 recognizes whether or not a procedure has been performed, and the endoscope information management system 31 monitors whether or not a biopsy has been performed using the biopsy monitoring unit 201. If a biopsy has been performed (step S320: YES), the biopsy monitoring unit 201 acquires information related to the biopsy (step S321), and the label printer control unit 203 automatically prints a biopsy label 350 related to that biopsy. In conventional endoscopic examinations, when a biopsy is performed, a doctor or staff member inputs information related to the biopsy into the label printer 22 to create the biopsy label 350. However, in the endoscopy-related business system 10, the biopsy label 350 is automatically created when the biopsy is performed, as described above, and therefore the creation of the biopsy label 350 can be performed more smoothly and conveniently than in the past.

[0098] As shown in FIG. 19, the biopsy label 350 includes, for example, a title such as "Specimen Label," an indication of the order in which the biopsy was performed such as "(1)," "(2)," and "(3)," the name of the patient on whom the biopsy was performed ("Fuji Taro" in FIG. 19), the patient's ID ("1234567890" in FIG. 19), and the site from which the specimen was taken ("Stomach" in FIG. 19).

[0099] Additionally, during an endoscopic examination, the image quality recognition unit 63 recognizes the image quality of the acquired endoscopic image 321, and the unphotographed portion recognition unit 64 recognizes the unphotographed portions of the subject. If the image quality is not appropriate (step S330: NO) or if there is an oversight due to an unphotographed portion (step S340: NO), the notification unit 55 issues a warning to that effect and / or a notification urging improvement (step S350). Therefore, in the endoscopy-related business system 10 equipped with the endoscopy information management system 31, oversights are reduced and endoscopic images of appropriate image quality are more likely to be obtained than in conventional endoscopy devices that do not have such warnings. In other words, endoscopic examinations can be performed smoothly and reliably.

[0100] The endoscopy-related business system 10 repeatedly executes the above steps as appropriate until the examination is completed (step S360: YES).

[0101] <Cleaning the endoscope> 20 , when the endoscope 42 used at the bedside after an endoscopic examination is subjected to primary cleaning, the endoscope information management system 31 uses the primary cleaning management unit 192 to display a primary cleaning information input screen 401 on the monitor 48 (step S401). Therefore, the doctor or staff member performing the primary cleaning of the endoscope 42 can input necessary information, such as information related to the primary cleaning, immediately after performing the primary cleaning of the endoscope 42 (step S402). Furthermore, once the input of the information related to the primary cleaning is complete, the primary cleaning management unit 192 acquires the information related to the primary cleaning, which is the input item on the primary cleaning information input screen 401 (step S403), and registers it in the database 156 (step S404). In conventional endoscope devices, the information related to the primary cleaning must be input separately using a device or system separate from the endoscope device 21. However, in the endoscope-related business system 10, the input and registration are completed at the time the primary cleaning is performed. This allows the work of inputting information related to the primary cleaning to be performed more smoothly than in conventional endoscope devices.

[0102] 21, the primary cleaning information input screen 401 includes items to be entered as information related to the primary cleaning, such as identification information 411 of the endoscope 42 to be primary cleaned ("EGXXX" in FIG. 21), identification information 412 of the cleaner who performed the primary cleaning ("Yamayago Taro" in FIG. 21), cleaning status 413 ("OK" icon indicating that the cleaning has been performed in FIG. 21), waterproof cap attachment status 414 ("OK" icon indicating that the cap has been attached in FIG. 21), and leak check result 415 ("No abnormalities" in FIG. 21). When the cleaner presses a cleaning completion button 416, the primary cleaning management unit 192 automatically registers this information in the database 156.

[0103] 22, when main cleaning is performed using the cleaning disinfection apparatus 23, the cleaning disinfection apparatus 23 automatically acquires identification information of the endoscope 42 to be cleaned and disinfected using the endoscope identification unit 122 (step S451). The cleaning disinfection apparatus 23 also acquires identification information of the cleaner who will perform the main cleaning using the cleaner identification unit 123 (step S452). The cleaning disinfection apparatus 23 then automatically inputs this information into the operation screen 460 displayed on the touch panel 115 (step S453).

[0104] 23 , the operation screen 460 displays, for example, a status display 461 indicating the operating status of the cleaning / disinfecting apparatus 23, a cleaning information input field 462 for inputting information related to the main cleaning and the first cleaning, and a cleaning start button 465. In the cleaning information input field 462, identification information 463 of the endoscope 42 that will perform the main cleaning and identification information 464 of the cleaner who will perform the main cleaning do not need to be input again. Furthermore, the cleaning / disinfecting apparatus 23 acquires information related to the first cleaning from the endoscope information management system 31 using the communication unit 121, and the input is automatically completed. Therefore, the cleaner who will perform the main cleaning does not need to input information related to the main cleaning and the first cleaning; they simply need to confirm the input content (step S454) and press the cleaning start button 465 (step S455). Therefore, the endoscope-related business system 10 allows the main cleaning to be performed more smoothly than conventional cleaning / disinfecting apparatuses and the like that require such input.

[0105] When the cleaner presses the cleaning start button 465 to start the main cleaning, or when the main cleaning is completed (including when it has abnormally ended), the cleaning / disinfecting apparatus 23 automatically transmits information related to the main cleaning to the endoscope information management system 31 using the communication unit 121 (step S456). As a result, the endoscope information management system 31 automatically registers the acquired information related to the main cleaning in the database 156 using the main cleaning management unit 193 (step S457). Therefore, the endoscope-related work system 10 can perform the main cleaning more smoothly than conventional management systems that require these inputs.

[0106] <Creating a report> When creating a report after an endoscopic examination, as shown in Fig. 24, the doctor creating the report accesses the endoscopic information management system 31 using the report creation device 24 (step S501). When accessed by the report creation device 24, the endoscopic information management system 31 generates a report creation screen 510 using the report creation screen generator 220 and displays it on the display 131 of the report creation device 24 (step S502). At that time, the doctor specifies information that identifies the patient and / or the endoscopic examination (step S503). This is to provide the doctor with an appropriate report creation screen 510 for the specific patient and endoscopic examination.

[0107] 25, the report creation screen 510 has a patient information display section 511 that displays patient information, a key image display section 512 that displays key images, etc., a report list display section 513 that displays a list of reports, and an item input section 514 that functions as an operation section for inputting information to be written in the report. Note that the display sections or operation sections related to report creation, such as the key image display section 512, report list display section 513, and item input section 514, are displayed by pressing an attach report button 516.

[0108] As shown in FIG. 26 , the key image display unit 512 has a schematic diagram field 520 that displays a schematic diagram and a plurality of endoscopic image display fields 521-527. The endoscopic image displayed in the endoscopic display field 521 is a key image. In conventional report creation devices, the schematic diagram is manually input by a doctor, but in the endoscopic-related work system 10, the endoscopic information management system 31 automatically selects a schematic diagram using the second recognition processing unit 222 and the image selection support unit 223 and automatically inserts it into the schematic diagram field 520 (step S504). Also, in conventional report creation devices, the key image is manually input by a doctor, but in the endoscopic-related work system 10, the endoscopic information management system 31 automatically selects a key image using the second recognition processing unit 222 and the image selection support unit 223 and automatically inserts it into the endoscopic image display fields 521-527 (step S504). Therefore, the endoscopic-related work system 10 allows report creation tasks to be performed more smoothly and quickly than conventional report creation devices.

[0109] 27, the item input section 514 of the report creation screen 510 includes, for example, a lesion site item input field 531 for inputting items related to the lesion site, a diagnosis item input field 532 for inputting items related to the diagnosis, a findings input field 533 for inputting findings, and a treatment etc. input field 534 for inputting items related to the treatment and / or specimen. Each of these item fields includes an item name display section that displays the item name and an item selection section that lists candidates for the item to be input. The item name display section also functions as an operation section that switches between displaying and hiding the item selection section.

[0110] For example, the lesion site item input field 531 includes an item name display section 540 indicating "lesion site," and a first item input field 541, a second item input field 542, a third item input field 543, a fourth item input field 544, and a fifth item input field 545. The first item input field 541 is a lesion site input field for globally selecting the imaging site, and input candidates include, for example, the esophagus, stomach, duodenum, and small intestine. The second item input field 542 is an input field for items that categorize the items selected in the first item input field 541, and the items listed change depending on the item selected in the first item input field 541. The third item input field 543 is an input field for items that further categorize the items selected in the first item input field 541 or the second item input field 542, and the items listed change depending on the item selected in the first item input field 541 or the second item input field 542. Furthermore, the fourth item input field 544 is an input field for items that further classify the selected items of the first item input field 541, the second item input field 542, and / or the third item input field 543, and the items listed change depending on the selected items of the first item input field 541, the second item input field 542, and / or the third item input field 543. The fifth item input field 545 is an input field for optionally entering supplementary information regarding the lesion site. Furthermore, for example, the diagnosis item input field 532 includes an item name display section 550 representing "Diagnosis," as well as a first item input field 551, a second item input field 552, a third item input field 553, and a fourth item input field 554.

[0111] In conventional report creation devices, input (selection) of the item input unit 514 is performed manually by a doctor. In contrast, in the endoscopy-related business system 10, the endoscopy information management system 31 automatically selects key images using the image selection support unit 223. Subsequently, the classification unit 236 of the third recognition processing unit 224 automatically performs classification processing on each key image (step S505). Then, the item selection support unit 226 automatically provisionally inputs some or all of the input items in the item input unit 514 using the recognition result of the second recognition processing unit 222 and / or the classification result of the third recognition processing unit 224, setting them to a selected state (step S506). That is, the endoscopy-related business system 10 provides a report creation screen 510 in which some or all of the input items in the item input unit 514 have been automatically selected. Therefore, the doctor simply confirms the input content (step S507) and performs an approval operation by pressing the confirm button 519 to confirm the input content, thereby completing report creation. Therefore, the endoscopy-related business system 10 can create a report more smoothly and quickly than when manually inputting the input items in the item input section 514. It can also prevent forgetting to input items.

[0112] When the approval operation is performed on the report creation screen 510, the endoscope information management system 31 automatically registers the approved report in the database 156 (step S508).

[0113] In the above embodiment, some or all of the components of the endoscope information management system 31 may be provided in the endoscope device 21 (particularly the processor device 46), the label printer 22, the cleaning / disinfecting device 23, or the report creation device 24. In this case, the endoscope device 21 and the like have the various functions of the endoscope information management system 31. Therefore, a system including the endoscope device 21 and the like that has the functions of the endoscope information management system 31 constitutes the endoscope-related business system 10 of the above embodiment.

[0114] In the above embodiment, the endoscope 42 is an insertion type, but instead of the insertion type endoscope 42, a capsule endoscope that is swallowed by the subject can be used.

[0115] The information relating to the primary cleaning and / or the information relating to the main cleaning can include information relating to the usage history, which indicates who (which patient) the endoscope 42 was used for. Therefore, the cleaning status monitoring unit 191 can monitor not only the cleaning status of the endoscope 42, but also information relating to the usage history.

[0116] In the above embodiment, the hardware structure of the processing units that execute various processes among the components of the endoscope-related business system 10, such as the components of the processor device 46 and the components of the endoscope information management system 31, is the following various processors: The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a GPU (Graphical Processing Unit), a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and a dedicated electrical circuit, which is a processor having a circuit configuration specifically designed to execute various processes.

[0117] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). Also, multiple processing units may be configured with a single processor. Examples of multiple processing units configured with a single processor include, first, a configuration in which one processor is configured with a combination of one or more CPUs and software, as typified by client or server computers, and this processor functions as multiple processing units. Second, a configuration in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip, as typified by a system-on-chip (SoC). In this way, the various processing units are configured with one or more of the above-mentioned various processors as a hardware structure.

[0118] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit in the form of a combination of circuit elements such as semiconductor elements. [Explanation of symbols]

[0119] 10 Endoscopy-related business system 21 Endoscopic equipment 22 Label printer 23 Cleaning and disinfecting equipment 24 Report writing device 26 Related business equipment 31 Endoscopy Information Management System 42 Endoscopy 42a Insertion part 42b Operation section 42c curved section 42d Tip 42e Angle Knob 42nd floor insertion slot 44 Light source device 46 Processor Unit 48 monitors 49 Console 51 Connection detection unit 52 Image acquisition unit 53 Image processing section 54 Display control unit 55 Information Department 56 Control Unit 57 Communications Department 60 First recognition processing unit 61 Shooting position recognition unit 62 Treatment Recognition Unit 63 Image quality recognition unit 64 Unphotographed part recognition section 71 Biometric information calculation unit 72 Speaker 73 Timing section 74 Information Acquisition Department 75 Information output section 92 Communications Department 93 Biopsy Information Acquisition Department 94 Output section 110 Cleaning tank 111 Main Unit 112 Lid 113 Pedals 115 Touch Panel 116 Caster 121 Communications Department 122 Endoscope Identification Unit 123 Cleaner Identification Unit 124 Control Unit 131 Display 132 Operation section 133 Communications Department 151 Test Information Management Department 152 Cleaning Information Management Department 153 Label Output Management Unit 154 Report Writing Support Department 156 databases 157 Operation section 158 Display 159 Communications Department 171 Test Order Acquisition Department 172 Endoscopy Decision Unit 173 Insertion path information acquisition unit 174 Contraindication Information Acquisition Department 175 Image acquisition unit 176 Report Acquisition Department 181 Pre-examination screen generation unit 182 Endoscope connection monitoring unit 183 User Monitoring Department 191 Cleaning status monitoring unit 192 Primary Cleaning Management Department 193 Cleaning Management Department 201 Biopsy Surveillance Department 203 Label printer control unit 220 Report Creation Screen Generation Unit 222 Second recognition processing unit 223 Image Selection Support Department 224 Third recognition processing section 226 Item Selection Support Department 231 Shooting position recognition unit 232 Treatment Recognition Unit 233 Lesion Recognition Department 236 Identification Department 251 Pre-examination screen 252 1st display section 253 2nd display section 261 Identification Information 262 Patient name 264 Contraindication information 267 Insertion Path 268 Report 301 Inspection screen 311 Endoscope image display unit 312 Contraindication information display section 313 Reference information display section 321 Endoscopic Images 322 No Biopsy Mark 323 Endoscopic Images 324 Report 350 Biopsy Labels 401 Primary cleaning information input screen 411 Identification Information 412 Identification Information 413 Cleaning implementation status 414 Waterproof cap installation status 415 Leak check results 416 Cleaning complete button 460 operation screen 461 Status Display 462 Cleaning information input field 463 Identification Information 464 Identification Information 465 Cleaning start button 510 Report creation screen 511 Patient information display section 512 Key image display section 513 Report list display section 514 Item Input Section 516 Report Attachment Button 519 Confirm button 520 Schematic diagram 521~527 Endoscopic image display column 531 Lesion site entry field 532 Diagnostic item input field 533 Comments entry field 534 Treatment etc. input field 540 Item name display area 541 Item 1 input field 542 Item 2 input field 543 Item 3 input field 544 Item 4 input field 545 Item 5 input field 550 Item name display area 551 Item 1 input field 552 Item 2 input field 553 Item 3 input field 554 Item 4 input field

Claims

1. An endoscope information management system connected to an endoscope device, a photographing position recognition unit in the endoscope information management system; an image selection support unit that automatically selects an endoscopic image to be used on a report creation screen from a plurality of endoscopic images using a recognition result obtained by recognizing a part of a subject shown in the endoscopic image, the recognition result is acquired from a photographing position recognition unit in the endoscope device or a photographing position recognition unit in the endoscope information management system; When the Confirm button is pressed to confirm the input contents on the report creation screen, the creation of the report creation screen is completed. The image selection support unit is an endoscope information management system that selects the endoscopic image in which a treatment is recognized.

2. An endoscope information management system connected to an endoscope device, a photographing position recognition unit in the endoscope information management system; an image selection support unit that automatically selects an endoscopic image to be used on a report creation screen from a plurality of endoscopic images using a recognition result obtained by recognizing a part of a subject shown in the endoscopic image, the recognition result is acquired from a photographing position recognition unit in the endoscope device or a photographing position recognition unit in the endoscope information management system; When the Confirm button is pressed to confirm the input contents on the report creation screen, the creation of the report creation screen is completed. The image selection support unit is an endoscope information management system that selects the endoscopic image in which a lesion is recognized.

3. 3. The endoscope information management system according to claim 1, wherein the recognition result is acquired in real time from a photographing position recognition unit in the endoscope device.

4. 3. The endoscope information management system according to claim 1, wherein the recognition result is obtained from a photographing position recognition unit in the endoscope information management system after the examination.

5. 5. The endoscope information management system according to claim 1, wherein the image selection support unit uses the recognition result to select the endoscopic image of a portion that is predetermined to be used on the report creation screen.

6. An endoscope information management system connected to an endoscope device, a photographing position recognition unit in the endoscope information management system; an image selection support unit that automatically selects an endoscopic image to be used on a report creation screen from a plurality of endoscopic images using a recognition result obtained by recognizing a part of a subject shown in the endoscopic image, the recognition result is acquired from a photographing position recognition unit in the endoscope device or a photographing position recognition unit in the endoscope information management system; When the Confirm button is pressed to confirm the input contents on the report creation screen, the creation of the report creation screen is completed. An endoscope information management system that automatically selects a schematic diagram using the image selection support unit and automatically inserts the schematic diagram into the report creation screen.

7. a discrimination unit that executes discrimination processing on the endoscopic image selected by the image selection support unit; 7. The endoscope information management system according to claim 1, further comprising an item input unit that inputs items on the report creation screen using the discrimination result of the discrimination unit.

8. The endoscope information management system according to claim 7 , wherein the discrimination result is acquired from the discrimination unit in the endoscope information management system.

9. The endoscope information management system according to claim 1 , wherein the treatment is recognized by a treatment recognition unit of the endoscope device.

10. The endoscope information management system according to claim 1 , wherein the treatment is recognized by a treatment recognition unit in the endoscope information management system.

11. The endoscope information management system according to claim 2 , wherein the lesion is recognized by a lesion recognition unit in the endoscope information management system.

12. 12. The endoscope information management system according to claim 1, further comprising a patient information acquisition unit that acquires patient information to be used on the report creation screen from a patient information database.

Images