Endoscope information management system

Abstract

To provide an endoscope information management system that enables a part or the whole of a series of operations related to an endoscope examination to be carried out smoothly.SOLUTION: An image selection support unit 223 automatically selects an endoscope image to be used in a report out of a plurality of endoscope images using a recognition result acquired by recognizing a part of a subject shown in the endoscope images. The recognition result is acquired from an imaging position recognition part 61 in an endoscope device 21 or an imaging position recognition part 231 in an endoscope information management system 10.SELECTED DRAWING: Figure 13

Description

[Technical field]

[0001] The present invention relates to an endoscope information management system for managing information related to an endoscope. [Background technology]

[0002] Conventionally, examinations and surgeries using endoscopes have become widespread in the medical field. Known devices or systems for managing information related to endoscopes include an image management device for managing endoscopic images (Patent Document 1), a diagnosis support device for supporting diagnosis (Patent Document 2), a report creation support system for supporting report creation (Patent Document 3), a cleaning management system for managing the cleaning of endoscopes (Patent Document 4), and a repair information management system for managing information related to the repair of endoscopes (Patent Document 5). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-053723 A [Patent Document 2] JP 2012-157384 A [Patent Document 3] JP 2011-072663 A [Patent Document 4] JP 2015-195867 A [Patent Document 5] JP 2015-099503 A Summary of the Invention [Problem to be solved by the invention]

[0004] When an examination is performed using an endoscope, various related tasks arise in addition to observing or photographing the subject. For example, before the examination, there is a task related to preparation for carrying out the examination that conforms to the order. During the examination, not only is the subject observed or photographed for the examination, but also, if necessary, a specimen for a biological tissue test (so-called biopsy) or a procedure such as an endoscopic surgery may be performed. After the examination, the doctor may have a task of creating a report using the endoscopic images. After the examination, the doctor or other medical staff may have a task of attaching a label to a container for storing the specimen or a task of cleaning the endoscope used for the examination.

[0005] The above-mentioned endoscopic examinations and tasks associated with endoscopic examinations are closely related to each other. Each task is performed using devices suitable for that task. For example, an examination using an endoscope is performed using an endoscope device that includes an endoscope, a light source device, and a processor device. On the other hand, for example, a report is created using a report creation device separate from the endoscope device. Similarly, a cleaning and disinfecting device separate from the endoscope device is used to clean the endoscope. The same is true for other related tasks.

[0006] For this reason, if the devices performing each task are not closely linked, it is inconvenient to perform each task. Therefore, it is desirable that some or all of the devices performing endoscopic examinations and tasks related to endoscopic examinations are closely linked.

[0007] The present invention aims to provide an endoscopic information management system that enables smooth execution of some or all of the series of tasks related to endoscopic examinations by comprehensively managing information related to endoscopic examinations. [Means for solving the problem]

[0008] The present invention is an endoscopic information management system connected to an endoscopic device, and includes a shooting position recognition unit within the endoscopic information management system, and an image selection support unit that automatically selects an endoscopic image to be used in a report from among a plurality of endoscopic images using the recognition results obtained by recognizing the parts of a subject appearing in an endoscopic image, and the recognition results are obtained from the shooting position recognition unit within the endoscopic device or the shooting position recognition unit within the endoscopic information management system.

[0009] The recognition result is preferably obtained from a photographing position recognition unit in the endoscope device.The recognition result is preferably obtained from a photographing position recognition unit in the endoscope information management system.

[0010] It is preferable that the image selection support unit selects an endoscopic image of a portion that is determined to be used in the report. It is preferable that the creation of the report is completed when a confirmation button is pressed to confirm the input contents of the report. It is preferable that a schematic diagram is automatically selected using the image selection support unit.

[0011] The image selection support unit may further include a discrimination unit that executes discrimination processing on the endoscopic image selected by the image selection support unit, and an item input unit that inputs items on the report creation screen using a discrimination result of the discrimination unit. The discrimination result is preferably obtained from the discrimination unit in the endoscope information management system.

[0012] It is preferable that the image selection support unit selects an endoscopic image in which a procedure has been recognized. It is preferable that the procedure is recognized by a procedure recognition unit of the endoscopic device. It is preferable that the procedure is recognized by a procedure recognition unit in the endoscopic information management system. It is preferable that the image selection support unit selects an endoscopic image in which a lesion has been recognized. It is preferable that the lesion is recognized by a lesion recognition unit in the endoscopic information management system. Effect of the Invention

[0013] According to the endoscopy-related task system of the present invention, a part or all of a series of tasks relating to endoscopic examination can be smoothly carried out. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is an explanatory diagram showing a medical system for endoscopic examination. [Diagram 2] FIG. 1 is a perspective view of an endoscope device. [Diagram 3] FIG. 2 is a block diagram of a processor device. [Figure 4] FIG. 4 is a block diagram of a first recognition processing unit. [Diagram 5] FIG. 1 is a block diagram of a label printer. [Figure 6] FIG. 2 is a perspective view of the cleaning and disinfecting apparatus. [Figure 7] FIG. 2 is a block diagram of the cleaning and disinfecting apparatus. [Figure 8] FIG. 2 is a block diagram of a report creation device. [Figure 9] 1 is a block diagram showing a configuration of an endoscope information management system. [Figure 10] FIG. 4 is a block diagram of a test information management unit. [Figure 11] FIG. 4 is a block diagram of a cleaning information management unit. [Figure 12] FIG. 4 is a block diagram of a label output management unit. [Figure 13] FIG. 2 is a block diagram of a report creation support unit. [Figure 14] 11 is a flowchart of a preparation support operation for supporting preparation for an endoscopic examination. [Figure 15] This is a pre-examination screen that is displayed before the start of an endoscopic examination. [Figure 16] 10 is a flowchart showing the operations for starting an endoscopic examination. [Figure 17] 10 is a flowchart showing operations during an endoscopic examination. [Figure 18] This is an examination in-progress screen that is displayed during an endoscopic examination. [Figure 19] This is a sample label. [Figure 20] 13 is a flowchart showing an operation when performing bedside cleaning. [Figure 21] 13 is a cleaning information input screen displayed when performing bedside cleaning. [Figure 22] 1 is a flowchart of the main cleaning process. [Diagram 23] 1 is a display screen of a cleaning and disinfecting apparatus. [Figure 24] 13 is a flowchart showing a report creation support operation. [Diagram 25] This is a report creation screen. [Figure 26] This is the key image display section. [Figure 27] This is the information input section. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] [Endoscopy-related business system] As shown in Fig. 1, the endoscope-related work system 10 is a system used for performing examination, observation, surgery, etc. of a subject using an endoscope 42 (see Fig. 2) (hereinafter referred to as endoscopic examination) and work related to endoscopic examination. Work related to endoscopic examination (hereinafter referred to as related work) is medical and other work other than endoscopic examination that is required during or before and after endoscopic examination. In other words, related work is work that accompanies endoscopic examination, and for example, printing labels to be affixed to biopsy containers, cleaning and disinfecting the endoscope 42, and creating reports are related work.

[0016] The endoscope-related business system 10 includes an endoscope device 21, a label printer 22, a cleaning and disinfecting device 23, a report creation device 24, and an endoscope information management system 31. Of these, the label printer 22, the cleaning and disinfecting device 23, and the report creation device 24 are related business devices 26. The related business device 26 may include devices for performing related business in addition to the label printer 22, the cleaning and disinfecting device 23, and the report creation device 24. Furthermore, the related business device 26 may not include the label printer 22, the cleaning and disinfecting device 23, and / or the report creation device 24 if not necessary.

[0017] (1) Configuration of the endoscope device As shown in FIG. 2, the endoscope device 21 includes an endoscope 42, a light source device 44, a processor device 46, a monitor 48, and a console 49. The endoscope 42 captures an image of a subject. The light source device 44 generates illumination light. The processor device 46 controls the endoscope device 21 and performs image processing, etc. The monitor 48 is a display unit that displays an endoscope image. The console 49 is an input device that inputs settings to the processor device 46, etc. The console 49 includes a device that inputs or reads information required for an endoscope examination, such as the ID (identification) of a doctor who performs an endoscope examination using the endoscope device 21 and the ID of a patient who is a subject of the endoscope examination. For example, when the doctor's ID and the patient's ID are input using barcodes, the console 49 includes a barcode reader. When a card equipped with an IC (integrated circuit) chip (a so-called IC card) is used, the console 49 includes a card reader.

[0018] The endoscope 42 has an insertion section 42a to be inserted into the subject, an operation section 42b provided at the base end of the insertion section 42a, a bending section 42c provided at the tip side of the insertion section 42a, and a tip section 42d. The bending section 42c is bent by operating an angle knob 42e of the operation section 42b. As a result, the tip section 42d faces a desired direction. In addition to the angle knob 42e, the operation section 42b has buttons, dials, switches, etc. used for various operations such as switching of observation modes, zoom operation, freeze operation, still image shooting operation, and air or water supply operation. In addition, the endoscope 42 has an insertion port 42f for a treatment tool. The insertion port 42f communicates with a treatment tool outlet (not shown) provided at the tip section 42d via a treatment tool channel (not shown) provided inside the endoscope 42. Therefore, when a treatment tool is inserted from the insertion opening 42f, the tip of the treatment tool can protrude toward the subject from the treatment tool outlet of the tip portion 42d. The treatment tool is, for example, forceps (biopsy forceps), a snare, a scalpel (high frequency scalpel), or the like.

[0019] The light source device 44 includes a light source unit (not shown) that emits illumination light, and a light source control unit (not shown) that controls the operation of the light source unit. The light source unit emits illumination light that illuminates a subject, or excitation light used to emit illumination light. The light source unit includes a light source such as a laser diode (hereinafter referred to as LD), an LED (Light Emitting Diode), a xenon lamp, or a halogen lamp, and emits at least white illumination light or excitation light used to emit white illumination light. The white light includes so-called pseudo-white light that is substantially equivalent to white light in photographing a subject using the endoscope 42. The light source unit includes, as necessary, a phosphor that emits light when irradiated with excitation light, or an optical filter that adjusts the wavelength band, spectrum, or light amount of the illumination light or excitation light. In addition, the light source unit can emit light having a specific wavelength band required for photographing an image used to calculate biological information such as oxygen saturation of hemoglobin contained in the subject. The light source control unit controls the timing of turning on, off, or blocking each light source constituting the light source unit, and the amount of light emitted, etc. As a result, the light source unit can emit multiple types of illumination light with different spectra. The light source control unit also controls the light source unit in accordance with the timing of shooting.

[0020] As shown in FIG. 3, the processor device 46 includes a connection detection unit 51, an image acquisition unit 52, an image processing unit 53, a display control unit 54, a notification unit 55, a control unit 56, and a communication unit 57.

[0021] The connection detection unit 51 detects the connection of the endoscope 42 to the processor device 46 and / or the light source device 44. In addition to detecting the connection of the endoscope 42, the connection detection unit 51 acquires identification information for identifying the connected endoscope 42. That is, the connection detection unit 51 functions as an identification unit for identifying the endoscope 42. The identification information for identifying the endoscope 42 is information for identifying the model of the endoscope 42 (model number, etc.) and / or information for identifying an individual endoscope 42 when there are multiple endoscopes 42 of the same model (serial number, etc.). In this embodiment, the connection detection unit 51 is a sensor that detects the connection of the endoscope 42 and acquires the identification information of the connected endoscope 42 by communicating with the endoscope 42 connected to the processor device 46 via wired or wireless communication.

[0022] The image acquiring unit 52 acquires an image (including a signal used to generate an image) from the endoscope 42. The image acquiring unit 52 has, for example, a DSP (Digital Signal Processor), a noise reduction unit, and a conversion unit (none of which are shown), and uses these to perform various processes on the acquired image as necessary.

[0023] The DSP performs various processes on the acquired image as necessary, such as defect correction, offset processing, gain correction, linear matrix processing, gamma conversion, demosaic processing, and YC conversion.

[0024] The defect correction process is a process for correcting the pixel values ​​of pixels corresponding to defective pixels of the image sensor. The offset process is a process for reducing dark current components from an image that has been subjected to the defect correction process and setting an accurate zero level. The gain correction process is a process for adjusting the signal level of each image by multiplying the offset processed image by a gain. The linear matrix process is a process for improving the color reproducibility of the offset processed image, and the gamma conversion process is a process for adjusting the brightness and saturation of the image after the linear matrix process. The demosaic process (also called isotropic process or simultaneous process) is a process for interpolating the pixel values ​​of missing pixels, and is performed on the image after the gamma conversion process. Missing pixels are pixels that have no pixel value due to the arrangement of the color filters (because pixels of other colors are arranged in the image sensor). For example, the demosaic process generates the pixel value of the B pixel at the position of the G pixel and the R pixel by interpolating using the pixel value of the B pixel. The same applies to other colors. The YC conversion process is a process for converting the image after the demosaic process into a luminance channel Y, a chrominance channel Cb, and a chrominance channel Cr.

[0025] The noise reduction unit performs noise reduction processing on the luminance channel Y, the chrominance channel Cb, and the chrominance channel Cr using, for example, a moving average method or a median filter method, etc. The conversion unit reconverts the luminance channel Y, the chrominance channel Cb, and the chrominance channel Cr after the noise reduction processing into images of each color of BGR again.

[0026] The image processing unit 53 uses the image acquired by the image acquisition unit 52 to generate an image to be displayed on the monitor 48 and / or an image to be used for diagnosis, etc. The image processing unit 53 may perform image processing on the image acquired by the image acquisition unit 52 or the endoscopic image depending on the setting of the observation mode, etc. The image processing unit 53 may output the image acquired by the image acquisition unit 52 as it is without performing image processing, etc. The image acquired by the image acquisition unit 52 is an endoscopic image because it is an image taken using the endoscope 42. The image generated by the image processing unit 53 is an image provided to the user by the endoscope device 21, so it is a so-called endoscopic image. Therefore, hereinafter, unless otherwise specified, the image acquired by the image acquisition unit 52 and / or the image generated by the image processing unit 53 will be referred to as an endoscopic image. The endoscopic image is a moving image or a still image.

[0027] The image processing unit 53 also includes a first recognition processing unit 60. The first recognition processing unit 60 performs recognition processing using an endoscopic image. Specifically, as shown in Fig. 4, the first recognition processing unit 60 includes various recognition processing units such as an imaging position recognition unit 61, a treatment recognition unit 62, an image quality recognition unit 63, and an unimaged portion recognition unit 64.

[0028] The photographing position recognition unit 61 recognizes the photographing position by using one or more endoscopic images. The photographing position is a position in the subject photographed by the endoscope 42. For example, the photographing position recognition unit 61 recognizes at least the part of the subject by using the endoscopic image as the photographing position. The part of the subject is the esophagus, stomach, for example, the duodenum, etc., in the upper digestive tract. The photographing position recognition unit 61 can also recognize a more detailed position. For example, when the part being observed is the stomach, the photographing position recognition unit 61 can recognize the cardia, the fundus, the body of the stomach, the angle of the stomach, the vestibule, the anterior pylorus, and / or the pylorus. In this embodiment, the photographing position recognition unit 61 recognizes the part of the subject, but does not recognize the detailed position. This is because the photographing position recognition process is performed in real time.

[0029] The treatment recognition unit 62 recognizes a treatment on the subject by using one or more endoscopic images. Recognizing a treatment means recognizing the presence or absence of a treatment and / or the type of treatment. A treatment on a subject means collection of a specimen such as tissue for a biopsy (hereinafter referred to as biopsy), incision, resection, hemostasis, removal of residue, or other operations on the subject. Recognizing the presence or absence of a treatment includes recognition of a state in which a treatment has already been performed, recognition of a state in which a treatment is being performed, and recognition of a state in which a treatment is about to be performed. Recognizing the type of treatment means recognizing a treatment by distinguishing between biopsy, incision, resection, hemostasis, removal of residue, etc.

[0030] The treatment recognition unit 62 recognizes the treatment on the subject by recognizing the treatment tool shown in the endoscopic image. The treatment recognition unit 62 can also recognize the treatment on the subject by recognizing the treatment scar or bleeding (or the cessation of bleeding) of the subject shown in the endoscopic image. In addition, the treatment recognition unit 62 can recognize the presence or absence of treatment and / or the type of treatment by using information other than one or more endoscopic images. For example, if the endoscope 42 has a mechanism for detecting the insertion of a treatment tool, the treatment can be recognized by using the detection result alone or in combination with an endoscopic image. In this embodiment, the treatment recognition unit 62 recognizes the presence or absence of a biopsy by recognizing the forceps used for the biopsy (biopsy forceps) using one or more endoscopic images. Therefore, the treatment recognition unit 62 in this embodiment functions as a biopsy recognition unit that recognizes the presence or absence of a biopsy.

[0031] The treatment recognition unit 62 also recognizes or counts the number of treatments. This is to distinguish between each treatment when multiple treatments are recognized. The treatment recognition unit 62 also recognizes the location where the treatment was performed. The recognition result of the imaging position recognition unit 61 can be used to recognize the location where the treatment was performed. For example, when biopsies are performed at two locations, the treatment recognition unit 62 of this embodiment recognizes that two biopsies were performed, and recognizes the site and order in which each biopsy was performed.

[0032] The image quality recognition unit 63 recognizes the image quality of an endoscopic image by using one or more endoscopic images. Recognizing the image quality means recognizing the presence or absence of blurring or clouding in the endoscopic image, and / or the presence or absence of factors that deteriorate the image of the subject, such as residue or residual liquid on the subject. Blurring or clouding in the endoscopic image is a factor on the endoscope 42 side (the side that captures the image, not the subject). Residue or residual liquid is a factor on the subject side (the side of the subject, not the endoscope 42).

[0033] The unphotographed portion recognition unit 64 recognizes the unphotographed portion of the subject by using one or more endoscopic images. The unphotographed portion refers to the portion of the subject that is not photographed due to the position and orientation of the tip 42d relative to the subject and the timing of photography. For example, the subject lumen may have an unphotographed portion due to the protuberance of the subject or the presence of folds (folds) generated by peristaltic movement. The unphotographed portion in the endoscopic image can be recognized, for example, by the global or local shape of the subject. In addition, the unphotographed portion recognition unit 64 can recognize and track the unphotographed portion by recognizing each of the unphotographed portions of multiple endoscopic images. That is, the unphotographed portion recognition unit 64 can recognize that the photographing position (the position of the tip 42d relative to the unphotographed portion) of a certain endoscopic image moves (is likely to move) to a position where the unphotographed portion cannot be properly photographed without being photographed even once thereafter. In this embodiment, the unphotographed portion recognition unit 64 recognizes the unphotographed portion and tracks the unphotographed portion.

[0034] The first recognition processing unit 60 and each of the above-mentioned components constituting the first recognition processing unit 60 are, for example, artificial intelligence (AI) having a learning function. Specifically, each of the components constituting the first recognition processing unit 60 is an AI that has been trained using a machine learning algorithm or deep learning, such as a neural network (NN), a convolutional neural network (CNN), adaboost, or a random forest. In addition, since the first recognition processing unit 60 has been trained to perform recognition processing using a specific image, even if it can perform recognition processing using other images, the accuracy of the results of the recognition processing may be low. "Having a learning function" means being able to learn, and includes having already been trained. Note that, instead of being configured with AI, some or all of the components constituting the first recognition processing unit 60 may be configured to calculate feature amounts from an image and perform detection, etc., using the calculated feature amounts.

[0035] In addition to the first recognition processing unit 60, the image processing unit 53 has a biometric information calculation unit 71. The biometric information calculation unit 71 calculates biometric information using one or more endoscopic images. The biometric information refers to a quantity based on the shape, color, or other characteristics of a subject that is a living organism, such as oxygen saturation, blood vessel density, length, size (area or volume), or the number or range of parts having a specific characteristic. The biometric information calculation unit 71 is activated as necessary, depending on the setting of the observation mode, etc.

[0036] The display control unit 54 converts the endoscopic image output by the image processing unit 53 into a format suitable for display and outputs it to the monitor 48. As a result, the monitor 48 displays the endoscopic image at least during the endoscopic examination. In addition, the display control unit 54 generates a screen used for observation or operation at each stage before the endoscopic examination (before the start of the period during which the subject is photographed), during the endoscopic examination (the period during which the subject is photographed), and after the endoscopic examination (after the end of the period during which the subject is photographed), and displays it on the monitor 48. At that time, the display control unit 54 can acquire information from the notification unit 55 or the communication unit 57 and display the information or information based on the information on the monitor 48. Specifically, before the endoscopic examination, the display control unit 54 displays a pre-examination screen 251 (see FIG. 15) acquired via the communication unit 57 on the monitor 48. During the endoscopic examination, the display control unit 54 may display, in addition to the endoscopic image, a warning message input by the notification unit 55 and / or information related to the examination acquired via the communication unit 57 on the monitor 48. For example, this is the examination-in-progress screen 301 (see FIG. 18). After the endoscopic examination, the display control unit 54 displays, for example, the first cleaning information input screen 401 (see FIG. 21) on the monitor 48.

[0037] The notification unit 55 issues a notification, a warning, or the like. The notification unit 55 has, for example, a speaker 72, and can issue a notification, a warning, or the like by issuing a sound or voice from the speaker 72. Furthermore, the notification unit 55 can issue a notification, a warning, or the like by using the display of the monitor 48 via the display control unit 54, by inputting a display instruction (including an instruction to change the display) of a message or the like indicating a notification, a warning, or the like to the display control unit 54. In addition, the notification unit 55 can include a lamp, or the like, and can issue a notification, a warning, or the like by turning on or off the lamp, or by changing the color, or the like.

[0038] Specifically, before an endoscopic examination, if the endoscope 42 whose connection is detected by the connection detection unit 51 (hereinafter referred to as the connected endoscope) is different from the endoscope 42 to be used, the notification unit 55 issues a warning to that effect. Furthermore, if the connected endoscope 42 has not been cleaned and disinfected and / or a predetermined time has passed since the completion of cleaning and disinfection, the notification unit 55 issues a warning to that effect. In addition, if the ID of the doctor and / or patient entered from the console 49 is different from that of the doctor and / or patient to be using the endoscopic device 21, a warning to that effect is issued.

[0039] During an endoscopic examination, the notification unit 55 notifies a part or all of information related to contraindications (contraindication information) such as "biopsy prohibited". In this embodiment, the notification unit 55 notifies the contraindication information by displaying it on the monitor 48. During an endoscopic examination, the notification unit 55 notifies a warning based on the results of various recognition processes in the first recognition processing unit 60. Specifically, when the image quality recognition unit 63 recognizes a deterioration in the image quality of the endoscopic image, the notification unit 55 notifies a warning indicating that the image quality has deteriorated, or a warning encouraging improvement of the image quality (for example, a display encouraging cleaning of the tip portion 42d). Furthermore, when the unphotographed portion recognition unit 64 recognizes the possibility that an unphotographed portion will not be photographed, a warning to that effect is issued.

[0040] After an endoscopic examination, the notification unit 55 may issue a notification or warning indicating that the primary cleaning of the endoscope 42 at the bedside (so-called bedside cleaning) has not been completed or has not started, and / or a notification or warning urging the primary cleaning to be performed.

[0041] The control unit 56 comprehensively controls each part of the processor device 46, as well as the endoscope 42 and the light source device 44. For example, the control unit 56 controls the synchronization of the emission of illumination light and the timing of imaging. The control unit 56 also includes a timer unit 73 that measures various times (including time) related to the endoscopic examination. Therefore, the control unit 56 can measure the start time and end time of the endoscopic examination, and / or the arrival time to a specific site (for example, the arrival time to the ileocecal area), etc. The timer unit 73 can measure various times related to the endoscopic examination based on information input using the console 49, etc. The timer unit 73 can also use various recognition results (for example, the recognition result of the imaging position) in the first recognition processing unit 60 to measure various times related to the endoscopic examination.

[0042] The communication unit 57 communicates with the endoscope information management system 31 via wired or wireless communication, and transmits or receives information. In this embodiment, the communication unit 57 includes an information acquisition unit 74 and an information output unit 75.

[0043] The information acquisition unit 74 acquires information usable in the endoscopic examination to be performed from the endoscope information management system 31. Specifically, before the endoscopic examination, the information acquisition unit 74 acquires, from the endoscope information management system 31, results of endoscopic examinations etc. performed in the past (including, for example, pathological examinations), images acquired in endoscopic examinations etc. performed in the past, reports created in endoscopic examinations etc. performed in the past, and / or information about the patient to be subjected to the endoscopic examination (information about contraindications, etc.). The display control unit 54 acquires this information via the information acquisition unit 74 and displays it on the monitor 48 as necessary.

[0044] The information output unit 75 outputs a part or all of the information related to the endoscopic examination performed (endoscopic examination currently being performed) to at least the endoscope information management system 31. The information output by the information output unit 75 is, for example, an endoscopic image, the results of the recognition processing performed by each unit of the first recognition processing unit 60, the biometric information calculated by the biometric information calculation unit 71, and / or various times measured by the timing unit 73. The endoscopic image etc. output by the information output unit 75 are registered in the endoscope information management system 31.

[0045] In addition, the communication unit 57 can communicate with the endoscope information management system 31 as well as the endoscope 42 or light source device 44 constituting the endoscopic device 21, the related business device 26, and / or other devices, and can transmit or receive some or all of the various information described above.

[0046] (2) Label printer configuration In the endoscope-related business system 10, the label printer 22 is a printer used to create (print, etc.) an identification label (hereinafter referred to as a biopsy label 350; see FIG. 19) to be affixed to a container for containing tissue (specimen) collected for biopsy. The label printer 22 is connected to the endoscope information management system 31 directly or indirectly, by wire or wirelessly. As shown in FIG. 5, the label printer 22 includes a communication unit 92, a biopsy information acquisition unit 93, and an output unit 94.

[0047] The communication unit 92 is an interface that is connected to the endoscope information management system 31 directly or indirectly by wire or wirelessly. When a biopsy is performed during an endoscopic examination, the biopsy information acquisition unit 93 communicates with the endoscope information management system 31 using the communication unit 92, and automatically acquires information related to the biopsy via the endoscope information management system 31 (or directly from the processor device 46 or the like based on an instruction from the endoscope information management system 31). The information related to the biopsy includes information related to the patient on whom the biopsy was performed (such as name and / or ID), information identifying each biopsy when multiple biopsies are performed (such as a number identifying the order), information related to the location where the biopsy was performed (such as the extraction site), and the like.

[0048] The output unit 94 is a mechanism for printing on a label, and has a configuration similar to that of a general printer, for example. The output unit 94 automatically outputs a biopsy label 350 (see FIG. 19) by printing some or all of the information related to the biopsy acquired by the biopsy information acquisition unit 93 in a predetermined arrangement. The biopsy label 350 is, for example, a sticker.

[0049] In this embodiment, the label printer 22 acquires information related to the biopsy via the endoscope information management system 31. Moreover, acquisition of information related to the biopsy and printing of the biopsy label are performed during the endoscopic examination. In other words, when a biopsy is performed during the endoscopic examination, the label printer 22 automatically outputs the biopsy label 350 in real time.

[0050] (3) Configuration of cleaning and disinfecting equipment The cleaning and disinfecting apparatus 23 is an apparatus for cleaning and disinfecting the endoscope 42 used in an endoscopic examination. After use, the endoscope 42 is subjected to a simple primary cleaning and / or disinfection (so-called bedside cleaning) at the bedside to prevent clogging of the ducts due to drying of the endoscope 42, etc. In contrast, the cleaning and disinfection performed by the cleaning and disinfecting apparatus 23 is so-called secondary cleaning or main cleaning. The main cleaning performed by the cleaning and disinfecting apparatus 23 is cleaning and disinfection to enable the used endoscope 42 to be used again in an endoscopic examination.

[0051] 6, the cleaning and disinfecting apparatus 23 has a main body 111 having a cleaning tank 110, a lid 112 provided so as to be freely opened and closed relative to the main body 111, a pedal 113 for opening and closing the lid 112, and a touch panel 115 which is a display and operation unit for inputting settings for cleaning and / or disinfection. In addition, the main body 111 is provided with casters 116. Therefore, the cleaning and disinfecting apparatus 23 is freely movable.

[0052] As shown in FIG. 7, the cleaning and disinfecting apparatus 23 includes a cleaning tank 110, a touch panel 115, a communication unit 121, an endoscope identification unit 122, a cleaner identification unit 123, and a control unit .

[0053] The communication unit 121 is connected to the endoscope information management system 31 directly or indirectly, by wire or wirelessly, and transmits or receives necessary information. When the endoscope 42 has a communication function, the communication unit 121 can automatically connect to an endoscope 42 that is in the vicinity of the cleaning and disinfecting apparatus 23 (for example, at least within a communication range). Furthermore, the communication unit 121 transmits information such as the result of cleaning and disinfection, identification information of the cleaned endoscope 42, and identification information of the staff member who performed the cleaning, to the endoscope information management system 31.

[0054] The endoscope identification unit 122 acquires information for identifying the endoscope 42 to be cleaned and disinfected (hereinafter, referred to as cleaning target information). The endoscope identification unit 122 can automatically acquire the cleaning target information from the endoscope 42 connected via the communication unit 121, for example. The endoscope identification unit 122 can also acquire the cleaning target information from information input using the touch panel 115. In this embodiment, the endoscope 42 has a function of automatically connecting wirelessly to the communication unit 121 in the vicinity of the cleaning and disinfecting apparatus 23, and the endoscope identification unit 122 automatically acquires the cleaning target information. Then, the endoscope identification unit 122 automatically inputs the acquired cleaning target information into a corresponding item of a GUI (Graphical User Interface) displayed on the touch panel 115, instead of the user manually inputting information using the touch panel 115.

[0055] The cleaner identifying unit 123 acquires information (hereinafter referred to as cleaner identifying information) for identifying a staff member in charge of cleaning and disinfection (hereinafter referred to as cleaner). When the cleaner's ID is input using a barcode, the cleaner identifying unit 123 is a barcode reader, and when the cleaner's ID is input using an IC card, the cleaner identifying unit 123 is a card reader. The cleaner identifying unit 123 can acquire the cleaner information by the cleaner inputting the cleaner information using the touch panel 115. Note that, for example, when the cleaner has a communication terminal or the like that automatically connects to the cleaning and disinfecting apparatus 23 via the communication unit 121, the cleaner identifying unit 123 can automatically acquire the cleaner identifying information from the communication terminal via the communication unit 121. In this embodiment, the cleaner identifying unit 123 automatically acquires the cleaner information.

[0056] The control unit 124 comprehensively controls the cleaning and disinfecting apparatus 23. For example, when a cleaning start instruction is input using the touch panel 115, the control unit 124 starts cleaning and disinfecting the endoscope 42 using the cleaning tank 110 in accordance with the conditions input using the touch panel 115.

[0057] (4) Configuration of report creation device The report creation device 24 is a so-called computer connected to the endoscope information management system 31 by wire or wirelessly, and provides a user with an interface for creating a report related to an endoscopic examination. As shown in FIG. 8, the report creation device 24 includes a display 131 for displaying a report creation screen 510 (see FIG. 25), an operation unit 132 for inputting an operation for creating a report using the report creation screen 510, and a communication unit 133 for communicating with the endoscope information management system 31. The operation unit 132 is, for example, a pointing device such as a keyboard and a mouse. The report creation device 24 may be a tablet terminal in which the display 131 and the operation unit 132 are integrated. The report creation device 24 automatically or manually inputs the ID of the doctor who is the user, thereby identifying the user and logging in to the endoscope information management system 31.

[0058] (5) Configuration of the endoscope information management system The endoscope information management system 31 comprehensively manages a series of information related to endoscopic examinations and smoothly links each device, etc. that constitutes the endoscope-related work system 10 by appropriately transmitting or receiving (including instructing transmission or reception) a part or all of the series of information related to endoscopic examinations to each device, etc. that constitutes the endoscope-related work system 10. As shown in Fig. 9, the endoscope information management system 31 includes an examination information management unit 151, a cleaning information management unit 152, a label output management unit 153, a report creation support unit 154, a database 156, an operation unit 157, a display 158, and a communication unit 159, etc.

[0059] (5a) Test Information Management Department The examination information management unit 151 manages information used in endoscopic examinations among various information (such as information on doctors and patients, endoscopic images, and recognition results) exchanged by each unit constituting the endoscope-related business system 10. Specifically, as shown in Fig. 10, the examination information management unit 151 includes an examination order acquisition unit 171, an endoscope determination unit 172, an insertion path information acquisition unit 173, a contraindication information acquisition unit 174, an image acquisition unit 175, a report acquisition unit 176, a pre-examination screen generation unit 181, an endoscope connection monitoring unit 182, and a user monitoring unit 183.

[0060] The examination order acquisition unit 171 acquires an examination order for an endoscopic examination. An examination order is a request for an endoscopic examination, and includes, for example, information on when, who, and what (which part and for what purpose) the endoscopic examination will be performed. The examination order can be directly input to the endoscope information management system 31. In this case, the examination order acquisition unit 171 acquires the examination order by input from a doctor or other staff member. In addition, the examination order acquisition unit 171 can acquire an examination order from another medical business system (for example, a system that manages examination orders within the hospital including other departments) that cooperates with the endoscope-related business system 10.

[0061] The endoscope determination unit 172 determines the endoscopic device 21 to be used for the examination order, particularly the endoscope 42 to be used. Determining the endoscopic device 21 to be used means, when there are multiple endoscopic devices 21 in the hospital, determining which endoscopic device 21 (processor device 46 and light source device 44) to use for the endoscopic examination based on the examination order and managing the reservation. When there is only one endoscopic device 21 in the hospital, determining the use of the endoscopic device 21 for the examination order and managing the reservation. Reservation management means reserving the use and managing the reservation so that no overlapping reservations for use occur. Determining the endoscope 42 to be used means, when there are multiple endoscopes 42 or multiple types of endoscopes 42 (for example, when there are a transnasal endoscope, an oral endoscope, and an endoscope for the lower digestive tract), determining which endoscope to use for the endoscopic examination based on the examination order and managing the reservation. When there is only one endoscope 42 (one model) in the hospital, determining the use of the endoscope 42 for the examination order and managing the reservation.

[0062] The endoscope determination unit 172 identifies the patient and the part, etc., that are the subject of the endoscopic examination based on the examination order. The endoscope determination unit 172 also determines the endoscopic device 21 and / or the endoscope 42 to be used based on the patient and the part, etc., that are the subject of the examination. In particular, the endoscope determination unit 172 refers to information related to past endoscopic examinations for the patient specified by the examination order, and when the patient and the part specified by the examination order are the patient and the part that have been subjected to an endoscopic examination in the past, the endoscope determination unit 172 preferentially determines the use of the endoscope 42 used in the past endoscopic examination. When the endoscope 42 used in the past endoscopic examination is managed for reservation for another examination order, the endoscope determination unit 172 preferentially determines the use of at least the same model of endoscope 42. For example, when a transnasal endoscope was used in the previous endoscopic examination, when reservations for the use of an oral endoscope and a transnasal endoscope are available, the endoscope determination unit 172 preferentially determines the use of a transnasal endoscope in the examination order for the second endoscopic examination. When there are multiple models of transnasal endoscopes, the endoscope determination unit 172 preferentially determines the use of the model used in the previous endoscopic examination.

[0063] The insertion path information acquisition unit 173 refers to information related to past endoscopic examinations for the patient and site specified by the examination order, and acquires information related to the insertion path of the endoscope 42 when the patient and site specified by the examination order were subjected to an endoscopic examination in the past. For example, the insertion path is "transnasal" and "oral" in the case of an endoscopic examination of the upper digestive tract, and for the transnasal insertion, a distinction is made between "transnasal (right)" which is insertion from the right nostril and "transnasal (left)" which is insertion from the left nostril.

[0064] The contraindication information acquisition unit 174 acquires information on contraindications (hereinafter, contraindication information) for the patient and / or site specified by the test order by referring to information on tests already performed (such as the results and reports of diagnoses or tests, etc.). The contraindication information is, for example, information on allergies and information on whether biopsy is possible. In this embodiment, the contraindication information acquisition unit 174 acquires at least information on whether biopsy is possible (particularly biopsy is prohibited) for the patient or site.

[0065] The image acquiring unit 175 acquires images obtained by an endoscopic examination and / or other examinations performed in the past for a patient specified by an examination order according to settings. For example, when an image acquired in a past examination is to be displayed on the pre-examination screen 251 and / or the during-examination screen 301, the image acquiring unit 175 acquires the image and inserts it on the pre-examination screen 251 and / or the during-examination screen 301. In addition, the image acquiring unit 175 can acquire ultrasound images, radiation images such as X-ray images, MRI (Magnetic Resonance Imaging) images, etc., and insert them on the during-examination screen 301, etc., by connecting to a PACS (Picture Archiving and Communication Systems).

[0066] The report acquisition unit 176 acquires reports created by past endoscopic examinations and / or other examinations, etc., for a patient specified by an examination order, according to settings. For example, when images acquired in past examinations are to be displayed on the pre-examination screen 251 and / or the during-examination screen 301, the report acquisition unit 176 acquires them and inserts them into the pre-examination screen 251 and / or the during-examination screen 301.

[0067] The pre-examination screen generating unit 181 generates a pre-examination screen 251 to be displayed on the monitor 48 of the endoscope device 21 before the endoscopic examination. The endoscope information management system 31 locks (prohibits other users from using) the endoscope device 21 to be used by displaying the pre-examination screen 251 generated by the pre-examination screen generating unit 181 on the monitor 48 of the endoscope device 21 to be used. The pre-examination screen generating unit 181 can be provided in the processor device 46. In this case, the endoscope information management system 31 provides information required for generating the pre-examination screen 251 to the processor device 46.

[0068] The endoscope connection monitoring unit 182 monitors the connection of the endoscope 42 to the endoscopic device 21 for which reservation management is being performed. Specifically, the endoscope connection monitoring unit 182 acquires the detection result of the connection detection unit 51 from the processor device 46. Then, when an endoscope 42 different from the endoscope 42 determined by the endoscope determination unit 172 is connected to the endoscopic device 21 for which reservation management is being performed, a warning to that effect is issued using the notification unit 55 of the processor device 46. This is to support preparation for an endoscopic examination in accordance with the examination order.

[0069] The user monitoring unit 183 monitors the doctors and patients who use the endoscopic device 21 whose reservations are managed by the endoscope information management system 31. Specifically, the user monitoring unit 183 acquires the IDs of the doctor and patient input from the console 49 via the communication unit 57 of the processor device 46, and determines whether the doctor and patient match the examination order. If the doctor or patient is different, the user monitoring unit 183 issues a warning to that effect using the notification unit 55 of the processor device 46. This is to prevent erroneous use of the endoscopic device 21 whose reservations are managed.

[0070] (5b) Cleaning Information Management Department The cleaning information management unit 152 manages information relating to cleaning of the endoscope 42, among various types of information exchanged by each unit constituting the endoscope-related business system 10. Specifically, as shown in Fig. 11, the cleaning information management unit 152 includes a cleaning state monitoring unit 191, a primary cleaning management unit 192, and a main cleaning management unit 193.

[0071] The cleaning status monitoring unit 191 monitors the cleaning status of the endoscope 42 connected to the endoscope device 21 that is managed by the endoscope information management system 31 through reservation. Specifically, the cleaning status monitoring unit 191 acquires the detection result of the connection detection unit 51 of the processor device 46. Then, the cleaning status monitoring unit 191 monitors whether the connected endoscope 42 is an endoscope 42 that has been properly cleaned, and whether a predetermined time has passed since the completion of cleaning. If the connected endoscope 42 is an endoscope 42 that has been properly cleaned, such as an uncleaned endoscope 42, or if a predetermined time or more has passed since the completion of cleaning, the connected endoscope 42 needs to be cleaned again. For this reason, the cleaning status monitoring unit 191 uses the notification unit 55 of the processor device 46 to warn of this fact.

[0072] The primary cleaning management unit 192 manages the primary cleaning performed after the endoscopy. Specifically, after the endoscopy, the primary cleaning management unit 192 displays the primary cleaning information input screen 401 on the monitor 48 via the display control unit 54. The primary cleaning management unit 192 prompts the implementation of the primary cleaning by issuing a notice or warning using the notification unit 55 of the processor device 46, or by displaying the primary cleaning information input screen 401 on the monitor 48, as necessary. In addition, the primary cleaning management unit 192 acquires information related to the primary cleaning input from the primary cleaning information input screen 401 (identification information of the person who performed the cleaning and status information indicating whether the cleaning has been completed normally, etc.) and registers it in the database 156. In this way, the primary cleaning management unit 192 manages the primary cleaning. The information related to the primary cleaning is identification information of the person who performed the primary cleaning (the person who performed the cleaning), the date and time when the primary cleaning was performed, and status information indicating whether the primary cleaning has been completed normally, etc. Registration in the database 156 includes creating new records as well as merging information into existing records.

[0073] The main cleaning management section 193 manages the main cleaning that is performed after the endoscopy is completed (more specifically, after the primary cleaning is completed). Specifically, information related to the main cleaning is obtained from the cleaning and disinfecting apparatus 23 and registered in the database 156. In this way, the main cleaning management section 193 manages the main cleaning. The information related to the main cleaning includes identification information of the person who performed the main cleaning (the cleaner), the date and time when the main cleaning was performed, and status information indicating whether the main cleaning was completed normally.

[0074] (5c) Label output management unit The label output management unit 153 manages information relating to the production of biopsy labels among various information exchanged between the units constituting the endoscope-related business system 10. Specifically, as shown in Fig. 12, the label output management unit 153 includes a biopsy monitoring unit 201 and a label printer control unit 203.

[0075] The biopsy monitoring unit 201 acquires the recognition results of the procedure recognition unit 62 (at least the recognition results related to biopsy among the recognition results of the procedure recognition unit 62) by communicating with the processor device 46 in substantially real time during the endoscopic examination. As a result, the biopsy monitoring unit 201 monitors the presence or absence of a biopsy using the recognition results of the procedure recognition unit 62. Furthermore, when the procedure recognition unit 62 recognizes a biopsy, the recognition results of the procedure recognition unit 62 include, in addition to the fact that a biopsy has been performed, the number of biopsies, the site where the biopsy was performed, and the order in which the biopsies were performed. Therefore, when the biopsy monitoring unit 201 detects that a biopsy has been performed using the recognition results of the procedure recognition unit 62, it acquires information related to the performed biopsy (the number of biopsies, the site, the order, etc.).

[0076] When the biopsy monitoring unit 201 detects that a biopsy has been performed during an endoscopic examination, the label printer control unit 203 automatically controls the label printer 22 to create a biopsy label 350 to be attached to a container for containing a specimen obtained by the biopsy. Specifically, the label printer control unit 203 inputs information related to the biopsy acquired by the biopsy monitoring unit 201 to the biopsy information acquisition unit 93, and creates a biopsy label 350 using the output unit 94. As a result, when a biopsy is performed during an endoscopic examination, the label printer 22 automatically creates a biopsy label 350. In this embodiment, when the biopsy monitoring unit 201 detects a biopsy, the label printer control unit 203 sequentially creates a biopsy label 350 related to the detected biopsy, but the label printer control unit 203 can automatically create a biopsy label 350 related to one or more detected biopsies all at once after the end of the endoscopic examination. In either case, a doctor or staff member can automatically obtain a biopsy label 350 after the end of the endoscopic examination.

[0077] (5d) Report Writing Support Department The report creation support unit 154 manages information relating to report creation among various information exchanged by each unit constituting the endoscope-related business system 10. In this way, the report creation support unit 154 supports the creation of a report. Specifically, as shown in FIG. 13, the report creation support unit 154 includes a report creation screen generating unit 220, a second recognition processing unit 222, an image selection support unit 223, a third recognition processing unit 224, and an item selection support unit 226.

[0078] The report creation screen generating unit 220 generates a report creation screen 510 in response to a request from the report creation device 24 connected to the endoscope information management system 31, and provides it to the report creation device 24. Specifically, when the report creation screen generating unit 220 receives a request to provide the report creation screen 510 from the report creation device 24, it collects information on a specific doctor, a specific patient, and a specific endoscopic examination (endoscopic images and other information, etc.), and generates and provides the report creation screen 510 by selecting and / or arranging the information.

[0079] The second recognition processing unit 222 performs one or more recognition processes on the endoscopic image used in the report creation screen 510 and / or the report. Specifically, the second recognition processing unit 222 includes a shooting position recognition unit 231, a treatment recognition unit 232, and a lesion recognition unit 233. The second recognition processing unit 222 and each of the above units constituting the second recognition processing unit 222 are, for example, artificial intelligence (AI) having a learning function.

[0080] The photographing position recognition unit 231 recognizes at least the part of the subject appearing in the endoscopic image acquired in one endoscopic examination. The photographing position recognition unit 231 can recognize a more detailed photographing position. For example, when the part being observed is the stomach, the photographing position recognition unit 231 can recognize the cardia, the fundus, the body of the stomach, the angle of the stomach, the vestibule, the prepylorus, and / or the pylorus. In this embodiment, the photographing position recognition unit 231 recognizes the part of the subject as well as a more detailed photographing position. That is, the photographing position recognition unit 61 in the first recognition processing unit 60 of the processor device 46 performs a relatively simple recognition process of the part, whereas the photographing position recognition unit 231 in the second recognition processing unit 222 of the report creation support unit 154 performs a relatively detailed recognition process of the photographing position. This is because the recognition of the photographing position during the endoscopic examination requires a quick and lightweight (low amount of calculation) recognition process in real time, whereas a detailed recognition result is required when creating a report, even if the processing amount and / or processing time becomes somewhat large. The photographing position recognition unit 231 can obtain and use the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60. In this embodiment, the second recognition processing unit 222 can obtain information related to the photographed part as the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60 for the endoscopic image that is the target of the recognition processing. Therefore, the second recognition processing unit 222 can narrow the range of the recognition processing for the part indicated by the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60 and perform the recognition processing to specify the detailed photographing position. For example, if the photographed part is the stomach, it can narrow down to the detailed position of the stomach (excluding the possibility of the esophagus or duodenum) and specify the detailed photographing position (specify that the photographing position is the cardia of the stomach, etc.). In this way, the photographing position recognition unit 231 can reduce the processing amount and / or the processing time by using the recognition result of the photographing position recognition unit 61 of the first recognition processing unit 60.

[0081] The treatment recognition unit 232 recognizes the treatment on the subject for the endoscopic image acquired in one endoscopic examination. The contents of the treatment that the treatment recognition unit 232 can recognize are the same as those of the treatment recognition unit 62 of the first recognition processing unit 60. In this embodiment, the treatment recognition unit 62 of the first recognition processing unit 60 recognizes biopsy, whereas the treatment recognition unit 232 also recognizes treatments other than biopsy. This is because the recognition process during the endoscopic examination is preferably performed in real time and therefore is minimal, whereas when creating a report, it is necessary to recognize treatments other than biopsy. The treatment recognition unit 232 can obtain and use the recognition result of the treatment recognition unit 62 of the first recognition processing unit 60. In this embodiment, the treatment recognition unit 62 of the first recognition processing unit 60 recognizes biopsy, so the treatment recognition unit 232 uses the recognition result of the treatment recognition unit 62 of the first recognition processing unit 60 for the recognition of biopsy. Then, the treatment recognition unit 232 executes the recognition process of treatments other than biopsy. This is to eliminate duplicated recognition processing and reduce the amount and time of processing.

[0082] The lesion recognition unit 233 recognizes the presence or absence of a lesion in an endoscopic image acquired in one endoscopic examination. Recognizing the presence or absence of a lesion includes not only recognizing the presence or absence of a part that is definitely a lesion, but also recognizing the presence or absence of a part that may be a lesion (benign tumor, dysplasia, etc.) and / or recognizing a part that has characteristics that may be directly or indirectly related to a lesion (redness, etc.).

[0083] The image selection support unit 223 automatically selects an endoscopic image (hereinafter referred to as a key image) to be used in the report creation screen 510 and / or the report from among a series of multiple endoscopic images acquired in one endoscopic examination, using various recognition results from the second recognition processing unit 222. Specifically, the image selection support unit 223 uses the recognition results from the photographing position recognition unit 231 to select, as a key image, an endoscopic image of at least a portion that is determined to be used in the report from among the multiple endoscopic images acquired in the endoscopic examination. The portion that is determined to be used in the report includes a portion that is practically determined to be used because it is a site where lesions tend to occur. For example, in an endoscopic examination of the upper digestive tract, it is an endoscopic image of the pylorus. In addition, when the procedure recognition unit 232 recognizes a procedure, the image selection support unit 223 selects, as a key image, a part or all of the endoscopic images from the endoscopic images that recognize the procedure. Similarly, when the lesion recognition unit 233 recognizes a lesion, the image selection support unit 223 selects, as a key image, a part or all of the endoscopic images from the endoscopic images that recognize the lesion. The reason why some of the endoscopic images in which a procedure or a lesion is recognized are selected is to minimize the number of images that can be used in the report creation screen 510 and / or the report. The image selection support unit 223 uses the recognition result of the imaging position recognition unit 231 to identify the part imaged in the endoscopic examination, thereby selecting a schematic diagram to be used in the report creation screen 510 and / or the report. For example, in the case of an endoscopic examination of the stomach, the image selection support unit 223 selects a schematic diagram of the stomach. The report creation screen generation unit 220 generates and provides the report creation screen 510 in which the schematic diagram selected by the image selection support unit 223 and one or more key images are automatically inserted.

[0084] The third recognition processing unit 224 performs discrimination processing on at least the endoscopic image used in the report. That is, the third recognition processing unit 224 performs discrimination processing on the key image selected by the image selection support unit 223. The discrimination processing refers to a process of recognizing symptoms (type of lesion and / or progression, etc.) of a lesion or the like shown in an endoscopic image. For this reason, the third recognition processing unit 224 includes one or more discrimination units 236. The third recognition processing unit 224 includes one discrimination unit 236 for each key image. Note that, when a doctor selects a key image regardless of the selection by the image selection support unit 223, the third recognition processing unit 224 performs discrimination processing on the key image selected by the doctor. Similarly, when the doctor manually reselects the key image selected by the image selection support unit 223, the third recognition processing unit 224 performs discrimination processing on the key image selected by the doctor. The third recognition processing unit 224 and the above-mentioned units constituting the third recognition processing unit 224 are, for example, artificial intelligence (AI) having a learning function.

[0085] The item selection support unit 226 automatically selects items to be written in the report using at least the discrimination result of the third recognition processing unit 224. The report creation screen generating unit 220 generates and provides a report creation screen 510 in which the items to be written in the report are automatically selected. In addition, the item selection support unit 226 can further select items to be written in the report using various recognition results of the second recognition processing unit 222.

[0086] (5e) Databases, etc. The database 156 provided in the endoscope information management system 31 includes, for example, a cleaning information management database for managing information related to the cleaning state and history of the endoscope 42, an endoscopic image database for managing endoscopic images, a patient information database for managing information related to patients, an examination information management database for managing information related to examinations of each patient, a report management database for managing reports created for various examinations including endoscopic examinations, etc. In this embodiment, the endoscope information management system 31 includes the database 156, but if some or all of the various databases described above are in an external environment connected to the endoscope-related business system 10, the endoscope information management system 31 can use a database in the external environment instead of the built-in database 156 or in addition to the built-in database 156.

[0087] The operation unit 157 of the endoscope information management system 31 is, for example, a keyboard, a mouse, and / or a touch panel, and the display 158 is a monitor or a touch panel. In this embodiment, the endoscope information management system 31 has the operation unit 157 and the display 158, but when an external terminal (such as a computer accessing the endoscope information management system 31) is used as the operation unit 157 and the display 158, the endoscope information management system 31 may be configured not to have the operation unit 157 and / or the display 158. The communication unit 159 is a communication interface that connects directly or indirectly to each unit constituting the endoscope-related work system 10 by wire or wirelessly. Each unit of the endoscope information management system 31 communicates with each unit of the endoscope-related work system 10 using the communication unit 159 to transmit and receive various information.

[0088] Hereinafter, the operation of the endoscope-related business system 10 configured as above, in particular the operation of the endoscope information management system 31, will be described.

[0089] <Preparing for endoscopy> As shown in FIG. 14, before an endoscopic examination, the endoscope information management system 31 acquires an examination order using the examination order acquisition unit 171 (step S101). When the examination order acquisition unit 171 acquires the examination order, the endoscope determination unit 172 determines the endoscope device 21 (the processor device 46 and the light source device 44) and the endoscope 42 to be used in the endoscopic examination related to the examination order (step S102). In addition, the endoscope information management system 31 collects information such as contraindications about the patient (step S103). Specifically, the endoscope information management system 31 acquires information about the insertion path of the endoscope 42 in the past examination of the patient using the insertion path information acquisition unit 173, and acquires contraindication information about the patient using the contraindication information acquisition unit 174. Thereafter, the endoscope information management system 31 generates a pre-examination screen 251 using the pre-examination screen generation unit 181 and displays it on the monitor 48 (step S104).

[0090] As shown in Fig. 15, the pre-examination screen 251 has a first display section 252 that displays information on the endoscopic examination to be performed, and a second display section 253 that displays information on the endoscopic examination performed in the past. The first display section 252 displays, for example, identification information 261 of the endoscope 42 to be used (model name "EGXXX" in Fig. 15), a patient name 262 ("Fuji Taro" in Fig. 15), a patient ID 263 ("1234567890" in Fig. 15), contraindication information 264 (information on "○×△" related to allergies and "biopsy prohibited" related to whether biopsy is possible in Fig. 15), and an insertion path 267 of the endoscope 42 recommended for this endoscopic examination determined based on the past insertion path ("transnasal (right)" in Fig. 15). The second display section 253 displays, for example, a report 268 of the endoscopic examination performed in the past on the patient, and / or an endoscopic image, etc.

[0091] As described above, in the endoscopy-related business system 10, the endoscopy information management system 31 displays information necessary for an endoscopic examination and preparation for an endoscopic examination on the monitor 48 via the pre-examination screen 251. Therefore, the doctor or staff preparing for the endoscopic examination can smoothly prepare for the endoscopic examination without referring to other materials or data, etc. Furthermore, when starting an endoscopic examination, the doctor can obtain, from the pre-examination screen 251, points to note in the endoscopic examination and / or information on past endoscopic examinations at a glance, so that the endoscopic examination can be started safely and smoothly.

[0092] 16, when an endoscope 42 is connected to the endoscope device 21 in preparation for an endoscopic examination (step S201), the connection detection unit 51 detects this. Therefore, the endoscope connection monitoring unit 182 checks whether the connected endoscope 42 is different from the endoscope 42 to be used that has been determined by the endoscope determination unit 172 (step S202). If the connected endoscope 42 is different from the endoscope 42 to be used, the endoscope connection monitoring unit 182 issues a warning to that effect using the notification unit 55 (step S210). This makes it possible to prevent an endoscope 42 that is not to be used from being used in an endoscopic examination, and as a result, the endoscopic examination can be performed safely.

[0093] Furthermore, when an endoscope 42 is connected to the endoscope device 21 (step S201), the endoscope information management system 31 uses the cleaning status monitoring unit 191 to check the cleaning status of the connected endoscope 42. If cleaning of the connected endoscope 42 has not been completed normally (step S203: NO), or if the endoscope 42 is not removed within a predetermined time after cleaning is completed (step S204: NO), the cleaning status monitoring unit 191 issues a warning to that effect using the notification unit 55 (step S210). This makes it possible to prevent an unclean endoscope 42 or an endoscope 42 that may be unclean from being used in an endoscopic examination, and as a result, an endoscopic examination can be performed safely.

[0094] Furthermore, when information such as the identification information of the doctor and the patient is input in preparation for the endoscopic examination (step S205), the endoscope information management system 31 collates the entered doctor and patient information using the user monitoring unit 183. If the doctor and patient are not the ones scheduled for the examination (step S206), the user monitoring unit 183 issues a warning to that effect using the notification unit 55 (step S210). This makes it possible to prevent an endoscopic examination from being performed by a doctor or patient other than the one scheduled, and as a result, the endoscopic examination can be performed safely.

[0095] As described above, in the endoscope-related business system 10, the endoscopic examination can be started (step S211) after various checks are performed by the endoscope information management system 31. Therefore, the endoscopic examination can be started safely.

[0096] <Performance of endoscopic examination> As shown in FIG. 17, when the endoscopic examination is started, the endoscopic device 21 acquires an endoscopic image and displays the acquired endoscopic image on the monitor 48 by the during examination screen 301 (step S301). As shown in FIG. 18, the during examination screen 301 has, for example, an endoscopic image display section 311 that displays the endoscopic images 321 acquired sequentially, a contraindication information display section 312 that displays information related to the safety of performing the endoscopic examination such as a "biopsy prohibited" mark 322, and a reference information display section 313 that displays reference information such as an endoscopic image 323 acquired in a past endoscopic examination and / or a report 324 of the past endoscopic examination. The endoscopic image 323 acquired in a past endoscopic examination is acquired by the image acquisition section 175 and inserted into the during examination screen 301. In addition, the report acquisition section 176 acquires the report 324 of the past endoscopic examination and inserts it into the during examination screen 301. Meanwhile, the photographing position recognition section 61 sequentially recognizes the photographing position of the endoscopic images 321 acquired and displayed (step S310). Therefore, when the shooting position has changed (step S312: YES), the endoscope information management system 31 appropriately updates the reference information on the examination-in-progress screen 301. For example, when displaying an endoscopic image 323 acquired in a past endoscopic examination on the reference information display unit 313, the endoscopic image 323 acquired in the past endoscopic examination and displayed on the reference information display unit 313 is updated according to the recognized shooting position. More specifically, the past endoscopic image 323 captured at a position corresponding to the captured endoscopic image 321 is displayed on the reference information display unit 313. In this way, by recognizing the shooting position and automatically updating the reference information, appropriate reference information can be referred to in real time, allowing the doctor to smoothly perform the endoscopic examination.

[0097] During an endoscopic examination, the treatment recognition unit 62 recognizes whether or not a treatment has been performed, and the endoscope information management system 31 monitors whether or not a biopsy has been performed by the biopsy monitoring unit 201. If a biopsy has been performed (step S320: YES), the biopsy monitoring unit 201 acquires information related to the biopsy (step S321), and the label printer control unit 203 automatically prints a biopsy label 350 related to the biopsy. In a conventional endoscopic examination, when a biopsy is performed, a doctor or staff member inputs information related to the biopsy into the label printer 22 to create a biopsy label 350. However, in the endoscope-related business system 10, the biopsy label 350 is automatically created by performing the biopsy as described above, so that the creation of the biopsy label 350 can be performed more smoothly and conveniently than before.

[0098] As shown in FIG. 19, the biopsy label 350 includes, for example, a title display such as "Specimen Label," an indication of the order in which the biopsy was performed such as "(1)," "(2)," and "(3)," the name of the patient who performed the biopsy ("Fuji Taro" in FIG. 19), the patient's ID ("1234567890" in FIG. 19), and the site where the sample was taken ("Stomach" in FIG. 19).

[0099] In addition, during an endoscopic examination, the image quality recognition unit 63 recognizes the image quality of the acquired endoscopic image 321, and the unphotographed portion recognition unit 64 recognizes the unphotographed portion of the subject. If the image quality is not appropriate (step S330: NO), or if there is an oversight due to an unphotographed portion (step S340: NO), the notification unit 55 issues a warning to that effect and / or a notification to encourage improvement (step S350). Therefore, in the endoscope-related business system 10 equipped with the endoscope information management system 31, oversights are reduced and endoscopic images of appropriate image quality are more likely to be obtained than in conventional endoscope devices that do not have such warnings. In other words, an endoscopic examination can be performed smoothly and reliably.

[0100] The endoscope-related business system 10 repeatedly executes the above-mentioned various steps as appropriate until the examination is completed (step S360: YES).

[0101] <Cleaning of endoscope> As shown in FIG. 20, when the endoscope 42 used at the bedside after the endoscopic examination is subjected to the first cleaning, the endoscope information management system 31 uses the first cleaning management unit 192 to display the first cleaning information input screen 401 on the monitor 48 (step S401). Therefore, the doctor or staff performing the first cleaning of the endoscope 42 can input the necessary items such as the information related to the first cleaning on the spot after performing the first cleaning of the endoscope 42 (step S402). Furthermore, when the input of the information related to the first cleaning is completed, the first cleaning management unit 192 acquires the information related to the first cleaning, which is the input item on the first cleaning information input screen 401 (step S403), and registers it in the database 156 (step S404). In the conventional endoscope device, the information related to the first cleaning must be input separately using a device or system other than the endoscope device 21, but in the endoscope-related work system 10, the input and registration are completed on the spot where the first cleaning is performed, so that the work of inputting the information related to the first cleaning can be performed more smoothly than in the conventional endoscope device.

[0102] As shown in Fig. 21, the primary cleaning information input screen 401 includes items to be input as information related to primary cleaning, such as identification information 411 of the endoscope 42 to be subjected to primary cleaning ("EGXXX" in Fig. 21), identification information 412 of the cleaner who performed the primary cleaning ("Yamanaya Taro" in Fig. 21), cleaning implementation status 413 ("OK" icon indicating that the implementation has been completed in Fig. 21), waterproof cap attachment status 414 ("OK" icon indicating that the cap has been attached in Fig. 21), and leakage check result 415 ("No abnormality" in Fig. 21). When the cleaner presses a cleaning completion button 416, the primary cleaning management unit 192 automatically registers this information in the database 156.

[0103] 22, when the cleaning and disinfecting apparatus 23 is used to perform the main cleaning, the cleaning and disinfecting apparatus 23 automatically acquires identification information of the endoscope 42 to be cleaned and disinfected using the endoscope identification unit 122 (step S451). The cleaning and disinfecting apparatus 23 also acquires identification information of the cleaner who will perform the main cleaning using the cleaner identification unit 123 (step S452). The cleaning and disinfecting apparatus 23 then automatically inputs this information into the operation screen 460 displayed on the touch panel 115 (step S453).

[0104] As shown in FIG. 23, the operation screen 460 displays, for example, a status display 461 showing the operating state of the cleaning and disinfecting apparatus 23, a cleaning information input field 462 for inputting information related to the main cleaning and the first cleaning, and a cleaning start button 465. In the cleaning information input field 462, it is not necessary to input the identification information 463 of the endoscope 42 performing the main cleaning and the identification information 464 of the cleaner performing the main cleaning again. In addition, the cleaning and disinfecting apparatus 23 acquires the information related to the first cleaning from the endoscope information management system 31 using the communication unit 121, and the input is automatically completed. Therefore, the cleaner performing the main cleaning only needs to confirm the input contents (step S454) and press the cleaning start button 465 (step S455) without inputting the information related to the main cleaning and the first cleaning. Therefore, according to the endoscope-related work system 10, the main cleaning can be performed more smoothly than in the conventional cleaning and disinfecting apparatuses and the like that require these inputs.

[0105] When the cleaner presses the cleaning start button 465 to start the main cleaning, or when the main cleaning is completed (including when it ends abnormally), the cleaning and disinfecting apparatus 23 automatically transmits information related to the main cleaning to the endoscope information management system 31 using the communication unit 121 (step S456). As a result, the endoscope information management system 31 automatically registers the acquired information related to the main cleaning in the database 156 using the main cleaning management unit 193 (step S457). Therefore, according to the endoscope-related work system 10, the main cleaning can be performed more smoothly than in conventional management systems and the like that require these inputs.

[0106] <Creating a report> When creating a report after an endoscopic examination, as shown in Fig. 24, the doctor creating the report accesses the endoscope information management system 31 using the report creation device 24 (step S501). When accessed by the report creation device 24, the endoscope information management system 31 generates a report creation screen 510 using the report creation screen generating unit 220 and displays it on the display 131 of the report creation device 24 (step S502). At that time, the doctor specifies information identifying the patient and / or the endoscopic examination (step S503). This is to be provided with an appropriate report creation screen 510 for the specific patient and endoscopic examination.

[0107] 25, the report creation screen 510 has a patient information display section 511 that displays patient information, a key image display section 512 that displays key images and the like, a report list display section 513 that displays a list of reports, and an item input section 514 that functions as an operation section for inputting information to be described in the report. The display sections or operation sections related to report creation, such as the key image display section 512, the report list display section 513, and the item input section 514, are displayed by pressing an attach report button 516.

[0108] As shown in FIG. 26, the key image display unit 512 has a schematic diagram column 520 for displaying a schematic diagram, and a plurality of endoscopic image display columns 521 to 527. The endoscopic image displayed in the endoscopic display column 521 is a key image. In conventional report creation devices, the schematic diagram is manually input by a doctor, but in the endoscope-related work system 10, the endoscope information management system 31 automatically selects the schematic diagram using the second recognition processing unit 222 and the image selection support unit 223, and automatically inserts it into the schematic diagram column 520 (step S504). In conventional report creation devices, the key image is manually input by a doctor, but in the endoscope-related work system 10, the endoscope information management system 31 automatically selects the key image using the second recognition processing unit 222 and the image selection support unit 223, and automatically inserts it into the endoscopic image display columns 521 to 527 (step S504). Therefore, according to the endoscope-related work system 10, the report creation work can be performed more smoothly and quickly than in conventional report creation devices.

[0109] 27, the item input section 514 of the report creation screen 510 has, for example, a lesion site item input field 531 for inputting items related to the lesion site, a diagnosis item input field 532 for inputting items related to the diagnosis, a findings input field 533 for inputting findings, and a treatment etc. input field 534 for inputting items related to the treatment and / or specimen. Each of these item fields has an item name display section for displaying the item name, and an item selection section for listing candidates for the items to be input. The item name display section also functions as an operation section for switching between displaying and hiding the item selection section.

[0110] For example, the lesion site item input field 531 includes an item name display section 540 indicating "lesion site", and a first item input field 541, a second item input field 542, a third item input field 543, a fourth item input field 544, and a fifth item input field 545. The first item input field 541 is a lesion site input field for globally selecting an imaging site, and for example, the esophagus, stomach, duodenum, and small intestine are input candidates. The second item input field 542 is an input field for items that classify the selected items of the first item input field 541, and the items listed change depending on the selected item of the first item input field 541. The third item input field 543 is an input field for items that further classify the selected items of the first item input field 541 or the second item input field 542, and the items listed change depending on the selected item of the first item input field 541 or the second item input field 542. The fourth item input field 544 is an input field for items that further classify the selected items of the first item input field 541, the second item input field 542, and / or the third item input field 543, and the items listed change depending on the selected items of the first item input field 541, the second item input field 542, and / or the third item input field 543. The fifth item input field 545 is an input field for arbitrarily inputting supplementary information regarding the lesion site. For example, the diagnosis item input field 532 includes an item name display section 550 indicating "diagnosis," a first item input field 551, a second item input field 552, a third item input field 553, and a fourth item input field 554.

[0111] In the conventional report creation device, the input (selection) of the item input section 514 is manually input by a doctor. In contrast, in the endoscope-related business system 10, when the endoscope information management system 31 automatically selects a key image using the image selection support section 223, the discrimination section 236 of the third recognition processing section 224 automatically executes discrimination processing for each key image (step S505). Then, the item selection support section 226 automatically provisionally inputs some or all of the input items of the item input section 514 using the recognition result of the second recognition processing section 222 and / or the discrimination result of the third recognition processing section 224, and sets them in a selected state (step S506). That is, in the endoscope-related business system 10, the report creation screen 510 is provided in which some or all of the input items of the item input section 514 are automatically selected. Therefore, the doctor only needs to confirm the input contents (step S507) and perform an approval operation of pressing the confirmation button 519 to confirm the input contents, thereby completing the creation of the report. Therefore, according to the endoscope-related business system 10, a report can be created more smoothly and quickly than in the case where the input items of the item input unit 514 are manually input. Also, it is possible to prevent forgetting to input items.

[0112] When an approval operation is performed on the report creation screen 510, the endoscope information management system 31 automatically registers the approved report in the database 156 (step S508).

[0113] In the above embodiment, some or all of the units shown as components of the endoscope information management system 31 may be provided in the endoscope device 21 (particularly the processor device 46), the label printer 22, the cleaning and disinfecting device 23, or the report creation device 24. In this case, the endoscope device 21 etc. has various functions of the endoscope information management system 31. Therefore, a system including the endoscope device 21 etc. having the functions of the endoscope information management system 31 constitutes the endoscope-related business system 10 of the above embodiment.

[0114] In the above embodiment, the endoscope 42 is an insertion type, but instead of the insertion type endoscope 42, a capsule endoscope that is swallowed by the subject for use can be used.

[0115] The information relating to the primary cleaning and / or the information relating to the main cleaning may include information relating to the usage history indicating for whom (for which patient) the endoscope 42 was used. Therefore, the cleaning status monitoring unit 191 can monitor not only the cleaning status of the endoscope 42 but also information relating to the usage history.

[0116] In the above embodiment, the hardware structure of the processing units that execute various processes among the components of the endoscope-related business system 10, such as the components of the processor device 46 and the components of the endoscope information management system 31, is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a GPU (Graphical Processing Unit), a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing various processes.

[0117] One processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same type or different types (for example, multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU, etc.). Also, multiple processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as represented by a computer such as a client or a server, there is a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0118] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit in the form of a combination of circuit elements such as semiconductor elements. [Explanation of symbols]

[0119] 10 Endoscopy-related business system 21 Endoscopic equipment 22 Label Printer 23 Cleaning and disinfecting equipment 24 Report writing device 26 Related business equipment 31 Endoscope Information Management System 42 Endoscopy 42a Insertion part 42b Operation section 42c Curved section 42d Tip 42e Angle knob 42f Insertion port 44 Light source device 46 Processor Unit 48 Monitors 49 Console 51 Connection detection unit 52 Image acquisition unit 53 Image processing section 54 Display control section 55 Notification Department 56 Control section 57 Communications Department 60 First recognition processing section 61 Shooting position recognition unit 62 Treatment Recognition Unit 63 Image quality recognition unit 64 Unphotographed part recognition section 71 Biometric information calculation unit 72 Speaker 73 Timing section 74 Information Acquisition Department 75 Information output section 92 Communications Department 93 Biopsy Information Acquisition Department 94 Output section 110 Cleaning tank 111 Main unit 112 Lid 113 Pedal 115 Touch Panel 116 Caster 121 Communications Department 122 Endoscope Identification Unit 123 Cleaner Identification Unit 124 Control Unit 131 Display 132 Operation section 133 Communications Department 151 Test Information Management Department 152 Cleaning Information Management Department 153 Label Output Management Unit 154 Report Writing Support Department 156 Databases 157 Operation section 158 Display 159 Communications Department 171 Inspection Order Acquisition Department 172 Endoscopy Decision Department 173 Insertion path information acquisition unit 174 Contraindication Information Acquisition Department 175 Image Acquisition Unit 176 Report Acquisition Department 181 Pre-examination screen generation unit 182 Endoscope connection monitoring unit 183 User Monitoring Department 191 Cleaning status monitoring unit 192 Primary Cleaning Management Department 193 Cleaning Management Department 201 Biopsy Surveillance Department 203 Label printer control unit 220 Report Creation Screen Generation Unit 222 Second recognition processing section 223 Image Selection Support Department 224 Third recognition processing section 226 Item Selection Support Department 231 Shooting position recognition unit 232 Treatment Recognition Unit 233 Lesion Recognition Department 236 Identification Department 251 Pre-examination screen 252 1st display section 253 2nd display section 261 Identification Information 262 Patient name 264 Contraindication information 267 Insertion Path 268 Report 301 Inspection screen 311 Endoscope image display unit 312 Contraindication information display section 313 Reference information display section 321 Endoscopic Images 322 Biopsy Prohibited Mark 323 Endoscopic Images 324 Report 350 Biopsy Label 401 1st cleaning information input screen 411 Identification Information 412 Identification Information 413 Cleaning implementation status 414 Waterproof cap installation status 415 Leak Check Results 416 Cleaning complete button 460 operation screen 461 Status Display 462 Cleaning information input field 463 Identification Information 464 Identification Information 465 Cleaning start button 510 Report creation screen 511 Patient information display section 512 Key image display section 513 Report list display section 514 Item Input Section 516 Report attachment button 519 Confirm button 520 Schematic diagram 521~527 Endoscopic image display section 531 Lesion site entry field 532 Diagnosis item input field 533 Comments entry field 534 Treatment etc. input field 540 Item name display area 541 1st item input field 542 2nd item input field 543 3rd item input field 544 Item 4 input field 545 5th item input field 550 Item name display area 551 1st item input field 552 2nd item input field 553 3rd item input field 554 4th item input field

Claims

1. An endoscope information management system connected to an endoscope device, a photographing position recognition unit in the endoscope information management system; an image selection support unit that automatically selects an endoscopic image to be used in a report from among a plurality of endoscopic images using a recognition result obtained by recognizing a part of a subject shown in the endoscopic image; The recognition result is obtained from a photographing position recognition unit in the endoscope device or a photographing position recognition unit in the endoscope information management system.

2. The endoscope information management system according to claim 1 , wherein the recognition result is obtained from a photographing position recognition unit in the endoscope device.

3. The endoscope information management system according to claim 1 , wherein the recognition result is acquired from a photographing position recognition unit in the endoscope information management system.

4. 4. The endoscope information management system according to claim 1, wherein the image selection support section selects the endoscopic image of a portion that is determined to be used in the report.

5. 5. The endoscope information management system according to claim 1, wherein the creation of the report is completed when a confirmation button for confirming the input contents of the report is pressed.

6. 6. The endoscope information management system according to claim 1, wherein a schematic diagram is automatically selected using the image selection support unit.

7. a discrimination unit that executes discrimination processing on the endoscopic image selected by the image selection support unit; 7. The endoscope information management system according to claim 1, further comprising an item input unit for inputting items on a report creation screen using a discrimination result of the discrimination unit.

8. The endoscope information management system according to claim 7 , wherein the discrimination result is acquired from the discrimination unit in the endoscope information management system.

9. The endoscope information management system according to claim 1 , wherein the image selection support unit selects the endoscopic image in which a treatment is recognized.

10. The endoscope information management system according to claim 9 , wherein the treatment is recognized by a treatment recognition unit of the endoscope device.

11. The endoscope information management system according to claim 9 , wherein the treatment is recognized by a treatment recognition unit in the endoscope information management system.

12. The endoscope information management system according to claim 1 , wherein the image selection support unit selects the endoscopic image in which a lesion is recognized.

13. The endoscope information management system according to claim 12, wherein the lesion is recognized by a lesion recognition unit in the endoscope information management system.

Images