Medical support device, medical support system, and operating method of medical support device

Abstract

Provided are a medical assistance device, a medical assistance system, and a program that make it possible to leave effective medical information regardless of information regarding the insertion of an endoscope into the body of a subject. The medical assistance device comprises a processor. The processor acquires usage status information regarding a usage status until an endoscope reaches observation of a preset observation site with respect to a subject, determines whether the endoscope has reached the observation site on the basis of the usage status information, generates handover information for a report regarding observation of the observation site on the basis of the determination result of whether the observation site has been reached by the endoscope and the usage status information, and records the handover information.

Description

Medical support device, medical support system and program

[0001] The present disclosure relates to a medical support device, a medical support system, and a program for providing endoscopic medical support.

[0002] Conventionally, there is known an endoscopic technique for extracting in-vivo images captured inside a body from a large number of image groups (see, for example, Patent Document 1). This technique extracts in-vivo images from a large number of image groups by determining whether or not the images are in-vivo images based on color component information of pixel values ​​contained in the images.

[0003] Furthermore, a technology is known in which, in an endoscopic examination management system, when a representative image is selected from multiple images, the organ can be input, and information indicating which organ was imaged can be input at the time of or immediately after imaging, thereby efficiently counting insurance points according to the number of organs (see, for example, Patent Document 2).

[0004] JP 2005-124965 A JP 2003-151483 A

[0005] However, in an endoscopic examination, there are cases where the examination is completed without inserting the endoscope into the body of a subject such as a patient.

[0006] However, in the above-mentioned Patent Documents 1 and 2, information is added to images taken after the endoscope has been inserted into the body. Therefore, in the above-mentioned Patent Documents 1 and 2, depending on the usage situation, such as when the endoscope is outside the body and cannot be inserted, or when the endoscope cannot be inserted to the desired observation site inside the body of the subject, it is not possible to hand over any useful medical information to the image reader who reads the endoscopic report or to the surgeon who will be treating the same subject on a different day.

[0007] The present disclosure has been made in consideration of the above, and aims to provide a medical support device, medical support system, and program that can transfer valid medical information depending on the usage status of the endoscope.

[0008] In order to solve the above-mentioned problems and achieve the objectives, the medical support device according to the present disclosure is a medical support device equipped with a processor, which acquires usage status information regarding the usage status of an endoscope up to the point of observing a predetermined observation site on a subject, determines whether or not the endoscope has reached the observation site based on the usage status information, generates handover information for a report regarding the observation of the observation site based on the determination result of whether or not the endoscope has reached the observation site and the usage status information, and records the handover information.

[0009] In addition, in the medical support device according to the present disclosure, in the above disclosure, the usage status information further includes insertion information indicating whether or not the endoscope has been inserted into the body of the subject based on a group of image data captured by the endoscope, and the processor determines whether or not the endoscope has been inserted into the body of the subject based on the insertion information, and if it is determined that the endoscope has not been inserted into the body of the subject, generates the handover information indicating that the endoscope has not been inserted into the body of the subject.

[0010] In addition, in the medical support device according to the present disclosure, in the above disclosure, the usage status information further includes operation information of the surgeon on an operation unit provided on the endoscope, and when it is determined that the endoscope has not been inserted into the body of the subject, the processor generates the handover information indicating that the endoscope has not been inserted into the body of the subject based on the operation information.

[0011] In addition, in the medical support device of the present disclosure, in the above disclosure, the usage information further includes cleaning history information regarding the cleaning history of the endoscope, and based on the operation information and the cleaning history information, generates the handover information to the effect that the endoscope was not inserted into the body of the subject.

[0012] In addition, in the medical support device according to the present disclosure, in the above disclosure, the usage status information further includes detection result information that detects a plurality of organs and parts based on a group of image data captured by inserting the endoscope into the subject, and the processor determines whether or not the endoscope has reached the observation site based on the insertion information and the detection result information, and if it determines that the endoscope has not reached the observation site, generates the handover information to the effect that the endoscope has not been inserted into the observation site.

[0013] Furthermore, in the medical support device according to the present disclosure, in the above disclosure, the usage status information further includes feature region detection information indicating whether or not a feature region inside the body of the subject has been detected based on a group of image data captured by the endoscope, and when the processor determines that the endoscope has reached the observation site, it determines whether or not the feature region has been detected based on the feature region detection information, and when it determines that the endoscope has reached the observation site and determines that the feature region has been detected, it generates the handover information indicating that an abnormality has occurred in the subject, while when it determines that the endoscope has reached the observation site and determines that the feature region has not been detected, it generates the handover information indicating that the subject is normal.

[0014] In addition, in the medical support device disclosed herein, in the above disclosure, the usage status information further includes release information regarding a history of release signals from an operating member provided on the endoscope, and the processor determines whether or not a still image is present based on the release information, and if it is determined that a still image is present, generates the handover information indicating that the still image is present.

[0015] In addition, the medical support device according to the present disclosure, in the above disclosure, acquires a group of image data generated by the endoscope continuously capturing images, and classifies the group of image data into a first group of image data obtained when the endoscope reaches the inside of the subject's body, and a second group of image data obtained after the endoscope has been inserted into the subject's body, and the detection result information is based on the second group of image data.

[0016] Further, a medical support system according to the present disclosure is a medical support system including an endoscope, a control device that controls the endoscope, an imaging diagnostic device, and a medical support device, wherein the endoscope includes an insertion section that can be inserted into a subject, and a tip section that is provided at the tip of the insertion section and that sequentially generates image data groups by continuously capturing images of a plurality of predetermined observation sites on the subject and outputs the image data groups to the control device, the imaging diagnostic device uses the image data groups and an inference model that has previously learned characteristics of organs and sites to generate detection result information that detects each of the plurality of observation sites from the image data groups and outputs the detection result information to the control device, and the medical support device includes a processor that acquires usage status information regarding the usage status of the endoscope up to the observation of the predetermined observation sites on the subject, determines whether the endoscope has reached the observation sites based on the usage status information, and generates handover information for a report regarding the observation of the observation sites based on the determination result of whether the endoscope has reached the observation sites and the usage status information, and records the handover information.

[0017] In addition, the program according to the present disclosure is a program executed by a medical support device having a processor, and causes the processor to acquire usage status information regarding the usage status of an endoscope up to the time of observing a predetermined observation site on a subject, determine whether or not the endoscope has reached the observation site based on the usage status information, generate handover information for a report regarding the observation of the observation site based on the determination result of whether or not the endoscope has reached the observation site and the usage status information, and record the handover information.

[0018] According to the present disclosure, it is possible to obtain an effect that valid medical information can be handed over depending on the usage status of the endoscope.

[0019] FIG. 1 is a diagram showing the overall configuration of a medical support system according to an embodiment. FIG. 2 is a block diagram showing the functional configuration of essential parts of an endoscope and a control device according to an embodiment. FIG. 3 is a block diagram showing the functional configuration of an imaging diagnostic apparatus according to an embodiment. FIG. 4 is a block diagram showing the functional configuration of a medical support device according to an embodiment. FIG. 5 is a flowchart showing an outline of processing executed by a medical support system according to an embodiment. FIG. 6 is a diagram showing an example of a list of observation orders and report items for organs and parts. FIG. 7 is a diagram showing another example of a list of observation orders and report items for organs and parts. FIG. 8 is a flowchart showing an outline of endoscopic imaging processing in FIG. 5. FIG. 9 is a flowchart showing an outline of report creation processing in FIG. 5. FIG. 10 is a diagram schematically showing an outline when a discrimination unit included in a medical support device according to an embodiment discriminates an image data group into first image data and a second image data group. FIG. 11 is a diagram showing an example of a handover information table generated by a generation unit included in a medical support device according to an embodiment, in which each condition is associated with handover content. FIG. 12 is a flowchart showing an outline of unexamined data processing in FIG. 5.

[0020] Hereinafter, embodiments for carrying out the present disclosure will be described in detail with reference to the drawings. Note that the present disclosure is not limited to the following embodiments. Furthermore, each drawing referred to in the following description merely shows a schematic representation of the shape, size, and positional relationship to the extent that the contents of the present disclosure can be understood. In other words, the present disclosure is not limited to only the shape, size, and positional relationship exemplified in each drawing. Furthermore, in the description of the drawings, the same parts are denoted by the same reference numerals.

[0021] [Overall Configuration of Medical Support System] Fig. 1 is a diagram showing the overall configuration of a medical support system according to one embodiment. The medical support system 1 shown in Fig. 1 continuously captures images of the inside of a subject, such as a human or animal, by inserting an insertion section 21 of an endoscope 2 from the mouth to the esophagus or from the anus to the large intestine of the subject, and displays a group of captured image data in chronological order on a display device 3.

[0022] Furthermore, in the medical support system 1, the image diagnostic device 5 (CAD: Computer Aided Detection) detects (recognizes or estimates) characteristic regions including organs, parts, the insertion speed of the insertion portion 21, and polyps or cancers at multiple observation sites shown in the image data, based on a group of image data input from the control device 4 and an inference model (trained model) trained using training data obtained by previously capturing images of the subject's organs, parts, lesions, etc., and outputs the detection results to the control device 4. An operator such as a doctor observes and treats the subject while checking the display image displayed on the display device 3 and the detection results (estimation results) of the image diagnostic device 5.

[0023] Furthermore, the medical support system 1 acquires image data groups input from the control device 4 via the network N100 to the medical support device 6, and detection result information including the detection results (estimated results) of the image diagnostic device 5, and records the acquired image data and detection result information in association with each other. The medical support system 1 then outputs various data in response to requests from the laptop computer 7 of the surgeon or the like via the network N100.

[0024] Furthermore, in the medical support system 1, report information such as an examination report of a subject by an operator or the like is created on the laptop computer 7, and this report information is output and recorded on the medical support device 6. Thereafter, the operator diagnoses the subject and conducts a conference or the like based on the report information and the diagnostic results of living cells obtained by biopsy during observation of the subject.

[0025] As shown in FIG. 1, the medical support system 1 includes an endoscope 2 , a display device 3 , a control device 4 , an image diagnostic device 5 , and a medical support device 6 .

[0026] The endoscope 2 continuously generates image data (RAW data) by capturing images of the inside of the subject, and sequentially outputs this image data to the control device 4. As shown in FIG. 1 , the endoscope 2 includes an insertion section 21, an operation section 22, and a universal cord 23.

[0027] 1, the insertion section 21 includes a distal end portion 24 provided at the distal end of the insertion section 21, a bending portion 25 connected to the proximal end side (the operation section 22 side) of the distal end portion 24 and configured to be bendable, and a flexible tube portion 26 connected to the proximal end side of the bending portion 25 and having flexibility.

[0028] The operation unit 22 is connected to the proximal end portion of the insertion unit 21. The operation unit 22 accepts various operations on the endoscope 2. As shown in FIG. 1 , the operation unit 22 is provided with a bending knob 221, an insertion port 222, and a plurality of operation members 223.

[0029] The bending knob 221 is configured to be rotatable in response to a user operation by a surgeon or other user. The bending knob 221, when rotated, operates a bending mechanism (not shown) such as a metal or resin wire disposed inside the insertion section 21. As a result, the bending section 25 is bent.

[0030] The insertion port 222 is connected to a treatment instrument channel (not shown), which is a duct extending from the tip of the insertion portion 21, and is an insertion port for inserting a treatment instrument or the like into the treatment instrument channel from outside the endoscope 2.

[0031] The multiple operating members 223 are composed of buttons and the like that accept various operations by users such as surgeons, and output operation signals corresponding to the various operations to the control device 4 via the universal cord 23. Examples of the various operations include a release operation that instructs the endoscope 2 to capture a still image, and an operation that switches the observation mode of the endoscope 2 to a normal light observation mode or a special observation mode.

[0032] The universal cord 23 extends from the operation unit 22 in a direction different from the extending direction of the insertion unit 21, and is a cord on which a light guide 231 (see FIG. 2) constituted by an optical fiber or the like, a first signal line 232 (see FIG. 2) for transmitting the image data described above, and a second signal line 233 (see FIG. 2) for transmitting the operation signal described above, etc. A first connector 27 is provided at the base end of the universal cord 23, as shown in FIG. 1. The first connector 27 is detachably connected to the control device 4.

[0033] The display device 3 is composed of a display monitor such as a liquid crystal or organic EL (Electro Luminescence) display monitor, and under the control of the control device 4, displays a display image based on image data that has been image processed in the control device 4, as well as various information related to the endoscope 2.

[0034] The control device 4 is realized using a processor, which is a processing device having hardware such as a GPU (Graphics Processing Unit), FPGA (Field Programmable Gate Array), or CPU (Central Processing Unit), and a memory, which is a temporary storage area used by the processor. The control device 4 comprehensively controls the operations of each part of the endoscope 2 in accordance with a program recorded in the memory.

[0035] The diagnostic imaging device 5 (CAD) uses the image data group input from the control device 4 and a trained model trained in advance using training data to detect (estimate) characteristic regions (abnormal regions or lesion candidate regions) including organs, parts, the insertion speed of the insertion portion 21, and polyps or cancers, etc., that appear in the image data, and outputs detection result information that associates the detection results with the detection times to the control device 4. The diagnostic imaging device 5 is realized using a processor that is a processing device having hardware such as a GPU, FPGA, or CPU, and a memory that is a temporary storage area used by the processor.

[0036] The medical support device 6 sequentially records various data input from the control device 4 and the recognition results of the image diagnostic device 5, and transmits data in response to a request from the laptop computer 7. The medical support device 6 is realized using a processor, which is a processing device having hardware such as a GPU, FPGA, or CPU, and memory, which is a temporary storage area used by the processor. Furthermore, the medical support device 6 is configured using a hard disk drive (HDD), a solid state drive (SSD), etc.

[0037] [Functional Configuration of Main Parts of Medical Support System] Next, a description will be given of the functional configuration of the main parts of the above-mentioned medical support system 1. Fig. 2 is a block diagram showing the functional configuration of the main parts of the endoscope 2 and the control device 4. Below, the endoscope 2 and the control device 4 will be described in that order, followed by the image diagnostic device 5 and the medical support device 6.

[0038] [Functional Configuration of Endoscope] First, a description will be given of the configuration of the endoscope 2. As shown in Fig. 2, the endoscope 2 includes an illumination optical system 201, an imaging optical system 202, an imaging element 203, an A / D conversion unit 204, a P / S conversion unit 205, an imaging and recording unit 206, and an imaging control unit 207. Here, the illumination optical system 201, the imaging optical system 202, the imaging element 203, the A / D conversion unit 204, the P / S conversion unit 205, the imaging and recording unit 206, and the imaging control unit 207 are each disposed within the tip portion 24.

[0039] The illumination optical system 201 is composed of one or more lenses and irradiates the subject with illumination light supplied from a light guide 231 .

[0040] The imaging optical system 202 is composed of one or more lenses, and focuses light such as reflected light from a subject, returned light from the subject, and fluorescent light emitted by the subject, to form an image of the subject on the light receiving surface of the image sensor 203. The imaging optical system 202 is also capable of changing the focal length and angle of view by moving the lens along the optical axis direction O1.

[0041] The image sensor 203 is configured using a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) image sensor, in which one of the color filters forming a Bayer array (RGGB) is arranged on each of a plurality of pixels arranged in a two-dimensional matrix. Under the control of the image capture control unit 207, the image sensor 203 receives the subject image formed by the image capture optical system 202 and performs photoelectric conversion to generate a captured image (analog signal). Note that in this embodiment, the image sensor 203 may be configured integrally with an image sensor and a Time of Flight (TOF) sensor that acquires subject distance information (hereinafter referred to as depth map information) using a TOF method. The depth map information is information that detects the subject distance for each pixel position from the position of the image sensor 203 (the position of the tip 24) to a corresponding position on the observation target that corresponds to the pixel position in the captured image. Note that the configuration for generating the depth map information is not limited to the TOF sensor described above, and an image sensor including a phase difference sensor may also be used. Hereinafter, the depth map information and the captured image will be collectively referred to as “image data.” The image sensor 203 outputs the image data to the A / D converter 204.

[0042] The A / D conversion unit 204 is configured using an A / D conversion circuit, etc. Under the control of the imaging control unit 207, the A / D conversion unit 204 performs A / D conversion processing on the analog image data input from the imaging element 203 and outputs the result to the P / S conversion unit 205.

[0043] The P / S conversion unit 205 is configured using a P / S conversion circuit or the like, and, under the control of the imaging control unit 207, performs parallel / serial conversion on the digital image data input from the A / D conversion unit 204 and outputs the data to the control device 4 via a first signal line 232. Note that instead of the P / S conversion unit 205, an E / O conversion unit that converts image data into an optical signal may be provided, and the image data may be output to the control device 4 via the optical signal. Alternatively, the image data may be transmitted to the control device 4 via wireless communication such as Wi-Fi (Wireless Fidelity) (registered trademark).

[0044] The imaging and recording unit 206 is configured with a non-volatile memory or a volatile memory, and records various information (e.g., pixel information of the imaging element 203) related to the endoscope 2. The imaging and recording unit 206 also records various setting data and control parameters transmitted from the control device 4 via a second signal line 233.

[0045] The imaging control unit 207 is realized using a TG (Timing Generator), a processor which is a processing device having hardware such as a CPU, and a memory which is a temporary storage area used by the processor. The imaging control unit 207 controls the operations of the imaging element 203, the A / D conversion unit 204, and the P / S conversion unit 205 based on setting data received from the control device 4 via a second signal line 233.

[0046] [Configuration of Control Device] Next, a description will be given of the configuration of the control device 4. As shown in Fig. 2 , the control device 4 includes a condenser lens 401, a first light source unit 402, a second light source unit 403, a light source control unit 404, an S / P conversion unit 405, an image processing unit 406, an input unit 407, a recording unit 408, a communication unit 409, and a control unit 410.

[0047] The condenser lens 401 condenses the light emitted by each of the first light source unit 402 and the second light source unit 403 and outputs the condensed light to the light guide 231 .

[0048] The first light source unit 402 emits visible white light (normal light) under the control of the light source control unit 404, and supplies the white light as illumination light to the light guide 231. The first light source unit 402 is configured using a collimator lens, a white LED (Light Emitting Diode) lamp, a driver, and the like. Note that the first light source unit 402 may supply visible white light by simultaneously emitting light from a red LED lamp, a green LED lamp, and a blue LED lamp. The first light source unit 402 may also be configured using a halogen lamp, a xenon lamp, or the like.

[0049] The second light source unit 403, under the control of the light source control unit 404, emits special light having a predetermined wavelength band and supplies the special light as illumination light to the light guide 231. Here, the special light is light used for narrow band imaging (NBI) using narrow band light including 390 to 445 nm and 530 to 550 nm. Of course, the special light may be amber light (600 nm and 630 nm) used for red dichromatic imaging (RDI) in addition to narrow band light.

[0050] The light source control unit 404 is realized by using a processor having hardware such as an FPGA or a CPU, and a memory that is a temporary storage area used by the processor. The light source control unit 404 controls the light emission timing and light emission duration of each of the first light source unit 402 and the second light source unit 403 based on control data input from the control unit 410.

[0051] Under the control of the control unit 410, the S / P conversion unit 405 performs serial / parallel conversion on the image data received from the endoscope 2 via the first signal line 232 and outputs the converted data to the image processing unit 406. Note that if the endoscope 2 outputs image data as an optical signal, an O / E conversion unit that converts an optical signal into an electrical signal may be provided instead of the S / P conversion unit 405. Also, if the endoscope 2 transmits image data via wireless communication, a communication module capable of receiving wireless signals may be provided instead of the S / P conversion unit 405.

[0052] The image processing unit 406 is realized using a processor having hardware such as a GPU or FPGA, and a memory that is a temporary storage area used by the processor. Under the control of the control unit 410, the image processing unit 406 performs predetermined image processing on the image data of parallel data input from the S / P conversion unit 405, and outputs the result to the display device 3. Examples of the predetermined image processing include demosaic processing, white balance processing, gain adjustment processing, gamma correction processing, and format conversion processing.

[0053] The input unit 407 is configured using a mouse, foot switch, keyboard, buttons, switches, a touch panel, etc., and accepts user operations by a user such as a surgeon, and outputs an operation signal corresponding to the user operation to the control unit 410.

[0054] The recording unit 408 is configured using a recording medium such as a volatile memory, a non-volatile memory, an SSD (Solid State Drive), an HDD (Hard Disk Drive), a memory card, etc. The recording unit 408 records data including various parameters necessary for the operation of the control device 4 and the endoscope 2. The recording unit 408 also has a program recording unit 408a that records various programs for operating the endoscope 2 and the control device 4, an image data recording unit 408b that records image data, and a usage information recording unit 408c that records usage information.

[0055] Under the control of the control unit 410, the image data recording unit 408b records the image data groups and still image data generated by the endoscope 2 continuously capturing images of multiple observation areas of the subject, in association with patient information, etc.

[0056] The usage information recording unit 408c records usage information. Here, the usage information includes detection result information input from the diagnostic imaging device 5, the detection time of the detection result, still image data, the imaging time when the still image data was captured, cleaning history information related to the cleaning history of the endoscope 2, and patient information. The still image data is image data captured by the imaging element 203 when imaging is instructed by a release signal input from the operation unit 22, and is image data with a higher resolution than the live view images sequentially generated by the imaging element 203.

[0057] Under the control of the control unit 410, the communication unit 409 transmits various types of information to the imaging diagnostic apparatus 5 and the medical support apparatus 6 via the network N100, and receives various types of information from the imaging diagnostic apparatus 5 and the medical support apparatus 6 and outputs the information to the control unit 410. Specifically, under the control of the control unit 410, the communication unit 409 transmits a group of temporally consecutive image data that has been subjected to image processing by the image processing unit 406 to the imaging diagnostic apparatus 5, receives detection results including organs, parts, characteristic regions, etc. detected by the imaging diagnostic apparatus 5, and outputs the detection results to the control unit 410. Furthermore, under the control of the control unit 410, the communication unit 41 transmits detection result information including the image data group, still image data, and detection results of the imaging diagnostic apparatus 5 to the medical support apparatus 6, and receives patient information of the subject and observation information indicating the observation order of observation locations during an examination of the subject from the medical support apparatus 6. The communication unit 409 is configured using a communication module, etc.

[0058] The control unit 410 corresponds to the second processor according to the present disclosure. This control unit 410 is realized using the second processor, which is a processing device having hardware such as an FPGA or a CPU, and a memory, which is a temporary storage area used by the second processor. The control unit 410 comprehensively controls each unit constituting the endoscope 2 and the control device 4. The control unit 410 has an imaging control unit 410a, an acquisition unit 410b, a determination unit 410c, a display control unit 410d, and a communication control unit 410e.

[0059] The imaging control unit 410a controls imaging by the endoscope 2. The imaging control unit 410a generates a group of temporally continuous image data by causing the endoscope 2 to continuously capture images. Furthermore, when a release signal is input from the operation unit 22, the imaging control unit 410a causes the image sensor 203 to capture still image data.

[0060] The acquisition unit 410b acquires image data from the endoscope 2 via the S / P conversion unit 405 or the image processing unit 406 and records the data in the image data recording unit 408b. The acquisition unit 410b also acquires detection result information from the image diagnostic device 5 via the communication unit 409 and records the information in the usage status information recording unit 408c.

[0061] The determination unit 410c determines whether the distal end 24 of the endoscope 2 has reached the final destination site based on the observation order information of the final destination site set in the observation order for report creation and the site in the subject detected by the diagnostic imaging device 5, and records this determination result in the usage status information recording unit 408c as one piece of usage status information. The determination unit 410c also determines whether the final destination site has not yet been imaged, and records this determination result in the usage status information recording unit 408c as one piece of usage status information. Specifically, the determination unit 410c determines whether still image data capturing the final destination site of the organ / site set in the observation order (insertion order) in the usage status information recording unit 408c has been recorded in the image data recording unit 408b.

[0062] When the judgment unit 410c determines that the tip 24 of the endoscope 2 has reached the final destination, the display control unit 410d causes the display device 3 to display information indicating that the tip 24 of the endoscope 2 has reached the final destination within the subject.

[0063] The communication control unit 410e causes the communication unit 409 to transmit various information to the medical support device 6 via the network N100, and causes the communication unit 409 to receive various information from the medical support device 6.

[0064] [Functional Configuration of Diagnostic Imaging Apparatus] Next, a description will be given of the functional configuration of the diagnostic imaging apparatus 5. Fig. 3 is a block diagram showing the functional configuration of the diagnostic imaging apparatus 5. The diagnostic imaging apparatus 5 shown in Fig. 3 includes a communication unit 51, an input unit 52, a recording unit 53, a display unit 54, and a control unit 55.

[0065] Under the control of the control unit 55, the communication unit 51 receives, from the control device 4 via the network N100, image data groups generated by the endoscope 2 and organ / region order information indicating the observation order of organs / regions in the subject, i.e., a patient, and outputs these to the control unit 55. Also, under the control of the control unit 55, the communication unit 51 outputs, via the network N100, to the control device 4, detection result information including the detection results of the subject's organs, etc., input from the control unit 55, and the detection times at which these detection results were detected. The communication unit 51 is configured using a communication module, etc.

[0066] The input unit 52 is configured using buttons, switches, a touch panel, etc., and receives various inputs and outputs them to the control unit 55.

[0067] The recording unit 53 is configured using recording media such as volatile memory, non-volatile memory, SSD, HDD, memory card, etc. The recording unit 53 records data including various parameters etc. necessary for the operation of the diagnostic imaging device 5. The recording unit 53 also has a program recording unit 531 that records various programs for operating the diagnostic imaging device 5, an observation order recording unit 532, and an inference model recording unit 533.

[0068] The observation order recording unit 532 records observation order information, which is input from the medical support device 6 described later, in which the observation order of multiple observation points such as pre-set organs and parts is set when observing a subject using the endoscope 2.

[0069] The inference model recording unit 533 records an inference model used to detect organs, parts, and characteristic regions based on image data. Here, the inference model takes image data from the endoscope 2 as input and outputs the organs, parts, and characteristic regions contained in the image data. This inference model is a model generated by machine learning using, for example, artificial intelligence (AI). Specifically, the inference model is a model such as deep learning that learns using training data in which image data of an image of a subject is assigned characteristic regions such as the subject's organs, parts, and lesions, and outputs the organs, parts, and characteristic regions contained in the image data.

[0070] The display unit 54 displays various information related to the diagnostic imaging apparatus 5 under the control of the control unit 55. The display unit 54 is configured using a liquid crystal display, an organic EL display, or the like.

[0071] The control unit 55 is realized using a processor having hardware such as an FPGA or a CPU, and a memory that is a temporary storage area used by the processor. The control unit 55 comprehensively controls each unit that constitutes the medical support device 6. The control unit 55 has an acquisition unit 551, an organ / region detection unit 552, and a detection time acquisition unit 553.

[0072] The acquisition unit 551 acquires image data sequentially generated by the endoscope 2 from the control device 4 via the communication unit 51 in chronological order.

[0073] The organ / part detection unit 552 detects the organs / parts and characteristic areas of the subject contained in the image data based on the image data sequentially acquired by the acquisition unit 551 and the inference model recorded by the inference model recording unit 533.

[0074] The detection time acquisition unit 553 acquires the detection time when the organ / part detection unit 552 detects the organ / part and characteristic region of the subject included in the image data. For example, the detection time acquisition unit 553 acquires, as the detection time, the time measured by a TG (not shown) when the organ / part detection unit 552 detects the organ / part and characteristic region of the subject included in the image data.

[0075] [Functional Configuration of Medical Support Device] Next, a description will be given of the functional configuration of the medical support device 6. Fig. 4 is a block diagram showing the functional configuration of the medical support device 6. The medical support device 6 shown in Fig. 4 includes a communication unit 61, a display unit 62, an input unit 63, a database 64 (hereinafter simply referred to as "DB 64"), a program recording unit 65, and a control unit 66.

[0076] Under the control of the control unit 66, the communication unit 61 transmits various information to the control device 4 and the diagnostic imaging device 5 via the network N100, and receives various information from the control device 4 and the diagnostic imaging device 5. The communication unit 61 is configured using a communication module.

[0077] The display unit 62 displays various information related to the medical support device 6 under the control of the control unit 66. The display unit 62 is configured using a liquid crystal display, an organic EL display, or the like.

[0078] The input unit 63 receives various inputs in response to external operations and outputs them to the control unit 66. The input unit 63 is configured using buttons, a keyboard, switches, a touch panel, and the like.

[0079] The DB 64 records various types of information. The DB 64 is configured using an HDD, an SSD, etc. The DB 64 includes a patient information DB 641, an endoscope DB 642, an image data DB 643, a usage status information DB 644, an observation order information DB 645, a report item DB 646, a handover information DB 647, a report information DB 648, and an operator information DB 649.

[0080] The patient information DB 641 records, for each patient, a patient ID for identifying the patient, the patient's date of birth, the patient's doctor, the patient's address, and the patient's allergy information.

[0081] The endoscope DB 642 records, for each endoscope 2, the type of endoscope 2, the endoscope ID, the repair history of the endoscope 2, the maintenance status of the endoscope 2, cleaning history information relating to the cleaning history of the endoscope 2, and the usage history and planned usage information of the endoscope 2.

[0082] The image data DB 643 records a group of image data captured by the endoscope 2 in association with each patient ID or each operator ID.

[0083] The usage status information DB 644 records usage status information related to the usage status of the endoscope 2 up to the time of observing a predetermined observation site on a subject. Here, the usage status information includes insertion information indicating whether or not the endoscope 2 has been inserted into the body of the subject based on the image data group captured by the endoscope 2, operation information of the operator using the operation unit 22 provided in the endoscope 2, cleaning history information related to the cleaning history of the endoscope 2, detection result information in which the imaging diagnostic device 5 has detected multiple organs and parts of the subject based on the image data group captured by the endoscope 2, characteristic region detection information indicating whether or not the imaging diagnostic device 5 has detected a characteristic region inside the body of the subject based on the image data group captured by the endoscope 2, and release information related to the history of release signals from the operation member 223 provided in the endoscope 2.

[0084] The observation order information DB 645 records the order of observation of organs and parts by the endoscope 2 set for each facility or each surgeon ID.

[0085] The report item DB 646 records report items for the endoscope 2 set for each facility or each operator ID.

[0086] The handover information DB 647 records handover information for handing over to the subject report information generated by the medical support device 6 (to be described later).

[0087] The report information DB 648 records, for each patient ID or each operator ID, report information generated by the endoscope 2 by the operator (radiography reader) and report information automatically generated by the medical support device 6 in association with each other.

[0088] The surgeon information DB 649 records the name, position, affiliation, and contact information for each surgeon ID in association with each other.

[0089] The program recording unit 65 is configured using a volatile memory, a non-volatile memory, an SSD, etc., and records various programs for operating the medical support device 6.

[0090] The control unit 66 corresponds to the first processor according to the present disclosure. This control unit 66 is realized using a first processor having hardware such as an FPGA or a CPU, and a memory that is a temporary storage area used by the first processor. The control unit 66 comprehensively controls each unit constituting the medical support device 6. The control unit 66 has an acquisition unit 661, a discrimination unit 662, a determination unit 663, a generation unit 664, a recording control unit 665, and a creation unit 666.

[0091] The acquisition unit 661 acquires the image data group and the usage status information from the control device 4 via the network N100.

[0092] The discrimination unit 662 discriminates between first image data captured during observation of a predetermined observation area and a second image data group captured after observation of the predetermined observation area based on the image data group acquired by the acquisition unit 661 and the usage status information.

[0093] The determination unit 663 determines whether the endoscope 2 has reached the observation site based on the usage status information acquired by the acquisition unit 661. Specifically, the determination unit 663 determines whether the distal end 24 of the endoscope 2 has been inserted into the subject's body based on the first image data group determined by the discrimination unit 662 and the usage status information. The determination unit 663 also determines whether the endoscope 2 has been inserted into the subject's body based on the insertion information included in the usage status information. The determination unit 663 also determines whether the endoscope 2 has reached a predetermined observation site (final arrival site) based on the insertion information and detection result information included in the usage status information. If the determination unit 663 determines that the endoscope 2 has reached the observation site, the determination unit 663 determines whether a characteristic region has been detected within the subject's body based on the characteristic region detection information included in the usage status information. The determination unit 663 also determines whether a still image is present based on the release information included in the usage status information.

[0094] The generating unit 664 generates handover information for a report on observation of the observation site of the subject based on the determination result of the determining unit 663 as to whether or not the observation site has been reached by the endoscope 2 and the usage status information. Details of the handover information generated by the generating unit 664 will be described later.

[0095] The recording control unit 665 records the handover information generated by the generating unit 664 in the handover information DB 647. In this case, the recording control unit 665 records the handover information in the handover information DB 647 in association with patient information or surgeon information.

[0096] The creation unit 666 creates report information for the subject based on operation information from the input unit 63 or laptop computer 7, the image data group and usage information acquired by the acquisition unit 661, patient information, and related information generated by the generation unit 664, and links this report information to patient information (patient ID) or surgeon information (surgeon ID) and records it in the report information DB 648.

[0097] [Processing of Medical Support System] Next, an outline of the processing executed by the medical support system 1 will be described. FIG.

[0098] 5, first, the control unit 66 determines whether or not the endoscope 2 is connected to the control device 4 via the network N100, thereby connecting the endoscope 2 to the medical support system 1 (step S101). Specifically, the control unit 66 determines whether or not an endoscope ID identifying the endoscope 2 has been input from the control device 4 via the network N100, and determines that the endoscope 2 is connected to the medical support system 1 if the endoscope ID identifying the endoscope 2 has been input from the control device 4.

[0099] If the control unit 66 determines that the endoscope 2 is connected to the control device 4 and thus connected to the medical support system 1 (step S101: Yes), the medical support system 1 proceeds to step S102. On the other hand, if the control unit 66 determines that the endoscope 2 is not connected to the control device 4 and thus not connected to the medical support system 1 (step S101: No), the medical support system 1 ends this process.

[0100] Next, the control unit 66 accepts settings for the observation order of the subject's organs and parts input from the laptop computer 7 or the control device 4, and records them in the observation order information DB 645 and inputs such as the patient's name in the patient information DB 641 (step S102). Specifically, based on the operation contents input from the surgeon's laptop computer 7 or the like, the control unit 66 accepts input of patient information including various information such as the patient's (subject's) name, the subject's patient ID (subject ID), and the patient's (subject's) date of birth, the type of endoscope 2 used to examine the subject, the surgeon ID identifying the attending physician, the type of report items, the contents of the report items, the patient's examination appointment details (examination date and time), the pre-examination consent form, the medical interview results, the consent form, and advance registration, and records this accepted patient information in the patient information DB 641. Furthermore, based on the operation contents input from the surgeon's laptop computer 7 or the like, the control unit 66 records observation order information regarding the observation order when observing organs and parts with the endoscope 2 in the observation order information DB 645.

[0101] Fig. 6 is a diagram showing an example of a list of organ / region observation orders and report items. Fig. 7 is a diagram showing another example of a list of organ / region observation orders and report items.

[0102] 6 and pattern Q2 shown in Fig. 7, the distal end portion 24 of the insertion section 21 (hereinafter simply referred to as "tip portion 24") of the endoscope 2 is inserted from outside the body of the subject into the body, and the order of observation of each organ and each region by the endoscope 2 is set for each operator (each doctor) or each facility. For example, in the organ / region observation order table W1, the order "9" is set for the organ / region "ileum."

[0103] Similarly, in the report item tables W2 and W4, items are set in association with the report type. For example, in the report item table W2, the report type "Gastrointestinal Endoscopy Report" is set with the item "Reached Site." Here, the reached site refers to the organ or site of the observation location within the subject that the distal end portion 24 was able to reach. In the following description, it is assumed that the pattern Q1 shown in FIG. 6 has been set.

[0104] 5 , the description of step S103 and subsequent steps will be continued. In step S103, the control unit 66 causes the display device 3 or the laptop computer 7 to display a consistency check and advice between the patient (i.e., the subject) and the endoscope 2, based on the patient information input in step S102, the past report information linked to the patient information and recorded in the report information DB 648, and the endoscope information recorded in the endoscope DB 642, via the network N100. Specifically, the control unit 66 checks the consistency of the settings of the endoscope 2 used to observe the patient, based on the patient information, the past report information linked to the patient information and recorded in the report information DB 648, and the endoscope information recorded in the endoscope DB 642. For example, the control unit 66 performs a consistency check to determine whether the type of endoscope 2 used to observe the patient is suitable for observation according to the observation order for observing organs and parts, the types of report items, and the examination reservation details set for the endoscope 2. In this case, when the control unit 66 determines that the type or settings of the endoscope 2 are incompatible for observing a patient, it displays a warning on the display device 3 or laptop computer 7. Furthermore, the control unit 66 determines whether the endoscope 2 has not been cleaned based on the usage information recorded in the usage information recording unit 408c, the endoscope information recorded in the endoscope DB 642, and the handover information recorded in the handover information DB 647, and if the endoscope 2 has not been cleaned, it displays a warning on the display device 3 or laptop computer 7. This allows the surgeon or the like to recognize that the endoscope 2 connected to the control device 4 is incompatible for observing a patient.

[0105] Furthermore, the control unit 66 displays handover information such as whether or not the current patient has any allergies, the surgeon's findings during the previous observation of the patient, and the tumor and the area of ​​the patient that was subject to follow-up observation in the previous observation, as advice on the display device 3 or laptop computer 7, based on the patient information, report information including past handover information recorded in the report information DB 648 linked to the patient information, and the endoscope information recorded in the endoscope DB 642. This allows the surgeon or other personnel to understand the details of the handover of information regarding the patient from the previous surgeon or report creator.

[0106] Next, the control unit 66 determines whether or not imaging of the subject with the endoscope 2 has started from the control device 4 or the endoscope 2 via the network N100 (step S104). Specifically, when the control unit 66 receives image data or a startup signal indicating that the endoscope 2 has started from the control device 4 via the network N100, the control unit 66 determines that imaging of the subject with the endoscope 2 has started.

[0107] If the control unit 66 determines that imaging of the subject with the endoscope 2 has started (step S104: Yes), the medical support system 1 proceeds to step S105, which will be described later. On the other hand, if the control unit 66 determines that imaging of the subject with the endoscope 2 has not started (step S104: No), the medical support system 1 proceeds to step S107, which will be described later.

[0108] In step S105, the medical support system 1 executes an endoscopic image capturing process in which the endoscope 2 is inserted into the subject and observed. Details of the endoscopic image capturing process will be described later. After step S105, the medical support system 1 proceeds to step S106.

[0109] Next, the control unit 66 determines whether or not the endoscope 2 has finished capturing images of the subject from the control device 4 or the endoscope 2 via the network N100 (step S106). Specifically, the control unit 66 determines that the endoscope 2 has stopped capturing images of the subject when it receives a stop signal from the control device 4 via the network N100 indicating that the reception of image data has stopped or that the endoscope 2 has stopped. If the control unit 66 determines that the endoscope 2 has stopped capturing images of the subject (step S106: Yes), the medical support system 1 proceeds to step S107, which will be described later. On the other hand, if the control unit 66 determines that the endoscope 2 has not stopped capturing images of the subject (step S106: No), the medical support system 1 returns to step S105.

[0110] In step S107, the control unit 66 determines via the network N100 whether a report creator, such as a doctor or radiologist, has started creating a report using the laptop computer 7. Specifically, the control unit 66 determines whether a request signal has been received from the laptop computer 7 requesting specific patient information and detection result information, including image data sets from the endoscope 2, still image data, and detection results from the diagnostic imaging device 5, that are linked to the patient information. If the control unit 66 determines that the report creator has started creating a report using the laptop computer 7 (step S107: Yes), the medical support system 1 proceeds to step S108, which will be described later. On the other hand, if the control unit 66 determines that the report creator has not started creating a report using the laptop computer 7 (step S107: No), the medical support system 1 proceeds to step S113.

[0111] In step S108, the medical support system 1 executes a report creation process for creating a report based on the observation results of the subject. Details of the report creation process will be described later.

[0112] Next, the control unit 66 determines via the network N100 whether the report creator, such as the doctor who interprets the images, has finished creating the report using the laptop computer 7 (step S109). Specifically, the control unit 66 determines whether an end signal indicating the end of report creation has been received from the laptop computer 7. If the end signal has been received, the control unit 66 determines that the report creation has ended. However, if the end signal has not been received, the control unit 66 determines that the report creation has not ended. If the control unit 66 determines that the report creator, such as the doctor who interprets the images, has finished creating the report using the laptop computer 7 (step S109: Yes), the medical support system 1 proceeds to step S110. On the other hand, if the control unit 66 determines that the report creator, such as the doctor who interprets the images, has not finished creating the report using the laptop computer 7 (step S109: No), the medical support system 1 returns to step S106.

[0113] In step S110, the control unit 66 determines, via the network N100, whether the laptop computer 7 or the control device 4 has terminated its connection to the medical support device 6. If the control unit 66 determines that the laptop computer 7 or the control device 4 has terminated its connection to the medical support device 6 (step S110: Yes), the medical support system 1 proceeds to step S115, which will be described later. On the other hand, if the control unit 66 determines that the laptop computer 7 or the control device 4 has not terminated its connection to the medical support device 6 (step S110: No), the medical support system 1 proceeds to step S111, which will be described later.

[0114] In step S111, the control unit 66 determines whether the endoscope 2 connected to the control device 4 has been changed based on the endoscope ID that identifies the endoscope 2 and is input from the control device 4 via the network N100. If the control unit 66 determines that the endoscope 2 connected to the control device 4 has been changed (step S111: Yes), the medical support system 1 proceeds to step S112, which will be described later. On the other hand, if the control unit 66 determines that the endoscope 2 connected to the control device 4 has not been changed (step S111: No), the medical support system 1 returns to step S102.

[0115] In step S112, the control device 4 switches the setting parameters of the endoscope 2 based on the endoscope ID of the connected endoscope 2. Specifically, the control device 4 switches the image processing parameters, such as white balance parameters, based on the endoscope ID of the connected endoscope 2. After step S112, the medical support system 1 returns to step S102.

[0116] In step S113, the control unit 66 determines whether the laptop computer 7 or the control device 4 has terminated the connection to the medical support device 6 via the network N100. If the control unit 66 determines that the laptop computer 7 or the control device 4 has terminated the connection to the medical support device 6 (step S113: Yes), the medical support system 1 proceeds to step S114, which will be described later. On the other hand, if the control unit 66 determines that the laptop computer 7 or the control device 4 has not terminated the connection to the medical support device 6 (step S113: No), the medical support system 1 returns to step S101, which will be described later.

[0117] In step S114, the medical support system 1 executes an unexamined process when the endoscope 2 has not yet been inserted into the subject. Details of the unexamined process will be described later. After step S114, the medical support system 1 proceeds to step S115.

[0118] Next, the control unit 66 determines whether or not to end observation of the subject using the endoscope 2 or report creation using the laptop computer 7 (step S115). If the control unit 66 determines that observation of the subject using the endoscope 2 or report creation using the laptop computer 7 should be ended (step S115: Yes), the medical support system 1 ends this processing. On the other hand, if the control unit 66 determines that observation of the subject using the endoscope 2 or report creation using the laptop computer 7 should not be ended (step S115: No), the medical support system 1 returns to step S102.

[0119] [Outline of Endoscopic Image Capturing Process] Next, details of the endoscopic image capturing process described in step S105 of Fig. 5 will be described. Fig. 8 is a flowchart showing an outline of the endoscopic image capturing process.

[0120] 8 , first, the control unit 410 starts imaging with the endoscope 2, recording of image data captured by the endoscope 2, detection of the presence or absence of insertion of a subject by the imaging diagnostic device 5, and detection of organs and parts by the imaging diagnostic device 5 (step S201). Specifically, the imaging control unit 410a causes the endoscope 2 to start imaging. In this case, the communication control unit 410e outputs image data (live view images) generated by sequentially capturing images by the endoscope 2 to the imaging diagnostic device 5 in chronological order. At this time, the imaging diagnostic device 5 starts detecting organs and parts contained in the image data, the presence or absence of insertion of the distal end 24 of the endoscope 2, and characteristic regions based on the image data input from the control device 4 and the inference model, and outputs this detection result information to the control device 4. In this case, the acquisition unit 410b generates usage status information that associates the detection result information input from the imaging diagnostic device 5, the endoscope ID of the endoscope 2, and patient information input from the medical support device 6 or the input unit 407, and starts recording this usage status information in the usage status information recording unit 408c.

[0121] The determination unit 410c determines whether the tip portion 24 of the endoscope 2 has been inserted into the subject's body based on the detection results of the diagnostic imaging device 5 acquired by the acquisition unit 410b (step S202). Specifically, if the detection results of the diagnostic imaging device 5 acquired by the acquisition unit 410b include the anus or oral cavity, the determination unit 410c determines that the tip portion 24 of the endoscope 2 has been inserted into the subject's body. If the determination unit 410c determines that the tip portion 24 of the endoscope 2 has been inserted into the subject's body (step S202: Yes), the control device 4 proceeds to step S203, which will be described later. On the other hand, if the determination unit 410c determines that the tip portion 24 of the endoscope 2 has not been inserted into the subject's body (step S202: No), the control device 4 proceeds to step S216, which will be described later.

[0122] In step S203, the acquisition unit 410b records the insertion result, which indicates that the distal end portion 24 of the endoscope 2 has been inserted into the body of the subject, detected by the diagnostic imaging device 5, in the usage status information recording unit 408c.

[0123] Next, the determination unit 410c determines whether the surgeon has operated the operation unit 22 (step S204). If the determination unit 410c determines that the surgeon has operated the operation unit 22 (step S204: Yes), the control device 4 proceeds to step S205, which will be described later. On the other hand, if the determination unit 410c determines that the surgeon has not operated the operation unit 22 (step S204: No), the control device 4 proceeds to step S208, which will be described later.

[0124] In step S205, the determination unit 410c determines whether the operation by the surgeon was an imaging operation. Specifically, when a release signal is input from the operation unit 22, the determination unit 410c determines that the surgeon has performed an imaging operation on the operation unit 22. When the control unit 410 determines that the surgeon has performed an imaging operation on the operation unit 22 (step S205: Yes), the control device 4 proceeds to step S206, which will be described later. On the other hand, when the determination unit 410c determines that the surgeon has not performed an imaging operation on the operation unit 22 (step S205: No), the control device 4 proceeds to step S207, which will be described later.

[0125] In step S206, the imaging control unit 410a causes the imaging element 203 to capture a still image (still image data). Specifically, the imaging control unit 410a records a still image file in the image data recording unit 408b, which associates the still image data generated by the imaging element 203 with the imaging time at which the imaging element 203 captured the still image data. At this time, the communication control unit 410e outputs the still image file to the medical support device 6 via the network N100. Here, the still image data is an image with a higher resolution (more pixels) than live view image data (e.g., a 4K image). After step S206, the control device 4 proceeds to step S208.

[0126] In step S207, the acquisition unit 410b acquires operation information relating to the operation performed by the surgeon on the operation unit 22 and records the information in the usage status information recording unit 408c. Here, the operation information includes a water supply operation for the endoscope 2 and an operation to change the angle of view of the imaging optical system 202. Of course, it may also include an operation using a treatment such as an energy device (not shown). After step S207, the control device 4 proceeds to step S208.

[0127] Next, the determination unit 410c determines whether the distal end 24 of the endoscope 2 has reached the final destination site based on the observation order information of the final destination site set in the observation order for report creation (see, for example, Part 1Q1 of FIG. 6 ) and the site of the subject detected by the diagnostic imaging device 5 (step S208). Specifically, when the final destination site set in the observation order is the ileum, the determination unit 410c determines that the distal end 24 of the endoscope 2 has reached the final destination site when the diagnostic imaging device 5 detects that the site is the ileum. Conversely, when the site detected by the diagnostic imaging device 5 is not the ileum, the determination unit 410c determines that the distal end 24 of the endoscope 2 has not reached the final destination site. If the determination unit 410c determines that the distal end 24 of the endoscope 2 has reached the final destination site (step S208: Yes), the control device 4 proceeds to step S209, which will be described later. On the other hand, if the determination unit 410c determines that the tip portion 24 of the endoscope 2 has not reached the final destination (step S208: No), the control device 4 proceeds to step S213, which will be described later.

[0128] In step S209, the display control unit 410d causes the display device 3 to display information indicating that the tip portion 24 of the endoscope 2 has reached the final destination site within the subject. For example, the display control unit 410d notifies the surgeon by causing the display device 3 to display information indicating that the tip portion 24 of the endoscope 2 has reached the "ileum," which is set as the final destination site. This allows the surgeon to understand that the tip portion 24 of the endoscope 2 has reached the final destination site set in the observation order.

[0129] Next, the acquisition unit 410b acquires the detection result information of the organ / site recognized by the diagnostic imaging device 5 and the detection time when the distal end 24 of the endoscope 2 reaches the final destination site, and records these in the usage information recording unit 408c (step S210). In this case, the acquisition unit 410b associates the detection result of detecting the final destination site with the detection time and records them in the usage information recording unit 408c.

[0130] Thereafter, the determination unit 410c determines, based on the detection result detected by the diagnostic imaging device 5, whether or not the diagnostic imaging device 5 has detected a characteristic region from the image data group generated by the endoscope 2 (step S211). If the determination unit 410c determines that the diagnostic imaging device 5 has detected a characteristic region from the image data group generated by the endoscope 2 (step S211: Yes), the control device 4 proceeds to step S212, which will be described later. On the other hand, if the determination unit 410c determines that the diagnostic imaging device 5 has not detected a characteristic region from the image data group generated by the endoscope 2 (step S211: No), the control device 4 proceeds to step S213, which will be described later.

[0131] In step S212, the acquisition unit 410b records the characteristic region detected by the diagnostic imaging apparatus 5 and the detection time when the diagnostic imaging apparatus 5 detected the characteristic region in the usage status information recording unit 408c.

[0132] Next, the determination unit 410c determines whether or not the tip portion 24 of the endoscope 2 has been removed from the body of the subject, based on the detection result from the diagnostic imaging device 5. If the determination unit 410c determines that the tip portion 24 of the endoscope 2 has been removed from the body of the subject (step S213: Yes), the control device 4 proceeds to step S214, which will be described later. On the other hand, if the determination unit 410c determines that the tip portion 24 of the endoscope 2 has not been removed from the body of the subject (step S213: No), the control device 4 returns to step S204, which has been described above.

[0133] In step S214, the control unit 410 records the extracorporeal removal time when the tip portion 24 of the endoscope 2 is removed from the subject's body as usage status information in the usage status information recording unit 408c based on the detection results from the imaging diagnostic device 5.

[0134] Next, the control unit 410 stops the imaging of the endoscope 2, the recording of image data captured by the endoscope 2, the detection of the presence or absence of insertion of the subject by the diagnostic imaging device 5, and the detection of organs and parts by the diagnostic imaging device 5 (step S215). After step S215, the control device 4 ends this processing and returns to the main routine of FIG.

[0135] In step S216, the determination unit 410c determines whether or not the surgeon has operated the operation unit 22. If the determination unit 410c determines that the surgeon has operated the operation unit 22 (step S216: Yes), the control device 4 proceeds to step S217, which will be described later. On the other hand, if the determination unit 410c determines that the surgeon has not operated the operation unit 22 (step S216: No), the control device 4 proceeds to step S220, which will be described later.

[0136] In step S217, the determination unit 410c determines whether the operation by the surgeon was an imaging operation. Specifically, when a release signal is input from the operation unit 22, the determination unit 410c determines that the surgeon has performed an imaging operation on the operation unit 22. When the control unit 410 determines that the surgeon has performed an imaging operation on the operation unit 22 (step S217: Yes), the control device 4 proceeds to step S218, which will be described later. On the other hand, when the determination unit 410c determines that the surgeon has not performed an imaging operation on the operation unit 22 (step S217: No), the control device 4 proceeds to step S219, which will be described later.

[0137] In step S218, the imaging control unit 410a causes the imaging element 203 to capture a still image (still image data). Specifically, the imaging control unit 410a records a still image file in the image data recording unit 408b, which associates the still image data generated by the imaging element 203 with the imaging time at which the imaging element 203 captured the still image data. At this time, the communication control unit 410e outputs the still image file to the medical support device 6 via the network N100. Here, the still image data is an image with a higher resolution (more pixels) than live view image data (e.g., a 4K image). After step S218, the control device 4 proceeds to step S220.

[0138] In step S219, the acquisition unit 410b acquires the details of the operation performed by the surgeon on the operation unit 22 and records the details in the usage status information recording unit 408c. Here, the details of the operation include a water supply operation for the endoscope 2 and an operation to change the angle of view of the imaging optical system 202. Of course, the details of the operation may also include an operation using a treatment such as an energy device (not shown). After step S219, the control device 4 proceeds to step S220.

[0139] In step S220, the determination unit 410c determines whether a predetermined time (e.g., five minutes) has elapsed since the endoscope 2 started capturing images. If the determination unit 410c determines that the predetermined time has elapsed since the endoscope 2 started capturing images (step S207: Yes), the control device 4 proceeds to step S215. This situation is assumed to indicate that some abnormality has occurred in the subject. For example, this may be a situation in which the subject is unable to insert the endoscope 2 due to poor physical condition, or the endoscope 2 has not been cleaned, or imaging or startup confirmation associated with maintenance of the endoscope 2. In this case, the acquisition unit 410b records information indicating that the endoscope 2 has not been inserted into the subject as usage status information in the usage status information recording unit 408c. On the other hand, if the determination unit 410c determines that the predetermined time has not elapsed since the endoscope 2 started capturing images (step S207: No), the control device 4 returns to step S202.

[0140] [Details of Report Creation Processing] Next, details of the report creation processing in step S108 in Fig. 5 will be described. Fig. 9 is a flowchart showing an outline of the report creation processing.

[0141] As shown in FIG. 9, first, the acquisition unit 661 acquires the image data group and the usage status information from the control device 4 via the network N100 (step S301).

[0142] Next, the discrimination unit 662 discriminates between first image data captured during observation of a predetermined observation area and a second image data group captured after observation of the predetermined observation area based on the image data group acquired by the acquisition unit 661 and the usage status information (step S302).

[0143] FIG. 10 is a diagram showing a schematic overview of when the discrimination unit 662 discriminates an image data group into first image data and a second image data group.

[0144] The endoscope 2 captures and generates a first image data group D1 consisting of multiple image data from the time the surgeon inserts the endoscope 2 into the subject's body until the tip portion 24 reaches the observation site, and continues to capture and generate a second image data group D2 consisting of multiple image data after the tip portion 24 reaches the observation site. In this case, when the surgeon inserts the tip portion 24 of the endoscope 2 (lower bowel endoscope) from outside the subject's body into the body, the surgeon wants to insert the tip portion 24 to the desired observation site as quickly as possible to reduce the subject's pain. However, there may be some kind of problem that prevents the tip portion 24 from being inserted to the desired observation site due to the patient's poor physical condition, a tumor that has developed in the subject's lumen causing a large obstruction, or the endoscope 2 not being cleaned. Furthermore, the first image data group D1 includes an image data group D3 of the endoscope 2 outside the body before insertion, which is the image data of the endoscope 2 before insertion into the subject's body due to the patient's poor physical condition or the endoscope 2 not being cleaned.

[0145] Therefore, as shown in Figure 10, the discrimination unit 662 discriminates between a first image data group D1 and a second image data group D2 based on the image data group acquired by the acquisition unit 661, the cleaning history information included in the usage status information, information on whether or not insertion into the body has occurred, and the detection result information on organs and parts.

[0146] 9 , the description of step S303 and subsequent steps will be continued. In step S303, the determination unit 663 determines whether the tip portion 24 of the endoscope 2 has been inserted into the body of the subject based on the first image data group determined by the discrimination unit 662 and the usage status information. If the determination unit 663 determines that the tip portion 24 of the endoscope 2 has been inserted into the body of the subject (step S303: Yes), the medical support device 6 proceeds to step S304, which will be described later. On the other hand, if the determination unit 663 determines that the tip portion 24 of the endoscope 2 has not been inserted into the body of the subject (step S304: No), the medical support device 6 proceeds to step S307, which will be described later.

[0147] In step S304, the determination unit 663 determines whether the distal end 24 of the endoscope 2 has reached the predetermined observation site based on the usage status information. Specifically, the determination unit 663 determines whether the distal end 24 of the endoscope 2 has reached the predetermined observation site based on the detection result information detected by the diagnostic imaging device 5 and the observation order table W1 (see pattern Q1 in FIG. 6 ) included in the usage status information. For example, if the innermost organ / site in the observation order table H1 is the "ileum," the observation order is "9," and the detection result by the diagnostic imaging device 5 includes "ileum," the determination unit 663 determines that the distal end 24 of the endoscope 2 has reached the predetermined observation site. If the determination unit 663 determines that the distal end 24 of the endoscope 2 has reached the predetermined observation site (step S304: Yes), the medical support device 6 proceeds to step S305, which will be described later. On the other hand, if the determination unit 663 determines that the tip 24 of the endoscope 2 has not reached the predetermined observation area (step S304: No), the medical support device 6 proceeds to step S306, which will be described later.

[0148] In step S305 , the generation unit 664 generates handover information based on the second image data group and the usage status information, and records the handover information in the handover information DB 647 .

[0149] Fig. 11 is a diagram showing an example of a handover information table in which each condition and handover content are associated with each other, generated by the generation unit 664. In the handover information table T1 shown in Fig. 11, each condition and handover content are recorded in association with each other.

[0150] Specifically, the generation unit 664 refers to the handover information table T1 and generates handover information based on the detection results detected by the diagnostic imaging device 5 included in the usage history information, the second image data group, the insertion information, the operation information, and the cleaning information. For example, when the insertion information of the detection results is "inside the body," the site determination result is "reached the observation site," the characteristic region detection result is "present," the operation information is "present," and the still image is "present," the generation unit 664 generates "characteristic region present" as handover information, which indicates that a lesion such as a tumor has occurred in the subject.

[0151] Furthermore, if the insertion information of the detection result is "inside the body," the site determination result is "reached the observation site," the feature region detection result is "none," the operation information is "none," and the still image is "none," the generation unit 664 generates "no abnormality (still image forgotten (still image not taken))" as handover information, indicating that there is no abnormality in the subject.

[0152] In this way, the generation unit 664 refers to the handover information table T1 and generates the handover information based on the second image data group included in the usage history information, the detection result detected by the imaging diagnostic device 5, the insertion information, the operation information, and the cleaning information. After step S305, the medical support device 6 proceeds to step S308, which will be described later.

[0153] In step S306, the generation unit 664 generates handover information based on the second image data group and the usage status information. In this case, the generation unit 664 references the handover information table T1 in FIG. 11 and generates the handover information based on the second image data group and the usage status information. For example, if the insertion information in the detection result is "inside the body," the site determination result is "not reached the observation site," the operation information is "present," and a still image is "present," the generation unit 664 generates "stenosis," which indicates that a stenosis has occurred in the subject due to a tumor or the like, as handover information. After step S307, the medical support device 6 proceeds to step S308, which will be described later.

[0154] In step S307, the generation unit 664 references the handover information table T1 in FIG. 11 and generates handover information based on the first image data group and the usage status information. For example, if the insertion information in the detection results is "not inserted," the operation information is "present," the still image is "present," and the cleaning history is "present," the generation unit 664 generates "test (usable)" as handover information, indicating testing or maintenance by the surgeon or a technician who maintains the endoscope 2. Furthermore, if the insertion information in the detection results is "not inserted," the operation information is "absent," the still image is "absent," and the cleaning history is "present," the generation unit 664 generates "poor health, pretreatment" as handover information, indicating poor health of the subject or an allergy due to pretreatment. Furthermore, if the insertion information in the detection results is "not inserted," the operation information is "present," the still image is "absent," and the cleaning history is "absent," the generation unit 664 generates "uncleaned" as handover information, indicating that the endoscope 2 has not been cleaned. After step S307, the medical support device 6 proceeds to step S308, which will be described later.

[0155] In step S308, the recording control unit 665 records the handover information generated by the generation unit 664 in the handover information DB 647. In this case, the recording control unit 665 records the handover information in the handover information DB 647 in association with the patient information or the surgeon information.

[0156] Next, the creation unit 666 creates a report for the subject based on the operation information from the input unit 63 or laptop computer 7, the image data group and usage information acquired by the acquisition unit 661, the patient information, and the handover information generated by the generation unit 664 (step S309). Specifically, the creation unit 666 creates report information (examination report) based on the operation information and usage information, including the determination result of the site reached by the distal end portion 24 of the endoscope 2 and handover information for use in a conference or the like with the subject, and records this report information in the report information DB 648 in association with the patient information or the operator information. After step S308, the medical support device 6 returns to the main routine of FIG. 5.

[0157] [Outline of Uninspected Processing] Next, details of the uninspected processing described in step S114 of Fig. 5 will be described. Fig. 12 is a flowchart showing an outline of the uninspected processing.

[0158] 12 , the creation unit 666 records the setting results of the subject to be observed, the patient name, etc., and the details of why observation was not performed as history in the patient information DB 641 based on the details input from the laptop computer 7 or the control device 4 (step S401). Specifically, the details of why observation was not performed include, for example, discontinuation due to a sudden deterioration in the subject's physical condition, discontinuation due to an allergic reaction to a prior injection, an incompatible type of endoscope 2 for the subject (patient), unmaintained endoscope 2, a malfunction of the endoscope 2, uncleaned endoscope 2, etc.

[0159] 11, the generation unit 664 generates handover information based on the first image data group and the usage status information (step S402). For example, if the insertion information of the detection result is "not inserted", the operation information is "none", the still image is "none", and the cleaning history is "present", the generation unit 664 generates "poor health, pretreatment" as handover information, which indicates that the subject is in poor health or has an allergy due to pretreatment.

[0160] Thereafter, the recording control unit 665 records the handover information generated by the generating unit 664 in the handover information DB 647 (step S403).

[0161] Next, the creation unit 666 creates report information about the subject that was left unobserved by the endoscope 2 based on the operation information from the input unit 63 or laptop computer 7 and the handover information about the details that led to the unobserved state by the endoscope 2, and records this report information in the report information DB 648 in association with the patient information or the surgeon information (step S404). This allows the surgeon to understand the details that led to the unobserved state the next time he or she interprets the patient's report information. After step S402, the medical support device 6 returns to the main routine of FIG. 5.

[0162] According to the embodiment described above, the generation unit 664 generates handover information for a report on the observation of the subject's observation site based on the determination result of whether or not the endoscope 2 has reached the observation site determined by the determination unit 663 and the usage status information acquired by the acquisition unit 661, and the recording control unit 665 records the handover information generated by the generation unit 664 in the handover information DB 647, so that valid medical information can be passed on depending on the usage status of the endoscope 2.

[0163] Furthermore, according to one embodiment, when the determination unit 663 determines that the endoscope 2 has not been inserted into the subject's body, the generation unit 664 generates handover information indicating that the endoscope 2 has not been inserted into the subject's body, thereby leaving behind clinical data that can be used as reference when observing the next subject.

[0164] Furthermore, according to one embodiment, when the determination unit 663 determines that the endoscope 2 has not been inserted into the subject's body, the generation unit 664 generates handover information indicating that the endoscope 2 has not been inserted into the subject's body based on the operation information included in the usage status information, so that information can be retained as to whether the use is temporary, such as for imaging due to maintenance.

[0165] Furthermore, according to one embodiment, the generation unit 664 generates handover information indicating that the endoscope 2 has not been inserted into the subject's body based on the operation information and cleaning history information contained in the usage status information, so that information indicating that the endoscope 2 has not been cleaned can be retained.

[0166] Furthermore, according to one embodiment, when the determination unit 663 determines that the endoscope 2 has not reached the observation site, the generation unit 664 generates handover information to the effect that the endoscope 2 was not inserted to the observation site, thereby leaving medical information to the effect that the endoscope 2 could not be inserted due to the subject's symptoms, such as stenosis or residual material.

[0167] Furthermore, according to one embodiment, when the determination unit 663 determines that the endoscope 2 has reached the observation site and that a characteristic region of the subject has been detected, the generation unit 664 generates handover information indicating that an abnormality has occurred in the subject. On the other hand, when the determination unit 663 determines that the endoscope 2 has reached the observation site and that a characteristic region of the subject has not been detected, the generation unit 664 generates handover information indicating that the subject is normal, thereby making it possible to retain medical information.

[0168] Furthermore, according to one embodiment, when the determination unit 663 determines that a still image exists, the generation unit 664 generates handover information indicating that a still image exists, so that medical information regarding the subject's tumor or characteristic area can be used in conferences, etc.

[0169] Various inventions can be formed by appropriately combining multiple components disclosed in the medical support system according to the embodiment of the present disclosure described above. For example, some components may be omitted from all the components described in the medical support system according to the embodiment of the present disclosure described above. Furthermore, the components described in the medical support system according to the embodiment of the present disclosure described above may be appropriately combined.

[0170] Furthermore, in the medical support system according to an embodiment of the present disclosure, the above-described "unit" can be read as "means" or "circuit," etc. For example, a control unit can be read as control means or a control circuit.

[0171] In addition, the program to be executed by the medical support system according to one embodiment of the present disclosure is provided as file data in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), a USB medium, or a flash memory.

[0172] Furthermore, the program executed by the medical support system according to one embodiment of the present disclosure may be configured to be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.

[0173] In the description of the flowcharts in this specification, expressions such as "first," "then," and "continue" are used to clearly indicate the order of processing between steps, but the order of processing required to implement the present invention is not uniquely determined by these expressions. In other words, the order of processing in the flowcharts described in this specification can be changed within a consistent range. Furthermore, programs are not limited to those consisting of simple branching processing, and branching can be achieved by comprehensively determining more judgment items.

[0174] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that have undergone various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the disclosure of the present invention.

[0175] REFERENCE SIGNS LIST 1 Medical support system 2 Endoscope 3 Display device 4 Control device 5 Diagnostic imaging device 6 Medical support device 7 Laptop computer 21 Insertion section 22 Operation section 23 Universal cord 24 Tip section 64 Database 65, 531 Program recording section 66, 410 Control section 410a Imaging control section 410b, 661 Acquisition section 410c, 663 Determination section 410d Display control section 410e Communication control section 622 Discrimination section 663 Determination section 664 Generation section 665 Recording control section 666 Creation section 641 Patient information DB 642 Endoscope DB 643 Image data DB 644 Usage status information DB 645 Observation order information DB 646 Report item DB 647 Related information DB 648 Report information DB 649 Operator information DB

Claims

1. A medical support device including a processor, The processor: Acquire usage status information regarding the usage status of the endoscope from the time when the endoscope is outside the body of the subject to the time when the desired observation site in the body cavity is observed; determining whether the endoscope has reached the observation site based on the usage status information; If it is determined that the endoscope has not reached the observation site based on the determination result of whether or not the endoscope has reached the observation site and the usage status information, handover information for a report on observation of the observation site is generated to the effect that the endoscope has not been inserted into the observation site; Recording the handover information; Medical support equipment.

2. The medical support device according to claim 1, The usage information is and further including insertion information indicating whether the endoscope has been inserted into the body of the subject based on a group of image data captured by the endoscope, The processor: determining whether the endoscope has been inserted into the body of the subject based on the insertion information; If it is determined that the endoscope has not been inserted into the body of the subject, the handover information indicating that the endoscope has not been inserted into the body of the subject is generated. Medical support equipment.

3. The medical support device according to claim 2, The usage information is The operation information further includes operation information of an operator with respect to an operation unit provided in the endoscope, The processor: if it is determined that the endoscope has not been inserted into the body of the subject, generating the handover information indicating that the endoscope has not been inserted into the body of the subject based on the operation information; Medical support equipment.

4. The medical support device according to claim 3, The usage information is Further, cleaning history information relating to the cleaning history of the endoscope is included. generating handover information indicating that the endoscope has not been inserted into the body of the subject based on the operation information and the cleaning history information; Medical support equipment.

5. The medical support device according to claim 4, The usage information is and further including characteristic region detection information indicating whether or not a characteristic region inside the subject has been detected based on the image data group captured by the endoscope, The processor: When it is determined that the endoscope has reached the observation region, it is determined whether or not the characteristic region has been detected based on the characteristic region detection information; When it is determined that the endoscope has reached the observation site and the characteristic region has been detected, the handover information is generated to indicate that an abnormality has occurred in the subject, whereas when it is determined that the endoscope has reached the observation site and the characteristic region has not been detected, the handover information is generated to indicate that the subject is normal. Medical support equipment.

6. The medical support device according to claim 5, The usage information is Further, release information relating to a history of release signals from an operation member provided in the endoscope is included, The processor: determining whether or not there is a still image based on the release information; If it is determined that the still image exists, the handover information indicating that the still image exists is generated. Medical support equipment.

7. The medical support device according to claim 6, The usage information is The endoscope further includes detection result information indicating that a plurality of organs and regions are detected based on a group of image data captured by inserting the endoscope into the subject, Acquiring a group of image data generated by continuous imaging by the endoscope; The image data group is classified into a first image data group obtained when the endoscope reaches the inside of the subject's body and a second image data group obtained when the endoscope is inserted into the subject's body; The detection result information is based on the second image data set; Medical support equipment.

8. An endoscope and a control device for controlling the endoscope; a diagnostic imaging device; A medical support device; A medical support system comprising: The endoscope comprises: an insertion section that can be inserted into a subject; a tip section provided at a tip of the insertion section, which successively captures images of a plurality of predetermined observation sites on the subject to sequentially generate image data groups and output the image data groups to the control device; Equipped with The diagnostic imaging device generating detection result information for detecting each of the plurality of observed regions from the image data group using the image data group and an inference model that has previously learned the characteristics of organs and regions, and outputting the detection result information to the control device; The medical support device includes: a processor; The processor: acquiring usage status information regarding usage status of the endoscope up to observation of a predetermined observation site on the subject; determining whether the endoscope has reached the observation site based on the usage status information; generating handover information for a report on observation of the observation region based on a determination result of whether the endoscope has reached the observation region and the usage status information; Recording the handover information; Medical support system.

9. A medical support system according to claim 8, The usage information is and further including insertion information indicating whether the endoscope has been inserted into the body of the subject based on a group of image data captured by the endoscope, The processor: determining whether the endoscope has been inserted into the body of the subject based on the insertion information; If it is determined that the endoscope has not been inserted into the body of the subject, the handover information indicating that the endoscope has not been inserted into the body of the subject is generated. Medical support system.

10. A medical support system according to claim 9, The usage information is The operation information further includes operation information of an operator with respect to an operation unit provided in the endoscope, The processor: if it is determined that the endoscope has not been inserted into the body of the subject, generating the handover information indicating that the endoscope has not been inserted into the body of the subject based on the operation information; Medical support system.

11. A medical support system according to claim 10, The usage information is Further, cleaning history information relating to the cleaning history of the endoscope is included. generating handover information indicating that the endoscope has not been inserted into the body of the subject based on the operation information and the cleaning history information; Medical support system.

12. A medical support system according to claim 11, The usage information is and further including characteristic region detection information indicating whether or not a characteristic region inside the subject has been detected based on the image data group captured by the endoscope, The processor: When it is determined that the endoscope has reached the observation region, it is determined whether or not the characteristic region has been detected based on the characteristic region detection information; When it is determined that the endoscope has reached the observation site and the characteristic region has been detected, the handover information is generated to indicate that an abnormality has occurred in the subject, whereas when it is determined that the endoscope has reached the observation site and the characteristic region has not been detected, the handover information is generated to indicate that the subject is normal. Medical support system.

13. A medical support system according to claim 12, The usage information is Further, release information relating to a history of release signals from an operation member provided in the endoscope is included, The processor: determining whether or not there is a still image based on the release information; If it is determined that the still image exists, the handover information indicating that the still image exists is generated. Medical support system.

14. A medical support system according to claim 13, Acquiring a group of image data generated by continuous imaging by the endoscope; The image data group is classified into a first image data group obtained when the endoscope reaches the inside of the subject's body and a second image data group obtained when the endoscope is inserted into the subject's body; The detection result information is based on the second image data set; Medical support system.

15. A method for operating a medical support device, comprising: Medical support equipment, acquiring usage status information relating to usage status of the endoscope from the time the endoscope is outside the body of the subject to the time when the endoscope observes a desired observation site within the body cavity; determining whether the endoscope has reached the observation region based on the usage status information; generating handover information for a report on observation of the observation site, when it is determined that the endoscope has not reached the observation site based on the determination result of whether the endoscope has reached the observation site and the usage status information; and recording the handover information; including performing A method of operating a medical support device.

16. A method for operating the medical support device according to claim 15, comprising: The usage information is and further including insertion information indicating whether the endoscope has been inserted into the body of the subject based on a group of image data captured by the endoscope, Medical support equipment, determining whether the endoscope has been inserted into the body of the subject based on the insertion information; generating handover information indicating that the endoscope has not been inserted into the body of the subject when it is determined that the endoscope has not been inserted into the body of the subject; [0033] A method of operating a medical support device.

17. A method for operating the medical support device according to claim 16, comprising: The usage information is The operation information further includes operation information of an operator with respect to an operation unit provided in the endoscope, Medical support equipment, generating, based on the operation information, handover information indicating that the endoscope has not reached the insertion stage of the subject's body when it is determined that the endoscope has not been inserted into the subject's body; [0033] A method of operating a medical support device.

18. A method for operating the medical support device according to claim 17, comprising: The usage information is Further, cleaning history information relating to the cleaning history of the endoscope is included. Medical support equipment, generating handover information indicating that the endoscope has not been inserted into the body of the subject based on the operation information and the cleaning history information; [0033] A method of operating a medical support device.

19. A method for operating the medical support device according to claim 18, comprising: The usage information is and further including characteristic region detection information indicating whether or not a characteristic region inside the subject has been detected based on the image data group captured by the endoscope, Medical support equipment, a step of determining whether or not the characteristic region has been detected based on the characteristic region detection information when it is determined that the endoscope has reached the observation region; generating handover information indicating that an abnormality has occurred in the subject when it is determined that the endoscope has reached the observation site and that the characteristic region has been detected, and generating handover information indicating that the subject is normal when it is determined that the endoscope has reached the observation site and that the characteristic region has not been detected; [0033] A method of operating a medical support device.

20. A method for operating the medical support device according to claim 19, comprising: The usage information is Further, release information relating to a history of release signals from an operation member provided in the endoscope is included, Medical support equipment, determining whether or not there is a still image based on the release information; generating the handover information indicating that the still image exists when it is determined that the still image exists; [0033] A method of operating a medical support device.