Endoscope system, endoscope system control method, and program

Abstract

Provided are an endoscope system, an endoscope system control method, and a program that are capable of assisting diagnosis without relying on a physician's knowledge or skill. The endoscope system comprises a sensor that detects a physical quantity to generate sensor data, and a processor that processes the sensor data output from the sensor. The sensor has a first sensor that outputs first data and a second sensor that outputs second data. The processor generates diagnosis assistance information on the basis of the first data and the second data, and outputs the diagnosis assistance information.

Description

Endoscope system, control method and program for endoscope system

[0001] The present disclosure relates to an endoscope system, a control method for an endoscope system, and a program.

[0002] Gastroesophageal reflux disease (GERD) is a pathological condition caused by the reflux of stomach contents, including a large amount of stomach acid, into the esophagus. Conventionally, an endoscope system using an endoscope has been proposed as a system for diagnosing gastroesophageal reflux disease (see, for example, Patent Document 1). In this technology, an insertion portion of the endoscope is inserted into the stomach, the endoscope is set to be able to image the gastric cardia, and air is blown into the stomach. The endoscope system then evaluates the function of the lower esophageal sphincter based on the pressure change inside the stomach detected during gas blowing into the stomach and the state of the gastric cardia observed from the image captured using the endoscope.

[0003] US Patent Application Publication No. 2020 / 0375485

[0004] In cases where GERD symptoms are confirmed, in order to identify the cause and determine a treatment method, a doctor must observe the condition in Phases 1 to 3 of the above-mentioned Patent Document 1. The esophagus is a digestive tract that is approximately 25 cm long and functions through a number of muscles.

[0005] However, because doctors rely on their own knowledge and skills to diagnose conditions such as acid clearance function caused by esophageal peristalsis, which is caused by complex mechanisms, it is difficult to make accurate diagnoses, and there was a need for technology to assist in diagnosis.

[0006] The present disclosure has been made in consideration of the above, and aims to provide an endoscopic system, a control method for an endoscopic system, and a program that can assist in diagnosis without relying on the knowledge and skills of a doctor.

[0007] In order to solve the above-mentioned problems and achieve the objectives, an endoscopic system according to the present disclosure is an endoscopic system comprising: a sensor that senses a physical quantity and generates sensor data; and a processor that processes the sensor data output from the sensor, wherein the sensor has a first sensor that outputs first data and a second sensor that outputs second data; the processor generates diagnostic assistance information based on the first data and the second data and outputs the diagnostic assistance information; the first sensor is an image sensor; and the diagnostic assistance information is information relating to the gastroesophageal tract.

[0008] Furthermore, a control method for an endoscopic system according to the present disclosure is a control method for an endoscopic system including a processor, wherein the endoscopic system includes a sensor that senses a physical quantity and generates sensor data, the sensor having a first sensor that outputs first data and a second sensor that outputs second data, the first sensor being an image sensor, and the processor generates diagnostic assistance information based on the first data and the second data, and outputs the diagnostic assistance information, the diagnostic assistance information being information relating to the gastroesophageal tract.

[0009] In addition, a program according to the present disclosure is a program executed by an endoscopic system having a processor, the endoscopic system including a sensor that senses a physical quantity and generates sensor data, the sensor having a first sensor that outputs first data and a second sensor that outputs second data, the first sensor being an image sensor, and causing the processor to generate diagnostic assistance information based on the first data and the second data and output the diagnostic assistance information, wherein the diagnostic assistance information is information relating to the gastroesophageal tract.

[0010] The present disclosure has the effect of being able to assist in diagnosis without relying on the knowledge and skills of a doctor.

[0011] FIG. 1 is a diagram illustrating a configuration of an endoscopic system according to a first embodiment of the present disclosure. FIG. 2 is a diagram illustrating a configuration of an endoscopic system according to the first embodiment of the present disclosure. FIG. 3 is a diagram illustrating the configuration and arrangement of a pressure sensor. FIG. 4 is a diagram illustrating a method for diagnosing gastroesophageal reflux disease according to the first embodiment of the present disclosure. FIG. 5 is a diagram illustrating a method for diagnosing gastroesophageal reflux disease according to the first embodiment of the present disclosure. FIG. 6 is a diagram illustrating a method for diagnosing gastroesophageal reflux disease according to the first embodiment of the present disclosure. FIG. 7 is a diagram illustrating a method for diagnosing gastroesophageal reflux disease according to the first embodiment of the present disclosure. FIG. 8 is a diagram illustrating a method for diagnosing gastroesophageal reflux disease according to the first embodiment of the present disclosure. FIG. 9 is a block diagram illustrating the functional configuration of a storage unit and a control unit according to the first embodiment of the present disclosure. FIG. 10 is a flowchart illustrating an outline of processing executed by a processing device according to the first embodiment of the present disclosure. FIG. 11 is a schematic diagram illustrating an outline of diagnostic support information generated by a generation unit of the processing device according to the first embodiment of the present disclosure. FIG. 12 illustrates the functional configuration of a storage unit and a control unit of a processing device according to a second embodiment of the present disclosure. FIG. 13 is a flowchart illustrating an outline of processing executed by a processing device according to a second embodiment of the present disclosure. FIG. 14 is a diagram schematically illustrating an insertion state of an endoscope into a subject during processing executed by a processing device according to the second embodiment of the present disclosure. FIG. 15 is a diagram illustrating the functional configuration of a storage unit and a control unit of a processing device according to a third embodiment of the present disclosure. FIG. 16 is a flowchart illustrating an outline of processing executed by a processing device according to the third embodiment of the present disclosure. FIG. 17 is a schematic diagram illustrating an outline of estimation of each feature amount by an estimation unit of a processing device according to the third embodiment of the present disclosure and generation of diagnostic support information by a generation unit. FIG. 18 is a diagram schematically illustrating an insertion state of an endoscope into a subject during processing executed by a processing device according to the third embodiment of the present disclosure.

[0012] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0013] (Embodiment 1) [Configuration of Endoscopic System] Fig. 1 is a diagram illustrating the configuration of an endoscopic system according to an embodiment of the present disclosure. Fig. 2 is a diagram illustrating the functional configuration of the endoscopic system according to embodiment 1 of the present disclosure. The endoscopic system 1 shown in Figs. 1 and 2 is used in the medical field and is a system for diagnosing gastroesophageal reflux disease in a subject using an endoscope 2. As shown in Figs. 1 and 2, the endoscopic system 1 includes an endoscope 2, a light source device 3, a processing device 4, a display device 5, an air supply device 6, a gastric pressure measuring device 7, and a microphone 8.

[0014] In the first embodiment, the endoscope 2 is a so-called flexible endoscope. A portion of the endoscope 2 is inserted into a living body, captures images of the inside of the living body, and outputs image signals generated by the image capture. As shown in FIG. 1 , the endoscope 2 includes an insertion section 21, an operation section 22, and a universal cord 23.

[0015] The insertion section 21 is a section that has at least a portion that is flexible and is inserted into a living body. As shown in Figures 1 and 2, the insertion section 21 includes a tip section 24, a freely bendable bending section 25 (Figure 1) composed of a plurality of bending pieces, a long, flexible flexible tube section 26 (Figure 1) that is connected to the base end side of the bending section 25, a first microphone 81, and a second microphone 82. An image sensor 244 (Figure 2) is built into the tip section 24. The insertion section 21 is inserted into a body cavity of a subject, and captures an image of a subject, such as biological tissue, that is located in a position that is not accessible by external light, using the image sensor 244.

[0016] Here, a pressure sensor 9 that detects pressure applied to the outer peripheral surface is provided on the outer peripheral surface of the insertion portion 21. The detailed configuration and arrangement of the pressure sensor 9 will be described later in the section "Configuration and arrangement of pressure sensor."

[0017] The detailed configuration and arrangement of the first microphone 81 and the second microphone 82 will be described later in the section "Configuration and arrangement of the first microphone 81 and the second microphone 82."

[0018] The operation unit 22 is connected to the base end portion of the insertion section 21. The operation unit 22 receives various operations for the endoscope 2. As shown in Fig. 1 , the operation unit 22 includes a bending knob 221 for bending the bending section 25 in the up-down and left-right directions, a treatment tool insertion section 222 that extends from the operation unit 22 to the tip of the insertion section 21 and inserts treatment tools such as biopsy forceps, an electric scalpel, and an examination probe into the body cavity of the subject, an air supply conduit 223 (Fig. 2) that extends from the operation unit 22 to the tip of the insertion section 21 and supplies air into the body cavity of the subject, and a plurality of switches 224 for operating peripheral devices such as the air supply device 6 and a water supply device (not shown).

[0019] The universal cord 23 incorporates at least a light guide 241 ( FIG. 2 ) and a cable assembly 245 ( FIG. 2 ) that bundles one or more signal lines. The light guide 241 is made of glass fiber or the like and serves as a light guide path for light emitted by the light source device 3. As shown in FIG. 1 , the universal cord 23 branches at the end opposite the end connected to the operation unit 22. The branched ends of the universal cord 23 are provided with a connector 231 that is detachable from the light source device 3 and a connector 232 that is detachable from the processing device 4. A portion of the light guide 241 extends from the end of the connector 231. The universal cord 23 transmits illumination light emitted from the light source device 3 to the distal end 24 via the connector 231 (light guide 241), the operation unit 22, and the flexible tube portion 26. The universal cord 23 also transmits image signals captured by an image sensor 244 provided in the distal end 24 to the processing device 4 via the connector 232. The cable assembly 245 includes a signal line for transmitting an image signal, a signal line for transmitting a drive signal for driving the image sensor 244, and a signal line for transmitting and receiving information including unique information related to the endoscope 2 (image sensor 244). Note that, in this embodiment, the signal lines are described as transmitting electrical signals, but they may also be used to transmit optical signals, or may be used to transmit signals between the endoscope 2 and the processing device 4 by wireless communication.

[0020] The output end side of the light guide 241 is inserted into the tip portion 24. As shown in Fig. 2, the tip portion 24 includes an illumination lens 242, an optical system 243 for collecting light, and an image sensor 244 that is provided at the imaging position of the optical system 243 and receives the light collected by the optical system 243, photoelectrically converts the light into an electrical signal, and performs predetermined signal processing.

[0021] The optical system 243 is configured using one or more lenses, and forms an observation image on the light receiving surface of the image sensor 244. The optical system 243 may have an optical zoom function that changes the angle of view and a focus function that changes the focus.

[0022] The image sensor 244 photoelectrically converts light from the optical system 243 to generate an electrical signal (image signal). The image sensor 244 is configured with a matrix of pixels, each of which includes a photodiode that accumulates an electric charge corresponding to the amount of light and a capacitor that converts the electric charge transferred from the photodiode into a voltage level. The image sensor 244 photoelectrically converts light incident on each pixel through the optical system 243 to generate an electric signal, sequentially reads out the electric signals generated by pixels arbitrarily designated as readout targets among the plurality of pixels, and outputs the electric signals as image signals. The image sensor 244 is implemented using, for example, a charge-coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor. The image sensor 244 functions as a first sensor that senses physical quantities and generates sensor data.

[0023] For ease of explanation, the image signal generated by the image sensor 244 capturing an image will be referred to as a captured image below.

[0024] Here, the endoscope 2 has a memory (not shown) that stores execution programs and control programs for the image sensor 244 to perform various operations, as well as data including identification information of the endoscope 2. The identification information includes the endoscope 2's unique information (ID), model year, specification information, transmission method, etc. The memory may also temporarily store captured images generated by the image sensor 244.

[0025] As shown in FIG. 2 , the light source device 3 includes a light source unit 31 , an illumination control unit 32 , and a light source driver 33 .

[0026] The light source unit 31 emits light under the control of the illumination control unit 32. The light source unit 31 emits light having a wavelength band of visible light (white light (illumination light)). The light source unit 31 is realized using any light source such as an LED (Light Emitting Diode) light source, a laser light source, a xenon lamp, or a halogen lamp. The light source unit 31 may also include one or more lenses. The light generated by the light source unit 31 passes through the light guide 241 and the illumination lens 242 and is emitted from the tip of the tip unit 24 toward the subject.

[0027] The light emitted from the light source unit 31 is not limited to white light, but may be narrowband light having light in a specific wavelength band, or may be excitation light that excites substances contained in the object of observation.

[0028] The light source driver 33 supplies current to the light source unit 31 under the control of the illumination control unit 32, thereby causing the light source unit 31 to emit light.

[0029] The processing device 4 includes an image processing unit 41 , a synchronization signal generating unit 42 , an input unit 43 , a control unit 44 , and a storage unit 45 .

[0030] Under the control of the control unit 44, the image processing unit 41 performs predetermined image processing on the captured image received from the endoscope 2 to generate an endoscopic image.

[0031] Examples of image processing performed by the image processing unit 41 include optical black subtraction processing (clamping processing), white balance adjustment processing, demosaic processing, color correction matrix processing, gamma correction processing, YC processing that converts RGB signals into luminance color difference signals (Y, Cb / Cr signals), digital gain adjustment that multiplies by digital gain, noise removal, and filter processing that emphasizes structure.

[0032] The image processing unit 41 described above is configured using dedicated processors such as memory and dedicated processors having hardware such as a GPU (Graphics Processing Unit), a DSP (Digital Signal Processing) or an FPGA (Field Programmable Gate Array), or various arithmetic circuits that execute specific functions, such as an ASIC (Application Specific Integrated Circuit).

[0033] The synchronization signal generation unit 42 generates a clock signal (synchronization signal) that serves as a reference for the operation of the processing device 4, and outputs the generated synchronization signal to the light source device 3, the image processing unit 41, the control unit 44, and the endoscope 2. Here, the synchronization signal generated by the synchronization signal generation unit 42 includes a horizontal synchronization signal and a vertical synchronization signal. Therefore, the light source device 3, the image processing unit 41, the control unit 44, and the endoscope 2 operate in synchronization with each other using the generated synchronization signal.

[0034] The input unit 43 is realized using a keyboard, a mouse, a switch, and a touch panel, and accepts various operations for instructing the operation of the endoscope system 1. The input unit 43 may include a switch provided on the operation unit 22 or a portable terminal such as an external tablet computer.

[0035] The control unit 44 is configured using a general-purpose processor such as a CPU or a dedicated processor such as various arithmetic circuits that execute specific functions, such as an ASIC. The control unit 44 generates esophageal pressure data, internal pressure data, and sound data based on data input from various sensors. In the first embodiment, the control unit 44 functions as the processor of the present disclosure. Details of the processing by the control unit 44 will be described later.

[0036] The storage unit 45 stores various programs executed by the control unit 44 and data including various parameters necessary for the processing of the control unit 44. Specifically, the storage unit 45 has a program storage unit 452 that stores various programs. The various programs can be recorded on computer-readable recording media such as a hard disk, flash memory, CD-ROM, DVD-ROM, or flexible disk and widely distributed. The various programs can also be obtained by downloading them via a communication network. The communication network referred to here is realized, for example, by an existing public line network, a LAN (Local Area Network), a WAN (Wide Area Network), or the like, and can be wired or wireless.

[0037] The storage unit 45 having the above configuration is realized using a ROM (Read Only Memory) in which various programs etc. are pre-installed, and a RAM, hard disk, SSD (Solid State Drive) etc. that store calculation parameters and data etc. for each process.

[0038] In the first embodiment, the light source device 3 and the processing device 4 are provided in separate housings, but the present invention is not limited to this and they may be provided integrally in the same housing.

[0039] The display device 5 displays the display image received from the processing device 4 (image processing unit 41) via the video cable. The display device 5 is configured using a monitor such as a liquid crystal or organic EL (Electro Luminescence) monitor.

[0040] The gas supply device 6 adjusts the pressure of gas supplied from a gas supply source (not shown, for example, a carbon dioxide gas cylinder) to a predetermined pressure and discharges the gas from the tip of the insertion section 21 into the space where the tip is located through the gas supply conduit 223. As shown in Fig. 1, the gas supply device 6 includes a gas supply unit 61, a flow rate measurement unit 62, and a control unit 63.

[0041] Although not specifically shown, the gas supply unit 61 includes a primary pressure reducer, a secondary pressure reducer, and a flow control valve. These primary pressure reducer, secondary pressure reducer, and flow control valve are connected in this order by an air supply conduit made of silicone, fluororesin, or the like. Gas supplied from a gas supply source (not shown) passes through the primary pressure reducer, secondary pressure reducer, and flow control valve in this order via the air supply conduit. After being adjusted to a predetermined pressure and flow rate, the gas is discharged from the air supply tube TU ( FIG. 1 ) via the flow rate measuring unit 62. The control unit 63 controls the flow control valve provided in the gas supply unit 61 to adjust the flow rate of gas supplied to the endoscope 2 to a predetermined value. The flow control valve is, for example, a type of electromagnetically driven valve, and is configured as a regulating valve using an electromagnetic coil in the drive unit. The opening degree of the valve unit is controlled by controlling the position of the plunger depending on the magnitude of the current flowing through the electromagnetic coil, thereby adjusting the flow rate of gas flowing through the air supply conduit to a predetermined value.

[0042] The gastric pressure measuring device 7 corresponds to an internal pressure sensor according to the present invention. This gastric pressure measuring device 7 detects the pressure (internal pressure data) inside the space where the tip is located, via a pressure measurement probe 71 inserted through the treatment tool insertion section 222 to the tip of the insertion section 21. A signal (hereinafter referred to as gastric pressure information) related to the pressure detected by the gastric pressure measuring device 7 (hereinafter referred to as "internal pressure data") is output to the processing device 4. In Embodiment 1, the gastric pressure measuring device 7 functions as one of the second sensors that senses a physical quantity and generates sensor data.

[0043] The microphone 8 (sound sensor) is placed on the throat or the like of the subject, and collects at least one of belching sounds (burping sounds) emitted from the subject's esophagus and sounds generated by the esophagus during peristaltic movement. A signal related to the sound collected by the microphone 8 (hereinafter referred to as "sound data") is output to the processing device 4. In the first embodiment, the microphone 8 functions as one of the second sensors that senses physical quantities and generates sensor data.

[0044] [Configuration and Arrangement of Pressure Sensor] Next, the configuration and arrangement of the pressure sensor 9 will be described. FIG.

[0045] The pressure sensor 9 (esophageal pressure sensor) shown in Fig. 3 is configured by, for example, a resistance-type pressure sensor or a capacitance-type pressure sensor that detects pressure (pressure data) using a known method. As shown in Fig. 3, the pressure sensor 9 according to the first embodiment is a circular pressure sensor that is provided around the entire circumference in the rotational direction around a central axis along the axial direction of the insertion section 21. Note that the pressure sensor 9 is not limited to a circular pressure sensor, and a point-type pressure sensor that is provided only around a portion of the entire circumference in the rotational direction may also be used.

[0046] 3, a total of 36 pressure sensors 9 are arranged at 1 cm intervals along the axial direction of the insertion section 21 on the outer peripheral surface of the insertion section 21. As a result, when the insertion section 21 is inserted into the stomach, the pressure sensors 9 are arranged at positions that detect contraction pressure and relaxation pressure at various locations inside the esophagus from the upper esophageal sphincter to the lower esophageal sphincter.

[0047] The number of pressure sensors 9 is not limited to 36, but may be, for example, 6 or more, 12 or more, or even more.

[0048] Here, the pressure sensors 9 may be positioned a predetermined distance from one or more of the nearest other pressure sensors 9. Optionally, the spacing between each pressure sensor 9 may be substantially the same. The spacing may be 3 cm or less, for example 2 cm or less, for example 1 cm, or even less than 1 cm.

[0049] A signal relating to the pressure detected by the pressure sensor 9 described above (hereinafter referred to as "pressure data") is output to the processing device 4. In the first embodiment, the pressure sensor 9 functions as one of the second sensors that senses a physical quantity and generates sensor data.

[0050] [Method for Diagnosing Gastroesophageal Reflux Disease] Next, a method for diagnosing gastroesophageal reflux disease will be described. FIGS. 4 to 8 are diagrams illustrating a method for diagnosing gastroesophageal reflux disease according to embodiment 1. Specifically, FIG. 4 is a flowchart illustrating the method for diagnosing gastroesophageal reflux disease. FIG. 5 is a cross-sectional view showing the vicinity of the gastric cardia, illustrating steps S1 to S3. For ease of explanation, FIG. 5 omits the pressure sensor 9 provided on the outer peripheral surface of the insertion section 21. FIGS. 6 and 7 are diagrams illustrating the structures of the stomach and esophagus. FIG. 6 is a cross-sectional view showing the structures of the stomach and esophagus. FIG. 7 is a view of the stomach and esophagus as viewed from the outside. FIG. 8 is a diagram illustrating images captured in Phases 1 to 3, which correspond to dynamic changes that occur when air is supplied to the stomach (during pneumoperitoneum).

[0051] First, a user such as a doctor inserts the insertion portion 21 into the subject through a natural opening such as the mouth or nose, and introduces the insertion portion 21 into the stomach through the esophagus, as shown in FIG. 5 (step S1).

[0052] After step S1, a user such as a doctor operates (bends) the bending knob 221 to set the field of view to include the gastric cardia (step S2). In step S2, in response to the operation of the bending knob 221, the insertion section 21 is set into a J-shape with the tip pointing toward the gastric cardia, as shown in Fig. 5. In this state, the pressure sensor 9 is disposed at a position to detect the contraction pressure and relaxation pressure at various locations inside the esophagus from the upper esophageal sphincter to the lower esophageal sphincter.

[0053] After step S2, a user such as a doctor operates switch 224 to start supplying air from the air supply device 6 to the stomach through the air supply conduit 223 (step S3). In Fig. 5, the state in which intragastric pressure increases due to air supply is represented by a hollow arrow.

[0054] When gas is supplied to the stomach (pneumoperitoneum), if the subject is healthy, the dynamic changes shown below occur in Phases 1 to 3. Before explaining Phases 1 to 3, the structure of the stomach and esophagus will be described with reference to Figures 6 and 7.

[0055] The intramural anti-reflux barrier complex (IM-ARB complex), which is part of the anti-reflux mechanism at the gastroesophageal junction, is composed of three main components: the collar sling muscle fibers (Figure 7), the clasp muscle fibers (Figure 7), and the lower esophageal sphincter (Figures 6 and 7).

[0056] The Collar Sling Muscle Fibers are oblique muscles located along the greater curvature of the stomach (Figure 6) and are arranged in a sling-like fashion to surround the upper part of the stomach (Figure 7). These Collar Sling Muscle Fibers constrict the gastric cardia, preventing reflux of gastric contents into the esophagus. From inside the stomach, the Collar Sling Muscle Fibers can be seen as a gastroesophageal flap valve (Figure 6). The gastroesophageal flap valve (GEFV) is a protrusion within the gastroesophageal junction formed by the acute angle between the esophagus and the gastric cardia, and is a type of mucosal flap valve (MFV). The MFV located at the gastroesophageal junction is called the gastroesophageal flap valve. The MFV is a flap-shaped portion of the mucosa. The gastroesophageal flap valve changes shape depending on the contraction and relaxation of muscles such as the Collar Sling Muscle Fibers and Clasp Muscle Fibers.

[0057] Clasp muscle fibers are located on the lesser curvature side of the stomach (Figure 6) and consist of a circular muscle layer. These clasp muscle fibers tighten the gastric cardia to prevent the reflux of stomach contents into the esophagus.

[0058] The lower esophageal sphincter (LES) is a ring of muscle located at the junction of the esophagus and stomach that normally contracts to close the esophagus and prevent stomach contents from refluxing.

[0059] Phase 1 begins with the amount of gas sent into the stomach being 0. During Phase 1, the gastroesophageal flap valve and the longitudinal folds of the lesser curvature are observed, as shown in Figures 8(a) and 8(b). The longitudinal folds of the lesser curvature are mucosal folds that extend vertically along the inner wall of the stomach. Their shape changes with the expansion and contraction and relaxation of muscles such as clasp muscle fibers, and they gradually stretch and flatten as intragastric pressure increases. Note that the esophageal mucosa is not observed during Phase 1. During Phase 1, as the amount of gas sent into the stomach increases, the longitudinal folds of the lesser curvature are stretched, the gastroesophageal flap valve gradually flattens, and the crura open, as shown in Figure 8(b). However, the esophageal mucosa is not observed.

[0060] In other words, in Phase 1, it is possible to evaluate the valve function (anti-reflux mechanism) of the stomach structure formed by the gastroesophageal flap valve and the longitudinal folds of the lesser curvature.

[0061] Phase 2 occurs after Phase 1. In Phase 2, as shown in Figure 8(c), the esophageal mucosa is observed beyond the squamocolumnar junction (SCJ) in Figure 6). The SCJ is the intersection of the esophageal squamous epithelium at the gastroesophageal junction (GEJ) and the gastric columnar epithelium, marking the boundary between different epithelial cells in the digestive tract. The GEJ is located near the border between the esophagus and the stomach and is composed of various anatomical components that form a barrier to prevent reflux of gastric contents. The GEJ also includes collar sling muscle fibers, clasp muscle fibers, the lower esophageal sphincter, the gastroesophageal flap valve, and the SCJ. If the subject is healthy, the scope holding sign (SHS) is observed. The SHS refers to the phenomenon in which the insertion tube 21 is held in place by contraction of the lower esophageal sphincter when intragastric pressure increases. The state shown in FIG. 8(c) is the SHS.

[0062] That is, in Phase 2, it becomes possible to evaluate the valve function (anti-reflux mechanism) of the lower esophageal sphincter.

[0063] Phase 3 occurs after Phase 2. In Phase 3, intragastric pressure exceeds the contractile force of the lower esophageal sphincter, causing the lower esophageal sphincter to relax. In Figure 8(d), the arrow indicates that gas leaks into the esophagus (producing a belching sound) due to the relaxation of the lower esophageal sphincter. If the subject is healthy, peristaltic waves will subsequently descend from the upper esophagus, and SHS will be observed again.

[0064] That is, in Phase 3, it becomes possible to evaluate the acid clearance function due to esophageal peristalsis.

[0065] After step S3, a user such as a doctor determines whether the state corresponds to the above-mentioned Phase 1 based on the diagnostic support information displayed on the display device 5, and evaluates the valve function (state of the gastric cardia) based on the structure of the stomach side (step S4).

[0066] After step S4, a user such as a doctor determines whether or not the state corresponds to the above-mentioned Phase 2 based on the diagnostic support information displayed on the display device 5, and evaluates the valve function of the lower esophageal sphincter (the state of the lower esophageal sphincter) (step S5).

[0067] After step S5, a user such as a doctor determines whether or not the patient is in a state corresponding to the above-mentioned Phase 3 based on the diagnostic support information displayed on the display device 5, and evaluates the acid clearance function due to esophageal peristalsis (the state of peristaltic movement in the esophagus) (step S6).

[0068] After step S6, a user such as a doctor diagnoses gastroesophageal reflux disease based on the evaluation results of steps S4 to S6 (step S7).

[0069] [Functional Configuration of Storage Unit and Control Unit] Next, a description will be given of the functional configuration of the storage unit 45 and the control unit 44. FIG.

[0070] [Functional Configuration of Storage Unit] First, the functional configuration of the storage unit 45 will be described. The storage unit 45 has a first trained model storage unit 451 that stores trained models and a program storage unit 452 that stores various programs executed by the processing device 4. The trained model stored in the first trained model storage unit 451 is, for example, a convolutional neural network (CNN). In this case, the trained model is trained using training data that associates pressure data detected by multiple pressure sensors 9 that are esophageal pressure sensors, pressure data of the internal space of the stomach measured by the gastric pressure measuring device 7 that is a gastric pressure sensor, audio data detected by the microphone 8, and information on whether or not the acid clearance function due to esophageal peristalsis is impaired. The trained model inputs endoscopic images and sensor data from various sensors as input parameters and outputs diagnostic support information (described later) as output parameters.

[0071] [Functional Configuration of Control Unit] Next, a description will be given of the functional configuration of the control unit 44. The control unit 44 has an acquisition unit 441, a generation unit 442, and a display control unit 443.

[0072] The acquisition unit 441 sequentially acquires endoscopic images obtained by processing the image data sequentially captured by the endoscope 2 by the image processing unit 41 .

[0073] The generating unit 442 generates diagnostic assistance information based on the endoscopic image, which is the first image data, and the sensor data from various sensors, which is the second data.

[0074] The display control unit 443 superimposes the diagnostic assistance information generated by the generation unit 442 on the endoscopic image and outputs the superimposed image to the display device 5 .

[0075] [Processing by Processing Device] Next, a description will be given of the processing performed by the processing device 4. Fig. 10 is a flowchart showing an outline of the processing performed by the processing device 4.

[0076] 10 , first, the acquisition unit 441 starts sequentially acquiring endoscopic images obtained by processing image data sequentially captured by the endoscope 2 by the image processing unit 41 and sensor data from the various sensors (step S101). In this case, the acquisition unit 441 acquires the endoscopic images (first data) and the sensor data (second data) from the various sensors while synchronizing them in time in accordance with the synchronization signal generated by the synchronization signal generation unit 42.

[0077] Next, the generation unit 442 generates diagnostic assistance information based on the endoscopic image, which is the first image data, and the sensor data from the various sensors, which is the second data (step S102). Specifically, the generation unit 442 inputs the endoscopic image acquired by the acquisition unit 441 and the sensor data output from the various sensors into the first trained model stored in the first trained model storage unit 451, and generates diagnostic assistance information based on the output result output by the first trained model.

[0078] 11 is a schematic diagram illustrating an overview of the diagnostic assistance information generated by the generation unit 442. As shown in Fig. 11 , the generation unit 442 inputs (input) the pressure data detected by the multiple pressure sensors 9 that are esophageal pressure sensors acquired by the acquisition unit 441, the pressure data of the internal space of the stomach measured by the gastric pressure measuring device 7 that is a gastric pressure sensor, and the voice data detected by the microphone 8 into the first learned model stored in the first learned model storage unit 451, and generates (output) the diagnostic assistance information based on the output result (estimation result) output from the first learned model.

[0079] Here, the diagnostic assistance information is one or more of information indicating whether or not the acid clearance function due to esophageal peristalsis has decreased, at least one of first data (endoscopic image) and second data (pressure data or sound data) related to the decrease in the acid clearance function due to esophageal peristalsis, and information indicating a section of at least one of the first data and second data (pressure data or sound data) that provides evidence of the decrease in the acid clearance function due to esophageal peristalsis. The information indicating the section is, for example, time information including a start time to an end time that provides evidence of the decrease in the acid clearance function due to esophageal peristalsis, thumbnail information consisting of the first and last endoscopic images of temporally consecutive endoscopic images acquired by the acquisition unit 441, etc.

[0080] 10, the description of step S103 and subsequent steps will be continued. In step S103, the display control unit 443 superimposes the diagnostic assistance information generated by the generation unit 442 on the endoscopic image and outputs the superimposed information to the display device 5.

[0081] Next, the control unit 44 determines whether an instruction signal to end the observation has been input from the input unit 43 (step S104). If the control unit 44 determines that an instruction signal to end the observation has been input (step S104: Yes), the processing device 4 ends this process. On the other hand, if the control unit 44 determines that an instruction signal to end the observation has not been input (step S104: No), the processing device 4 returns to step S102.

[0082] According to the embodiment 1 described above, the display control unit 443 superimposes the diagnostic assistance information generated by the generation unit 442 on the endoscopic image and outputs it to the display device 5, so that diagnosis can be assisted without relying on the doctor's knowledge and skills.

[0083] (Embodiment 2) Next, embodiment 2 will be described. In embodiment 2, the configuration is different from that of the processing device of the endoscope system 1 according to embodiment 1 described above, and the processing executed by the processing device is also different. In the following, the configuration of the processing device according to embodiment 2 will be described, and then the processing executed by the processing device according to embodiment 2 will be described. Note that the same components as those in the endoscope system 1 according to embodiment 1 described above will be assigned the same reference numerals, and detailed description thereof will be omitted.

[0084] [Functional Configuration of Control Unit] Fig. 12 illustrates the functional configuration of the storage unit and control unit of the processing device according to embodiment 2. The processing device 4A shown in Fig. 12 includes a control unit 44A instead of the control unit 44 of embodiment 1 described above. The control unit 44A further includes a determination unit 444 in addition to the configuration of the control unit 44 of embodiment 1 described above.

[0085] The determination unit 444 determines whether or not the cardia is observable in the endoscopic image acquired by the acquisition unit 441. Specifically, the determination unit 444 determines whether or not the cardia is included in the endoscopic image using a well-known pattern matching technique.

[0086] [Processing by Processing Device] Fig. 13 is a flowchart showing an outline of the processing executed by the processing device 4 A. Fig. 14 is a diagram showing a schematic diagram of the insertion state of the endoscope 2 into the subject during the processing executed by the processing device 4 A.

[0087] 13 , first, the acquisition unit 441 starts sequentially acquiring endoscopic images obtained by processing imaging data sequentially captured by the endoscope 2 by the image processing unit 41, and sensor data from various sensors (step S201). Specifically, as shown in FIG. 14 ( a), the acquisition unit 441 sequentially acquires endoscopic images and sensor data from various sensors when the doctor inserts the endoscope 2 into the esophagus W1 of the subject. In this case, the doctor proceeds with inserting the endoscope 2 into the stomach of the subject while observing the endoscopic image displayed on the display device 5.

[0088] Next, the determination unit 444 determines whether the cardia W3 is observable in the endoscopic image acquired by the acquisition unit 441 (step S202). Specifically, as shown in FIG. 14B, the doctor inserts the distal end 24 of the endoscope 2 into the stomach W2 and operates the operation unit 22 to adjust the angle so that the field of view of the image sensor 244 faces the cardia W3. Therefore, the determination unit 444 determines whether the cardia W3 is included in the endoscopic image using a well-known pattern matching technique. Of course, the determination unit 444 may also determine whether the cardia W3 is included in the endoscopic image using a trained model trained using training data that combines multiple endoscopic images and the position of the cardia W3 included in each of the multiple endoscopic images. The trained model inputs the endoscopic image and outputs information about the presence or absence and position of the cardia W3 in the endoscopic image. If the determination unit 444 determines that the cardia W3 is observable in the endoscopic image acquired by the acquisition unit 441 (step S202: Yes), the processing device 4 proceeds to step S203, which will be described later. On the other hand, if the determination unit 444 determines that the cardia W3 is not observable in the endoscopic image acquired by the acquisition unit 441 (step S202: No), the processing device 4 causes the determination unit 444 to repeat the determination.

[0089] In step S203, the generation unit 442 generates diagnostic assistance information based on the endoscopic image, which is the first image data, and the sensor data from various sensors, which is the second data. The generation unit 442 inputs the endoscopic image acquired by the acquisition unit 441 and the sensor data output from the various sensors into the first trained model stored in the first trained model storage unit 451, and generates diagnostic assistance information based on the output result output by the first trained model. In this case, the generation unit 442 inputs the timing at which the determination unit 444 determines that the cardia W3 is observable in the endoscopic image acquired by the acquisition unit 441, the endoscopic image acquired and accumulated by the acquisition unit 441, and the sensor data output from the various sensors, and generates diagnostic assistance information based on the output result output by the first trained model.

[0090] Thereafter, the display control unit 443 superimposes the diagnostic assistance information generated by the generation unit 442 on the endoscopic image and outputs the superimposed diagnostic assistance information to the display device 5 (step S204). Specifically, as shown in FIG. 14C, the display control unit 443 superimposes the diagnostic assistance information A1 generated by the generation unit 442 on the endoscopic image P1 and outputs the superimposed diagnostic assistance information to the display device 5. In this case, the display control unit 443 superimposes the diagnostic assistance information A1 on the endoscopic image P1 at a position corresponding to a location considered to be abnormal. Here, abnormality indicates a decrease in the acid clearance function due to esophageal peristalsis. Note that the diagnostic assistance information A1 may include information generated by the generation unit 442 regarding the location considered to be abnormal, along with a message indicating the abnormality. The message may be, for example, "The pressure sensor data value from the pressure sensor 9 indicates an abnormality compared to a healthy subject. This indicates the possibility of decreased muscle strength of the LES." In this case, the display control unit 443 may superimpose a message on the endoscopic image P1 and display it on the display device 5. Of course, the display control unit 443 may cause a speaker or the like (not shown) of the display device 5 to play and output the message.

[0091] Next, the control unit 44 determines whether an instruction signal to end the observation has been input from the input unit 43 (step S205). If the control unit 44A determines that an instruction signal to end the observation has been input (step S205: Yes), the processing device 4A ends this process. On the other hand, if the control unit 44A determines that an instruction signal to end the observation has not been input (step S205: No), the processing device 4A returns to step S202.

[0092] According to the second embodiment described above, the display control unit 443 superimposes the support information generated by the generation unit 442 on the endoscopic image and outputs the superimposed information to the display device 5, thereby enabling diagnosis to be supported without relying on the knowledge and skills of the doctor.

[0093] (Embodiment 3) Next, embodiment 3 will be described. The endoscopic system according to embodiment 3 differs not only in the configuration of the processing device of the endoscopic system according to embodiment 1 described above, but also in the processing performed by the processing device. Specifically, the processing device according to embodiment 3 generates diagnostic assistance information using a plurality of trained models. Below, the configuration of the processing device according to embodiment 3 will be described, and then the processing performed by the processing device according to embodiment 3 will be described. Note that the same components as those in the endoscopic system 1 according to embodiment 1 described above will be assigned the same reference numerals, and detailed description thereof will be omitted.

[0094] [Functional Configuration of Storage Unit and Control Unit] Fig. 15 is a diagram showing the functional configuration of the storage unit and control unit of a processing device according to embodiment 3. Processing device 4B shown in Fig. 15 includes a storage unit 45B and a control unit 44B instead of the storage unit 45 and control unit 44 of embodiment 1 described above. Note that Fig. 15 shows only the main parts of processing device 4A that are modified from processing device 4 according to embodiment 1 described above.

[0095] [Functional Configuration of Storage Unit] First, the functional configuration of the storage unit 45 A will be described. The storage unit 45 B has a program storage unit 452 and a trained model database 453 (hereinafter referred to as the “trained model DB 453”) that stores a plurality of trained models.

[0096] The trained model DB 453 stores a plurality of trained models. Specifically, the trained model DB 453 stores at least an image trained model, a pressure trained model, an internal pressure trained model, a voice trained model, and a diagnostic assistance trained model.

[0097] The image-trained model is a model that learns using training data that combines multiple endoscopic images and evaluation values ​​that evaluate the acid clearance performance due to esophageal peristalsis using each of the multiple endoscopic images, inputs the endoscopic images as input parameters, and estimates and outputs a first feature value that is an evaluation value that evaluates the acid clearance performance due to esophageal peristalsis for the input endoscopic images as output parameters.

[0098] The pressure-trained model is a model that learns using training data that combines multiple pressure data detected by the pressure sensor 9 and evaluation values ​​that evaluate the acid clearance performance due to esophageal peristalsis for each of the multiple pressure data, inputs the pressure data as an input parameter, and estimates and outputs a second feature value that is an evaluation value that evaluates the acid clearance performance due to esophageal peristalsis for the input pressure data as an output parameter.

[0099] The internal pressure trained model is a model that learns using training data that combines multiple internal pressure data detected by the gastric pressure measuring device 7 and evaluation values ​​that evaluate the acid clearance performance due to esophageal peristalsis for each of the multiple internal pressure data, inputs the internal pressure data as an input parameter, and estimates and outputs a third feature value that is an evaluation value that evaluates the acid clearance performance due to esophageal peristalsis for the input internal pressure data as an output parameter.

[0100] The speech-trained model is a model that learns using training data that combines multiple pieces of speech data detected by microphone 8 and evaluation values ​​that evaluate the acid clearance performance due to esophageal peristalsis for each piece of speech data, inputs the speech data as input parameters, and estimates and outputs a fourth feature that is an evaluation value that evaluates the acid clearance performance due to esophageal peristalsis for the input speech data as output parameters.

[0101] The diagnostic assistance trained model is a model trained using training data that combines a plurality of first feature amounts output by the image trained model, a plurality of second feature amounts output by the pressure trained model, a plurality of third feature amounts output by the internal pressure trained model, and a plurality of fourth feature amounts output by the voice trained model with diagnostic assistance information. This diagnostic assistance trained model receives the first feature amounts, the second feature amounts, the third feature amounts, and the fourth feature amounts as input parameters and outputs the diagnostic assistance information as output parameters.

[0102] Note that each trained model is assumed to be, for example, a CNN or an RNN. Furthermore, in embodiment 3, the image trained model functions as a first trained model, the pressure trained model, the internal pressure trained model, and the voice trained model function as second trained models, and the diagnostic assistance trained model functions as a third trained model. Furthermore, in the following description, the image trained model, the pressure trained model, the internal pressure trained model, and the voice trained model will be collectively referred to as each trained model.

[0103] [Functional Configuration of Control Unit] Next, the functional configuration of the control unit 44B will be described. The control unit 44B further includes an inference unit 445 in addition to the functional configuration of the control unit 44 according to the first embodiment described above.

[0104] The inference unit 445 inputs the endoscopic image, which is the first image data, and the sensor data from various sensors, which is the second data, into each trained model, thereby estimating features as output parameters.

[0105] [Processing by Processing Device] Next, the processing executed by the processing device 4B will be described. Fig. 16 is a flowchart showing an outline of the processing executed by the processing device 4B. Fig. 17 is a schematic diagram explaining an outline of the estimation of each feature amount by the inference unit 445 and the generation of diagnostic support information by the generation unit 442. Fig. 18 is a diagram showing a schematic diagram of the insertion state of the endoscope 2 into the subject during the processing executed by the processing device 4B.

[0106] 16 , first, the acquisition unit 441 starts sequentially acquiring endoscopic images obtained by processing imaging data sequentially captured by the endoscope 2 by the image processing unit 41, and sensor data from various sensors (step S301). Specifically, as shown in FIG. 18( a), the acquisition unit 441 sequentially acquires endoscopic images and sensor data from various sensors when the doctor inserts the endoscope 2 into the esophagus W1 of the subject. In this case, the doctor proceeds with inserting the endoscope 2 into the stomach of the subject while observing the endoscopic image displayed on the display device 5.

[0107] Next, the inference unit 445 inputs the endoscopic image (first image data) and the sensor data from the various sensors (second data) into each trained model, thereby estimating feature quantities as output parameters (step S302). Specifically, as shown in Fig. 17, the inference unit 445 inputs the endoscopic image into the image trained model (input), estimates the first feature quantity as an output parameter, and outputs it (output). Similarly, the inference unit 445 inputs pressure data, internal pressure data, and voice data into the pressure trained model, internal pressure trained model, and voice trained model, respectively, and estimates the second feature quantity, third feature quantity, and fourth feature quantity as output parameters and outputs them.

[0108] Thereafter, the generation unit 442 inputs the first feature amount, the second feature amount, the third feature amount, and the fourth feature amount estimated and output by the inference unit 445 into the diagnostic assistance trained model, and generates diagnostic assistance information based on the output results output as output parameters (step S303). Specifically, as shown in Fig. 17 , the generation unit 442 inputs the first feature amount, the second feature amount, the third feature amount, and the fourth feature amount estimated and output by the inference unit 445 from each trained model (input) into the diagnostic assistance trained model, and generates diagnostic assistance information based on the output results output as output parameters (output).

[0109] Next, the display control unit 443 superimposes the diagnostic assistance information generated by the generation unit 442 on the endoscopic image and outputs the superimposed diagnostic assistance information to the display device 5 (step S304). Specifically, as shown in FIG. 18B, the display control unit 443 superimposes the diagnostic assistance information A2 generated by the generation unit 442 on the endoscopic image P2 and outputs the superimposed diagnostic assistance information to the display device 5. The diagnostic assistance information A2 shown in FIG. 18B is information used by the generation unit 442 to warn a doctor of an abnormality when the diagnostic assistance trained model estimates and outputs the sensor data as an abnormality. Note that the generation unit 442 may generate a message or audio instead of a graphic representation of the diagnostic assistance information A2. For example, when the diagnostic assistance trained model outputs an estimation result that estimates an abnormality in the audio data from the microphone 8, the generation unit 442 may generate text or audio data of the message, "An abnormality has been detected in the audio data from the microphone 8. The peristalsis of the subject may not be functioning properly." as the diagnostic assistance information. This allows the doctor to carefully observe the location where the diagnostic assistance information A2 is displayed, thereby improving the accuracy of diagnosis. Note that in Figure 188(b), the generation unit 442 generates diagnostic assistance information A2 indicating a warning, but if the diagnostic assistance trained model outputs an estimation result that indicates normal based on each feature amount, it generates diagnostic analysis information indicating normality.

[0110] Thereafter, the control unit 44B determines whether an instruction signal to end observation has been input from the input unit 43 (step S305). If the control unit 44B determines that an instruction signal to end observation has been input (step S305: Yes), the processing device 4B ends this process. On the other hand, if the control unit 44B determines that an instruction signal to end observation has not been input (step S305: No), the processing device 4B returns to step S302.

[0111] According to the third embodiment described above, the generation unit 442 inputs the first feature amount, the second feature amount, the third feature amount, and the fourth feature amount output by the inference unit 445 into the diagnostic assistance trained model, and generates diagnostic assistance information based on the output results output as output parameters. This makes it possible to output diagnostic analysis information with higher accuracy, allowing the doctor to carefully observe the location where the diagnostic assistance information is displayed, thereby improving diagnostic accuracy.

[0112] (Other Embodiments) Various inventions can be formed by appropriately combining multiple components disclosed in the endoscope systems according to the above-described first to third embodiments of the present disclosure. For example, some components may be omitted from all of the components described in the medical support systems according to the above-described embodiments of the present disclosure. Furthermore, the components described in the medical support systems according to the above-described embodiments of the present disclosure may be appropriately combined.

[0113] In the above-described first to third embodiments of the present disclosure, in order to diagnose gastroesophageal reflux disease, at least two pieces of information, namely, an endoscopic image and esophageal pressure information, are required, and it is not necessary to use all of the information, namely, the endoscopic image, the esophageal pressure information, the intragastric pressure information, and the eructation information.

[0114] Although the above-described first to third embodiments of the present disclosure have been described as technologies capable of diagnosing gastroesophageal reflux disease, this is not intended to be limiting. For example, the present invention can be useful for diagnosing esophageal achalasia, since it can also evaluate the relaxation dysfunction of the lower esophageal sphincter. It can also evaluate the function of the major sphincters present in the human digestive tract. Specifically, it can evaluate the external anal sphincter, i.e., physiological anorectal function associated with aging.

[0115] Furthermore, in embodiments 1 to 3 of the present disclosure, the control unit as a processor generates diagnostic assistance information using a trained model. However, without using a trained model, for example, the control unit may determine the opening and closing of the gastric cardia based on imaging data, determine the relaxation or contraction of the esophagus based on pressure data, and then generate diagnostic assistance information based on the determination result of the opening and closing of the gastric cardia and the determination result of the relaxation or contraction of the esophagus.

[0116] In addition, in embodiments 1 to 3 of the present disclosure, the control unit as a processor generates diagnostic assistance information using a trained model, but the control unit may also generate diagnostic assistance information based on imaging data and pressure data.

[0117] In addition, in embodiments 1 to 3 of the present disclosure, the processing performed by the control unit 44 may be performed by the image processing unit 41, or external devices or servers connectable to the processing device 4 and the image processing unit 41 may be provided with the functions of the control unit 44, i.e., the functions of the acquisition unit 441, the generation unit 442, and the display control unit 443.

[0118] Furthermore, in the endoscope systems according to the first to third embodiments of the present disclosure, the above-described "unit" can be read as "means," "circuit," etc. For example, a control unit can be read as control means or a control circuit.

[0119] In addition, the programs to be executed by the endoscopic systems according to the first to third embodiments of the present disclosure are provided as file data in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), a USB medium, or a flash memory.

[0120] In addition, the programs to be executed by the endoscopic systems according to embodiments 1 to 3 of the present disclosure may be configured to be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.

[0121] In the description of the flowcharts in this specification, expressions such as "first," "then," and "continue" are used to clearly indicate the order of processing between steps, but the order of processing required to implement the present invention is not uniquely determined by these expressions. In other words, the order of processing in the flowcharts described in this specification can be changed within a consistent range. Furthermore, programs are not limited to those consisting of simple branching processing, and branching can be achieved by comprehensively determining more judgment items.

[0122] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that have undergone various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the disclosure of the present invention.

[0123] REFERENCE SIGNS LIST 1 Endoscope system 2 Endoscope 3 Light source device 4, 4A, 4B Processing device 5 Display device 6 Air supply device 7 Gastric pressure measuring device 8 Microphone 9 Pressure sensor 21 Insertion section 22 Operation section 23 Universal cord 24 Tip section 25 Bending section 26 Flexible tube section 31 Light source section 32 Lighting control section 33 Light source driver 41 Image processing section 42 Synchronization signal generation section 43 Input section 44, 44A Control section 45, 45B Memory section 61 Air supply section 62 Flow rate measurement section 63 Control section 71 Pressure measurement probe 221 Bending knob 222 Treatment tool insertion section 223 Air supply conduit 224 Switch 231, 232 Connector 241 Light guide 242 Illumination lens 243 Optical system 244 Image pickup element 245 Assembled cable 441 Acquisition unit 442 Generation unit 443 Display control unit 444 Determination unit 445 Inference unit 451 First trained model storage unit 452 Program storage unit 453 Trained model DB TU Air supply tube

Claims

1. An endoscope system comprising: a sensor that senses a physical quantity and generates sensor data; and a processor that processes the sensor data output from the sensor, wherein the sensor has: a first sensor that outputs first data; and a second sensor that outputs second data; the processor generates diagnostic assistance information based on the first data and the second data, and outputs the diagnostic assistance information; the first sensor is an image sensor; and the diagnostic assistance information is information relating to the gastroesophageal tract.

2. An endoscopic system as described in claim 1, wherein the processor acquires an endoscopic image by processing the imaging data output from the image sensor, inputs the endoscopic image and the second data into a first trained model, and generates the diagnostic assistance information based on the output result of the first trained model.

3. An endoscope system according to claim 2, further comprising a memory unit, wherein the memory unit stores the first trained model.

4. An endoscopic system as described in claim 1, wherein the processor: acquires an endoscopic image by processing the imaging data output from the image sensor; inputs the endoscopic image into a first trained model; inputs the second data into a second trained model; inputs a first feature output by the first trained model and a second feature output by the second trained model into a third trained model; and generates the diagnostic assistance information based on the output result output by the third trained model.

5. An endoscope system according to claim 4, further comprising a memory unit, wherein the memory unit stores the first trained model, the second trained model, and the third trained model.

6. An endoscope system according to claim 1, wherein the image sensor generates imaging data of the area around the gastric cardia.

7. An endoscope system according to claim 1, wherein the second sensor is an esophageal pressure sensor that detects pressure generated around the outer periphery of the endoscope insertion portion due to relaxation or contraction of muscles present in the esophagus.

8. An endoscope system according to claim 7, wherein the second sensor comprises a plurality of esophageal pressure sensors.

9. An endoscope system according to claim 7, wherein the esophageal pressure sensors are arranged at intervals of 3 cm or less in the insertion section of the endoscope.

10. An endoscope system according to claim 7, wherein the esophageal pressure sensors are arranged at intervals of 1 cm in the insertion portion of the endoscope.

11. An endoscope system according to claim 7, wherein the esophageal pressure sensor detects changes in pressure due to relaxation and contraction of the esophagus from the upper esophageal sphincter to the lower esophageal sphincter.

12. An endoscope system according to claim 1, wherein the second sensor is an intragastric pressure sensor, and the intragastric pressure sensor detects the internal pressure of the internal space of the stomach.

13. An endoscope system according to claim 1, wherein the second sensor is a sound sensor that detects sounds generated in the esophagus such as eructation and / or peristalsis.

14. An endoscope system according to claim 1, wherein the processor generates esophageal pressure data based on data output from an esophageal pressure sensor.

15. An endoscope system according to claim 1, wherein the processor generates internal pressure data based on data output from an internal gastric pressure sensor.

16. An endoscope system according to claim 1, wherein the processor generates sound data based on data output from a sound sensor.

17. An endoscope system according to claim 1, wherein the processor temporally synchronizes the first data and the second data.

18. An endoscopy system according to claim 1, wherein the diagnostic support information is information relating to an evaluation of acid clearance function by esophageal peristalsis.

19. An endoscope system according to claim 18, wherein the diagnostic support information is information on whether or not the acid clearance function by esophageal peristalsis is impaired.

20. An endoscope system according to claim 19, wherein the diagnostic support information includes at least one of the first data and the second data related to a decrease in acid clearance function due to esophageal peristalsis.

21. An endoscope system according to claim 20, wherein the diagnostic support information includes information indicating a section of at least one of the first data and the second data that is evidence of a decrease in acid clearance function due to esophageal peristalsis.

22. An endoscopic system according to claim 1, wherein the first sensor is an image sensor, the second sensor is an esophageal pressure sensor, the image sensor outputs imaging data as the first data, and the esophageal pressure sensor outputs pressure data as the second data, and the processor generates the diagnostic support information based on the imaging data and the pressure data.

23. An endoscopic system as described in claim 22, wherein the image sensor generates the imaging data capturing an image of the area around the cardiac region of the stomach; the esophageal pressure sensor outputs the pressure data detecting the pressure generated around the endoscope insertion portion due to relaxation or contraction of muscles present in the esophagus; the processor determines whether the cardiac region of the stomach is open or closed based on the imaging data; determines whether the esophagus is relaxed or contracted based on the pressure data; and generates the diagnostic support information based on the determination result of whether the cardiac region of the stomach is open or closed and the determination result of whether the esophagus is relaxed or contracted.

24. A control method for an endoscope system including a processor, wherein the endoscope system includes a sensor that senses a physical quantity and generates sensor data, the sensor having a first sensor that outputs first data and a second sensor that outputs second data, the first sensor being an image sensor, and the processor generates diagnostic support information based on the first data and the second data and outputs the diagnostic support information, the diagnostic support information being information related to the gastroesophageal tract.

25. A program executed by an endoscopic system having a processor, wherein the endoscopic system comprises: a sensor that senses a physical quantity and generates sensor data, the sensor having: a first sensor that outputs first data; and a second sensor that outputs second data, the first sensor being an image sensor; and the program causes the processor to generate diagnostic assistance information based on the first data and the second data, and output the diagnostic assistance information, wherein the diagnostic assistance information is information relating to the stomach and esophagus.

Images