Medical device, medical system, learning device, method for operating medical device, and program

Abstract

Provided are a medical device, a medical system, a learning device, a method for operating a medical device, and a program with which it is possible to confirm the state of thermal denaturation in a specific region. A medical device is provided with a processor that performs: a process for acquiring a thermally denatured image including at least a thermally denatured region; determining a specific area contained in the thermal denaturation image; setting a detection range, which is a target range in which a thermally denatured region is detected, in the thermally denatured image on the basis of a specific region; and outputting thermal denaturation information based on the detection range and the thermal denaturation region.

Description

Technical Field

[0001] The present disclosure relates to a medical device, a medical system, a learning device, an operating method of the medical device, and a program. Background Art

[0002] Conventionally, a technique for visualizing the state of cauterization of a subject, such as biological tissue, using an energy device or the like is known in the medical field (see, for example, Patent Document 1). This technique irradiates the subject with excitation light and displays an image and information containing fluorescence image data generated based on an imaging signal acquired by capturing fluorescence generated from a heat-affected region of the subject in response to the excitation light, thereby visualizing the state of cauterization for a user, such as a surgeon.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: International Publication No. 2020 / 054723 Summary of the Invention

[0006] Problems to be solved by the invention

[0007] In addition, in transurethral resection of bladder tumors (TUR-Bt), a surgical endoscope (resectoscope) is inserted through the urethra of the subject. The surgeon uses the eyepiece of the surgical endoscope to observe the lesion while using resection instruments such as energy devices to perform resection of a specific area containing the lesion or a specified organ.

[0008] However, Patent Document 1 mentioned above does not consider grasping the state of thermal denaturation corresponding to a specific region at all, and a technology capable of confirming the state of thermal denaturation corresponding to a specific region is desired.

[0009] The present disclosure has been made in view of the above, and an object thereof is to provide a medical device, a medical system, a learning device, an operating method of a medical device, and a program that can confirm the state of thermal denaturation corresponding to a specific area.

[0010] Solutions for solving problems

[0011] In order to solve the above-mentioned problems and achieve the purpose, the medical device involved in the present disclosure includes a processor, wherein the processor performs the following processing: obtaining a thermal denaturation image that at least includes a thermal denaturation area; determining a specific area included in the thermal denaturation image; setting an object range, i.e., a detection range, for detecting the thermal denaturation area within the thermal denaturation image based on the specific area; and outputting thermal denaturation information based on the detection range and the thermal denaturation area.

[0012] In the medical device according to the present disclosure, in the above disclosure, the processor performs the following processing: determining whether the thermally denatured region is included in the detection range; and outputting the thermal denaturation information if the thermally denatured region is included in the detection range.

[0013] In the medical device according to the present disclosure, in the above disclosure, the processor outputs the image with the thermally denatured region emphasized when the detection range includes the thermally denatured region, compared to when the detection range does not include the thermally denatured region.

[0014] In the medical device according to the present disclosure, in the above disclosure, the processor outputs the thermally denatured region included in the detection range and the thermally denatured region not included in the detection range in a manner that allows them to be distinguished from each other.

[0015] In the medical device according to the present disclosure, in the above disclosure, the processor performs the following processing: acquiring an imaging signal generated by an imaging device; and generating the thermal denaturation image based on the imaging signal.

[0016] In the medical device according to the present disclosure, in the above disclosure, the thermal denaturation image is a fluorescent image.

[0017] In the medical device according to the present disclosure, in the above disclosure, the processor generates the fluorescence image based on the imaging signal generated by the imaging device capturing fluorescence emitted from the thermally denatured region when the biological tissue is irradiated with excitation light.

[0018] In the medical device according to the present disclosure, in the above disclosure, the fluorescence is emitted from advanced glycation end products produced by heat treatment of the biological tissue.

[0019] Furthermore, in the medical device according to the present disclosure, in the above disclosure, the processor determines whether the thermally denatured region has occurred based on a signal value of each pixel in the fluorescent image.

[0020] In the medical device according to the present disclosure, in the above disclosure, the processor performs the following processing: acquiring an imaging signal generated by an imaging device; and generating a white light image based on the imaging signal.

[0021] Furthermore, in the medical device according to the present disclosure, in the above disclosure, the processor specifies the specific area based on the white light image.

[0022] In the medical device according to the present disclosure, in the above disclosure, the processor specifies the specific area based on a feature value in the white-light image.

[0023] Furthermore, in the medical device according to the present disclosure, in the above disclosure, the processor specifies the specific area based on an instruction signal input from the outside.

[0024] In the medical device according to the present disclosure, in the above disclosure, the processor superimposes the detection range on the thermal denaturation image and outputs the result to a display device.

[0025] Furthermore, in the medical device according to the present disclosure, in the above disclosure, the processor sets the detection range based on the type of the specific area.

[0026] In the medical device according to the present disclosure, in the above disclosure, the processor sets the detection range based on an instruction signal input from the outside.

[0027] In the medical device according to the present disclosure, in the above disclosure, the processor sets the detection range based on the type of the specific area and the distance from the front end of the imaging device to the specific area.

[0028] In addition, in the medical device involved in the present disclosure, in the above disclosure, the processor performs the following processing: obtaining the distance information from a memory that records distance information that establishes a correspondence between the category of the specific area and the distance of the detection range; and setting the detection range based on the category of the specific area and the distance information.

[0029] In the medical device according to the present disclosure, in the above disclosure, the processor superimposes the thermally denatured region on the white light image and outputs the result to a display device.

[0030] In the medical device according to the present disclosure, in the above disclosure, the processor superimposes the thermally denatured region within the detection range and the thermally denatured region outside the detection range on the white light image in different ways and outputs the superimposed images to a display device.

[0031] In the medical device according to the present disclosure, in the above disclosure, the specific area is an organ or an entrance or exit of an organ.

[0032] In addition, the learning device involved in the present disclosure includes a processor, wherein the processor generates a learned model by performing machine learning using training data, in which a fluorescence image obtained by irradiating excitation light to biological tissue and capturing fluorescence and a white light image obtained by irradiating white light to biological tissue and capturing the white light are used as input data, and information representing the relationship between a thermally denatured area extracted from the fluorescence image and a specific area determined based on the white light image is used as output data.

[0033] In addition, the medical system involved in the present disclosure is a medical system comprising a light source device, an imaging device and a medical device, wherein the light source device has a light source that emits excitation light, the excitation light is used to excite glycation end products produced by heat treatment of biological tissue, the imaging device has an imaging element, the imaging element generates an imaging signal by capturing fluorescence emitted by the excitation light, and the medical device has a processor that performs the following processing: acquiring a thermal denaturation image that at least includes a thermal denaturation area; determining a specific area included in the thermal denaturation image; setting an object range, i.e., a detection range, for detecting the thermal denaturation area within the thermal denaturation image based on the specific area; and outputting thermal denaturation information based on the detection range and the thermal denaturation area.

[0034] In the medical system according to the present disclosure, in the above disclosure, the imaging device is an endoscope.

[0035] In addition, the operating method of the medical device involved in the present disclosure is an operating method of a medical device equipped with a processor, wherein the processor performs the following processing: acquiring a thermal denaturation image including at least a thermal denaturation area; determining a specific area included in the thermal denaturation image; setting an object range, i.e., a detection range, for detecting the thermal denaturation area within the thermal denaturation image based on the specific area; and outputting thermal denaturation information based on the detection range and the thermal denaturation area.

[0036] In addition, the program involved in the present disclosure is a program executed by a medical device equipped with a processor, and the program causes the processor to perform the following processing: acquiring a thermal denaturation image including at least a thermal denaturation area; determining a specific area included in the thermal denaturation image; setting a target range, i.e., a detection range, within the thermal denaturation image for detecting the thermal denaturation area based on the specific area; and outputting thermal denaturation information based on the detection range and the thermal denaturation area.

[0037] Effects of the Invention

[0038] According to the present disclosure, it is possible to confirm the state of thermal denaturation corresponding to a specific region. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is a diagram showing a schematic configuration of an endoscope system according to the first embodiment.

[0040] Figure 2 This is a block diagram showing the functional configuration of the main parts of the endoscope system according to the first embodiment.

[0041] Figure 3This is a diagram schematically showing the wavelength characteristics of the excitation light emitted by the light source unit according to the second embodiment of the first embodiment.

[0042] Figure 4 This is a diagram schematically showing the structure of a pixel portion according to Embodiment 1.

[0043] Figure 5 This is a diagram schematically showing the structure of the color filter according to Embodiment 1.

[0044] Figure 6 This is a diagram schematically showing the sensitivity and wavelength range of each filter according to the first embodiment.

[0045] Figure 7A Schematically shows the signal value of the R pixel of the image sensor according to the first embodiment.

[0046] Figure 7B Schematically showing the signal values ​​of the G pixels of the image sensor according to the first embodiment.

[0047] Figure 7C This is a diagram schematically showing the signal value of the B pixel of the image sensor according to the first embodiment.

[0048] Figure 8 This is a diagram schematically showing the structure of the cut filter according to the first embodiment.

[0049] Figure 9 This is a diagram schematically showing the transmission characteristics of the cut filter according to the first embodiment.

[0050] Figure 10 This is a flowchart showing an overview of processing executed by the control device according to the first embodiment.

[0051] Figure 11 This is a diagram schematically showing a specific area in a white-light image specified by the specifying unit according to the first embodiment.

[0052] Figure 12 This is a diagram schematically showing the detection range set by the setting unit according to the first embodiment.

[0053] Figure 13 This is a diagram showing an example of a display image displayed by the display device according to the first embodiment.

[0054] Figure 14 This is a diagram showing an example of a display image displayed by the display device according to the first embodiment.

[0055] Figure 15 This is a diagram showing a schematic configuration of an endoscope system according to the second embodiment.

[0056] Figure 16 This is a block diagram showing the functional configuration of a medical device according to the second embodiment. DETAILED DESCRIPTION

[0057] The following is a method for implementing the present disclosure and the attached Figure 1 Detailed description will be given below. In addition, the present disclosure is not limited to the following embodiments. In addition, the figures referred to in the following description are merely schematic illustrations of shapes, sizes and positional relationships to the extent that the contents of the present disclosure can be understood. That is, the present disclosure is not limited to the shapes, sizes and positional relationships illustrated in the figures. Moreover, in the description of the drawings, the same parts are marked with the same figure numbers for description. In addition, as an example of the endoscope system involved in the present disclosure, an endoscope system including a rigid endoscope and a medical imaging device is described.

[0058] (Implementation 1)

[0059] [Structure of the endoscope system]

[0060] Figure 1 This is a diagram showing a schematic configuration of an endoscope system according to the first embodiment. Figure 1 The endoscope system 1 shown is a system used in the medical field to observe and treat biological tissues in a subject such as a living body. Figure 1The rigid endoscope system shown in FIG. 1 is a rigid endoscope system having a rigid endoscope (insertion portion 2), but the present invention is not limited thereto and may also include, for example, an endoscope system having a flexible endoscope. Furthermore, the endoscope system 1 can also be applied to a medical microscope or medical surgical robot system that includes a medical imaging device for imaging a subject and performs surgery or treatment while displaying an observation image based on an imaging signal (image data) captured by the medical imaging device on a display device. Furthermore, in recent years, minimally invasive treatments using endoscopes and laparoscopes have become widespread in the medical field. For example, as minimally invasive treatments using endoscopes and laparoscopy, endoscopic submucosal dissection (ESD), laparoscopic endoscopic combined gastrectomy (LECS), non-exposed endoscopic wall-inversion surgery (NEWS), and transurethral resection of the bladder tumor (TUR-bt) are widely performed. In these minimally invasive treatments, when performing treatments on living tissue, for example, doctors use treatment instruments that emit energy such as high-frequency waves, ultrasound waves, and microwaves to remove characteristic areas (pathogenic areas) of the lesion by cauterization or mark the characteristic areas (pathogenic areas) of the lesion by thermal treatment, thereby marking the surgical area as a preliminary treatment. In addition, in the case of actual treatment, the surgeon also uses energy devices to perform treatments such as excision and coagulation of the subject's biological tissue. Figure 1 The endoscope system 1 shown is used when performing surgery or treatment on a subject using a treatment instrument (not shown) such as an energy device capable of performing heat treatment. Figure 1 The endoscope system 1 shown is used for transurethral resection of bladder tumor (TUR-Bt), and is used when treating a tumor (bladder cancer) or a diseased area of ​​the bladder.

[0061] Figure 1 The illustrated endoscope system 1 includes an insertion portion 2 , a light source device 3 , a light guide 4 , an endoscopic camera head 5 (endoscopic imaging device), a first transmission cable 6 , a display device 7 , a second transmission cable 8 , a control device 9 , and a third transmission cable 10 .

[0062] The insertion portion 2 is rigid or at least partially flexible and has an elongated shape. The insertion portion 2 is inserted into a subject such as a patient via a cannula. The insertion portion 2 is internally provided with an optical system such as a lens for forming an observation image.

[0063] The light source device 3 is connected to one end of the light guide 4. Under the control of the control device 9, the light source device 3 supplies illumination light to the one end of the light guide 4 to irradiate the subject. The light source device 3 is implemented using the following components: any one or more light sources such as LED (Light Emitting Diode: Light Emitting Diode) light source, xenon lamp and LD (Laser Diode: Laser Diode) semiconductor laser element; a processor as a processing device having hardware such as FPGA (Field Programmable Gate Array: Field Programmable Gate Array), CPU (Central Processing Unit: Central Processing Unit); and a memory as a temporary storage area used by the processor. In addition, the light source device 3 and the control device 9 can be as follows: Figure 1 Although the structure is set as a structure in which communication is performed individually as shown, it can also be an integrated structure.

[0064] One end of the light guide 4 is detachably connected to the light source device 3 , and the other end is detachably connected to the insertion portion 2 . The light guide 4 guides illumination light supplied from the light source device 3 from one end to the other end, and supplies the illumination light to the insertion portion 2 .

[0065] The endoscope camera head 5 is detachably connected to the eyepiece portion 21 of the insertion portion 2. Under the control of the control device 9, the endoscope camera head 5 receives the observation image formed by the insertion portion 2 and performs photoelectric conversion to generate an imaging signal (RAW data). The imaging signal is output to the control device 9 via the first transmission cable 6.

[0066] One end of the first transmission cable 6 is detachably connected to the control device 9 via a video connector 61, and the other end is detachably connected to the endoscopic camera 5 via a camera connector 62. The first transmission cable 6 transmits the imaging signal output from the endoscopic camera 5 to the control device 9, and transmits setting data and power output from the control device 9 to the endoscopic camera 5. Here, the setting data refers to control signals, synchronization signals, clock signals, and the like for controlling the endoscopic camera 5.

[0067] The display device 7 displays an observation image based on an imaging signal processed by the control device 9 and various information related to the endoscope system 1 under the control of the control device 9. The display device 7 is implemented using a display monitor such as liquid crystal or organic EL (Electro Luminescence).

[0068] One end of the second transmission cable 8 is detachably connected to the display device 7 , and the other end is detachably connected to the control device 9 . The second transmission cable 8 transmits the image signal processed by the control device 9 to the display device 7 .

[0069] The control device 9 is implemented using the following components: a processor (including hardware such as a GPU (Graphics Processing Unit), FPGA, or CPU) as a processing device; and memory as a temporary storage area used by the processor. The control device 9 comprehensively controls the operation of the light source device 3, the endoscopic camera head 5, and the display device 7 via the first transmission cable 6, the second transmission cable 8, and the third transmission cable 10, in accordance with a program stored in the memory. Furthermore, the control device 9 performs various image processing on the imaging signal input via the first transmission cable 6 and outputs it to the second transmission cable 8.

[0070] One end of the third transmission cable 10 is detachably connected to the light source device 3 , and the other end is detachably connected to the control device 9 . The third transmission cable 10 transmits control data from the control device 9 to the light source device 3 .

[0071] [Functional structure of the main parts of the endoscope system]

[0072] Next, the functional configuration of the main parts of the endoscope system 1 will be described. Figure 2 1 is a block diagram showing the functional configuration of the main parts of the endoscope system 1 .

[0073] [Structure of the insertion part]

[0074] First, the structure of the insertion portion 2 will be described. The insertion portion 2 includes an optical system 22 and an illumination optical system 23 .

[0075] The optical system 22 forms an image of the subject by converging reflected light from the subject, return light from the subject, excitation light from the subject, and fluorescent light emitted from thermally denatured areas thermally denatured by heat treatment with an energy device, etc. The optical system 22 is implemented using one or more lenses, etc.

[0076] The illumination optical system 23 irradiates the subject with illumination light supplied from the light guide 4. The illumination optical system 23 is implemented using one or more lenses and the like.

[0077] [Structure of light source device]

[0078] Next, a description will be given of the configuration of the light source device 3 . The light source device 3 includes a condenser lens 30 , a first light source unit 31 , a second light source unit 32 , and a light source control unit 33 .

[0079] The condenser lens 30 condenses the light emitted by each of the first light source unit 31 and the second light source unit 32 and emits the light toward the light guide 4 .

[0080] Under the control of the light source control unit 33, the first light source unit 31 emits white light (normal light) as visible light, thereby supplying white light as illumination light to the light guide 4. The first light source unit 31 is constructed using a collimating lens, a white LED lamp, and a driver. Alternatively, the first light source unit 31 can simultaneously emit red, green, and blue LED lamps to supply visible white light. Of course, the first light source unit 31 can also be constructed using a halogen lamp, a xenon lamp, or the like.

[0081] Under the control of the light source control unit 33, the second light source unit 32 emits excitation light within a predetermined wavelength range, which is supplied as illumination light to the light guide 4. The excitation light has a wavelength range of 400 nm to 430 nm (with a center wavelength of 415 nm). The second light source unit 32 is implemented using a collimating lens, a semiconductor laser such as a violet laser diode (LD), and a driver. Furthermore, in the first embodiment, the excitation light excites advanced glycation end products (AGEs) produced by heat treatment of biological tissue using an energy device or the like. Furthermore, when amino acids and reducing sugars are heated, a glycation reaction (Maillard reaction) occurs. The end products produced as a result of this Maillard reaction are collectively referred to as advanced glycation end products (AGEs). AGEs are known to contain substances with fluorescent properties. Specifically, AGEs are generated when biological tissue is heat treated using an energy device, where amino acids and reducing sugars in the tissue are heated and undergo a Maillard reaction. The AGEs generated by this heating can be visualized through fluorescence observation, allowing the state of heat treatment to be visualized. Furthermore, AGEs are known to emit stronger fluorescence than the autofluorescent substances naturally present in living tissue. Specifically, in Embodiment 1, the fluorescent properties of AGEs generated in living tissue by heat treatment with an energy device, etc., are utilized to visualize the thermally denatured areas caused by the heat treatment. Therefore, in Embodiment 1, the second light source unit 32 irradiates the living tissue with excitation light of blue light having a wavelength of approximately 415 nm, which excites AGEs. Thus, Embodiment 1 enables observation of a fluorescence image (thermal denaturation image) based on an imaging signal obtained by capturing fluorescence (e.g., green light with a wavelength of 490 nm to 625 nm) emitted from the thermally denatured areas by AGEs.

[0082] The light source control unit 33 is implemented using a processor having hardware such as an FPGA or a CPU, and a memory serving as a temporary storage area used by the processor. The light source control unit 33 controls the light emission timing and light emission duration of each of the first light source unit 31 and the second light source unit 32 based on control data input from the control device 9.

[0083] Here, the wavelength characteristics of the light emitted by the second light source unit 32 will be described. Figure 3 Schematically shows the wavelength characteristics of the excitation light emitted by the second light source unit 32. Figure 3 In the figure, the horizontal axis represents wavelength (nm) and the vertical axis represents wavelength characteristics. Figure 3 In the middle, the broken line L V represents the wavelength characteristics of the excitation light emitted by the second light source unit 32. Figure 3 In the middle, curve L B Indicates the wavelength range of blue, curve L G Indicates the wavelength range of green, curve L R Indicates the wavelength range of red.

[0084] like Figure 3 The broken line L V As shown, the second light source unit 32 emits excitation light having a central wavelength (peak wavelength) of 415 nm and a wavelength range of 400 nm to 430 nm.

[0085] [Structure of endoscope camera]

[0086] return Figure 2 , the structure of the endoscope system 1 is further described.

[0087] Next, the configuration of the endoscopic camera head 5 will be described. The endoscopic camera head 5 includes an optical system 51, a drive unit 52, an imaging element 53, a cut filter 54, an A / D converter 55, a P / S converter 56, an imaging and recording unit 57, and an imaging control unit 58.

[0088] The optical system 51 forms an image of the subject, focused by the optical system 22 of the insertion portion 2, onto the light-receiving surface of the imaging element 53. The optical system 51 is capable of changing the focal length and focus position. The optical system 51 is constructed using a plurality of lenses 511. The optical system 51 changes the focal length and focus position by moving each of the plurality of lenses 511 along the optical axis L1 via the drive unit 52.

[0089] The drive unit 52 moves the multiple lenses 511 of the optical system 51 along the optical axis L1 under the control of the imaging control unit 58. The drive unit 52 is configured using a motor such as a stepping motor, a DC motor, or a voice coil motor, and a transmission mechanism such as gears that transmits the motor's rotation to the optical system 51.

[0090] The imaging element 53 is implemented using a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) image sensor having a plurality of pixels arranged in a two-dimensional matrix. Under the control of the imaging control unit 58, the imaging element 53 receives the subject image (light) formed by the optical system 51 and passed through the cut filter 54, performs photoelectric conversion on the image, generates an imaging signal (RAW data), and outputs it to the A / D converter 55. The imaging element 53 includes a pixel unit 531 and a color filter 532.

[0091] Figure 4 Schematic diagram showing the structure of the pixel portion 531. Figure 4 As shown, the pixel portion 531 is composed of a plurality of pixels P such as photodiodes that store charges according to the amount of light. nm (n=integer greater than or equal to 1, m=integer greater than or equal to 1) are arranged in a two-dimensional matrix. The pixel unit 531 is controlled by the imaging control unit 58 to obtain a plurality of pixels P nm The pixel P in the reading area arbitrarily set as the reading object nm The image signal is read as image data and output to the A / D conversion unit 55 .

[0092] Figure 5 Schematically shows the structure of the color filter 532. Figure 5 As shown, the color filter 532 is formed of a Bayer array with 2×2 units. The color filter 532 is composed of a filter R that transmits light in the red wavelength range, two filters G that transmit light in the green wavelength range, and a filter B that transmits light in the blue wavelength range.

[0093] Figure 6 is a diagram schematically showing the sensitivity and wavelength range of each filter. Figure 6 In the figure, the horizontal axis represents wavelength (nm) and the vertical axis represents transmission characteristics (sensitivity characteristics). Figure 6 In the middle, curve L B Indicates the transmission characteristics of filter B, curve L G Indicates the transmission characteristics of filter G, curve L R Indicates the transmission characteristics of filter R.

[0094] like Figure 6 The curve L B As shown in FIG, filter B transmits light in the blue wavelength range. Figure 6 The curve L GAs shown in FIG, the filter G transmits light in the green wavelength range. Figure 6 The curve L R As shown, the filter R transmits light in the red wavelength range. In the following, the filter R is arranged on the light receiving surface to form a pixel P. nm The pixel P is formed by placing the filter G on the light receiving surface. nm The pixel P is formed by placing the filter B on the light receiving surface. nm This will be described as a B pixel.

[0095] According to the imaging element 53 configured in this manner, when receiving the subject image formed by the optical system 51, Figures 7A to 7C As shown, color signals (R signal, G signal, and B signal) are generated for each of the R pixel, the G pixel, and the B pixel.

[0096] return Figure 2 , the structure of the endoscope system 1 is further described.

[0097] The cutoff filter 54 is disposed on the optical axis L1 between the optical system 51 and the imaging element 53. The cutoff filter 54 is provided on the light-receiving surface side (incident surface side) of at least the G pixel of the color filter 532, which is provided with the filter G that transmits the green wavelength range. The cutoff filter 54 blocks light in the short wavelength range including the wavelength range of the excitation light, and transmits light in the long wavelength range that is longer than the wavelength range of the excitation light.

[0098] Figure 8 Schematically shows the structure of the cut filter 54. Figure 8 As shown, the filter F constituting the cutoff filter 54 11 Configured on filter G 11 (Refer to Figure 5 ) is configured at a position where the filter G 11 The light-receiving side directly above the .

[0099] Figure 9 is a diagram schematically showing the transmission characteristics of the cut filter 54. Figure 8 In the figure, the horizontal axis represents wavelength (nm) and the vertical axis represents transmittance. Figure 8 In the middle, the broken line L F The transmission characteristics of the cut filter 54 are shown in FIG. NG The wavelength characteristic of fluorescence is shown in the broken line L. V Indicates the wavelength characteristics of the excitation light.

[0100] like Figure 9As shown, the cutoff filter 54 blocks light in the wavelength range of the excitation light and transmits light in a wavelength range longer than the wavelength range of the excitation light. Specifically, the cutoff filter 54 blocks light in a wavelength range shorter than the wavelength range of 400 nm to 430 nm, which includes the excitation light, and transmits light in a wavelength range longer than the wavelength range of 400 nm to 430 nm, which includes the excitation light.

[0101] return Figure 2 , continue to explain the structure of the endoscope camera 5.

[0102] Under the control of the imaging control unit 58, the A / D converter 55 performs A / D conversion processing on the analog imaging signal input from the imaging element 53 and outputs the resulting signal to the P / S converter 56. The A / D converter 55 is implemented using an A / D conversion circuit or the like.

[0103] Under the control of the camera control unit 58, the P / S converter 56 performs parallel / serial conversion on the digital camera signal input from the A / D converter 55, and outputs the parallel / serial converted camera signal to the control device 9 via the first transmission cable 6. The P / S converter 56 is implemented using a P / S conversion circuit, etc. In the first embodiment, an E / O converter that converts the camera signal into an optical signal may be provided in place of the P / S converter 56, and the camera signal may be output to the control device 9 via an optical signal. Alternatively, the camera signal may be transmitted to the control device 9 via wireless communication such as Wi-Fi (Wireless Fidelity) (registered trademark).

[0104] The image recording unit 57 records various information related to the endoscopic camera head 5 (e.g., pixel information of the image sensor 53 and characteristics of the cutoff filter 54). Furthermore, the image recording unit 57 records various setting data and control parameters transmitted from the control device 9 via the first transmission cable 6. The image recording unit 57 is configured using a nonvolatile memory or a volatile memory.

[0105] The imaging control unit 58 controls the operation of the drive unit 52, the imaging element 53, the A / D converter 55, and the P / S converter 56 based on the setting data received from the control device 9 via the first transmission cable 6. The imaging control unit 58 is implemented using the following components: a TG (Timing Generator); a processor including hardware such as an ASIC (Application Specific Integrated Circuit) or a CPU; and a memory serving as a temporary storage area used by the processor.

[0106] [Structure of control device]

[0107] Next, the configuration of the control device 9 will be described.

[0108] The control device 9 includes an S / P conversion unit 91 , an image processing unit 92 , an input unit 93 , a recording unit 94 , and a control unit 96 .

[0109] Under the control of the control unit 96, the S / P converter 91 performs serial / parallel conversion on the image data received from the endoscopic camera 5 via the first transmission cable 6 and outputs the data to the image processing unit 92. Furthermore, if the endoscopic camera 5 outputs the imaging signal via an optical signal, an O / E converter that converts the optical signal into an electrical signal may be provided in place of the S / P converter 91. Furthermore, if the endoscopic camera 5 transmits the imaging signal via wireless communication, a communication module capable of receiving wireless signals may be provided in place of the S / P converter 91.

[0110] Under the control of the control unit 96, the image processing unit 92 performs predetermined image processing on the parallel data imaging signal input from the S / P conversion unit 91 and outputs the image to the display device 7. The predetermined image processing herein includes processing such as demosaicing, white balance, gain adjustment, gamma correction, and format conversion. The image processing unit 92 is implemented using a processor as a processing device, including hardware such as a GPU or FPGA, and a memory as a temporary storage area used by the processor.

[0111] The input unit 93 receives input of various operations related to the endoscope system 1 and outputs the received operations to the control unit 96. The input unit 93 is configured using a mouse, a foot switch, a keyboard, buttons, switches, a touch panel, and the like.

[0112] The recording unit 94 is implemented using a recording medium such as a volatile memory, a nonvolatile memory, an SSD (Solid State Drive), an HDD (Hard Disk Drive), or a memory card. The recording unit 94 records data including various parameters required for the operation of the endoscope system 1. The recording unit 94 also includes a program recording unit 941 for recording various programs used to operate the endoscope system 1.

[0113] The output unit 95 outputs various information under the control of the control unit 96. The output unit 95 is configured using, for example, a speaker and a display panel.

[0114] The control unit 96 is implemented using a processor comprising hardware such as an FPGA or CPU, and a memory serving as a temporary storage area for the processor. The control unit 96 comprehensively controls the various components that comprise the endoscope system 1. Specifically, the control unit 96 reads the program recorded in the program recording unit 941 into the working area of ​​the memory and executes it. The processor executes the program to control the various components, thereby enabling the hardware and software to collaborate and implement functional modules that meet the prescribed objectives. Specifically, the control unit 96 includes an acquisition unit 961, a generation unit 962, a determination unit 963, a setting unit 964, a determination unit 965, an output control unit 966, and a learning unit 967.

[0115] The acquisition unit 961 acquires an imaging signal generated by the endoscopic camera 5 through the insertion portion 2 .

[0116] The generation unit 962 generates a white light image based on the imaging signal acquired by the acquisition unit 961. The generation unit 962 performs demosaicing, white balance, gain adjustment, and gamma correction on the imaging signal acquired by the acquisition unit 961 to generate the white light image.

[0117] The determination unit 963 determines the specific area based on the white-light image generated by the generation unit 962. The determination unit 963 determines the specific area A1 based on the white-light image P1 using a known technique such as pattern matching.

[0118] The setting unit 964 sets a circle having a predetermined radius centered on the specific area A1 identified by the identification unit 963 as the detection range.

[0119] The determination unit 965 determines whether a fluorescent area having a fluorescence amount exceeding that recognized as thermal denaturation has occurred in the fluorescent image.

[0120] The output control unit 966 outputs information indicating that the light-emitting area is within the detection range R1 to the display device 7 .

[0121] Alternatively, the learning unit 967 generates a learned model by performing machine learning using training data, wherein the training data includes a fluorescence image obtained by irradiating excitation light onto biological tissue and capturing fluorescence, and a white light image obtained by irradiating white light onto biological tissue and capturing the white light, as input data, and information representing the relationship between a thermally denatured area extracted from the fluorescence image and the position (coordinates) of an organ or an entrance and exit of an organ in a specific area determined based on the white light image as output data.

[0122] Here, the learned model is composed of a neural network with one or more nodes in each layer. The type of machine learning is not particularly limited. For example, training data and learning data are prepared that correspond to multiple fluorescence images and multiple white-light images of subjects, and the locations of organs or organ entrances and exits in specific regions determined based on these multiple fluorescence images and multiple white-light images. This training data and learning data can then be input into a computational model based on a multi-layer neural network for learning.

[0123] Furthermore, as a machine learning technique, a technique based on a multilayer neural network such as CNN (Convolutional Neural Network) or 3D-CNN (Deep Neural Network) is used.

[0124] Furthermore, as a machine learning technique, techniques based on recurrent neural networks (RNNs) or LSTMs (Long Short-Term Memory units), which are an extension of RNNs, may also be used. Furthermore, a learning unit of a learning device separate from the control device 4 may perform these functions to generate a learned model. Of course, the functions of the learning unit 967 may also be provided within the image processing unit 92.

[0125] 〔Control device processing〕

[0126] Next, the processing executed by the control device 9 will be described. Figure 10 It is a flowchart showing an outline of the processing executed by the control device 9 .

[0127] First, if Figure 10 As shown, the control unit 96 causes the first light source unit 31 of the light source device 3 to emit light to supply white light to the insertion portion 2 , thereby irradiating the living tissue with the white light (step S101 ).

[0128] Next, the acquisition unit 961 acquires an imaging signal generated by the endoscope camera 5 through the insertion portion 2 (step S102 ).

[0129] Next, the generation unit 962 generates a white-light image based on the imaging signal acquired by the acquisition unit 961 (step S103). Specifically, the generation unit 962 performs demosaicing, white balance, gain adjustment, and gamma correction on the imaging signal acquired by the acquisition unit 961 to generate the white-light image. While the generation unit 962 generates the white-light image based on the imaging signal acquired by the acquisition unit 961, this is not limiting. The generation unit 962 may also acquire the white-light image generated by the image processing unit 92.

[0130] Next, the identification unit 963 identifies the specific area based on the white-light image generated by the generation unit 962 (step S104 ).

[0131] Figure 11 Schematically shows a specific area in the white light image determined by the determination unit 963. Figure 11 As shown, the identification unit 963 uses known techniques such as pattern matching to identify specific areas A1 based on the white-light image P1. Here, specific areas refer to the entrances and exits of organs such as the ureteral orifice, cardia, pylorus, pancreatic duct, and bile duct, as well as specified organs. Specifically, the identification unit 963 performs known pattern matching on the white-light image P1 using pre-set patterns for each organ to identify the specific areas A1.

[0132] In Embodiment 1, the case where the specific area A1 of the white-light image P1 is the urinary tract orifice is described. Alternatively, the determination unit 963 may use the results of machine learning (a learned model) such as deep learning, performed on training data that associates multiple white-light images P1 with annotation information regarding the region (position information) and category of the organ contained in each of the multiple white-light images P1. In this case, the determination unit 963 may use the white-light image P1 as input data and the category and region (organ position information) of the organ contained in the white-light image P1 as output data, outputting the specific area A1.

[0133] Furthermore, the identification unit 963 may perform any of edge detection processing, blob analysis processing, and binarization processing on the pixel value of each pixel constituting the white-light image P1 to identify the specific area A1 in the white-light image P1 .

[0134] return Figure 10 In step S105 , the setting unit 964 sets a circle having a predetermined radius centered on the specific area A1 identified by the identification unit 963 as the detection range.

[0135] Figure 12 Schematically shows the detection range set by the setting unit 964. Figure 12As shown, the setting unit 964 sets a detection range R1 for detecting the thermally denatured region within the white-light image P1 (thermal denaturation image) based on the specific region identified by the identification unit 963. Specifically, the setting unit 964 sets a circle having a predetermined radius D1 centered on the specific region A1 identified by the identification unit 963 as the detection range. In this case, the setting unit 964 sets the length of the radius D1 based on at least one of the type and size of the organ in the specific region A1 identified by the identification unit 963.

[0136] In addition, Figure 12 In the example, the setting unit 964 sets the shape of the detection range to a circle, but the shape is not limited to this and can be modified as appropriate. For example, it can also be a polygon, a quadrilateral, or a pentagon. Alternatively, the setting unit 964 can set a circle centered on the specific area A1 and having a radius specified by the user input through the input unit 93 as the detection range R1.

[0137] return Figure 10 In step S106 , the control unit 96 causes the second light source unit 32 of the light source device 3 to emit light to supply the excitation light to the insertion portion 2 , thereby irradiating the excitation light toward the living tissue.

[0138] Next, the acquisition unit 961 acquires an imaging signal generated by the endoscope camera 5 through the insertion portion 2 (step S107 ).

[0139] Thereafter, the generating unit 962 generates a fluorescent image as a thermally denatured image including at least the thermally denatured region based on the imaging signal acquired by the acquiring unit 961 (step S108 ).

[0140] The determination unit 965 determines whether a fluorescent area exists in the fluorescence image at an amount greater than that considered to be thermal denaturation (step S109). Specifically, the determination unit 965 determines whether the pixel value (brightness value) of each pixel constituting the fluorescence image is greater than the amount (brightness value) considered to be thermal denaturation for each pixel or for each predetermined number of pixels. If the number of pixels with pixel values ​​(brightness values) greater than the amount (brightness value) considered to be thermal denaturation is greater than the predetermined number, the determination unit 965 determines that a fluorescent area exists in the fluorescence image. On the other hand, if the number of pixels with pixel values ​​(brightness values) greater than the amount (brightness value) considered to be thermal denaturation is less than the predetermined number, the determination unit 965 determines that no fluorescent area exists in the fluorescence image. If the determination unit 965 determines that a fluorescent area exists in the fluorescence image at an amount greater than that considered to be thermal denaturation (step S109: "YES"), the control device 9 proceeds to step S110, described later. In contrast, when the determination unit 965 determines that no fluorescent region having a fluorescence amount greater than that recognized as thermal denaturation occurs in the fluorescent image (step S109 : No), the control device 9 proceeds to step S115 described later.

[0141] In step S110, the determination unit 965 determines whether the fluorescence area is within the detection range R1 set by the setting unit 964. If the determination unit 965 determines that the fluorescence area is within the detection range R1 set by the setting unit 964 (step S110: "Yes"), the control device 9 proceeds to step S111, which will be described later. In contrast, if the determination unit 965 determines that the fluorescence area is not within the detection range R1 set by the setting unit 964 (step S110: "No"), the control device 9 proceeds to step S113, which will be described later.

[0142] In step S111, the output control unit 966 outputs information indicating that the light-emitting area is within the detection range R1 to the display device 7. In this case, the output control unit 966 outputs text data as the information indicating that the light-emitting area is within the detection range R1 to the display device 7. Alternatively, the output control unit 966 may output an output signal causing the display device 7 to output sound as the information indicating that the light-emitting area is within the detection range R1 to the display device 7.

[0143] Next, the output control unit 966 causes the image processing unit 92 to superimpose the light-emitting area within the detection range R1 on the white-light image P1 so as to be distinguishable from other light-emitting areas, and output the superimposed image to the display device 7 (step S112 ).

[0144] Figure 13 : is a diagram showing an example of a display image displayed by the display device 7. Figure 13As shown, the output control unit 966 outputs a display image P2 to the display device 7. This display image P2 is an image that is superimposed on the white light image P1 after the image processing unit 92 has emphasized the luminous region W1 within the detection range R1 in a manner that allows it to be distinguished from other luminous regions. Specifically, the output control unit 966 outputs the following display image P2 to the display device 7: This display image P2 is an image that is superimposed on the white light image P1 after the image processing unit 92 has converted the color of the luminous region W1, which is a thermally denatured region within the detection range R1, to an emphasized color, such as red, blue, or black. In this case, the output control unit 966 may also change the emphasized color in steps according to the luminous intensity of the luminous region W1, or may change the saturation, brightness, etc. before superimposing it on the white light image P1. Of course, the output control unit 966 may output to the display device 7 a display image P2 in which a portion of the light-emitting region W1, for example, only the outline of the light-emitting region W1, is recognizable and superimposed on the white-light image P1. Alternatively, the output control unit 966 may output to the display device 7 a display image P2 in which a color pre-specified by the user is recognizable and superimposed on the white-light image P1. This allows the user to intuitively understand that the light-emitting region W1 is included in the detection range R1. After step S112, the control device 9 proceeds to step S115, which will be described later.

[0145] In step S113 , the output control unit 966 causes the image processing unit 92 to superimpose the light-emitting area on the white-light image P1 and output the result to the display device 7 .

[0146] Figure 14 : is a diagram showing an example of a display image displayed by the display device 7. Figure 14 As shown, the output control unit 966 causes the image processing unit 92 to output the display image P3, which is a superposition of the light-emitting area W2 and the white-light image P1, to the display device 7. This allows the user to intuitively grasp the position of the light-emitting area W2. After step S113, the control device 9 proceeds to step S115, which will be described later.

[0147] In step S114, the output control unit 966 causes the image processing unit 92 to output the white-light image P1 to the display device 7. After step S114, the control device 9 proceeds to step S115 described later.

[0148] In step S115, the determination unit 965 determines whether a termination signal for terminating observation of the subject by the endoscope system 1 has been input from the input unit 93. If the determination unit 965 determines that a termination signal for terminating observation of the subject by the endoscope system 1 has been input from the input unit 93 (step S115: "Yes"), the control device 9 terminates this processing. In contrast, if the determination unit 965 determines that a termination signal for terminating observation of the subject by the endoscope system 1 has not been input from the input unit 93 (step S115: "No"), the control device 9 returns to step S101 described above.

[0149] According to the first embodiment described above, the output control unit 966 outputs thermal denaturation information to the display device 7 or the output unit 95 based on the detection range set by the setting unit 964 and the thermal denaturation area within the white light image as the thermal denaturation image acquired by the acquisition unit 961. This allows the user to confirm the state of thermal denaturation in a specific area.

[0150] Furthermore, according to the first embodiment, when the output control unit 966 determines that the detection range includes a fluorescent region that is a thermally denatured region through the determination unit 965, the thermal denaturation information is output to the output unit 95 or the display device 7. This allows the user to understand that a specific area includes a thermally denatured region.

[0151] Furthermore, according to Embodiment 1, the output control unit 966 outputs a display image P2 to the display device 7. This display image P2 is an image obtained by causing the image processing unit 92 to emphasize the luminous region W1 within the detection range R1 so that it can be distinguished from other luminous regions and superimpose it on the white light image P1. This allows the user to intuitively understand the luminous region W1 within the detection range R1.

[0152] Furthermore, according to the first embodiment, the determination unit 965 determines whether a thermally denatured region due to heat treatment has occurred based on the signal value of each pixel in the fluorescence image. This allows for determination to be made in a manner that distinguishes it from fluorescence of autofluorescent substances originally present in biological tissue.

[0153] Furthermore, according to the first embodiment, the identification unit 963 identifies the specific region including the organ and the like based on the feature amount in the white-light image. Therefore, the specific region can be easily identified from the white-light image.

[0154] Furthermore, according to the first embodiment, since the setting unit 964 sets the detection range based on the type of the specific area, it is possible to automatically set the optimal detection range according to the specific area.

[0155] In addition, in embodiment 1, the determination unit 963 determines the specific area based on the feature value in the white light image, but is not limited to this. For example, the specific area in the white light image may be determined based on an instruction signal input by the user through the operation input unit 93.

[0156] In the first embodiment, the setting unit 964 sets the detection range based on the type of the specific area, but the present invention is not limited thereto. For example, the detection range may be set based on an instruction signal input by the user through the operation input unit 93. In this way, the detection range can be set to a range desired by the user.

[0157] In addition, in embodiment 1, the setting unit 964 may set the detection range based on the category of the specific area and the distance from the front end of the insertion portion 2 to the specific area. In this case, the setting unit 964 calculates the distance from the front end of the insertion portion 2 to the specific area based on one white light image or two white light images that are continuous in time, and sets the detection range based on the calculation result and the category of the specific area. Thus, it is possible to set a detection range suitable for the surgery currently being performed. In addition, the setting unit 964 uses the white light image to calculate the distance from the front end to the specific area, but is not limited to this. For example, a distance sensor or a distance measuring sensor may be provided at the front end of the insertion portion 2, and the distance from the front end to the specific area may be calculated based on the detection results of these sensors.

[0158] In addition, in embodiment 1, the recording unit 94 may record distance information that establishes a correspondence between the category of the specific area and the distance of the detection range, and the setting unit 964 may obtain the distance information from the recording unit 94 and set the detection range based on the distance information and the category of the specific area determined by the determination unit 963.

[0159] Furthermore, in the first embodiment, the output control unit 966 causes the image processing unit 92 to output the display image P2, which is a superimposition of the light-emitting area W1 within the detection range R1 on the white-light image P1 in a manner distinguishable from other light-emitting areas, to the display device 7. However, the present invention is not limited to this. The detection range R1 set by the setting unit 964 may be superimposed on the fluorescent image W1, which is a thermal denaturation image, and then output to the display device 7. This allows the user to intuitively grasp the detection range R1 in the fluorescent image W1.

[0160] In addition, in embodiment 1, the learning unit 967 is provided in the control device 4, but it is not limited to this. The learning unit 967 that generates the learned model can also be provided in a device different from the control device 4, such as a learning device or a server that can be connected via a network.

[0161] (Implementation Method 2)

[0162] Next, Embodiment 2 will be described. In Embodiment 1, the control unit 96 of the control device 9 determines whether a fluorescent area exists within the detection range and outputs the determination result to the display device 7. However, in Embodiment 2, a separate medical device is provided to determine whether a fluorescent area exists within the detection range. The configuration of the endoscope system according to Embodiment 2 will be described below. Components identical to those of the endoscope system 1 according to Embodiment 1 are denoted by the same reference numerals, and detailed descriptions will be omitted.

[0163] [Structure of the endoscope system]

[0164] Figure 15 This is a diagram showing a schematic configuration of an endoscope system according to the second embodiment. Figure 15 The illustrated endoscope system 1A includes a control device 9A instead of the control device 9 of the endoscope system 1 according to Embodiment 1. In addition to the configuration of the endoscope system 1 according to Embodiment 1, the endoscope system 1A further includes a medical device 11 and a fourth transmission cable 12.

[0165] The control device 9A is implemented using the following components: a processor comprising hardware such as a GPU, FPGA, or CPU as a processing device; and a memory serving as a temporary storage area used by the processor. The control device 9A comprehensively controls the operation of the light source device 3, the endoscopic camera head 5, the display device 7, and the medical device 11 via each of the first transmission cable 6, the second transmission cable 8, the third transmission cable 10, and the fourth transmission cable 12, in accordance with a program stored in the memory. The control device 9A omits the functions of the acquisition unit 961, the generation unit 962, the determination unit 963, the setting unit 964, the determination unit 965, the output control unit 966, and the learning unit 967 from the control unit 96 of the first embodiment described above.

[0166] The medical device 11 is implemented using the following components: a processor (e.g., a GPU, FPGA, or CPU) serving as a processing device; and a memory (e.g., a temporary storage area) used by the processor. The medical device 11 receives various information from the control device 9A via a fourth transmission cable 12 and outputs the received information to the control device 9A. The detailed functional structure of the medical device 11 will be described later.

[0167] One end of the fourth transmission cable 12 is detachably connected to the control device 9A, and the other end is detachably connected to the medical device 11. The fourth transmission cable 12 transmits various information from the control device 9A to the medical device 11, and transmits various information from the medical device 11 to the control device 9A.

[0168] [Functional structure of medical devices]

[0169] Figure 16 1 is a block diagram showing the functional configuration of the medical device 11 . Figure 16 The illustrated medical device 11 includes a communication I / F 111 , an input unit 112 , a recording unit 113 , and a control unit 114 .

[0170] The communication I / F 111 is an interface for communicating with the control device 9A via the fourth transmission cable 12. The communication I / F 111 receives various information from the control device 9A according to a predetermined communication standard and outputs the received information to the control unit 114.

[0171] The input unit 112 receives input of various operations related to the endoscope system 1A and outputs the received operations to the control unit 114. The input unit 112 is configured using a mouse, a foot switch, a keyboard, buttons, switches, a touch panel, and the like.

[0172] The recording unit 113 is implemented using a recording medium such as a volatile memory, a nonvolatile memory, an SSD, an HDD, or a memory card. The recording unit 113 records data including various parameters required for the operation of the medical device 11. The recording unit 113 also includes a program recording unit 113a that records various programs for operating the medical device 11.

[0173] The control unit 114 is implemented using a processor comprising hardware such as an FPGA or CPU, and a memory serving as a temporary storage area for the processor. The control unit 114 comprehensively controls the various components comprising the medical device 11. The control unit 114 has the same functions as the control unit 96 described in the first embodiment. Specifically, the control unit 114 includes a generation unit 962, a determination unit 963, a setting unit 964, a determination unit 965, an output control unit 966, and a learning unit 967.

[0174] The medical device 11 thus configured performs the same processing as the control device 9 according to the first embodiment described above, and outputs the processing results to the control device 9A. In this case, based on the processing results of the medical device 11, the control device 9A causes the image processing unit 92 to output a display image corresponding to the presence or absence of a light-emitting area within the detection range R1 of the white-light image generated by the image processing unit 92, and causes the display device 7 to display the display image.

[0175] According to the second embodiment described above, the same effects as those of the first embodiment are achieved, and the user can confirm the state of thermal denaturation in a specific area.

[0176] (Other embodiments)

[0177] By appropriately combining the multiple components disclosed in the endoscope systems according to the first and second embodiments of the present disclosure, various inventions can be formed. For example, some components may be deleted from all the components described in the endoscope systems according to the embodiments of the present disclosure. Furthermore, the components described in the endoscope systems according to the embodiments of the present disclosure may be appropriately combined.

[0178] Furthermore, in the endoscope systems according to the first and second embodiments of the present disclosure, the systems are connected to each other by wires, but they may be connected wirelessly via a network.

[0179] In the first and second embodiments of the present disclosure, the functions of the control unit, the generating unit 962, the determining unit 963, the setting unit 964, the judging unit 965, and the functional modules of the output control unit 966 included in the endoscope system may be provided on a server etc. which can be connected via a network. Of course, a server may be provided for each functional module.

[0180] Furthermore, in Embodiments 1 and 2 of the present disclosure, an example of application to transurethral bladder tumor resection has been described, but the present invention is not limited thereto and can be applied to various surgeries for resecting lesions using energy devices or the like, for example.

[0181] In the endoscope systems according to the first and second embodiments of the present disclosure, the aforementioned “units” can be replaced by “units” or “circuits”, etc. For example, the control unit can be replaced by a control unit or a control circuit.

[0182] Furthermore, although expressions such as "first," "afterwards," and "next" are used in the descriptions of the flowcharts in this specification to clarify the sequential relationship between the processes in the steps, the order of the processes required to implement the present invention is not solely defined by these expressions. In other words, the order of the processes in the flowcharts described in this specification can be changed within a range consistent with the order in which they are performed.

[0183] While several embodiments of the present application have been described in detail above based on the drawings, these are merely examples and the present invention can be implemented in other ways that are variously modified and improved based on the knowledge of those skilled in the art, represented by the methods described in the columns of this disclosure.

[0184] Description of Reference Numerals

[0185] 1. 1A: Endoscope system; 2. Insertion unit; 3. Light source device; 4. Light guide; 5. Endoscope camera head; 6. First transmission cable; 7. Display device; 8. Second transmission cable; 9. 9A: Control device; 10. Third transmission cable; 11. Medical device; 12. Fourth transmission cable; 21. Eyepiece unit; 22. Optical system; 23. Illumination optical system; 30. Converging lens; 31. First light source unit; 32. Second light source unit; 33. Light source control unit; 51. Optical system; 52. Drive unit; 53. Image sensor; 54. Cutoff filter; 55. A / D converter; 56. P / S converter; 57. Image recording unit; 58. Image control unit. 61: Video connector; 62: Camera connector; 91: S / P conversion unit; 92: Image processing unit; 93, 112: Input unit; 94, 113: Recording unit; 95: Output unit; 96, 114: Control unit; 111: Communication I / F; 113a, 941: Program recording unit; 511: Lens; 531: Pixel unit; 532: Color filter; 961: Acquisition unit; 962: Generation unit; 963: Determination unit; 964: Setting unit; 965: Judgment unit; 966: Output control unit; 967: Learning unit; A1: Specific area; W1, W2: Luminous area; P1: White light image; P2, P3: Display image; R1: Detection range.

Claims

1. A medical device comprising a processor, wherein: The processor performs the following processing: acquiring a thermal denaturation image including at least a thermally denatured region; determining a specific area included in the thermal denaturation image; setting a detection range, which is a target range for detecting a thermal denaturation region in the thermal denaturation image, based on the specific region; and Thermal denaturation information is output based on the detection range and the thermal denaturation region.

2. The medical device according to claim 1, wherein The processor performs the following processing: determining whether the thermally denatured region is included in the detection range; and When the thermal denaturation region is included in the detection range, the thermal denaturation information is output.

3. The medical device according to claim 2, wherein: When the detection range includes the thermally denatured region, the processor emphasizes the thermally denatured region and outputs the result, compared to when the detection range does not include the thermally denatured region.

4. The medical device according to claim 2, wherein: The processor outputs the thermally denatured region included in the detection range and the thermally denatured region not included in the detection range in a manner that allows them to be distinguished from each other.

5. The medical device according to claim 1, wherein The processor performs the following processing: acquiring an imaging signal generated by an imaging device; and The thermal denaturation image is generated based on the imaging signal.

6. The medical device according to claim 5, wherein The thermal denaturation image is a fluorescent image.

7. The medical device according to claim 6, wherein: The processor generates the fluorescence image based on the imaging signal generated by the imaging device capturing fluorescence emitted from the thermally denatured region when excitation light is irradiated onto living tissue.

8. The medical device according to claim 7, wherein: The fluorescence is emitted from advanced glycation end products produced by heat treatment of the biological tissue.

9. The medical device according to claim 6, wherein: The processor determines whether the thermally denatured region has occurred based on a signal value of each pixel in the fluorescent image.

10. The medical device according to claim 1, wherein The processor performs the following processing: acquiring an imaging signal generated by an imaging device; and A white light image is generated based on the imaging signal.

11. The medical device according to claim 10, wherein: The processor determines the specific area based on the white light image.

12. The medical device according to claim 11, wherein The processor determines the specific area based on a feature amount in the white light image.

13. The medical device according to claim 11, wherein The processor determines the specific area based on an instruction signal input from the outside.

14. The medical device according to claim 1, wherein The processor superimposes the detection range on the thermal denaturation image and outputs the result to a display device.

15. The medical device according to claim 14, wherein The processor sets the detection range based on the category of the specific area.

16. The medical device according to claim 14, wherein The processor sets the detection range based on an instruction signal input from the outside.

17. The medical device according to claim 14, wherein The processor sets the detection range based on the type of the specific area and the distance from the front end of the imaging device to the specific area.

18. The medical device according to claim 17, wherein: The processor performs the following processing: acquiring the distance information from a memory recording distance information in which the category of the specific area and the distance of the detection range are associated with each other; as well as The detection range is set based on the category of the specific area and the distance information.

19. The medical device according to claim 11, wherein The processor superimposes the thermally denatured region on the white light image and outputs the result to a display device.

20. The medical device according to claim 19, wherein The processor superimposes the thermally denatured region within the detection range and the thermally denatured region outside the detection range on the white light image in different ways and outputs the superimposed image to a display device.

21. The medical device according to claim 11, wherein The specific area is an organ or an entrance or exit of an organ.

22. A learning device comprising a processor, wherein: The processor generates a learned model by performing machine learning using training data, wherein the training data includes a fluorescence image obtained by irradiating biological tissue with excitation light and capturing fluorescence, and a white light image obtained by irradiating biological tissue with white light and capturing the white light, and outputs information indicating a relationship between a thermally denatured region extracted from the fluorescence image and a specific region determined based on the white light image.

23. A medical system comprising a light source device, an imaging device, and a medical device, wherein: The light source device includes a light source for emitting excitation light for exciting advanced glycation end products generated by heat treatment of biological tissue. The imaging device includes an imaging element that generates an imaging signal by capturing fluorescence emitted by the excitation light. The medical device includes a processor. The processor performs the following processing: acquiring a thermal denaturation image including at least a thermally denatured region; determining a specific area included in the thermal denaturation image; setting a detection range, which is a target range for detecting a thermal denaturation region in the thermal denaturation image, based on the specific region; and Thermal denaturation information based on the detection range and the thermal denaturation region is output.

24. A method for operating a medical device, the medical device comprising a processor, wherein: The processor performs the following processing: acquiring a thermal denaturation image including at least a thermally denatured region; determining a specific area included in the thermal denaturation image; setting a detection range, which is a target range for detecting a thermal denaturation region in the thermal denaturation image, based on the specific region; and Thermal denaturation information based on the detection range and the thermal denaturation region is output.

25. A program executed by a medical device having a processor, wherein: The program causes the processor to execute the following processing: acquiring a thermal denaturation image including at least a thermally denatured region; determining a specific area included in the thermal denaturation image; setting a detection range, which is a target range for detecting a thermal denaturation region in the thermal denaturation image, based on the specific region; and Thermal denaturation information based on the detection range and the thermal denaturation region is output.

Images