Medical processing device and medical observation system
The medical processing device maintains display mode and image quality by processing images according to pre-abnormality settings, addressing the issue of system initialization during image processing failures in medical observation systems.
Patent Information
- Application Number
- JP2022102945
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-06-27
- Publication Date
- 2026-02-13
- Estimated Expiration
- 2042-06-27
AI Technical Summary
In medical observation systems, when an abnormality occurs in the digital image processing circuit during surgery or a procedure, the system is initialized, leading to a disruption in displaying captured images, requiring users to perform unnecessary operations to reset the display mode.
A medical processing device and system that includes an internal module and a processor, where the internal module processes images according to the display mode specified by the processor before the abnormality, ensuring continuous operation without user intervention.
The system maintains the display mode and image quality during and after a processor abnormality, allowing users to continue surgeries or procedures without additional operations, enhancing convenience.
Smart Images

Figure 0007813664000001 
Figure 0007813664000002 
Figure 0007813664000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a medical processing device, a medical observation system, and a medical device. [Background technology]
[0002] BACKGROUND ART Conventionally, in the medical field, a medical observation system is known that displays an image of a subject on a display device to observe the subject (see, for example, Patent Document 1). The medical observation system (endoscopic system) described in Patent Document 1 includes a digital image processing circuit that performs image processing on captured images and an alternative digital image processing circuit that replaces the digital image processing circuit. In the event of an abnormality in the digital image processing circuit, the medical observation system activates the alternative digital image processing circuit, which then performs image processing on the captured images. Furthermore, in the medical observation system, when the digital image processing circuit is initialized and returns to normal operation, the digital image processing circuit performs image processing on the captured images. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-4979 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the medical observation system described in Patent Document 1, if an abnormality occurs in the digital image processing circuit during surgery or a procedure, the digital image processing circuit is initialized. That is, because the digital image processing circuit is initialized, after the initialization, it may not be possible to display captured images on the display device in the desired display mode that allows the surgery or procedure to be continued. In such cases, the user, such as the surgeon, must perform an operation to reset the display mode to the desired mode. Therefore, there is a demand for technology that allows users such as surgeons to continue surgery or procedures without having to perform unnecessary operations, thereby improving convenience.
[0005] The present disclosure has been made in view of the above, and aims to provide a medical processing device, a medical observation system, and a medical device that can improve convenience. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems and achieve the objectives, the medical processing device of the present disclosure includes an internal module that processes an image of a subject and generates an image for display, and a processor that controls the operation of the internal module, and after an abnormality occurs in the processor, the internal module processes the image according to the display mode specified by the processor before the abnormality occurred in the processor.
[0007] A medical observation system according to the present disclosure comprises a medical observation device that images a subject and generates an imaged image, a medical processing device that processes the imaged image and generates an image for display, and a display device that displays the image for display, wherein the medical processing device comprises an internal module that processes the imaged image and generates the image for display, and a processor that controls the operation of the internal module, and after an abnormality occurs in the processor, the internal module processes the imaged image in accordance with a display mode that was specified by the processor before the abnormality occurred in the processor.
[0008] The medical device of the present disclosure is a medical device that operates using operating parameters set by a processor, and after an abnormality occurs in the processor, it operates using the operating parameters that were set by the processor before the abnormality occurred in the processor. [Effects of the Invention]
[0009] The medical processing device, medical observation system, and medical device according to the present disclosure can improve convenience. [Brief explanation of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram showing a medical observation system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of the control device. [Figure 3] FIG. 3 is a flowchart showing the operation of the control device. [Figure 4] FIG. 4 is a flowchart showing the operation of the control device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0011] Hereinafter, modes for carrying out the present disclosure (hereinafter, referred to as embodiments) will be described with reference to the drawings. Note that the present disclosure is not limited to the embodiments described below. Furthermore, in the drawings, the same parts are denoted by the same reference numerals.
[0012] (Embodiment 1) [General configuration of medical observation system] FIG. 1 is a diagram showing a medical observation system 1 according to the first embodiment. The medical observation system 1 is used in the medical field to observe the inside of a subject (inside a living organism). As shown in Fig. 1, the medical observation system 1 includes an insertion section 2, a light source device 3, a light guide 4, a camera head 5, a first transmission cable 6, a display device 7, a second transmission cable 8, a control device 9, and a third transmission cable 10.
[0013] In the first embodiment, the insertion section 2 is configured as a rigid endoscope. That is, the insertion section 2 has an elongated shape that is entirely rigid or partially flexible and partially rigid, and is inserted into a living body. The insertion section 2 includes an optical system (not shown) that is configured using one or more lenses and focuses an image of a subject.
[0014] The light source device 3 is connected to one end of the light guide 4, and under the control of the control device 9, supplies illumination light specified by the control device 9 to the one end of the light guide 4 at a light intensity specified by the control device 9. The light source device 3 includes first to third light source units 31 to 33 and a light source control unit 34 (see FIG. 2). The first light source unit 31 emits visible white light (normal light) under the control of the light source control unit 34, thereby supplying the white light as illumination light to the light guide 4 with an amount of light specified by the light source control unit 34. The first light source unit 31 is configured using a collimator lens, a white LED (Light Emitting Diode), a driver, etc. Note that the first light source unit 31 may supply visible white light by simultaneously emitting light from a red LED, a green LED, and a blue LED, or may be configured with a halogen lamp, a xenon lamp, or the like.
[0015] The second light source unit 32 emits first narrowband light under the control of the light source control unit 34, thereby supplying the first narrowband light of an amount specified by the light source control unit 34 as illumination light to the light guide 4. Here, the first narrowband light is light with a wavelength band of 530 nm to 550 nm (with a center wavelength of 540 nm). The second light source unit 32 is configured using a collimator lens, a green LED, a transmission filter that transmits light of 530 nm to 550 nm, a driver, etc.
[0016] The third light source unit 33, under the control of the light source control unit 34, emits second narrowband light having a wavelength band different from the first narrowband light, and supplies the second narrowband light of an amount specified by the light source control unit 34 as illumination light to the light guide 4. Here, the second narrowband light is light having a wavelength band of 400 nm to 430 nm (with a central wavelength of 415 nm). The third light source unit 33 is configured using a collimating lens, a semiconductor laser such as a violet LD (Laser Diode), a driving driver, etc.
[0017] The light source control unit 34 is configured by an FPGA (Field Programmable Gate Array) etc. The light source control unit 34 has a register 341 that stores light source drive parameters specified by the control device 9, and controls the operations of the first to third light source units 31 to 33 using the light source drive parameters. Here, the light source driving parameters include a special light observation flag and a light amount (brightness evaluation value), which will be described in detail later.
[0018] The special light observation flag is set to ON when the display mode of the medical observation system 1 is the special light observation mode, and is set to OFF when the display mode is the normal light observation mode. Here, the normal light observation mode is an observation method in which white light (normal light) is irradiated onto living tissue and the living tissue irradiated with the white light is observed. Narrow Band Imaging (NBI) is an observation method that utilizes the fact that hemoglobin in blood strongly absorbs light with wavelengths around 415 nm to highlight the capillaries in the mucosal surface layer of biological tissue and the mucosal surface structure. Specifically, in NBI, biological tissue is irradiated with two narrowband lights that are easily absorbed by hemoglobin in blood: a first narrowband light (wavelength band: 530 nm to 550 nm) and a second narrowband light (wavelength band: 400 nm to 430 nm). This makes it possible to highlight blood vessels and blood flow information deep within the mucosa, which are difficult to visualize using white light (normal light).
[0019] In the first embodiment, the light source device 3 is configured as a separate unit from the control device 9, but the present invention is not limited to this, and the light source device 3 may be configured to be provided within the control device 9.
[0020] One end of the light guide 4 is detachably connected to the light source device 3, and the other end is detachably connected to the insertion portion 2. The light guide 4 transmits light supplied from the light source device 3 from one end to the other end and supplies it to the insertion portion 2. The light supplied to the insertion portion 2 is emitted from the tip of the insertion portion 2 and irradiated into the living body. The light irradiated into the living body and returned from the living body (subject image) is collected by the optical system in the insertion portion 2.
[0021] The camera head 5 corresponds to the medical observation device according to the present disclosure. The camera head 5 is detachably connected to the eyepiece 21 of the insertion section 2. The camera head 5 includes an imaging section 51 (see FIG. 2) that captures an image of a subject focused by the insertion section 2 under the control of the control device 9 and generates an image signal (hereinafter referred to as a captured image), an operation section 52 (see FIG. 2), and the like.
[0022] As shown in FIG. 2, the imaging unit 51 includes an imaging element 511 and a signal processing unit 512. The imaging element 511 is an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) that receives a subject image focused by the insertion portion 2 and converts it into an electrical signal (analog signal). The signal processing unit 512 performs signal processing on the captured image, which is an analog signal generated by the imaging element 511, and outputs the captured image, which is a digital signal. The signal processing unit 512 has a register 5121 that stores an analog gain specified by the control device 9. The signal processing unit 512 performs signal processing on the captured image (analog signal) generated by the imaging element 511, such as processing to remove reset noise, processing to multiply the analog signal by the analog gain stored in the register 5121, and A / D conversion.
[0023] The operation unit 52 is composed of buttons, switches, etc., and accepts user operations by a user such as an operator. The operation unit 52 then outputs an operation signal corresponding to the user operation to the control device 9 via the first transmission cable 6. Examples of the user operation include an operation to switch the display mode of the medical observation system 1 between a normal light observation mode and a special light observation mode, or between a still image display mode and a video display mode.
[0024] Here, the still image display mode is a display mode in which the display device 7 continues to display one frame of the display image that was being displayed on the display device 7 at the time the user, such as the surgeon, performed an operation to switch to the still image display mode. The moving image display mode is a display mode in which the captured images (display images) captured by the imaging unit 51 are switched sequentially frame by frame and displayed on the display device 7 as a moving image.
[0025] One end of the first transmission cable 6 is detachably connected to the control device 9, and the other end is detachably connected to the camera head 5. The first transmission cable 6 transmits captured images and other signals output from the camera head 5 to the control device 9, and also transmits control signals, synchronization signals, clocks, power, and other signals output from the control device 9 to the camera head 5. The captured images and the like may be transmitted as optical signals or electrical signals from the camera head 5 to the control device 9 via the first transmission cable 6. The same applies to the transmission of control signals, synchronization signals, and clocks from the control device 9 to the camera head 5 via the first transmission cable 6.
[0026] The display device 7 is configured with a display using liquid crystal or organic EL (Electro Luminescence) or the like, and displays an image based on a video signal from the control device 9 under the control of the control device 9. One end of the second transmission cable 8 is detachably connected to the display device 7, and the other end is detachably connected to the control device 9. The second transmission cable 8 transmits the video signal processed by the control device 9 to the display device 7.
[0027] The control device 9 corresponds to the medical processing device according to the present disclosure. The control device 9 is configured with a CPU (Central Processing Unit), an FPGA (Field-Programmable Gate Array), etc., and controls the overall operations of the light source device 3, the camera head 5, and the display device 7. The detailed configuration of the control device 9 will be explained later in the section "Configuration of the Control Device." One end of the third transmission cable 10 is detachably connected to the light source device 3, and the other end is detachably connected to the control device 9. The third transmission cable 10 transmits a control signal from the control device 9 to the light source device 3.
[0028] [Configuration of the control device] Next, the configuration of the control device 9 will be described. FIG. 2 is a block diagram showing the configuration of the control device 9. As shown in FIG. 2, the control device 9 includes an internal module 91, a memory 92, a control unit 93, an input unit 94, an output unit 95, and a storage unit 96.
[0029] The internal module 91 is configured by an FPGA and executes hardware processing. As shown in FIG. 2, the internal module 91 includes an image processing unit 911, a freeze control unit 912, an abnormality monitoring unit 913, and an interface unit 914. The image processing unit 911 has a register 9111 that stores image processing parameters, and uses the image processing parameters stored in the register 9111 to perform image processing on a captured image (digital image) output from the camera head 5, and to generate a display image (video signal for display) for displaying the captured image. The image processing unit 911 then outputs the display image to the display device 7. As a result, the display image is displayed on the display device 7. Here, the register 9111 corresponds to an image processing parameter storage unit according to the present disclosure.
[0030] Specifically, examples of such image processing include optical black subtraction processing, demosaic processing, white balance adjustment processing, digital gain processing (processing in which a digital signal is multiplied by a digital gain that amplifies the digital signal), noise reduction processing, color correction processing, color enhancement processing, contour enhancement processing, enlargement processing, color tone change processing, and YC processing in which an RGB signal (captured image) is converted into a luminance color difference signal (Y, Cb / Cr signal).
[0031] The image processing performed by the image processing unit 911 differs depending on whether the display mode of the medical observation system 1 is the normal light observation mode or the special light observation mode. That is, in the normal light observation mode, image processing parameters corresponding to the normal light observation mode are stored in the register 9111 under the control of the control unit 93. In addition, in the special light observation mode, image processing parameters corresponding to the special light observation mode are stored in the register 9111 under the control of the control unit 93.
[0032] The freeze control unit 912 has a register 9121 that stores a still image display flag. The still image display flag is set to ON when the display mode of the medical observation system 1 is the still image display mode, and is set to OFF when the display mode is the moving image display mode.
[0033] Then, the freeze control unit 912 checks the still image display flag stored in the register 9121, and if the still image display flag is OFF (if the display mode of the medical observation system 1 is the moving image display mode), it writes one frame of display image after image processing has been performed by the image processing unit 911 to the memory 92, and also reads out the one frame of display image from the memory 92 and outputs it to the display device 7. As a result, the display images are switched sequentially frame by frame, and are displayed on the display device 7 as a moving image.
[0034] On the other hand, the freeze control unit 912 checks the still image display flag stored in the register 9121, and if the still image display flag is ON (if the display mode of the medical observation system 1 is the still image display mode), it stops writing the one frame of display image after image processing by the image processing unit 911 to the memory 92, and reads out the one frame of display image that has already been written from the memory 92 and outputs it to the display device 7. As a result, the one frame of display image that was displayed on the display device 7 at approximately the same timing as the operation to switch to the still image display mode continues to be displayed as a still image.
[0035] The abnormality monitoring unit 913 is configured with, for example, a watchdog timer, and monitors whether an abnormality has occurred in the control unit 93. Furthermore, if the abnormality monitoring unit 913 determines that an abnormality has occurred in the control unit 93, it outputs a reboot signal to the control unit 93 via a path P1 (FIG. 2) that does not go through the interface unit 914, which will be described later, to prompt the control unit 93 to reboot. Here, the abnormality monitoring unit 913 has a register 9131 that stores a reboot flag. Then, if the abnormality monitoring unit 913 outputs the reboot signal, it sets the reboot flag to ON. Furthermore, if the abnormality monitoring unit 913 determines that an abnormality has occurred in the control unit 93, it stops communication between the internal module 91 and the control unit 93. In the first embodiment, the abnormality monitoring unit 913 is provided in the internal module 91, but the present invention is not limited to this and may be provided outside the internal module 91.
[0036] The interface unit 914 is an interface for communication between the internal module 91 and the control unit 93, and is also an interface for communication between the internal module 91 and the light source device 3 and the camera head 5. In other words, the control unit 93 controls the registers 341, 5121, 9111, 9121, and 9131 via the interface unit 914.
[0037] The memory 92 is used by the freeze control unit 912 and stores at least one frame of display image.
[0038] The control unit 93 corresponds to a processor according to the present disclosure. This control unit 93 is realized by a controller such as a CPU or an MPU (Micro Processing Unit) executing various programs stored in the storage unit 96, and executes software processing. The control unit 93 controls the operations of the light source device 3 and the camera head 5, as well as the operation of the control device 9 as a whole.
[0039] For example, the control unit 93 executes the following brightness control. Specifically, the control unit 93 calculates the luminance level (average luminance value) within the detection region based on the luminance signal (Y signal) within the detection region, which is at least a portion of the entire image region of the captured image, out of the luminance and color difference signals (Y, Cb / Cr signals) of the captured image after YC processing has been performed by the image processing unit 911. Then, based on the luminance level (average luminance value) within the detection region, the control unit 93 calculates a brightness evaluation value for changing the brightness of the image within the detection region of the entire image region of the captured image to a reference brightness (changing the calculated average luminance value to the reference average luminance value).
[0040] Here, examples of brightness evaluation values include an analog gain used in the signal processing unit 512, a digital gain used in image processing (digital gain processing) by the image processing unit 911, and the light intensity of illumination light supplied by the light source device 3. The analog gain stored in the register 5121 is sequentially updated to the analog gain (brightness evaluation value) calculated by the control unit 93 via the interface unit 914. The digital gain among the image processing parameters stored in the register 9111 is sequentially updated to the digital gain (brightness evaluation value) calculated by the control unit 93 via the interface unit 914. The light intensity among the light source driving parameters stored in the register 341 is sequentially updated to the light intensity (brightness evaluation value) calculated by the control unit 93 via the interface unit 914. Then, the signal processing unit 512 performs processing using the updated analog gain, the image processing unit 911 performs digital gain processing using the updated digital gain, and the light source device 3 supplies illumination light with the updated amount of light, thereby controlling the brightness of the captured image to the desired brightness.
[0041] The input unit 94 is configured using operation devices such as a mouse, a keyboard, and a touch panel, and receives user operations by a user such as a surgeon. The input unit 94 then outputs an operation signal to the control unit 93 in accordance with the user operation. The output unit 95 is configured using a speaker, a printer, etc., and outputs various information. The storage unit 96 stores programs executed by the control unit 93, information necessary for the processing of the control unit 93, and the like.
[0042] [Control device operation] Next, the operation of the control device 9 will be described. FIG. 3 is a flowchart showing the operation of the control device 9. The following describes the operation of the control device 9 when an abnormality occurs in the control unit 93 when the display mode of the medical observation system 1 is the special light observation mode. For the sake of convenience, the brightness control performed by the control unit 93 is omitted in Fig. 3, but this control is always performed before an abnormality occurs in the control unit 93 and after restarting.
[0043] First, the control unit 93 switches the display mode of the medical observation system 1 to the special light observation mode in response to an operation by a user such as an operator on the operation unit 52 to "switch the display mode of the medical observation system 1 to the special light observation mode" (step S1). Specifically, the control unit 93 sets the special light observation flag included in the light source driving parameters stored in the register 341 to ON via the interface unit 914. As a result, the light source control unit 34 confirms that the special light observation flag included in the light source driving parameters stored in the register 341 is ON, and causes the second and third light source units 32 and 33 of the first to third light source units 31 to 33 to supply the first and second narrowband light as illumination light. In addition, the control unit 93 updates the image processing parameters stored in the register 9111 to image processing parameters corresponding to the special light observation mode via the interface unit 914. As a result, the image processing unit 911 performs image processing on the captured image (digital image) of the biological tissue irradiated with the first and second narrowband lights using image processing parameters corresponding to the special light observation mode, and generates an image for display.
[0044] After step S1, the abnormality monitoring unit 913 constantly monitors whether or not an abnormality has occurred in the control unit 93 (step S2). If it is determined that no abnormality has occurred in the control unit 93, the abnormality monitoring unit 913 continues the process of step S2. On the other hand, if it is determined that an abnormality has occurred in the control unit 93, the abnormality monitoring unit 913 outputs a reboot signal to the control unit 93 via a path P1 that does not pass through the interface unit 914, prompting the control unit 93 to restart (step S3). Then, the abnormality monitoring unit 913 sets a reboot flag stored in the register 9131 to ON. Note that an IC chip may be provided between the internal module 91 and the control unit 93 on the path P1 that does not pass through the interface unit 914. In this case, the internal module 91 (abnormality monitoring unit 913) is configured to output a reboot signal to the control unit 93 via the IC chip.
[0045] After step S3, the abnormality monitoring unit 913 stops communication between the internal module 91 and the control unit 93 via the interface unit 914 (step S4). That is, the control unit 93 becomes unable to execute control of the registers 341, 5121, 9111, 9121, and 9131 via the interface unit 914. As a result, the light source driving parameters (special light observation flag and light amount (brightness evaluation value)), analog gain (brightness evaluation value), image processing parameters (image processing parameters according to the special light observation mode (including digital gain (brightness evaluation value))), and still image display flag stored in the registers 341, 5121, 9111, and 9121 are maintained at the settings before the abnormality occurred in the control unit 93. The light source device 3, camera head 5, and internal module 91 continue processing using the light source driving parameters (special light observation flag and light intensity (brightness evaluation value)), analog gain (brightness evaluation value), image processing parameters (image processing parameters according to the special light observation mode (including digital gain (brightness evaluation value))), and still image display flag stored in registers 341, 5121, 9111, and 9121. The light source driving parameters (special light observation flag and light intensity (brightness evaluation value)), analog gain (brightness evaluation value), image processing parameters (image processing parameters according to the special light observation mode (including digital gain (brightness evaluation value))), and still image display flag correspond to the operating parameters according to the present disclosure. In other words, the light source device 3, camera head 5, and internal module 91 correspond to the medical device according to the present disclosure.
[0046] After step S4, the control unit 93 executes a restart (step S5). After step S5, if a link is established between the internal module 91 and the control unit 93 via the interface unit 914, the abnormality monitoring unit 913 starts communication between the internal module 91 and the control unit 93 via the interface unit 914 (step S6).
[0047] After step S6, the control unit 93 checks the reboot flag stored in the register 9131 via the interface unit 914 (step S7). If the reboot flag is set to ON (step S8: Yes), the control unit 93 keeps the display mode of the medical observation system 1 in the special light observation mode (step S9). That is, the control unit 93 does not change the setting of the special light observation flag stored in the register 341 and the setting of the image processing parameters stored in the register 9111 via the interface unit 914.
[0048] On the other hand, if the reboot flag is set to OFF (step S8: No), that is, if the abnormality monitoring unit 913 has not prompted a reboot by a reboot signal (for example, when the power is turned on), the control unit 93 switches the display mode of the medical observation system 1 to the normal light observation mode (step S10). That is, the control unit 93 sets the special light observation flag included in the light-source driving parameters stored in the register 341 to OFF via the interface unit 914. As a result, the light source control unit 34 confirms that the special light observation flag included in the light-source driving parameters stored in the register 341 is OFF and causes the first light source unit 31 of the first to third light source units 31 to 33 to supply white light (normal light) as illumination light. In addition, the control unit 93 updates the image processing parameters stored in the register 9111 to image processing parameters corresponding to the normal light observation mode via the interface unit 914. As a result, the image processing unit 911 performs image processing on the captured image (digital image) of biological tissue irradiated with white light (normal light) using image processing parameters corresponding to the normal light observation mode, and generates an image for display.
[0049] According to the first embodiment described above, the following effects are achieved. In the control device 9 according to the first embodiment, when an abnormality occurs in the control unit 93, the internal module 91 performs processing on the captured image according to the display mode specified by the control unit 93 before the abnormality occurred in the control unit 93. Specifically, when an abnormality occurs in the control unit 93 during the special light observation mode, the internal module 91 performs processing on the captured image according to the special light observation mode during and after the restart of the control unit 93. Therefore, even if an abnormality occurs in the control unit 93 while performing surgery or a procedure in special light observation mode, the display state (special light observation mode) can be maintained equivalent to that before the abnormality occurred in the control unit 93 during and after the restart of the control unit 93. Therefore, the control device 9 according to the first embodiment allows a user such as an operator to continue a surgery or procedure without performing unnecessary operations, thereby improving convenience.
[0050] In particular, if an abnormality occurs in the control unit 93, communication between the internal module 91 and the control unit 93 is stopped. As a result, the light source driving parameters (special light observation flag and light intensity (brightness evaluation value)), analog gain (brightness evaluation value), image processing parameters (image processing parameters according to the special light observation mode (including digital gain (brightness evaluation value))), and still image display flag stored in the registers 341, 5121, 9111, and 9121 are maintained at the set values before the abnormality occurred in the control unit 93. In other words, since the image processing parameters and brightness evaluation value are maintained in the states before the abnormality occurred in the control unit 93, high-definition and bright image display can be maintained even during and after the restart of the control unit 93.
[0051] (Embodiment 2) Next, the second embodiment will be described. In the following, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted or simplified. In the second embodiment, the operation of the control device 9 is different from that of the first embodiment described above.
[0052] The operation of the control device 9 according to the second embodiment will be described below. FIG. 4 is a flowchart showing the operation of the control device 9 according to the second embodiment. The following describes the operation of the control device 9 when an abnormality occurs in the control unit 93 when the display mode of the medical observation system 1 is the still image display mode. For the sake of convenience, the brightness control performed by the control unit 93 is omitted in Fig. 4, but this control is always performed before an abnormality occurs in the control unit 93 and after restarting.
[0053] 4, in the operation of the control device 9 according to the second embodiment, step S1A is adopted instead of step S1 in the operation of the control device 9 described in the first embodiment. Furthermore, in the operation of the control device 9 according to the second embodiment, steps S9 and S10 are omitted and steps S11 to S13 are added. Therefore, steps S1A and S11 to S13 will be mainly described below.
[0054] First, in step S1A, the control unit 93 switches the display mode of the medical observation system 1 to the still image display mode in response to an operation by a user such as an operator on the operation unit 52 to "switch the display mode of the medical observation system 1 to the still image display mode." Specifically, the control unit 93 sets the still image display flag stored in the register 9121 to ON via the interface unit 914. As a result, the freeze control unit 912 confirms that the still image display flag stored in the register 9121 is ON, stops writing one frame of display image after image processing by the image processing unit 911 to the memory 92, and reads out the one frame of display image that has already been written from the memory 92 and outputs it to the display device 7. Then, the display device 7 continues to display, as a still image, the one frame of display image that was displayed on the display device 7 at approximately the same timing as the operation to switch to the still image display mode was performed.
[0055] Step S11 is executed after step S4. Specifically, in step S11, the freeze control unit 912 stores the value of the still image display flag OFF in another address area within the register 9121, for example. When the abnormality monitoring unit 913 notifies the control unit 93 that an abnormality has occurred, the freeze control unit 912 retrieves the still image display flag stored in the other address area within the register 9121. As a result, the freeze control unit 912 confirms that the still image display flag stored in the register 9121 is OFF (confirms that the display mode of the medical observation system 1 has been switched to the moving image display mode), writes one frame of display image after image processing by the image processing unit 911 to the memory 92, and reads out the one frame of display image from the memory 92 and outputs it to the display device 7. Then, on the display device 7, the display of the display image is switched sequentially frame by frame, and is displayed as a moving image. Alternatively, the same effect can be achieved by a configuration in which the abnormality monitoring unit 913 sets the still image display flag stored in the register 9121 to OFF in step S11. This eliminates the need for the freeze control unit 912 to branch its processing between normal and abnormal situations. Thereafter, the control device 9 proceeds to step S5.
[0056] Step S12 is executed when the reboot flag is set to ON (step S8: Yes). Specifically, in step S12, the control unit 93 holds the setting of the still image display flag stored in the register 9121. That is, in step S11, the still image display flag is set to OFF. Therefore, in step S12, the setting of the still image display flag is held in the OFF state. In other words, the display mode of the medical observation system 1 is maintained in the moving image display mode.
[0057] Step S13 is executed when the reboot flag is set to OFF (step S8: No). Specifically, in step S13, the control unit 93 initializes the setting of the still image display flag stored in the register 9121 via the interface unit 914. In other words, the display mode of the medical observation system 1 is switched to the display mode set as the default, either the still image display mode or the moving image display mode.
[0058] According to the second embodiment described above, in addition to the same effects as those of the first embodiment, the following effects are achieved. In the control device 9 according to the second embodiment, if an abnormality occurs in the control unit 93 during the still image display mode, the internal module 91 sets the still image display flag to OFF (switches to the moving image display mode). In other words, even if an abnormality occurs in the control unit 93 during still image display mode, the mode will switch to video display mode, allowing the surgeon or other user to continue the surgery or procedure without having to perform any unnecessary operations, thereby improving convenience.
[0059] (Other embodiments) Although the embodiments for carrying out the present disclosure have been described above, the present disclosure should not be limited to only the first and second embodiments described above. In the above-described first and second embodiments, the medical processing device and medical device according to the present disclosure are mounted in a medical observation system 1 in which the insertion section 2 is configured as a rigid endoscope, but this is not limiting. For example, the medical processing device and medical device according to the present disclosure may be mounted in a medical observation system in which the insertion section 2 is configured as a flexible endoscope. Furthermore, the medical processing device and medical device according to the present disclosure may be mounted in a medical observation system such as a surgical microscope (see, for example, Japanese Patent Application Laid-Open No. 2016-42981) that magnifies and observes a predetermined field of view inside or on the surface of a living body.
[0060] In the first and second embodiments described above, the internal module 91 is configured with an FPGA and configured to execute hardware processing, but this is not limiting and the internal module 91 may be configured with a controller such as a CPU or MPU and configured to execute software processing. Also, the control unit 93 is configured with a controller such as a CPU or MPU and configured to execute software processing, but this is not limiting and the control unit 93 may be configured with an FPGA or the like and configured to execute hardware processing.
[0061] In the first and second embodiments described above, the special light observation mode is used as the display mode of the medical observation system 1, but this is not limiting, and a fluorescent observation mode may be used instead of the special light observation mode. Here, the fluorescence observation mode is an observation technique for observing the inside of a subject by irradiating the subject with excitation light that excites fluorescent substances within the subject and capturing an image of the fluorescence emitted from the fluorescent substances.
[0062] In the first and second embodiments described above, the light source device 3 is configured to use three light sources, the first to third light source units 31 to 33. However, this is not limiting. For example, a configuration may be adopted in which only one light source is provided, and a transmission filter that transmits light in a specific wavelength band and blocks other light is moved in or out of the optical path of the light emitted from the light source to switch between white light (normal light observation mode) and first and second narrowband light (special light observation mode).
[0063] The following configurations also fall within the technical scope of the present disclosure. (1) A medical processing device comprising an internal module that processes an image of a subject and generates an image for display, and a processor that controls the operation of the internal module, wherein after an abnormality occurs in the processor, the internal module processes the image according to a display mode specified by the processor before the abnormality occurred in the processor. (2) The internal module includes an image processing parameter memory unit that stores image processing parameters corresponding to the display mode specified by the processor, and an image processing unit that performs image processing on the captured image using the image processing parameters stored in the image processing parameter memory unit, and the image processing unit performs image processing on the captured image using the image processing parameters that were stored in the image processing parameter memory unit before the processor abnormality occurred, after an abnormality occurs in the processor, in the medical processing device described in (1) above. (3) The display mode includes a special light observation mode in which special light of a specific wavelength band is irradiated onto the subject, and the display image corresponding to the captured image of the subject irradiated with the special light is displayed on the display device, and if an abnormality occurs in the processor during the special light observation mode, the internal module performs processing on the captured image corresponding to the special light observation mode after the abnormality occurs in the processor. (4) A medical processing device described in any one of (1) to (3) above, wherein the display modes include a still image display mode in which the display image is displayed on the display device as a still image, and a moving image display mode in which the display image is displayed on the display device as a moving image, and the internal module switches to the moving image display mode if an abnormality occurs in the processor during the still image display mode. (5) The medical processing device according to any one of (1) to (4) above, wherein the internal module performs hardware processing, and the control unit performs software processing. (6) The medical processing device according to any one of (1) to (5) above, further comprising an abnormality monitoring unit that monitors whether an abnormality has occurred in the processor. (7) A medical observation system comprising: a medical observation device that images a subject and generates an imaged image; a medical processing device that processes the imaged image and generates an image for display; and a display device that displays the image for display, wherein the medical processing device comprises an internal module that processes the imaged image and generates the image for display; and a processor that controls the operation of the internal module, and wherein, after an abnormality occurs in the processor, the internal module processes the imaged image in accordance with a display mode that was specified by the processor before the abnormality occurred in the processor. (8) A medical device that operates using operating parameters set by a processor, and after an abnormality occurs in the processor, the medical device operates using the operating parameters that were set by the processor before the abnormality occurred in the processor. [Explanation of symbols]
[0064] 1 Medical observation system 2 Insertion section 3 Light source device 4 Light Guide 5 Camera Head 6. First Transmission Cable 7 Display device 8 Second Transmission Cable 9 Control Device 10 Third Transmission Cable 21 Eyepiece 31 First light source unit 32 Second light source section 33 Third light source 34 Light source control unit 51 Imaging unit 52 Operation section 91 Internal Module 92 memory 93 Control Unit 94 Input section 95 Output section 96 Memory section 341 registers 511 Image sensor 512 Signal Processing Unit 5121 registers 911 Image Processing Unit 912 Freeze control unit 913 Abnormality Monitoring Department 914 Interface section 9111,9121,9131 registers
Claims
1. an internal module for processing an image of a subject and generating an image for display; a processor that specifies a display mode and controls the operation of the internal modules; The display mode is a special light observation mode in which special light in a specific wavelength band is irradiated onto the subject, and the display image corresponding to the captured image of the subject irradiated with the special light is displayed on a display device; The internal module comprises: After an abnormality occurs in the processor, the medical processing device performs processing on the captured image according to the display mode specified by the processor before the abnormality occurs in the processor, and if an abnormality occurs in the processor during the special light observation mode, performs processing on the captured image according to the special light observation mode after the abnormality occurs in the processor.
2. The internal module comprises: an image processing parameter storage unit that stores image processing parameters corresponding to a display mode designated by the processor; an image processing unit that performs image processing on the captured image using the image processing parameters stored in the image processing parameter storage unit; The image processing unit The medical processing device according to claim 1 , wherein, after an abnormality occurs in the processor, image processing is performed on the captured image using the image processing parameters stored in the image processing parameter storage unit before the abnormality occurs in the processor.
3. An internal module that processes an image of a subject and generates an image for display; a processor that specifies a display mode and controls the operation of the internal modules; The display mode is a still image display mode in which the display image is displayed on the display device as a still image; a moving image display mode in which the display image is displayed on the display device as a moving image, The internal module comprises: After an abnormality occurs in the processor, the medical processing device processes the captured image according to the display mode specified by the processor before the abnormality occurred in the processor, and if an abnormality occurs in the processor while in the still image display mode, switches to the video display mode.
4. The internal module comprises: Hardware processing is performed, The processor: The medical processing device according to claim 1, wherein software processing is performed.
5. The medical processing device according to claim 1 , further comprising an abnormality monitoring unit that monitors whether an abnormality has occurred in the processor.
6. a medical observation device that captures an image of a subject and generates a captured image; a medical processing device that processes the captured image and generates an image for display; a display device that displays the display image, The medical treatment device includes: an internal module that processes the captured image and generates the display image; a processor that specifies a display mode and controls the operation of the internal modules; The display mode is a special light observation mode in which special light in a specific wavelength band is irradiated onto the subject, and the display image corresponding to the captured image of the subject irradiated with the special light is displayed on a display device; The internal module comprises: a medical observation system in which, after an abnormality occurs in the processor, the captured image is processed in accordance with the display mode specified by the processor before the abnormality occurs in the processor, and, if an abnormality occurs in the processor during the special light observation mode, the captured image is processed in accordance with the special light observation mode after the abnormality occurs in the processor.
7. A medical observation device that captures an image of a subject and generates a captured image; a medical processing device that processes the captured image and generates an image for display; a display device that displays the display image, The medical treatment device includes: an internal module that processes the captured image and generates the display image; a processor that specifies a display mode and controls the operation of the internal modules; The display mode is a still image display mode in which the display image is displayed on the display device as a still image; a moving image display mode in which the display image is displayed on the display device as a moving image, The internal module comprises: After an abnormality occurs in the processor, the medical observation system processes the captured image in accordance with the display mode specified by the processor before the abnormality occurred in the processor, and if an abnormality occurs in the processor while in the still image display mode, switches to the video display mode.
Citation Information
Patent Citations
Endoscope imaging host and endoscope imaging system
CN113633246A
Imaging apparatus having electronic finder
JP2005223516A
Light source device for endoscope
JP2007117287A
Processor device for endoscope and operation method of processor device for endoscope
JP2009284920A
Image processor and processor for endoscope
JP2010004979A