Medical image processing device, medical image processing method, and medical image processing program
Patent Information
- Application Number
- JP2025509663
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Filing Date
- 2025-09-26
- Publication Date
- 2025-12-15
AI Technical Summary
Existing medical image processing devices cannot generate endoscopic images that satisfy both users who prefer the original image quality after updates and those who prefer the latest image processing algorithms, leading to inconsistent image quality across different endoscope generations.
A medical image processing device that allows users to select between a dedicated algorithm for older endoscopes and a common algorithm compatible with newer endoscopes, enabling data processing based on user preference and endoscope generation, ensuring compatibility and convenience.
The solution allows for generating endoscopic images that both users who prefer original and updated image quality can appreciate, improving convenience by accommodating different user preferences and endoscope generations.
Abstract
Description
Medical image processing device, medical image processing method, and medical image processing program
[0001] The present invention relates to a medical image processing device, a medical image processing method, and a medical image processing program.
[0002] Conventionally, an endoscopic system has been known that includes an endoscope that is inserted into a living body and includes an imaging element that captures images of the inside of the living body, and a medical image processing device to which the endoscope is detachably connected and that includes a processing module that processes imaging data obtained by imaging with the endoscope.
[0003] Incidentally, a variety of endoscopes of different release generations may be connected to a single medical image processing device, and these endoscopes have different types of image sensors (CCD (Charge Coupled Device), CMOS (Complementary Metal Oxide Semiconductor)), the number of pixels of the image sensor, the sensitivity of the image sensor, the characteristics of the optical system, etc.
[0004] The following first and second configurations are conceivable for medical image processing devices compatible with various endoscopes of different release generations: The first configuration is a configuration in which a data processing algorithm is changed for each connected endoscope, and a display image (endoscopic image) is generated by performing data processing using the changed algorithm on image data obtained by imaging using the endoscope.
[0005] The second configuration is a configuration in which, regardless of which of various endoscopes is connected, an endoscopic image is generated by performing data processing using a common algorithm on the imaging data obtained by the endoscope (see, for example, Patent Document 1).
[0006] Japanese Patent Application Publication No. 8-238216
[0007] Users of endoscope systems can be broadly divided into the following two types: users 1 and 2. Users 1 prefer that, even if a medical image processing device is updated, when using an older endoscope, endoscopic images be generated that look exactly the same as when using the pre-updated medical image processing device.
[0008] The second type of user is a user who, when using an older endoscope, prefers that the updated medical image processing device will generate endoscopic images that have been processed using the latest algorithms when the medical image processing device is updated.
[0009] However, the medical image processing device described in Patent Document 1 processes imaging data using a common algorithm. As a result, the generated endoscopic images look different from endoscopic images generated by previous medical image processing devices. In other words, while it is possible to generate endoscopic images preferred by a second user, it is not possible to generate endoscopic images preferred by a first user. Therefore, there is a demand for technology that can generate endoscopic images preferred by both the first and second users and improve convenience.
[0010] The present invention has been made in view of the above, and aims to provide a medical image processing device, a medical image processing method, and a medical image processing program that can improve convenience.
[0011] In order to solve the above-mentioned problems and achieve the object, a medical image processing device according to the present invention comprises a processing module that executes data processing on imaging data obtained by imaging with medical observation devices, and an operation receiving unit that receives user operations, wherein the processing module executes data processing on first imaging data obtained by imaging with a first medical observation device among the medical observation devices, using an algorithm selected in response to the user operation from among a first algorithm dedicated to the first medical observation device and a second algorithm that is an algorithm of a later design generation than the first algorithm and is compatible with both the first medical observation device and a second medical observation device that is a medical observation device of a later release generation than the first medical observation device, and executes data processing on second imaging data obtained by imaging with the second medical observation device, using the second algorithm.
[0012] A medical image processing method according to the present invention is a medical image processing method executed by a medical image processing device, and includes a data processing step of performing data processing on imaging data obtained by imaging with medical observation devices. In the data processing step, first imaging data obtained by imaging with a first medical observation device among the medical observation devices is processed using an algorithm selected in response to a user operation from among a first algorithm dedicated to the first medical observation device and a second algorithm which is an algorithm of a later design generation than the first algorithm and is compatible with both the first medical observation device and a second medical observation device which is a medical observation device of a later release generation than the first medical observation device. And data processing is performed on second imaging data obtained by imaging with the second medical observation device using the second algorithm.
[0013] A medical image processing program according to the present invention is a medical image processing program to be executed by a medical image processing device, and the medical image processing device executes a data processing step of performing data processing on imaging data obtained by imaging with medical observation devices. In the data processing step, for first imaging data obtained by imaging with a first medical observation device among the medical observation devices, data processing is performed using an algorithm selected in response to a user operation from among a first algorithm dedicated to the first medical observation device and a second algorithm which is an algorithm of a later design generation than the first algorithm and is compatible with both the first medical observation device and a second medical observation device which is a medical observation device of a later release generation than the first medical observation device. And for second imaging data obtained by imaging with the second medical observation device, data processing is performed using the second algorithm.
[0014] The medical image processing device, medical image processing method, and medical image processing program according to the present invention can improve convenience.
[0015] Fig. 1 is a diagram showing the configuration of an endoscope system according to an embodiment. Fig. 2 is a block diagram showing the configuration of a control device. Fig. 3 is a diagram explaining a first modification of the embodiment. Fig. 4 is a diagram explaining a second modification of the embodiment. Fig. 5 is a diagram explaining a third modification of the embodiment. Fig. 6 is a diagram explaining a fourth modification of the embodiment. Fig. 7 is a diagram explaining a fifth modification of the embodiment. Fig. 8 is a diagram explaining a sixth modification of the embodiment.
[0016] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.
[0017] [Schematic Configuration of Endoscope System] Fig. 1 is a diagram showing the configuration of an endoscope system 1 according to an embodiment. The endoscope system 1 is used in the medical field to observe the inside of a living body. As shown in Fig. 1, the endoscope system 1 includes an endoscope 2, a light source device 3, a display device 4, and a control device 5.
[0018] The endoscope 2 corresponds to a medical observation device according to the present invention. In this embodiment, the endoscope 2 is a so-called flexible endoscope. A portion of the endoscope 2 is inserted into a living body, images the inside of the living body, and output image signals obtained by the images. As shown in FIG. 1 , the endoscope 2 includes an insertion section 21, an operation section 22, a universal cord 23, and a connector section 24.
[0019] The insertion section 21 has at least a portion that is flexible and is inserted into a living body. As shown in FIG. 1 , the insertion section 21 includes a tip unit 211, a bending section 212, and a flexible tube 213.
[0020] The tip unit 211 is provided at the tip of the insertion section 21. Although not specifically shown in the drawings, the tip unit 211 is provided with an illumination optical system, an imaging optical system, and an imaging unit.
[0021] The illumination optical system faces one end of a light guide (not shown) routed within the insertion portion 21 , and irradiates the observation light transmitted by the light guide from the tip of the insertion portion 21 into the living body.
[0022] The imaging optical system receives observation light (subject image) that is irradiated from the illumination optical system onto the inside of the living body and returns from the living body, and forms an image on the imaging surface of an imaging element that constitutes the imaging unit.
[0023] The imaging unit includes an imaging element such as a CCD or CMOS, captures an image of a subject formed by an imaging optical system, and outputs an image signal generated by the image capture. Hereinafter, the image signal will be referred to as imaging data.
[0024] The bending portion 212 is connected to the base end side (the operation portion 22 side) of the tip unit 211. Although not specifically shown in the drawings, the bending portion 212 has a configuration in which a plurality of bending pieces are connected to each other, and is capable of bending.
[0025] The flexible tube 213 is connected to the base end side (operation section 22 side) of the bending section 212 and is formed in a flexible, long shape.
[0026] The operation unit 22 is connected to the base end portion of the insertion unit 21. The operation unit 22 accepts various operations on the endoscope 2. The universal cord 23 extends from the operation unit 22 in a direction different from the extension direction of the insertion unit 21, and is a cord on which the above-mentioned light guide, the above-mentioned signal line for transmitting imaging data, etc. are disposed.
[0027] The connector portion 24 is provided at the end of the universal cord 23 and is detachably connected to the light source device 3 and the control device 5 .
[0028] In this embodiment, various endoscopes 2 of different release generations are connectable to the light source device 3 and the control device 5. Hereinafter, of the various endoscopes 2, existing endoscopes 2 will be referred to as first to third existing endoscopes 201 to 203 (see FIG. 2). Furthermore, of the various endoscopes 2, the latest endoscope 2 will be referred to as the latest endoscope 204 (see FIG. 2).
[0029] Here, the latest endoscope 204 is an endoscope of the same release generation as the control device 5, or an endoscope released at the same time that the software that constitutes the main parts of the control device 5 was updated. The latest endoscope 204 corresponds to the second medical observation device according to the present invention. Hereinafter, imaging data obtained by imaging using the latest endoscope 204 will be referred to as latest imaging data. This latest imaging data corresponds to the second imaging data according to the present invention.
[0030] Furthermore, the third existing endoscope 203 is an endoscope of a generation that was released one generation earlier (for example, about 3 to 5 years earlier) than the latest endoscope 204. In other words, the third existing endoscope 203 is an endoscope of a generation that was released one generation earlier than the release date of the control device 5, or an endoscope that was released one generation earlier than the time when the software that forms the main parts of the control device 5 was updated. The third existing endoscope 203 corresponds to the first medical observation device according to the present invention. Hereinafter, imaging data obtained by imaging using the third existing endoscope 203 will be referred to as third existing imaging data. This third existing imaging data corresponds to the first imaging data according to the present invention.
[0031] Furthermore, the second existing endoscope 202 is an endoscope of a release generation one generation earlier than the third existing endoscope 203. In other words, the second existing endoscope 202 is an endoscope of a release generation two generations earlier than the release date of the control device 5, or an endoscope released two generations earlier than the time when the software that constitutes the main parts of the control device 5 was updated. The second existing endoscope 202 corresponds to the first medical observation device according to the present invention. Hereinafter, imaging data obtained by imaging using the second existing endoscope 202 will be referred to as second existing imaging data. This second existing imaging data corresponds to the first imaging data according to the present invention.
[0032] Furthermore, the first existing endoscope 201 is an endoscope of a release generation one generation earlier than the second existing endoscope 202. In other words, the first existing endoscope 201 is an endoscope of a release generation three generations earlier than the release date of the control device 5, or an endoscope released three generations earlier than the time when the software that constitutes the main parts of the control device 5 was updated. The second existing endoscope 202 corresponds to the first medical observation device according to the present invention. Hereinafter, imaging data obtained by imaging using the first existing endoscope 201 will be referred to as first existing imaging data. This first existing imaging data corresponds to the first imaging data according to the present invention.
[0033] The first to third existing endoscopes 201 to 203 and the latest endoscope 204 differ in the type of image sensor (CCD, CMOS), the number of pixels of the image sensor, the sensitivity of the image sensor, and the characteristics of the illumination optical system and the image sensor.
[0034] The light source device 3 supplies observation light to the other end of the light guide under the control of the control device 5. The observation light then passes through the light guide and the illumination optical system, and is then irradiated into the living body from the tip of the insertion section 21. Examples of the observation light include broadband white light (normal light), narrowband excitation light that excites a fluorescent agent such as indocyanine green, and narrowband light used in Narrow Band Imaging (NBI).
[0035] The display device 4 is an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, or the like, and displays a display image (endoscopic image) according to a video signal output from the control device 5 under the control of the control device 5.
[0036] The control device 5 corresponds to the medical image processing device according to the present invention. The control device 5 includes controllers such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and comprehensively controls the operations of the endoscope 2 (the imaging unit described above, etc.) and the light source device 3. The control device 5 is not limited to a CPU or an MPU, and may include an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), etc. The detailed configuration of the control device 5 will be described later in the section "Configuration of the Control Device."
[0037] [Configuration of Control Device] Next, a description will be given of the configuration of the control device 5. Fig. 2 is a block diagram showing the configuration of the control device 5. As shown in Fig. 2, the control device 5 includes a processing module 51, a control unit 52, a storage unit 53, and an input unit 54.
[0038] The processing module 51 performs data processing on the imaging data (RAW data) obtained by imaging using the endoscope 2, and generates a video signal corresponding to the display image to be displayed on the display device 4. As shown in FIG. 2 , the processing module 51 includes a switching unit 511 and a data processing unit 512.
[0039] The switching unit 511 switches the output destination of the imaging data (RAW data) from the endoscope 2 under the control of the control unit 52. As shown in FIG. 2 , the switching unit 511 includes first to third existing switching units 5111 to 5113 and a common switching unit 5114.
[0040] The first existing-use switching unit 5111 switches whether or not to output the first existing imaging data (RAW data) obtained by imaging using the first existing endoscope 201 to the first existing-use data processing unit 5121 ( FIG. 2 ) in the data processing unit 512. For ease of explanation, the state of the first existing-use switching unit 5111 will be referred to as an “ON” state when the first existing imaging data (RAW data) is output to the first existing-use data processing unit 5121, and as an “OFF” state when the first existing imaging data is not output to the first existing-use data processing unit 5121.
[0041] The second existing image switching unit 5112 switches whether or not to output second existing imaging data (RAW data) obtained by imaging using the second existing endoscope 202 to the second existing image data processing unit 5122 ( FIG. 2 ) in the data processing unit 512. For ease of explanation, the state of the second existing image switching unit 5112 will be referred to as an “ON” state when the second existing imaging data (RAW data) is output to the second existing image data processing unit 5122, and as an “OFF” state when the second existing image data is not output to the second existing image data processing unit 5122.
[0042] The third existing imaging switching unit 5113 switches whether or not to output the third existing imaging data (RAW data) obtained by imaging using the third existing endoscope 203 to the third existing data processing unit 5123 ( FIG. 2 ) in the data processing unit 512. For ease of explanation, the state of the third existing imaging switching unit 5113 will be referred to as an “ON” state when the third existing imaging data (RAW data) is output to the third existing data processing unit 5123, and as an “OFF” state when the third existing imaging data is not output to the third existing data processing unit 5123.
[0043] The common switching unit 5114 switches whether to output the first existing imaging data (RAW data), the second existing imaging data (RAW data), or the third existing imaging data (RAW data) to the common data processing unit 5124 ( FIG. 2 ) in the data processing unit 512. For convenience of explanation, the state of the common switching unit 5114 in which the first existing imaging data (RAW data), the second existing imaging data (RAW data), or the third existing imaging data (RAW data) is output to the common data processing unit 5124 will be referred to as an "ON" state, and the state in which the common switching unit 5114 is not output to the common data processing unit 5124 will be referred to as an "OFF" state.
[0044] The data processing unit 512 performs data processing on the input imaging data (RAW data). This data processing unit 512 is configured with an FPGA or GPU. As shown in FIG. 2 , the data processing unit 512 includes first to third existing data processing units 5121 to 5123 and a common data processing unit 5124.
[0045] The first existing data processing unit 5121 processes the input first existing imaging data (RAW data) using a dedicated algorithm corresponding to the first existing endoscope 201, and generates a video signal based on the first existing imaging data. This algorithm corresponds to the first algorithm according to the present invention.
[0046] Here, the data processing executed by the first existing data processing unit 5121 includes adjustment of resolution, contrast, noise removal, etc., and brightness correction (gain correction) according to the first existing endoscope 201. The data processing also includes image processing according to the display characteristics of the display device 4 and color adjustment according to, for example, a user operation on the input unit 54. Examples of the display characteristics of the display device 4 include the color balance and gamma curve of the display device 4. Furthermore, the data processing may include optical black subtraction processing (clamping processing), white balance adjustment processing, demosaic processing, color correction matrix processing, gamma correction processing, YC processing for converting RGB signals into luminance color difference signals (Y, Cb / Cr signals), and the like.
[0047] The second existing data processing unit 5122 processes the input second existing imaging data (RAW data) using a dedicated algorithm corresponding to the second existing endoscope 202, and generates a video signal based on the second existing imaging data. This algorithm corresponds to the first algorithm according to the present invention.
[0048] Here, the data processing executed by the second existing data processing unit 5122 includes adjustment of resolution, contrast, noise removal, etc., and brightness correction (gain correction) according to the second existing endoscope 202. The data processing also includes image processing according to the display characteristics of the display device 4 and color adjustment according to, for example, a user operation on the input unit 54. Examples of the display characteristics of the display device 4 include the color balance and gamma curve of the display device 4. Furthermore, the data processing may include optical black subtraction processing (clamping processing), white balance adjustment processing, demosaic processing, color correction matrix processing, gamma correction processing, YC processing for converting RGB signals into luminance color difference signals (Y, Cb / Cr signals), and the like.
[0049] The third existing data processing unit 5123 processes the input third existing imaging data (RAW data) using a dedicated algorithm corresponding to the third existing endoscope 203, and generates a video signal based on the third existing imaging data. This algorithm corresponds to the first algorithm according to the present invention.
[0050] Here, the data processing executed by the third existing data processing unit 5123 includes adjustment of resolution, contrast, noise removal, etc., and brightness correction (gain correction) according to the third existing endoscope 203. The data processing also includes image processing according to the display characteristics of the display device 4 and color adjustment according to, for example, a user operation on the input unit 54. Examples of the display characteristics of the display device 4 include the color balance and gamma curve of the display device 4. Furthermore, the data processing may include optical black subtraction processing (clamping processing), white balance adjustment processing, demosaic processing, color correction matrix processing, gamma correction processing, YC processing for converting RGB signals into luminance color difference signals (Y, Cb / Cr signals), and the like.
[0051] The common data processing unit 5124 processes the input imaging data from among the first to third existing imaging data (RAW data) and the latest imaging data (RAW data) using an algorithm that is a later design generation algorithm than the above-mentioned first algorithm and that is compatible with all of the endoscopes 2, the first to third existing endoscopes 201 to 203 and the latest endoscope 204, and generates a video signal based on the imaging data. This algorithm is the latest algorithm designed around the same time that the control device 5 was released or around the same time that the software that is a major part of the control device 5 was updated, and corresponds to the second algorithm according to the present invention.
[0052] The data processing performed by the common data processing unit 5124 mainly includes adjustments of resolution, contrast, noise removal, etc., and brightness correction (gain correction) according to the latest endoscope 204. As described above, this data processing is performed using algorithms compatible with all of the endoscopes 2, including the first to third existing endoscopes 201 to 203 and the latest endoscope 204. Therefore, the adjustments of resolution, contrast, noise removal, etc., and brightness correction (gain correction) are also applicable to the first to third existing imaging data. The data processing also includes image processing according to the display characteristics of the display device 4 and color adjustment according to, for example, user operations on the input unit 54. Examples of the display characteristics of the display device 4 include the color balance and gamma curve of the display device 4. Furthermore, the data processing may include optical black subtraction (clamping), white balance adjustment, demosaic processing, color correction matrix processing, gamma correction, and YC processing for converting RGB signals into luminance and color difference signals (Y, Cb / Cr signals).
[0053] In Figure 2, for ease of explanation, dots are used to indicate the parts (first to third existing data processing units 5121 to 5123) that perform data processing using an algorithm (first algorithm) that was used in the past, and diagonal lines are used to indicate the parts (common data processing unit 5124) that perform data processing using an algorithm (second algorithm) that can be used in common for all of the first to third existing endoscopes 201 to 203 and the latest endoscope 204.
[0054] The control unit 52 is realized by a controller such as a CPU or an MPU executing various programs stored in the storage unit 53, and controls the operation of the endoscope 2 (the imaging unit described above, etc.) and the light source device 3, as well as the operation of the entire control device 5. The control unit 52 is not limited to a CPU or an MPU, and may be configured using an ASIC, an FPGA, etc. The functions of the control unit 52 will be described later in "Operation of the Control Device."
[0055] The storage unit 53 stores programs executed by the control unit 52 (including the medical image processing program according to the present invention), information necessary for the processing of the control unit 52, and the like.
[0056] The input unit 54 corresponds to an operation receiving unit according to the present invention. The input unit 54 is configured using operation devices such as a mouse, a keyboard, and a touch panel, and receives user operations. The input unit 54 then outputs an operation signal corresponding to the user operation to the control unit 52.
[0057] [Operation of the Control Device] Next, a description will be given of the operation (medical image processing method) of the control device 5. The operation when the user uses the first conventional endoscope 201, the second conventional endoscope 202, the third conventional endoscope 203, and the latest endoscope 204 will be described below in that order.
[0058] [Operations when a user uses a first conventional endoscope] First, a description will be given of operations when a user uses a first conventional endoscope 201. That is, in this case, only the first conventional endoscope 201 is connected to the control device 5 out of the first to third conventional endoscopes 201 to 203 and the latest endoscope 204.
[0059] When the processing module 51 executes data processing on the first existing imaging data (RAW data) obtained by imaging using the first existing endoscope 201 (data processing step), the processing module 51 operates as follows.
[0060] When the first algorithm is selected from the first and second algorithms by a user operation on the input unit 54, the first existing-use switching unit 5111 is turned "ON" and the common switching unit 5114 is turned "OFF" under the control of the control unit 52. As a result, the first existing imaging data (RAW data) output from the first existing endoscope 201 is input to the first existing-use data processing unit 5121. Furthermore, the first existing-use data processing unit 5121 performs data processing on the first existing imaging data (RAW data) using the first algorithm to generate a video signal. Then, a display image based on the video signal is displayed on the display device 4.
[0061] On the other hand, when the second algorithm is selected from the first and second algorithms by a user operation on the input unit 54, the first existing switching unit 5111 is set to the "OFF" state and the common switching unit 5114 is set to the "ON" state under the control of the control unit 52. As a result, the first existing imaging data (RAW data) output from the first existing endoscope 201 is input to the common data processing unit 5124. Furthermore, the common data processing unit 5124 performs data processing on the first existing imaging data (RAW data) using the second algorithm to generate a video signal. Then, a display image based on the video signal is displayed on the display device 4.
[0062] [Operations when a user uses a second conventional endoscope] Next, a description will be given of operations when a user uses a second conventional endoscope 202. That is, in this case, only the second conventional endoscope 202 is connected to the control device 5 out of the first to third conventional endoscopes 201 to 203 and the latest endoscope 204.
[0063] When the processing module 51 executes data processing on the second existing imaging data (RAW data) obtained by imaging using the second existing endoscope 202 (data processing step), the processing module 51 operates as follows.
[0064] The operation of the processing module 51 when the user uses the second existing endoscope 202 is the same as that described above in the "operation when the user uses the first existing endoscope," except that "first existing switching unit 5111" is replaced with "second existing switching unit 5112," "first existing endoscope 201" is replaced with "second existing endoscope 202," "first existing imaging data (RAW data)" is replaced with "second existing imaging data (RAW data)," and "first existing data processing unit 5121" is replaced with "second existing data processing unit 5122."
[0065] [Operations when a user uses a third conventional endoscope] Next, a description will be given of operations when a user uses a third conventional endoscope 203. That is, in this case, of the first to third conventional endoscopes 201 to 203 and the latest endoscope 204, only the third conventional endoscope 203 is connected to the control device 5.
[0066] When the processing module 51 executes data processing on the third existing imaging data (RAW data) obtained by imaging using the third existing endoscope 203 (data processing step), the processing module 51 operates as follows.
[0067] The operation of the processing module 51 when the user uses the third existing endoscope 203 is the same as that in the above-mentioned "operation when the user uses the first existing endoscope," except that "first existing switching unit 5111" is replaced with "third existing switching unit 5113," "first existing endoscope 201" is replaced with "third existing endoscope 203," "first existing imaging data (RAW data)" is replaced with "third existing imaging data (RAW data)," and "first existing data processing unit 5121" is replaced with "third existing data processing unit 5123."
[0068] [Operations when a user uses the latest endoscope] Next, a description will be given of operations when a user uses the latest endoscope 204. That is, in this case, of the first to third existing endoscopes 201 to 203 and the latest endoscope 204, only the latest endoscope 204 is connected to the control device 5.
[0069] When the processing module 51 executes data processing on the latest imaging data (RAW data) obtained by imaging using the latest endoscope 204 (data processing step), the processing module 51 operates as follows.
[0070] The latest imaging data (RAW data) output from the latest endoscope 204 is input directly to the common data processing unit 5124 without going through the switching unit 511. In addition, the common data processing unit 5124 performs data processing on the latest imaging data (RAW data) using a second algorithm to generate a video signal. Then, a display image based on the video signal is displayed on the display device 4.
[0071] The above-described embodiment provides the following advantages. The control device 5 according to this embodiment processes first existing imaging data obtained by imaging with the first existing endoscope 201 using an algorithm selected in response to a user operation from among a first algorithm dedicated to the first existing endoscope 201 and a second algorithm compatible with both the first existing endoscope 201 and the latest endoscope 204. The same applies to second and third existing imaging data obtained by imaging with the second and third existing endoscopes 202 and 203. Meanwhile, the control device 5 processes latest imaging data obtained by imaging with the latest endoscope 204 using the second algorithm. Therefore, endoscopic images preferred by both the first and second users can be generated, improving convenience. The first user prefers that, even after updating the control device 5, endoscopic images generated using an older endoscope 2 appear exactly the same as those generated using the pre-update control device. The second user is a user who, when using an older endoscope 2 after updating the control device 5, prefers that the updated control device 5 generate endoscopic images whose data has been processed using the latest algorithm.
[0072] Other Embodiments Although the embodiments for carrying out the present invention have been described above, the present invention should not be limited to the above-described embodiments. The configurations of the following modified examples 1 to 6 may also be adopted.
[0073] (Variation 1) Fig. 3 is a diagram illustrating Variation 1 of the embodiment. Specifically, Fig. 3 is a block diagram corresponding to Fig. 2. In the above-described embodiment, the configuration of the processing module 51 may be changed to the configuration of Variation 1 shown in Fig. 3. For ease of explanation, the processing module 51 according to Variation 1 will be referred to as processing module 51A below.
[0074] 3, the processing module 51A includes the switching unit 511 described in the above embodiment as well as first and second data processing units 513 and 514. These first and second data processing units 513 and 514 are configured with FPGAs or GPUs. For example, the first data processing unit 513 may be configured with an FPGA, and the second data processing unit 514 may be configured with a GPU.
[0075] The first data processing unit 513 performs data processing corresponding to the type of the endoscope 2 on the input imaging data of the first to third existing imaging data (RAW data) and the latest imaging data (RAW data). As shown in Fig. 3, the first data processing unit 513 has substantially the same configuration as the data processing unit 512 described in the above-mentioned embodiment. For convenience of explanation, the first to third existing data processing units 5121 to 5123 and the common data processing unit 5124 according to this modification 1 will be referred to below as the first to third existing data processing units 5121A to 5123A and the common data processing unit 5124A, respectively.
[0076] The first existing data processing unit 5121A executes data processing on the input first existing imaging data (RAW data) using a dedicated algorithm according to the first existing endoscope 201. This algorithm corresponds to the first algorithm according to the present invention.
[0077] Here, the data processing executed by the first existing data processing unit 5121A includes adjustment of resolution, contrast, noise removal, etc. according to the first existing endoscope 201, and brightness correction (gain correction).
[0078] The second existing data processing unit 5122A executes data processing on the input second existing imaging data (RAW data) using a dedicated algorithm according to the second existing endoscope 202. This algorithm corresponds to the first algorithm according to the present invention.
[0079] Here, the data processing executed by the second existing data processing unit 5122A includes adjustment of resolution, contrast, noise removal, etc. according to the second existing endoscope 202, and brightness correction (gain correction).
[0080] The third existing data processing unit 5123A executes data processing on the input third existing imaging data (RAW data) using a dedicated algorithm according to the third existing endoscope 203. This algorithm corresponds to the first algorithm according to the present invention.
[0081] Here, the data processing executed by the third existing data processing unit 5123A includes adjustment of resolution, contrast, noise removal, etc. according to the third existing endoscope 203, and brightness correction (gain correction).
[0082] The common data processing unit 5124A processes the input imaging data from among the first to third existing imaging data (RAW data) and the latest imaging data (RAW data) using an algorithm that is a later design generation algorithm than the above-mentioned first algorithm and that is compatible with all endoscopes 2, the first to third existing endoscopes 201 to 203 and the latest endoscope 204. This algorithm is the latest algorithm designed at the same time when the control device 5 was released or when the software that is the main part of the control device 5 was updated, and corresponds to the second algorithm according to the present invention.
[0083] Here, the data processing executed by the common data processing unit 5124A mainly includes adjustment of resolution, contrast, noise removal, etc., and brightness correction (gain correction) according to the latest endoscope 204. As described above, this data processing is data processing using an algorithm compatible with all endoscopes 2, namely the first to third existing endoscopes 201 to 203 and the latest endoscope 204. For this reason, the adjustment of resolution, contrast, noise removal, etc., and brightness correction (gain correction) can also be applied to the first to third existing imaging data.
[0084] The second data processing unit 514 performs data processing that does not correspond to the type of endoscope 2 on the imaging data after data processing has been performed by the first data processing unit 513, and generates a video signal based on the imaging data.
[0085] Here, the data processing executed by the second data processing unit 514 includes image processing according to the display characteristics of the display device 4 and color adjustment according to, for example, a user operation on the input unit 54. Examples of the display characteristics of the display device 4 include the color balance and gamma curve of the display device 4.
[0086] The data processing performed by the first data processing unit 513 or the data processing performed by the second data processing unit 514 may include optical black subtraction processing (clamping processing), white balance adjustment processing, demosaic processing, color correction matrix processing, gamma correction processing, YC processing for converting RGB signals into luminance color difference signals (Y, Cb / Cr signals), and the like.
[0087] In Figure 3, for ease of explanation, dots are used to indicate the parts (first to third existing data processing units 5121A to 5123A) that perform data processing using an algorithm (first algorithm) that was used in the past, and diagonal lines are used to indicate the parts (common data processing unit 5124A) that perform data processing using an algorithm (second algorithm) that can be used in common for all of the first to third existing endoscopes 201 to 203 and the latest endoscope 204.
[0088] The medical image processing method according to the first modification is similar to the medical image processing method described in the above embodiment, and therefore a description thereof will be omitted.
[0089] Even when the configuration of the present modified example 1 described above is adopted, the same effects as those of the above-described embodiment are achieved.
[0090] (Variation 2) Fig. 4 is a diagram illustrating Variation 2 of the embodiment. Specifically, Fig. 4 is a block diagram corresponding to Fig. 2. The control device 5 according to Variation 2 is configured to be connectable to various display devices 4 of different release generations. Hereinafter, of the various display devices 4, an existing display device 4 will be referred to as an existing display device 401 (Fig. 4). Furthermore, of the various display devices 4, the latest display device 4 will be referred to as a latest display device 402 (Fig. 4).
[0091] Here, the latest display device 402 is a display device of the same release generation as the control device 5, or a display device that was released at the same time that the software that is the main part of the control device 5 was updated. Also, the existing display device 401 is a display device of an earlier release generation than the latest display device 402.
[0092] The existing display device 401 and the latest display device 402 have different display characteristics, etc. Examples of the display characteristics include the color balance and gamma curve of the display device 4.
[0093] In the above-described embodiment, the configuration of the processing module 51 may be changed to the configuration of Modification 2 shown in Fig. 4. For ease of explanation, the processing module 51 according to Modification 2 will be referred to as processing module 51B below.
[0094] As shown in FIG. 4, the processing module 51B includes a switching unit 515 and a second data processing unit 514B in addition to the switching unit 511 and first data processing unit 513 described in the first modification example.
[0095] Under the control of the control unit 52, the switching unit 515 switches the output destination of the first to third existing imaging data after data processing is performed from the first to third existing data processing units 5121A to 5123A to the existing data processing unit 5141 (Figure 4) or the common data processing unit 5142 (Figure 4) in the second data processing unit 514B.
[0096] Similar to the second data processing unit 514 described in the above-mentioned modified example 1, the second data processing unit 514B performs data processing that does not correspond to the type of endoscope 2 on the imaging data after data processing has been performed by the first data processing unit 513, and generates a video signal based on the imaging data. As shown in Fig. 4, this second data processing unit 514B includes an existing data processing unit 5141 and a common data processing unit 5142.
[0097] The existing data processing unit 5141 performs data processing that does not correspond to the type of endoscope 2 on the input existing imaging data from the first to third existing imaging data after data processing from the first to third existing data processing units 5121A to 5123A has been performed, and generates a video signal based on the existing imaging data.
[0098] Here, the data processing executed by the existing data processing unit 5141 includes image processing according to the display characteristics of the existing display device 401 and color adjustment according to user operations on the input unit 54, for example.
[0099] The common data processing unit 5142 performs data processing that does not correspond to the type of endoscope 2 on the input imaging data from the first to third existing imaging data and the latest imaging data after data processing from the first to third existing data processing units 5121A to 5123A and the common data processing unit 5124A has been performed, and generates a video signal based on the imaging data.
[0100] Here, the data processing executed by the common data processing unit 5142 includes image processing according to the display characteristics of the latest display device 402 and color adjustment according to user operations on the input unit 54, for example.
[0101] For ease of explanation, in Figure 4, dots are used to indicate parts that perform data processing using algorithms that were used in the past (including the first algorithm) (the first to third existing data processing units 5121A to 5123A and the existing data processing unit 5141), and diagonal lines are used to indicate parts that perform data processing using algorithms that can be used in common for all of the first to third existing endoscopes 201 to 203 and the latest endoscope 204 (including the second algorithm).
[0102] Next, the operation of the processing module 51B described above will be explained. Note that the operation of the switching unit 511 is the same as that described in the above embodiment. Therefore, the following mainly describes the operations of the switching unit 515 and the second data processing unit 514B.
[0103] First, the operation when a user uses the first existing endoscope 201 will be described. When the user operates the input unit 54 to select the existing display device 401 from the existing display device 401 and the latest display device 402, under the control of the control unit 52, the switching unit 515 switches the output destination of the first existing imaging data after data processing from the first existing data processing unit 5121A to the existing data processing unit 5141. As a result, the existing data processing unit 5141 processes the first existing imaging data and generates a video signal. Then, a display image based on the video signal is displayed on the existing display device 401.
[0104] On the other hand, when the latest display device 402 is selected from the existing display device 401 and the latest display device 402 by a user operation on the input unit 54, the switching unit 515, under the control of the control unit 52, switches the output destination of the first existing imaging data after data processing from the first existing data processing unit 5121A to the common data processing unit 5142. As a result, the common data processing unit 5142 processes the first existing imaging data and generates a video signal. Then, a display image based on the video signal is displayed on the latest display device 402.
[0105] In addition, the operations when the user uses the second existing endoscope 202 are the same as those in the above-mentioned "operations when the user uses the first existing endoscope 201," except that "first existing data processing unit 5121A" is read as "second existing data processing unit 5122A" and "first existing imaging data" is read as "second existing imaging data."
[0106] In addition, the operations when the user uses the third existing endoscope 203 are the same as those in the above-mentioned "operations when the user uses the first existing endoscope 201," except that "first existing data processing unit 5121A" is read as "third existing data processing unit 5123A" and "first existing imaging data" is read as "third existing imaging data."
[0107] Next, the operation when a user uses the latest endoscope 204 will be described. The latest imaging data after data processing from the common data processing unit 5124A is input directly to the common data processing unit 5142 without passing through the switching unit 515. The common data processing unit 5142 also performs data processing on the latest imaging data to generate a video signal. An image based on the video signal is then displayed on the latest display device 402.
[0108] The above-described second modification provides the same effects as the above-described embodiment, as well as the following effects: The second modification can generate appropriate endoscopic images compatible with various display devices 4, thereby further improving convenience.
[0109] (Variation 3) Fig. 5 is a diagram illustrating Variation 3 of the embodiment. Specifically, Fig. 5 is a block diagram corresponding to Fig. 2. In Variation 2 described above, the configuration of processing module 51B may be changed to the configuration of Variation 3 shown in Fig. 5. For ease of explanation, the processing module 51B according to Variation 3 will be referred to as processing module 51C below.
[0110] As shown in FIG. 5, the processing module 51C includes the switching units 511, 515 and the first and second data processing units 513, 514B described in the above-mentioned variant example 2, as well as a switching unit 516 and a third data processing unit 517.
[0111] Under the control of the control unit 52, the switching unit 516 switches the output destination of the first to third existing imaging data after data processing is performed from the first to third existing data processing units 5121A to 5123A to the existing data processing unit 5171 (Figure 5) or the common data processing unit 5172 (Figure 5) in the third data processing unit 517.
[0112] The third data processing unit 517 performs data processing on the imaging data after the data processing by the first data processing unit 513, corresponding to a set setting mode among a plurality of setting modes for providing diagnostic support. Here, the plurality of setting modes include at least one of a normal light observation mode in which white light is irradiated into the living body, a special light observation mode in which narrow-band excitation light that excites a fluorescent agent such as indocyanine green or narrow-band light used in NBI is irradiated into the living body, and a structure-enhanced observation mode in which structure is enhanced by image processing. One of the plurality of setting modes is set, for example, by a user operation on the input unit 54. As shown in FIG. 5 , the third data processing unit 517 includes an existing data processing unit 5171 and a common data processing unit 5172.
[0113] The existing data processing unit 5171 performs data processing corresponding to the set setting mode on the input existing imaging data from the first to third existing imaging data after data processing from the first to third existing data processing units 5121A to 5123A has been performed.
[0114] Here, the data processing performed by the existing data processing unit 5171 is data processing corresponding to a setting mode used in a control device (hereinafter referred to as a conventional control device) released in a generation earlier than the control device 5. For example, if the conventional control device is provided with only a normal light observation mode among the various observation modes described above, the data processing performed by the existing data processing unit 5171 is image processing corresponding to the normal light observation mode. In other words, the data processing performed by the existing data processing unit 5171 is data processing performed by an existing algorithm.
[0115] As shown in Figure 5, the switching unit 515 in this variant example 3 switches the output destination of the first to third existing imaging data after data processing from the existing data processing unit 5171 is performed to the existing data processing unit 5141 or the common data processing unit 5142 in the second data processing unit 514B under the control of the control unit 52.
[0116] The common data processing unit 5172 performs data processing corresponding to the set setting mode on the input imaging data from the first to third existing imaging data and the latest imaging data after data processing from the first to third existing data processing units 5121A to 5123A and the common data processing unit 5124A has been performed.
[0117] Here, the data processing performed by the common data processing unit 5172 includes data processing corresponding to setting modes used in control devices (hereinafter referred to as conventional control devices) that were released in a generation earlier than the control device 5, as well as data processing corresponding to setting modes newly added at the time of release of the control device 5. For example, if the newly added setting mode is a special light observation mode in which a new fluorescent agent is excited by excitation light that is narrowband light in a new wavelength band, the data processing performed by the common data processing unit 5172 includes image processing corresponding to the special steel observation mode. Furthermore, if the newly added setting mode is a structure-enhanced observation mode, the data processing performed by the common data processing unit 5172 includes filter processing for structure enhancement. In other words, the data processing performed by the common data processing unit 5172 is data processing performed using the latest algorithms.
[0118] In Figure 5, for ease of explanation, dots are used to indicate parts that perform data processing using algorithms that were used in the past (including the first algorithm) (the first to third existing data processing units 5121A to 5123A and the existing data processing units 5141, 5171), and diagonal lines are used to indicate parts that perform data processing using algorithms that can be used in common for all of the first to third existing endoscopes 201 to 203 and the latest endoscope 204 (including the second algorithm).
[0119] Next, the operation of the processing module 51C will be described. Note that the operations of the switching units 511 and 515 are the same as those described in the above-mentioned embodiment and Modification 2. Therefore, the following mainly describes the operations of the switching unit 516 and the third data processing unit 517.
[0120] First, a description will be given of the operation when a user uses the first existing endoscope 201. When the user operates the input unit 54 to select the existing algorithm from among the existing algorithm and the latest algorithm, under the control of the control unit 52, the switching unit 516 switches the output destination of the first existing imaging data after data processing from the first existing data processing unit 5121A to the existing data processing unit 5171. As a result, the existing data processing unit 5171 processes the first existing imaging data using the existing algorithm according to the set setting mode.
[0121] On the other hand, when the latest algorithm is selected from the existing algorithm and the latest algorithm by a user operation on the input unit 54, under the control of the control unit 52, the switching unit 516 switches the output destination of the first existing imaging data after data processing from the first existing data processing unit 5121A to the common data processing unit 5172. As a result, the common data processing unit 5172 processes the first existing imaging data using the latest algorithm according to the set setting mode.
[0122] In addition, the operations when the user uses the second existing endoscope 202 are the same as those in the above-mentioned "operations when the user uses the first existing endoscope 201," except that "first existing data processing unit 5121A" is read as "second existing data processing unit 5122A" and "first existing imaging data" is read as "second existing imaging data."
[0123] In addition, the operations when the user uses the third existing endoscope 203 are the same as those in the above-mentioned "operations when the user uses the first existing endoscope 201," except that "first existing data processing unit 5121A" is read as "third existing data processing unit 5123A" and "first existing imaging data" is read as "third existing imaging data."
[0124] Next, a description will be given of the operation when a user uses the latest endoscope 204. The latest imaging data after data processing from the common data processing unit 5124A is input directly to the common data processing unit 5172 without passing through the switching unit 516. Then, in the common data processing unit 5172, data processing is performed on the latest imaging data using the latest algorithm corresponding to the set mode.
[0125] The above-described third modification provides the following effects in addition to the same effects as those of the above-described embodiment and second modification: The third modification can generate appropriate endoscopic images corresponding to observation modes that provide new diagnostic support, thereby further improving convenience.
[0126] The third data processing unit 517 may perform data processing at a stage prior to the first data processing unit 513 .
[0127] 6 is a diagram illustrating a fourth modification of the embodiment. In the above-described embodiment, when the user is prompted to select either the first or second algorithm, the algorithm to be selected may be displayed on the display device 4 based on a scope ID (identifier).
[0128] Specifically, the scope ID is identification information unique to the endoscope 2 that identifies the endoscope 2 connected to the control device 5, and corresponds to device identification information according to the present invention. The scope ID of the first existing endoscope 201 is "Type A" as shown in FIG. 6 . The scope ID is stored in a memory (not shown) provided in the first existing endoscope 201. The scope ID of the second existing endoscope 202 is "Type B". The scope ID is stored in a memory (not shown) provided in the second existing endoscope 202. The scope ID of the third existing endoscope 203 is "Type C". The scope ID is stored in a memory (not shown) provided in the third existing endoscope 203. The scope ID of the latest endoscope 204 is "New Scope". The scope ID is stored in a memory (not shown) provided in the latest endoscope 204.
[0129] The control unit 52 according to the fourth modification reads a scope ID from a memory (not shown) of the endoscope 2 connected to the control device 5 and determines the type of the endoscope 2 (determination step). If the control unit 52 determines that the type of the endoscope 2 is the first existing endoscope 201 (the scope ID is "Type A"), it causes the display device 4 to display "the first algorithm or the second algorithm for Type A" as an algorithm to be selected, as shown in FIG. 6 . If the control unit 52 determines that the type of the endoscope 2 is the second existing endoscope 202 (the scope ID is "Type B"), it causes the display device 4 to display "the first algorithm or the second algorithm for Type B" as an algorithm to be selected. If the control unit 52 determines that the type of the endoscope 2 is the third existing endoscope 203 (the scope ID is "Type C"), it causes the display device 4 to display "the first algorithm or the second algorithm for Type C" as an algorithm to be selected. Furthermore, when the control unit 52 determines that the type of the endoscope 2 is the latest endoscope 204 (the scope ID is "New Scope"), it causes the display device 4 to display a "second algorithm" as the algorithm to be executed. That is, the control unit 52 according to the present modification 4 has the function of a determination unit according to the present invention.
[0130] According to the fourth modification described above, in addition to the same effects as those of the above-described embodiment, the following effects are achieved: According to the fourth modification, selectable algorithms can be presented to the user, thereby further improving convenience.
[0131] 7 is a diagram illustrating a fifth modification of the embodiment. In the above-described embodiment, when the control unit 52 controls the operation of the switching unit 511, the control unit 52 may control the operation of the switching unit 511 based on reference information stored in the storage unit 53.
[0132] Specifically, the control unit 52 stores in the storage unit 53 reference information that associates the scope ID acquired when the conventional endoscope system 1 was used, the user ID that identifies the user who used the endoscope 2, and algorithm information that indicates the algorithm used from the first and second algorithms. The scope ID is the scope ID described in the above-mentioned modification example 4. The user ID is identification information unique to the user who used the endoscope 2, and is input by the user's operation on the input unit 54, for example, and corresponds to the user identification information according to the present invention. Note that FIG. 7 illustrates an example of the reference information stored in the storage unit 53.
[0133] The control unit 52 then recognizes, from the reference information stored in the storage unit 53, algorithm information associated with the scope ID and user ID acquired during the current use of the endoscopic system 1 (recognition step). The control unit 52 also controls the operation of the switching unit 511 so as to cause the processing module 51 to execute data processing using an algorithm corresponding to the recognized algorithm information. For example, if the scope ID and user ID acquired during the current use of the endoscopic system 1 are “Type A” and “User a,” respectively, the control unit 52 recognizes “first algorithm for Type A” as algorithm information associated with the scope ID and user ID from the reference information. The control unit 52 then sets the first existing switching unit 5111 to the “ON” state and the common switching unit 5114 to the “OFF” state so as to cause the processing module 51 to execute data processing using the “first algorithm for Type A.” That is, the control unit 52 according to the fifth modification has the function of a recognition unit according to the present invention.
[0134] The fifth modification described above provides the same effects as the above-described embodiment, as well as the following effects: According to the fifth modification, once the first algorithm or the second algorithm has been selected only once, it will be automatically selected thereafter, eliminating the need for the user to select an algorithm and further improving convenience.
[0135] When the configuration of this variant 5 is applied to the configuration of the above-mentioned variant 2, the reference information may be associated with the scope ID acquired when the previous endoscopic system 1 was used, the user ID identifying the user who used the endoscope 2, algorithm information indicating the algorithm used from the first and second algorithms, as well as display device information indicating the display device selected from the existing display device 401 and the latest display device 402.
[0136] That is, the control unit 52 recognizes, from the reference information stored in the storage unit 53, the algorithm information and display device information associated with the scope ID and user ID respectively acquired during the current use of the endoscope system 1. Then, the control unit 52 controls the operation of the switching unit 511 to cause the processing module 51 to execute data processing using an algorithm corresponding to the recognized algorithm information. Furthermore, the control unit 52 controls the operation of the switching unit 515 to cause the display device 4 corresponding to the recognized display device information to display a display image.
[0137] 8 is a diagram illustrating a sixth modification of the embodiment. In the third modification, when the control unit 52 controls the operation of the switching unit 511, the control unit 52 may control the operation of the switching unit 511 based on reference information stored in the storage unit 53.
[0138] Specifically, the control unit 52 stores in the storage unit 53 reference information that associates the scope IDs acquired when the conventional endoscope system 1 was used, mode information indicating the setting mode that was set among a plurality of setting modes for providing diagnostic support, and algorithm information indicating the algorithm that was used among the first and second algorithms. The scope IDs are the scope IDs described in the above-mentioned Modification 4. Note that FIG. 8 illustrates an example of the reference information stored in the storage unit 53.
[0139] The control unit 52 then recognizes, from the reference information stored in the storage unit 53, algorithm information associated with the scope ID and mode information acquired during the current use of the endoscopic system 1 (recognition step). The control unit 52 also controls the operation of the switching unit 511 so as to cause the processing module 51B to execute data processing using an algorithm corresponding to the recognized algorithm information. For example, when the scope ID and mode information acquired during the current use of the endoscopic system 1 are "Type A" and "Mode α," the control unit 52 recognizes a "second algorithm" as the algorithm information associated with the scope ID and mode information from the reference information. The control unit 52 then turns the first existing switching unit 5111 to the "OFF" state and the common switching unit 5114 to the "ON" state so as to cause the processing module 51B to execute data processing using the "second algorithm." That is, the control unit 52 according to the fifth modification functions as a recognition unit according to the present invention.
[0140] Even when the configuration of the sixth modification described above is adopted, the same effects as those of the third and fifth modifications described above are achieved.
[0141] (Variant 7) In the above-mentioned variant 6, the reference information may be associated with the scope ID acquired when the previous endoscopic system 1 was used, mode information indicating the setting mode that was set among multiple setting modes for providing diagnostic support, algorithm information indicating the algorithm that was used among the first and second algorithms, second algorithm information indicating the algorithm selected from the existing algorithm and the latest algorithm, and display device information indicating the display device selected from the existing display device 401 and the latest display device 402.
[0142] That is, the control unit 52 recognizes, from the reference information stored in the storage unit 53, the algorithm information, second algorithm information, and display device information associated with the scope ID and mode information respectively acquired during the current use of the endoscope system 1. Then, the control unit 52 controls the operation of the switching unit 511 to cause the processing module 51B to execute data processing using an algorithm corresponding to the recognized algorithm information. The control unit 52 also controls the operation of the switching unit 516 to cause the processing module 51B to execute data processing using an algorithm corresponding to the recognized second algorithm information. Furthermore, the control unit 52 controls the operation of the switching unit 515 to cause the display device 4 corresponding to the recognized display device information to display an image.
[0143] Even when the configuration of the above-described modified example 7 is adopted, the same effects as those of the above-described modified example 6 are achieved.
[0144] (Variation 8) In the above-described Variation 6, the reference information may be associated with a user ID in addition to the scope ID acquired when the previous endoscopic system 1 was used, mode information indicating a setting mode selected from multiple setting modes for diagnostic assistance, and algorithm information indicating a used algorithm from the first and second algorithms. That is, the control unit 52 recognizes, from the reference information stored in the storage unit 53, the algorithm information associated with the scope ID, mode information, and user ID acquired when the current endoscopic system 1 was used (recognition step). Then, the control unit 52 controls the operation of the switching unit 511 to cause the processing module 51B to perform data processing using an algorithm corresponding to the recognized algorithm information.
[0145] Even when the configuration of the eighth modified example described above is adopted, the same effects as those of the sixth modified example described above can be achieved.
[0146] (Variation 9) In the above-described embodiment and variations 1 to 8, the number of existing data processing units (first to third existing data processing units 5121 to 5123 (5121A to 5123A)) is not limited to three and may be any other number. The number of existing data processing units may be provided according to the number of existing endoscopes (first to third existing endoscopes 201 to 203). Furthermore, in variations 2 and 3 described above, the number of existing data processing units 5141, 5171 is not limited to one and may be any other number.
[0147] (Variation 10) In the above-described embodiment and variations 1 to 9, the medical image processing device according to the present invention is mounted in an endoscopic system 1 in which the endoscope 2 is configured as a flexible endoscope, but this is not limiting. For example, the medical image processing device according to the present invention may be mounted in an endoscopic system in which the endoscope 2 is configured as a rigid endoscope. Furthermore, the medical image processing device according to the present invention may be mounted in a medical observation system including a surgical microscope (see, for example, JP 2016-42981 A) that magnifies and observes a predetermined field of view inside a subject (inside a living body) or on the surface of a subject (surface of a living body). In this case, the surgical microscope corresponds to the medical observation device according to the present invention.
[0148] REFERENCE SIGNS LIST 1 Endoscope system 2 Endoscope 3 Light source device 4 Display device 5 Control device 21 Insertion section 22 Operation section 23 Universal cord 24 Connector section 51, 51A to 51C Processing module 52 Control section 53 Memory section 54 Input section 201 First existing endoscope 202 Second existing endoscope 203 Third existing endoscope 204 Latest endoscope 211 Tip unit 212 Bending section 213 Flexible tube 401 Existing display device 402 Latest display device 511 Switching section 512 Data processing section 513 First data processing section 514, 514B Second data processing section 515 Switching section 516 Switching section 517 Third data processing section 5111 First existing use switching section 5112 Second existing use switching section 5113 Third existing use switching section 5114 Common switching units 5121, 5121A First existing data processing unit 5122, 5122A Second existing data processing unit 5123, 5123A Third existing data processing unit 5124, 5124A Common data processing unit 5141 Existing data processing unit 5142 Common data processing unit 5171 Existing data processing unit 5172 Common data processing unit
Claims
1. A medical image processing device, comprising: a processing module that performs data processing on input imaging data; The processing module includes: a first algorithm capable of processing first imaging data obtained by imaging using a first endoscope, and a second algorithm capable of processing the first imaging data and second imaging data obtained by imaging using a second endoscope; where: The processing module includes: Identify the type of endoscope connected, when a connection with the first endoscope is detected, data processing is performed using an algorithm selected in response to a user operation from the first algorithm and the second algorithm; a medical image processing device that, when detecting a connection with the second endoscope, executes data processing using the second algorithm;
2. The first algorithm comprises: a dedicated algorithm corresponding to the first endoscope, The second algorithm comprises:
2. The medical image processing device according to claim 1, wherein the algorithm is of a later design generation than the first algorithm and is compatible with both the first endoscope and the second endoscope, which is an endoscope of a later release generation than the first endoscope.
3. a processing module that performs data processing on imaging data obtained by imaging using the medical observation device; an operation receiving unit that receives a user operation, The processing module includes: for first imaging data obtained by imaging with a first medical observation device among the medical observation devices, data processing is performed using an algorithm selected in response to the user's operation from among a first algorithm dedicated to the first medical observation device and a second algorithm that is an algorithm of a later design generation than the first algorithm and is compatible with both the first medical observation device and a second medical observation device that is a medical observation device of a later release generation than the first medical observation device, a medical image processing device that performs data processing on second imaging data obtained by imaging using the second medical observation device using the second algorithm;
4. The processing module includes: a first data processing unit that performs data processing corresponding to the type of the medical observation device on the first imaging data or the second imaging data; 4. The medical image processing apparatus according to claim 3, further comprising: a second data processing unit that performs data processing that does not correspond to a type of the medical observation device on the first imaging data or the second imaging data after data processing has been performed by the first data processing unit.
5. The data processing corresponding to the type of the medical observation device is The medical image processing apparatus according to claim 4 , further comprising at least one of noise removal and brightness correction corresponding to the type of the medical observation apparatus.
6. The data processing that does not correspond to the type of the medical observation device is: The medical image processing apparatus according to claim 4 , further comprising image processing in accordance with the display characteristics of a display device connected to said medical image processing apparatus.
7. The processing module includes: The medical image processing device according to claim 4 , further comprising a third data processing unit that executes data processing on the first imaging data or the second imaging data corresponding to a set setting mode among a plurality of setting modes for providing diagnostic assistance.
8. a discrimination unit that discriminates the medical observation device connected to the medical image processing device based on device identification information unique to the medical observation device that identifies the medical observation device connected to the medical image processing device, The processing module includes: when the discrimination unit discriminates that the medical observation device connected to the medical image processing device is the first medical observation device, data processing is performed on the first imaging data using an algorithm selected in response to the user operation from the first algorithm and the second algorithm; 4. The medical image processing device according to claim 3, wherein when the discrimination unit discriminates that the medical observation device connected to the medical image processing device is the second medical observation device, data processing is performed on the second imaging data using the second algorithm.
9. a storage unit that stores reference information that associates device identification information that identifies the medical observation device connected to the medical image processing device, which information was acquired when the medical image processing device was previously used, user identification information that identifies a user who used the medical observation device, and algorithm information that indicates which of the first algorithm and the second algorithm was used; a recognition unit that recognizes the algorithm information associated with the device identification information and the user identification information, respectively acquired during the current use of the medical image processing device, from the reference information; The processing module includes: The medical image processing device according to claim 3, wherein, when the medical image processing device is currently in use, data processing is performed on the first imaging data or the second imaging data using an algorithm corresponding to the algorithm information recognized by the recognition unit.
10. a storage unit that stores reference information that associates device identification information that identifies the medical observation device connected to the medical image processing device, which information was acquired when the medical image processing device was previously used, mode information that indicates a setting mode that was set among a plurality of setting modes for performing diagnostic support, and algorithm information that indicates the algorithm that was used among the first algorithm and the second algorithm; a recognition unit that recognizes the algorithm information associated with the device identification information and the mode information, respectively acquired during the current use of the medical image processing device, from the reference information; The processing module includes: The medical image processing apparatus according to claim 3 , wherein data processing is performed on the first imaging data or the second imaging data using an algorithm corresponding to the algorithm information recognized by the recognition unit.
11. a storage unit that stores reference information that associates device identification information that identifies the medical observation device connected to the medical image processing device, which information was acquired when the medical image processing device was previously used, user identification information that identifies a user who used the medical observation device, mode information that indicates a set setting mode among a plurality of setting modes for performing diagnostic support, and algorithm information that indicates a used algorithm among the first algorithm and the second algorithm; a recognition unit that recognizes the algorithm information associated with the device identification information, the user identification information, and the mode information, each of which is acquired during the current use of the medical image processing device, from the reference information; The processing module includes: The medical image processing apparatus according to claim 3 , wherein data processing is performed on the first imaging data or the second imaging data using an algorithm corresponding to the algorithm information recognized by the recognition unit.
12. The plurality of setting modes include:
11. The medical image processing device according to claim 10, comprising at least one of a normal light observation mode in which normal light is irradiated onto the subject, a special light observation mode in which narrowband light is irradiated onto the subject, and a structure-enhanced observation mode in which structure is enhanced by image processing.
13. The first data processing unit and the second data processing unit are 5. The medical image processing device according to claim 4, which is configured by an FPGA (Field-Programmable Gate Array) or a GPU (Graphics Processing Unit).
14. The first data processing unit It is configured by FPGA, The second data processing unit The medical image processing device according to claim 13, which is configured by a GPU.
15. The medical observation device is 4. The medical image processing apparatus according to claim 3, which is an endoscope that is inserted into a subject and generates the imaging data by imaging the inside of the subject.
16. A medical image processing method executed by a medical image processing device, comprising: a data processing step of performing data processing on imaging data obtained by imaging using the medical observation device; In the data processing step, for first imaging data obtained by imaging with a first medical observation device among the medical observation devices, data processing is performed using an algorithm selected in response to a user operation from among a first algorithm dedicated to the first medical observation device and a second algorithm that is an algorithm of a later design generation than the first algorithm and is compatible with both the first medical observation device and a second medical observation device that is a medical observation device of a later release generation than the first medical observation device, A medical image processing method, comprising: performing data processing using the second algorithm on second imaging data obtained by imaging using the second medical observation device.
17. a determination step of determining the medical observation device connected to the medical image processing apparatus based on device identification information unique to the medical observation device that identifies the medical observation device connected to the medical image processing apparatus, In the data processing step, when it is determined in the determining step that the medical observation device connected to the medical image processing device is the first medical observation device, data processing is performed on the first imaging data using an algorithm selected in response to the user operation from the first algorithm and the second algorithm; 17. The medical image processing method according to claim 16, wherein, when the determining step determines that the medical observation device connected to the medical image processing device is the second medical observation device, data processing is performed on the second imaging data using the second algorithm.
18. a recognition step of recognizing the algorithm information associated with the device identification information and the user identification information acquired when the medical image processing device is currently being used from reference information that associates device identification information for identifying the medical observation device connected to the medical image processing device, user identification information for identifying a user who used the medical observation device, and algorithm information indicating which of the first algorithm and the second algorithm was used, each acquired when the medical image processing device was previously used; In the data processing step, 17. The medical image processing method according to claim 16, wherein, when the medical image processing device is currently in use, data processing is performed on the first imaging data or the second imaging data using an algorithm corresponding to the algorithm information recognized by the recognition step.
19. a recognition step of recognizing, from reference information associating device identification information for identifying the medical observation device connected to the medical image processing device, which was acquired when the medical image processing device was previously used, mode information indicating a setting mode set among a plurality of setting modes for performing diagnostic support, and algorithm information indicating an algorithm used among the first algorithm and the second algorithm, the algorithm information associated with the device identification information and the mode information acquired when the medical image processing device is currently used, In the data processing step, 17. The medical image processing method according to claim 16, wherein data processing is performed on the first imaging data or the second imaging data using an algorithm corresponding to the algorithm information recognized in the recognition step.
20. A medical image processing program to be executed by a medical image processing device, The medical image processing program The medical image processing device includes: a data processing step of performing data processing on imaging data obtained by imaging using the medical observation device; In the data processing step, for first imaging data obtained by imaging with a first medical observation device among the medical observation devices, data processing is performed using an algorithm selected in response to a user operation from among a first algorithm dedicated to the first medical observation device and a second algorithm that is an algorithm of a later design generation than the first algorithm and is compatible with both the first medical observation device and a second medical observation device that is a medical observation device of a later release generation than the first medical observation device, a medical image processing program that processes second imaging data obtained by imaging using the second medical observation device using the second algorithm;
21. The medical image processing program The medical image processing device includes: further executing a determination step of determining the medical observation device connected to the medical image processing device based on device identification information unique to the medical observation device that identifies the medical observation device connected to the medical image processing device; In the data processing step, when it is determined in the determining step that the medical observation device connected to the medical image processing device is the first medical observation device, data processing is performed on the first imaging data using an algorithm selected in response to the user operation from the first algorithm and the second algorithm; 21. The medical image processing program according to claim 20, wherein, when the determining step determines that the medical observation device connected to the medical image processing device is the second medical observation device, data processing is performed on the second imaging data using the second algorithm.
22. The medical image processing program The medical image processing device includes: further executing a recognition step of recognizing the algorithm information associated with the device identification information and the user identification information acquired when the medical image processing device is currently being used, from reference information that associates device identification information that identifies the medical observation device connected to the medical image processing device, user identification information that identifies the user who used the medical observation device, and algorithm information that indicates which of the first algorithm and the second algorithm was used, each acquired when the medical image processing device was previously used; In the data processing step, A medical image processing program as described in claim 20, wherein, when the medical image processing device is currently being used, data processing is performed on the first imaging data or the second imaging data using an algorithm corresponding to the algorithm information recognized by the recognition step.