Medical image processing system and method for operating the medical image processing system
The medical image processing system addresses the issue of selecting suboptimal images for diagnosis by using recognition processing to identify the image with the highest visibility of the region of interest, ensuring accurate and comprehensive image selection.
Patent Information
- Application Number
- JP2020203256
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-12-08
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-12-08
AI Technical Summary
Existing medical image processing systems fail to consistently select the most optimal image for diagnosis, as the image designated by the doctor may not be accurate due to monitor updates and mechanical setting of representative images can lead to overlooking relevant images.
A medical image processing system that uses a processor to detect regions of interest through recognition processing, selects the medical image with the highest visibility of the region of interest, and allows for freeze or capture operations to ensure the optimal image is displayed or recorded.
The system effectively specifies the most suitable image for diagnosis, preventing important images from being overlooked by selecting the image with the highest visibility of the region of interest and allowing for freeze or capture operations.
Smart Images

Figure 0007593796000001 
Figure 0007593796000002 
Figure 0007593796000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a medical image processing system and a method of operating a medical image processing system. [Background technology]
[0002] In the medical field, image diagnosis such as diagnosis of a patient's condition and follow-up observation is performed using medical images such as endoscopic images, ultrasound images, X-ray images, CT (Computed Tomography) images, and MR (Magnetic Resonance) images. Doctors and others make decisions on treatment plans based on such image diagnosis.
[0003] For example, Patent Document 1 listed below describes a configuration in which an endoscopic device sequentially outputs and displays multiple medical images (endoscopic images) generated by continuously capturing images of an object to be observed on a monitor, and a user (doctor) operates a freeze switch while observing the monitor to obtain a specified endoscopic image as a still image.
[0004] Furthermore, the following Patent Document 2 describes a configuration in which an endoscopic device uses a learning device to detect abnormal areas (areas of interest) that require careful observation, such as lesions, from each endoscopic image, and sets the endoscopic image with the highest visibility of the areas of interest as a representative image from a series of endoscopic images that include common lesions, etc. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent No. 4694255 [Patent Document 2] Patent No. 6351323 Summary of the Invention [Problem to be solved by the invention]
[0006] However, in the above-mentioned Patent Document 1, there is a problem that the image specified by the doctor is not necessarily the most suitable image for diagnosis. In other words, since the monitor screen is updated (image capture is performed in units of several tens of frames per second, there are cases where the endoscopic image several frames before (or after) when the doctor operates the freeze switch has higher visibility and is more suitable for diagnosis.
[0007] Furthermore, in the above-mentioned Patent Document 2, the representative image is set mechanically regardless of the doctor's wishes, so there is a risk that the doctor will only observe the representative image and overlook images that should be observed before or after the representative image.
[0008] The present invention has been made in consideration of the above-mentioned background, and aims to provide a medical image processing system and an operating method of a medical image processing system that are capable of specifying an image that is optimal for diagnosis while preventing images that should be observed from being overlooked. [Means for solving the problem]
[0009] In order to achieve the above-mentioned object, the medical image processing system of the present invention is a medical image processing system equipped with a memory for storing program instructions and a processor for executing the program instructions, in which the processor sequentially acquires a plurality of medical images generated by continuously imaging the object of observation, detects a region of interest by performing recognition processing on each of the plurality of medical images, and sequentially outputs and displays the plurality of medical images on a monitor, and when a designation operation is performed to designate a medical image for the medical image currently being displayed on the monitor, selects the medical image with the highest visibility of the region of interest as the medical image to be designated by the designation operation from among the medical image currently being displayed on the monitor and medical images captured at least one before or after the medical image currently being displayed on the monitor.
[0010] The medical image with the highest contrast may be determined to have the highest visibility.
[0011] A region including a lesion site may be detected as a region of interest by recognition processing.
[0012] The recognition process may include a discrimination process for discriminating an area of interest.
[0013] The medical image to be specified may be selected from medical images captured within a predetermined period from the capture of the medical image being displayed on the monitor.
[0014] The designated operation may be a freeze operation that stops updating of the monitor screen and continues to display one medical image.
[0015] The designation operation may be a capture operation for acquiring the medical image displayed on the monitor as an image for recording.
[0016] In the recognition process, a Convolutional Neural Network may be used.
[0017] The medical images may be images obtained from an endoscope.
[0018] In addition, in order to achieve the above-mentioned object, the operating method of the medical image processing system of the present invention is a method for operating a medical image processing system equipped with a memory for storing program instructions and a processor for executing the program instructions, in which the processor sequentially acquires a plurality of medical images generated by continuously imaging the object of observation, detects a region of interest by performing recognition processing on each of the plurality of medical images, and sequentially outputs and displays the plurality of medical images on a monitor, and when a designation operation is performed to designate a medical image for the medical image currently being displayed on the monitor, selects the medical image with the highest visibility of the region of interest as the medical image to be designated by the designation operation from among the medical image currently being displayed on the monitor and medical images captured at least one before or after the medical image currently being displayed on the monitor. Effect of the Invention
[0019] According to the present invention, it is possible to provide a medical image processing system and a method of operating a medical image processing system that are capable of specifying an image optimal for diagnosis while preventing an image to be observed from being overlooked. [Brief description of the drawings]
[0020] [Figure 1] FIG. 1 is an external view of an endoscope system. [Diagram 2] 2 is a block diagram showing the functions of the endoscope system. FIG. [Diagram 3] 13 is a flowchart showing the flow of operations of a designated image selection unit. [Figure 4] 13 is a flowchart showing the flow of a designated image selection process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0021] 1, an endoscope system 10 (medical image processing system) includes an endoscope 12, a light source device 14, a processor device 16, a monitor 18, and a UI (User Interface) 19. The endoscope 12 is optically connected to the light source device 14 and electrically connected to the processor device 16.
[0022] The endoscope 12 has an insertion section 12a to be inserted into the body of an observation subject, an operation section 12b provided at the base end of the insertion section 12a, and a bending section 12c and a tip section 12d provided at the tip side of the insertion section 12a. The bending section 12c is bent by operating the operation section 12b. The tip section 12d is directed in a desired direction by the bending operation of the bending section 12c.
[0023] The operation unit 12b is provided with a designation switch 12g used for a designation operation for designating a medical image (an endoscopic image in this embodiment), a mode changeover switch 12h used for a changeover operation of the observation mode, and a zoom operation unit 12i used for a changeover operation of the zoom magnification. The designation operations include a freeze operation for stopping the screen update of the monitor 18 and continuously displaying one medical image (frame), and a capture operation for acquiring (saving in the storage device 58a (see FIG. 2)) the medical image displayed on the monitor 18 as a still image for recording. For example, the freeze operation can be performed by pressing and holding the designation switch 12g on the medical image displayed on the monitor 18, and the capture operation can be performed by pressing the designation switch 12g once briefly.
[0024] In this embodiment, the freeze operation and the capture operation are performed by one operation member (designation switch 12g), but an operation member for the freeze operation and an operation member for the capture operation may be provided separately. Also, in this embodiment, an operation member for the freeze operation and an operation member for the capture operation are provided in the operation unit 12b, but these may be provided in the UI 19. Furthermore, in this embodiment, an example has been described in which the present invention is applied to an endoscope system capable of both the freeze operation and the capture operation, but the present invention may be applied to an endoscope system capable of only one of the freeze operation and the capture operation.
[0025] The light source device 14 includes a light source section 20 (see FIG. 2) that emits illumination light for illuminating an observation target. The illumination light from the light source section 20 is guided by a light guide 25 (see FIG. 2) and irradiated from the tip section 12d toward the observation target. The observation target illuminated by the illumination light from the light source section 20 is imaged by an imaging sensor 44 (see FIG. 2) built into the tip section 12d.
[0026] The processor device 16 is electrically connected to the monitor 18 and the UI 19. The monitor 18 outputs and displays an image of the observation target, information associated with the image of the observation target, and the like. The UI 19 has a keyboard, mouse, touch pad, microphone, and the like, and has a function of accepting input operations such as function settings. An external memory (not shown) may be connected to the processor device 16.
[0027] 2, the light source device 14 includes the above-mentioned light source section 20. The light source section 20 is connected to a light source control section 21 of the processor device 16, and the emission spectrum and emission timing of the illumination light emitted by the light source section 20 are controlled by the light source control section 21.
[0028] In this embodiment, the light source unit 20 emits normal light and special light having different emission spectra. The normal light is, for example, white light. The white light includes, for example, purple light in a wavelength band of 380 to 420 nm, blue light in a wavelength band of 420 to 500 nm, green light in a wavelength band of 480 to 600 nm, and red light in a wavelength band of 600 to 650 nm. An endoscopic image (normal image) captured by irradiating the observation target with the normal light is displayed on the monitor 18.
[0029] The special light may be one type or multiple types. For example, the special light may be a purple light (peak wavelength 400nm to 420nm) that has a high absorption coefficient of hemoglobin in blood, and the amount of the light emitted is greater than that of normal light. An endoscopic image (special image) captured by irradiating the observation subject with this special light is used to generate a blood vessel image (biometric information image) showing the superficial blood vessel structure and glandular duct structure.
[0030] As for the special light, for example, there is a type that emits only the aforementioned purple light. An endoscopic image (special image) captured by irradiating the observation target with this special light is used to generate a blood vessel image (biological information image) that shows a more superficial blood vessel structure and glandular duct structure compared to the aforementioned case (when the amount of purple light emitted is greater than that of normal light).
[0031] Furthermore, the special light may be, for example, a light that emits blue-violet light (peak wavelength 470 nm to 480 nm) due to the difference in the absorption coefficient between oxygenated hemoglobin and reduced hemoglobin. An endoscopic image (special image) captured by irradiating an observation subject with this special light is used to generate an oxygen saturation image (biometric information image) that shows the oxygen saturation of hemoglobin in the blood.
[0032] In addition, the special light may be, for example, the aforementioned purple light, blue-violet light, and red light (peak wavelength 620 nm to 630 nm) with a greater emission amount than normal light. An endoscopic image (special image) captured by irradiating an observation object with this special light is used to generate a color difference expanded image (biometric information image) in which the color difference between the lesion and non-lesion areas is expanded. Note that the type of special light and the type of biometric information image generated using the endoscopic image (special image) captured by irradiating each special light are not limited to those described above and can be changed as appropriate.
[0033] Illumination light from the light source unit 20 is incident on the above-mentioned light guide 25 via an optical path coupling unit 23 composed of a mirror, a lens, etc. The light guide 25 is built into the endoscope 12 and a universal cord (a cord that connects the endoscope 12 with the light source device 14 and the processor device 16). The light guide 25 propagates the light from the optical path coupling unit 23 to the tip 12d of the endoscope 12.
[0034] An illumination optical system 30a and an imaging optical system 30b are provided at the tip 12d of the endoscope 12. The illumination optical system 30a has an illumination lens 32, and illumination light propagated by the light guide 25 is irradiated onto the observation object via the illumination lens 32. The imaging optical system 30b has an objective lens 42, a zoom lens 43, and an imaging sensor 44. Light from the observation object irradiated with illumination light is incident on the imaging sensor 44 via the objective lens 42 and the zoom lens 43. As a result, an image of the observation object is formed on the imaging sensor 44. The zoom lens 43 is a lens for enlarging the observation object, and is moved between the telephoto end and the wide end by operating the zoom operation unit 12i.
[0035] The imaging sensor 44 is a color sensor, and in this embodiment, a primary color sensor is used that has three types of pixels: a B pixel having a B (blue) color filter, a G pixel having a G (green) color filter, and an R pixel having an R (red) color filter. As the imaging sensor 44, a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) imaging sensor or the like can be used.
[0036] The imaging sensor 44 is controlled by an imaging sensor control unit 45 of the processor device 16. The imaging sensor control unit 45 captures images (reads out signals from the imaging sensor 44) at a predetermined cycle (for example, 60 times per second). Along with this imaging, an image signal is output from the imaging sensor 44. For example, when imaging is performed at a cycle of 60 times per second, image signals for 60 frames (pieces) are output per second.
[0037] Instead of the primary color imaging sensor 44 having RGB primary color filters, a complementary color imaging sensor having C (cyan), M (magenta), Y (yellow) and G (green) complementary color filters may be used. When a complementary color imaging sensor is used, image signals of four colors, CMYG, are output. Therefore, image signals of each of the RGB colors similar to those of the imaging sensor 38 can be obtained by converting the four color image signals of CMYG into image signals of three colors, RGB, by complementary color-primary color conversion. Also, instead of the imaging sensor 38, a monochrome sensor not having color filters may be used.
[0038] A CDS / AGC (Correlated Double Sampling / Automatic Gain Control) circuit 46 performs correlated double sampling (CDS) and automatic gain control (AGC) on the analog image signal obtained from the image sensor 44. The image signal passed through the CDS / AGC circuit 46 is converted into a digital image signal by an A / D (Analog / Digital) converter 48. The digital image signal after A / D conversion is input to the processor device 16.
[0039] The processor device 16 includes a central control unit 68 that constitutes the processor of the present invention. The central control unit 68 is a hardware resource for executing program instructions stored in a memory 69, and drives and controls each unit of the processor device 16 to execute the program instructions. Due to the drive control of the central control unit 68 accompanying the execution of the program instructions, the processor device 16 functions as an imaging control unit 50, a DSP (Digital Signal Processor) 52, a noise reduction unit 54, an image processing unit 58, and a display control unit 60.
[0040] The imaging control unit 50 is provided with the above-mentioned light source control unit 21 and imaging sensor control unit 45. The imaging control unit 50 controls the light source unit 20 via the light source control unit 21 to illuminate the observation target, and controls the imaging sensor 44 via the imaging sensor control unit 45 to capture an image of the observation target (reads out a signal from the imaging sensor 44). Then, the imaging control unit 50 obtains an endoscopic image output from the imaging sensor 44 by this imaging.
[0041] The imaging control unit 50 performs normal imaging by irradiating the observation subject with normal light and capturing an image, thereby acquiring a normal image. The imaging control unit 50 also performs special imaging by irradiating the observation subject with special light and capturing an image, thereby acquiring a special image. Special imaging is performed for each type of special light. Note that in this embodiment, endoscopic images such as normal images and special images are color images composed of blue signals (B image signals), green signals (G image signals), and red signals (R image signals) output from the B pixels, G pixels, and R pixels of the imaging sensor 44.
[0042] The endoscopic image acquired by the imaging control unit 50 is transmitted to the DSP 52. The DSP 52 performs various signal processing such as defect correction processing, offset processing, gain correction processing, matrix processing, gamma conversion processing, demosaic processing, and YC conversion processing on the received endoscopic image.
[0043] In the defect correction process, signals from defective pixels of the imaging sensor 44 are corrected. In the offset process, dark current components are removed from the image signal that has been subjected to the defect correction process, and an accurate zero level is set. In the gain correction process, the signal level of the endoscopic image is adjusted by multiplying the image signal of each color after the offset process by a specific gain coefficient. Note that, when a monochrome sensor is used as the imaging sensor 44, it is preferable that the endoscopic image is captured by the monochrome sensor for each emission of light of a specific color, and a monochrome image of multiple colors is output from the monochrome sensor.
[0044] The image signals of each color after the gain correction process are subjected to matrix processing to improve color reproducibility. Then, the brightness and saturation of the endoscopic image are adjusted by gamma conversion. The endoscopic image after the matrix process is subjected to demosaic processing (also called isotropic processing or synchronization processing), and signals of the missing colors of each pixel are generated by interpolation. The demosaic processing ensures that all pixels have signals of each of the RGB colors. The DSP 52 performs YC conversion processing on the endoscopic image after the demosaic processing, and outputs the luminance signal Y and the color difference signals Cb and Cr to the noise reduction unit 54.
[0045] The noise reduction unit 54 performs noise reduction processing, for example, by a moving average method or a median filter method, on the endoscopic image that has been subjected to demosaic processing and the like by the DSP 56. The endoscopic image with reduced noise is input to an image processing unit 58. In this embodiment, a normal image which is an endoscopic image captured by irradiating with normal light, and a special image which is an endoscopic image captured by irradiating with special light are input to the image processing unit 58 as the endoscopic images.
[0046] The image processing unit 58 includes a storage device 58a and stores the input normal image and special image in the storage device 58a. The image processing unit 58 also includes a biometric information image generating unit 58b, a recognition processing unit 58c, and a designated image selecting unit 58d, and each of these units performs various processes on the normal image and the special image.
[0047] The biometric image generating unit 58b generates a biometric image showing the biometric information of the observation target by using the special image alone or by using both the special image and the normal image. The biometric image is the above-mentioned blood vessel image, oxygen saturation image, color difference expansion image, etc., and is an image generated by performing an analysis process on the special image or the special image and the normal image, and is a type of endoscopic image.
[0048] The recognition processing unit 58c performs recognition processing on the normal image. The recognition processing includes a detection processing for detecting an attention area such as a lesion, and a discrimination processing for discriminating the type and stage (degree) of the lesion. The discrimination processing also includes a processing performed on the attention area and a processing performed on the entire image to be subjected to the recognition processing.
[0049] In the recognition process, for example, an endoscopic image is divided into a plurality of small regions, and image features are calculated from the divided endoscopic image. In the detection process, it is determined whether each small region is a lesion based on the calculated features, a group of regions identified as the same type is extracted as one lesion, and a region including the extracted lesion is detected as a region of interest. In the discrimination process, the type and / or degree (stage) of the lesion is determined for the detected region of interest based on the features in the region of interest and the state (position, size, shape, etc.) of the region of interest. The judgment in the above-mentioned recognition process (detection process, discrimination process) is preferably performed by a machine learning algorithm such as a Convolutional Neural Network or Deep Learning.
[0050] The recognition process for the normal image may be performed using the normal image alone, or may be performed using a special image and / or a biometric image in addition to the normal image. Although the recognition process for the normal image has been described as an example, the recognition process may be performed on a special image and / or a biometric image.
[0051] After generating and recognizing the biometric information image, the image processing unit 58 inputs the normal image, the biometric information image, and the result of the recognition process to the display control unit 60. The display control unit 60 controls the display of the monitor 18, and generates a display screen using the input normal image, the biometric information image, and the result of the recognition process, and displays it on the monitor 18. On the display screen, the biometric information image is displayed superimposed on the normal image or side-by-side with the normal image. The result of the recognition process is displayed, for example, by superimposing a frame indicating the region of interest on the normal image.
[0052] 3, the designated image selection unit 58d operates when a designation operation (operation of the designation switch 12g) is performed on a normal image (or an image in which a biometric information image and / or a result of a recognition process is superimposed on a normal image) displayed on the monitor 18. Then, the designated image selection unit 58d performs a designated image selection process to select a designated image.
[0053] 4, in the designated image selection process, the normal image being displayed on the monitor 18 when the designation operation is performed and several tens of frames of normal images captured within a predetermined period from the capture of the normal image (for example, several seconds before and after the designation operation) are selected as selection target images, the attention areas of these selection target images are compared, and the image with the highest visibility of the attention area is selected as the designated image. Note that in this embodiment, it is considered that the higher the contrast, the higher the visibility, and the image determined by image analysis to have the highest contrast of the attention area is selected as the designated image.
[0054] 3, after the designated image is selected by the designated image selection process, if the designating operation is a freeze operation, the designated image selection unit 58d continues to display the selected designated image on the monitor 18 while the freeze operation continues. On the other hand, if the designating operation is a capture operation, the designated image selection unit 58d stores the selected designated image as a still image in the storage device 58a.
[0055] In the above embodiment, an example has been described in which the higher the contrast, the higher the visibility is considered to be, but for example, edge (contour) detection may be performed, and the more edges and / or the more clearly the edges are detected, the higher the visibility is considered to be. Of course, the visibility may be determined based on elements other than contrast and edges. Also, the visibility may be determined taking into account multiple elements, such as determining the visibility based on both the contrast and edge elements.
[0056] In the above embodiment, an example has been described in which images captured within a predetermined period from a designation operation are selected as selection targets for selecting a designated image, but the present invention is not limited to this. Even if an image is captured within a predetermined period from a designation operation, there may be images in which an attention area is set for a lesion or the like different from the image displayed on the monitor 18 when the designation operation is performed (hereinafter, the display image). In this way, it is preferable to exclude images in which an attention area is set for a lesion or the like different from the display image from the selection targets for the designated image.
[0057] Specifically, it is preferable to exclude from the selection of the designated image an image in which the position of the attention area (for example, the position of the center of the attention area) is more than a predetermined distance away from the attention area of the displayed image. It is also preferable to exclude from the selection of the designated image an image in which the number of attention areas (detection number) differs from the attention areas of the displayed image and / or the area of the attention areas differs from the attention areas of the displayed image by more than a predetermined size. Furthermore, it is preferable to exclude from the selection of the designated image an image in which the discrimination result of the attention area differs from that of the displayed image.
[0058] In addition, when images captured within a predetermined period from the display image include images in which no attention area is detected, only images captured within a range (period) in which the attention area is continuously detected from the display image may be selected as the designated image, and images captured within other ranges (periods) may be excluded from the selection of the designated image. Furthermore, when images captured within a predetermined period from the display image include images in which the discrimination result of the attention area is different from that of the display image, only images captured within a range (period) in which the same discrimination result is continuously detected from the display image may be selected as the designated image, and images captured within other ranges (periods) may be excluded from the selection of the designated image.
[0059] In the above embodiment, the present invention is applied to an endoscope system (the medical image is an endoscopic image), but the present invention is not limited to this. The present invention may be applied to a medical system other than an endoscope system (the medical image may be an image other than an endoscopic image). Examples of medical systems other than an endoscope system include an ultrasound inspection system that uses ultrasound to obtain an ultrasound image and an X-ray inspection system that uses X-rays to obtain an X-ray image.
[0060] In the above embodiment, the hardware structure of the processing units that execute various processes, such as the light source control unit 21, the imaging sensor control unit 45, the imaging control unit 50, the DPS 52, the noise reduction unit 54, the image processing unit 58, the biometric information image generating unit 58b, the recognition processing unit 58c, the designated image selecting unit 58d, the display control unit 60, and the central control unit 68, is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing various processes.
[0061] One processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same type or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as represented by a computer such as a client or server, one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.
[0062] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit (circuitry) in the form of a combination of circuit elements such as semiconductor elements, and the hardware structure of the memory unit is a storage device such as a hard disk drive (HDD) or a solid state drive (SSD). [Explanation of symbols]
[0063] 10 Endoscope system (medical image processing system) 12 Endoscopy 12a Insertion part 12b Operation section 12c Curved section 12d Tip 12g designated switch 12h Mode Switch 12i Zoom control section 14 Light source device 16 Processor Unit 18 Monitors 19 UI 20 Light source section 21 Light source control unit 23 Optical path coupling section 25 Light Guide 30a illumination optical system 30b Imaging optical system 32 Lighting Lens 42 Objective Lens 43 Zoom Lens 44 Image sensor 45 Image sensor control unit 46 CDS / AGC circuit 48 A / D Converter 50 Imaging control section 52 DSP 54 Noise reduction section 58 Image Processing Section 58a Storage Devices 58b Biometric information image generating unit 58c Recognition processing section 58d Designated image selection section 60 Display control unit 68 Central Control Unit (Processor) 69 Memory
Claims
1. A medical image processing system comprising a memory for storing program instructions and a processor for executing the program instructions, The processor, Sequentially acquiring a plurality of medical images generated by continuously imaging the observation target; performing a recognition process on each of the plurality of medical images to detect an area of interest, and sequentially outputting and displaying the plurality of medical images on a monitor; when a designation operation for designating a medical image is performed on the medical image being displayed on the monitor, a medical image having the highest visibility of the attention area is selected as the medical image to be designated by the designation operation from among the medical image being displayed on the monitor and medical images captured at least one before or after the medical image being displayed on the monitor; A medical image processing system in which at least any of the following is excluded from the selection of medical images to be specified: an image in which the area of interest is set for a lesion different from that of the display image displayed on the monitor when the designation operation is performed; an image in which the position of the area of interest is away from the area of interest of the display image by a predetermined distance or more; an image in which the number of areas of interest differs from that of the area of interest of the display image by a predetermined size or more.
2. A medical image processing system comprising a memory for storing program instructions and a processor for executing the program instructions, The processor, Sequentially acquiring a plurality of medical images generated by continuously imaging the observation target; performing a recognition process on each of the plurality of medical images to detect an area of interest, and sequentially outputting and displaying the plurality of medical images on a monitor; when a designation operation for designating a medical image is performed on the medical image being displayed on the monitor, a medical image having the highest visibility of the attention area is selected as the medical image to be designated by the designation operation from among the medical image being displayed on the monitor and medical images captured at least one before or after the medical image being displayed on the monitor; A medical image processing system in which, when the designation operation is performed, the images captured within a specified period from the display image displayed on the monitor include images in which the area of interest is not detected, and images captured during a period in which the area of interest is continuously detected are selected as the medical image to be designated, and images captured during a period other than the period in which the area of interest is continuously detected are excluded from the medical image to be designated.
3. A medical image processing system comprising a memory for storing program instructions and a processor for executing the program instructions, The processor, Sequentially acquiring a plurality of medical images generated by continuously imaging the observation target; performing a recognition process on each of the plurality of medical images to detect an area of interest, and sequentially outputting and displaying the plurality of medical images on a monitor; when a designation operation for designating a medical image is performed on the medical image being displayed on the monitor, a medical image having the highest visibility of the attention area is selected as the medical image to be designated by the designation operation from among the medical image being displayed on the monitor and medical images captured at least one before or after the medical image being displayed on the monitor; The recognition process includes a discrimination process for discriminating the attention area, A medical image processing system in which at least any of the following are excluded from the selection of medical images to be specified: an image in which the area of interest is set for a lesion different from that of the display image displayed on the monitor when the designation operation is performed; an image in which the position of the area of interest is away from the area of interest of the display image by a predetermined distance or more; an image in which the number of areas of interest differs from that of the area of interest of the display image by a predetermined size or more; and an image in which the results of the discrimination processing of the area of interest differ from that of the display image.
4. A medical image processing system comprising a memory for storing program instructions and a processor for executing the program instructions, The processor, Sequentially acquiring a plurality of medical images generated by continuously imaging the observation target; performing a recognition process on each of the plurality of medical images to detect an area of interest, and sequentially outputting and displaying the plurality of medical images on a monitor; when a designation operation for designating a medical image is performed on the medical image being displayed on the monitor, a medical image having the highest visibility of the attention area is selected as the medical image to be designated by the designation operation from among the medical image being displayed on the monitor and medical images captured at least one before or after the medical image being displayed on the monitor; The recognition process includes a discrimination process for discriminating the attention area, A medical image processing system in which, when the designation operation is performed, and images captured within a specified period from the display image displayed on the monitor include images in which the results of the discrimination processing of the area of interest differ from those of the display image, images captured during the period in which the same discrimination result is continuously detected from the display image are selected as the medical image to be specified, and images captured during periods other than the period in which the same discrimination result is continuously detected are excluded from the selection of the medical image to be specified.
5. 5. The medical image processing system according to claim 1, wherein a medical image having the highest contrast is determined to have the highest visibility.
6. 6. The medical image processing system according to claim 1, wherein a region including a lesion site is detected as the region of interest by the recognition process.
7. 7. The medical image processing system according to claim 1, wherein the specified operation is a freeze operation that stops updating of the screen of the monitor and continues to display one medical image.
8. 8. The medical image processing system according to claim 1, wherein the designation operation is a capture operation for acquiring the medical image displayed on the monitor as an image for recording.
9. 9. The medical image processing system according to claim 1, wherein the recognition process uses a Convolutional Neural Network.
10. 10. The medical image processing system according to claim 1, wherein the medical image is an image obtained from an endoscope.
11. 1. A method of operating a medical image processing system having a memory for storing program instructions and a processor for executing the program instructions, comprising: The processor, Sequentially acquiring a plurality of medical images generated by continuously imaging the observation target; performing a recognition process on each of the plurality of medical images to detect an area of interest, and sequentially outputting and displaying the plurality of medical images on a monitor; when a designation operation for designating a medical image is performed on the medical image being displayed on the monitor, a medical image having the highest visibility of the attention area is selected as the medical image to be designated by the designation operation from among the medical image being displayed on the monitor and medical images captured at least one before or after the medical image being displayed on the monitor; A method for operating a medical image processing system in which at least any of the following is excluded from the selection of medical images to be specified: an image in which the area of interest is set for a lesion different from that of the display image displayed on the monitor when the designation operation is performed; an image in which the position of the area of interest is away from the area of interest of the display image by a predetermined distance or more; an image in which the number of areas of interest differs from that of the area of interest of the display image by a predetermined size or more.
12. 1. A method of operating a medical image processing system having a memory for storing program instructions and a processor for executing the program instructions, comprising: The processor, Sequentially acquiring a plurality of medical images generated by continuously imaging the observation target; performing a recognition process on each of the plurality of medical images to detect an area of interest, and sequentially outputting and displaying the plurality of medical images on a monitor; when a designation operation for designating a medical image is performed on the medical image being displayed on the monitor, a medical image having the highest visibility of the attention area is selected as the medical image to be designated by the designation operation from among the medical image being displayed on the monitor and medical images captured at least one before or after the medical image being displayed on the monitor; The recognition process includes a discrimination process for discriminating the attention area, A method for operating a medical image processing system in which at least any of the following are excluded from the selection of medical images to be specified: an image in which the area of interest is set for a lesion different from that of the display image displayed on the monitor when the designation operation is performed; an image in which the position of the area of interest is away from the area of interest of the display image by a predetermined distance or more; an image in which the number of areas of interest differs from that of the area of interest of the display image by a predetermined size or more; and an image in which the results of the discrimination processing of the area of interest differ from that of the display image.
Citation Information
Patent Citations
Stereopsis endoscopy, system comprising the same, and medical stereopsis display method
CN102707426A
Fitting jig of mold to plate glass
JP1980001210A
Bathing agent composition
JP1988051323A
Endoscope instrument and method for controlling endoscope instrument
JP2013230319A
Image processing device, image processing method, and image processing program
JP2015181594A
