Medical image processing system, processor device for recognition processing, and working method of medical image processing system

Abstract

The present invention provides a medical image processing system, a processor device for recognition processing, and an operating method of the medical image processing system that are free from delay caused by recognition processing and can perform stable image display. An endoscope processor device (12) generates a first image signal. A processor device (14) for recognition processing reflects the result of recognition processing based on the first image signal and generates a second image signal. A display (16) displays either the second image signal or the first image signal switched from the second image signal according to a first image switching signal from the processor device (14) for recognition processing. When the display of the result of recognition processing based on the second image signal is stopped, the display indicates that the result of recognition processing is being stopped.

Description

Technical Field

[0001] The present invention relates to a medical image processing system that uses recognition processing using AI (Artificial Intelligence) or the like, a processor device for recognition processing, and an operating method of the medical image processing system. Background Art

[0002] In the current medical field, medical image processing systems that use medical images, such as endoscope systems equipped with a light source device, an endoscope, and a processor device, are becoming increasingly common. Furthermore, in recent years, functions that use AI (artificial intelligence) and other recognition processing to detect regions of interest from medical images such as endoscopic images (e.g., Patent Document 1) and diagnostic support functions that classify lesions have become increasingly common. These diagnostic support functions are expected to prevent the omission of lesions and reduce the burden on users.

[0003] Previous technical literature

[0004] Patent Literature

[0005] Patent Document 1: International Publication No. 2017 / 073338

[0006] Patent Document 2: Japanese Patent Application Laid-Open No. 2011-87827 Summary of the Invention

[0007] Technical issues to be solved by the invention

[0008] To implement the above-mentioned diagnostic support function, it is conceivable to transmit image signals from a medical image processor device that processes medical images such as endoscopic images to a recognition processing processor device connected to the medical image processor device, where recognition processing is performed in the recognition processing processor device. The recognition processing results in the recognition processing processor device are subjected to processing such as highlighting the region of interest and displayed on a display.

[0009] However, there are cases where a delay in the recognition process can adversely affect user operations, or where a malfunction in the recognition processing processor prevents the image signal from being properly displayed on the display. There is a demand for stable image display without such delays.

[0010] Patent Document 2 also describes that if no abnormality is detected with respect to the second video signal recorded in the archiving device, the second video signal (a PC-standard video signal) is displayed, and if the abnormality is detected, the first video signal (a TV-standard video signal) is displayed. However, Patent Document 2 does not describe any abnormality recognition processing.

[0011] The object of the present invention is to provide a medical image processing system, a processor device for recognition processing, and a working method of the medical image processing system, which can perform stable image display without delay caused by recognition processing when recognition processing is performed based on medical images.

[0012] Means for solving technical problems

[0013] The medical image processing system of the present invention comprises: a first processor, which sequentially acquires medical images and generates a first image signal from the medical images; a second processor, which receives the first image signal from the first processor, performs recognition processing on the first image signal, and performs recognition processing for displaying the result of the recognition processing on the first image signal to generate a second image signal; and a display, wherein the second processor generates a first image switching signal, the display displays either the second image signal or the first image signal switched from the second image signal according to the first image switching signal, and when the result display of the recognition processing based on the second image signal is stopped, the display indicates that the result display of the recognition processing is stopping.

[0014] Preferably, a third processor is provided in the display, the display receives the first image signal from the first processor and the second image signal from the second processor, and when the display displays the second image signal, the third processor switches the display on the display from the second image signal to the first image signal according to the first image switching signal.

[0015] Preferably, when the first processor receives the first image switching signal from the second processor, it sends the first image priority signal for displaying the first image signal in priority to the second image signal to the display, the display receives either the first image signal or the first image priority signal from the first processor, and receives the second image signal from the second processor, and when the display displays the second image signal, the display on the display is switched from the second image signal to the first image signal according to the first image priority signal.

[0016] Preferably, when the first processor switches the display from the second image signal to the first image signal in accordance with the first image priority signal, it generates a first image signal processed for stop display obtained by performing processing for stop display on the first image signal, and sends the first image signal processed for stop display as the first image signal to the display.

[0017] Preferably, when the second processor determines that the recognition processing is being executed based on the first image switching signal, the second processor sends the second image signal to the display; when it determines that the recognition processing is being stopped based on the first image switching signal, the second processor sends the first image signal to the display; when the second image signal is sent from the second processor, the display displays the second image signal on the display; when the first image signal is sent from the second processor, the display displays the first image signal on the display.

[0018] Preferably, when the second processor displays the first image signal on the display according to the first image switching signal, it generates a first image signal processed for stop display obtained by performing processing for stop display on the first image signal, and sends the first image signal processed for stop display as the first image signal to the display.

[0019] Preferably, the second processor stops the recognition process in response to at least one of a user input to stop the recognition process, the recognition process being in an abnormal state, or the user's operating condition being a specific operating condition, thereby stopping the display of the recognition process results. Preferably, the specific operating condition includes a user's treatment action using a treatment instrument. Preferably, the second processor generates a second image switching signal when resuming the recognition process, and the display displays the second image signal that has been switched from the first image signal in response to the second image switching signal.

[0020] The present invention is a processor device for recognition processing, which is connected to a first processor that sequentially acquires medical images and generates a first image signal from the medical images, and is connected to a display. The processor device for recognition processing has a second processor that receives the medical image from the first processor, performs recognition processing on the first image signal, and performs recognition processing on the first image signal for displaying the result of the recognition processing to generate a second image signal. The second processor generates a first image switching signal, and when either the second image signal or the first image signal switched from the second image signal according to the first image switching signal is displayed on the display, and when the display of the result of the recognition processing based on the second image signal is stopped, the display displays on the display that the result of the recognition processing is stopping.

[0021] The present invention is a working method of a medical image processing system, which comprises: a first processor, which sequentially acquires medical images and generates a first image signal from the medical images; a second processor, which receives the first image signal from the first processor, performs recognition processing on the first image signal, and performs recognition processing for displaying the result of the recognition processing on the first image signal to generate a second image signal; and a display, the working method of the medical image processing system includes the following steps: the second processor generates a first image switching signal; and the display displays either the second image signal or the first image signal switched from the second image signal according to the first image switching signal, and when the result display of the recognition processing based on the second image signal is stopped, displays that the result display of the recognition processing is stopping.

[0022] Effects of the Invention

[0023] According to the present invention, when recognition processing is performed based on medical images, there is no delay caused by the recognition processing, and stable image display can be performed. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a block diagram showing the functions of an endoscope system and a medical image processing system.

[0025] Figure 2 This is a block diagram showing the functions of the medical image processing system of the first embodiment.

[0026] Figure 3 This is an explanatory diagram showing the processing for recognition processing.

[0027] Figure 4 This is an explanatory diagram showing the switching of the display from the second video signal to the first video signal.

[0028] Figure 5 This is an explanatory diagram showing the switching of the display from the first video signal to the second video signal.

[0029] Figure 6 is a block diagram representing the user interface.

[0030] Figure 7 This is a block diagram showing an abnormal state detection unit.

[0031] Figure 8 This is a block diagram showing an operation status recognition unit.

[0032] Figure 9 This is a block diagram showing the functions of the medical image processing system of the second embodiment.

[0033] Figure 10 This is a block diagram showing the functions of the medical image processing system of the third embodiment.

[0034] Figure 11 This is a block diagram showing a diagnosis support device.

[0035] Figure 12 This is a block diagram showing a medical work support device. DETAILED DESCRIPTION

[0036] [First embodiment]

[0037] like Figure 1 As shown, the medical image processing system 10 of the first embodiment includes an endoscope processor device 12 , a recognition processing processor device 14 (recognition processing image processing device), and a display 16 .

[0038] The endoscope processor 12 is disposed within the endoscope system 20. In addition to the endoscope processor 12, the endoscope system 20 also includes a light source device 22 and an endoscope 24. The light source device 22 supplies illumination light to the endoscope 24 for illuminating the interior of a subject. The endoscope 24 captures an endoscopic image by illuminating the subject with at least one of light in the white wavelength band or light in the specific wavelength band. The specific wavelength band used by the endoscope 24 as illumination light is, for example, light in a shorter wavelength band than the green wavelength band, particularly light in the blue or violet bands in the visible region.

[0039] The endoscope processor 12 sequentially acquires endoscopic images from the endoscope 24 and generates a first image signal from the acquired endoscopic images. The first image signal is a signal for display on the display 16. The first image signal is transmitted to at least the recognition processing processor 14. In addition, if the endoscope system 20 is provided with an endoscope display (not shown), the first image signal can be transmitted to the endoscope display so that the first image signal is displayed on the endoscope display.

[0040] In this embodiment, the endoscope processor device 12 that obtains an endoscopic image from the endoscope 24 is used as an example for explanation, but in addition to the endoscope processor device 12, a medical image processing device that can be used to obtain various medical images for image processing can also be used. The medical image is a still image or a dynamic image (so-called examination dynamic image). In the case where the medical image is a dynamic image, the frame images constituting the dynamic image can be obtained as a still image after the examination. Moreover, in the case where the medical image is a dynamic image, in addition to displaying a still image of a representative frame constituting the dynamic image, the display of the medical image also includes playing one or more dynamic images. Furthermore, in the medical image, in addition to the images captured by the doctor using the medical device of the medical image processing device, the medical image also includes images automatically captured by the medical device of the medical image processing device without following the doctor's shooting instructions.

[0041] Furthermore, when the medical image processing apparatus can acquire multiple medical images, it can selectively acquire one or more medical images from among these medical images. Furthermore, the medical image processing apparatus can acquire multiple medical images acquired during multiple different examinations. For example, the medical image processing apparatus can acquire one or both of medical images acquired during a past examination and medical images acquired during a recent examination. In other words, the medical image processing apparatus can acquire medical images arbitrarily.

[0042] The recognition processing processor 14 receives the first image signal from the endoscope processor 12, performs recognition processing on the first image signal, and performs recognition processing processing on the first image signal to display the result of the recognition processing, thereby generating a second image signal. Furthermore, the recognition processing processor 14 generates a first image switching signal when the recognition processing is stopped.

[0043] The display 16 displays either the second image signal from the recognition processing processor device 14 or the first image signal switched from the second image signal in response to the first image switching signal. Furthermore, when the display of the result of the recognition processing based on the second image signal is stopped in the recognition processing processor device 14, the display indicates that the display of the result of the recognition processing is being stopped. Furthermore, the display of the result of the recognition processing being stopped includes not only the case where the display of the result of the recognition processing is stopped due to the stopping of the recognition processing, but also the case where only the display of the result of the recognition processing is stopped even though the recognition processing itself is being executed.

[0044] Below, use Figure 2 The details of the switching display of the second image signal and the first image signal when the recognition processing is stopped are explained. The endoscope processor device 12 has an image signal generating unit 12a that generates a first image signal from a medical image. The recognition processing processor device 14 has a recognition processing unit 14a, a recognition processing processing unit 14b, a first image switching signal generating unit 14c that generates a first image switching signal, and a second image switching signal generating unit 14d that generates a second image switching signal. The display 16 has a display unit 16a and a display control unit 16b that performs display control of the display unit 16a. In addition, Figure 2 In the embodiment, the input portion to the display 16 is set as two systems, namely, the input from the endoscope processor device 12 and the input from the recognition processing processor device 14. However, the input portion to the display 16 may be set as one system by integrating the input from the endoscope processor device 12 and the input from the recognition processing processor device 14 using a mixer.

[0045] In addition, in the endoscope processor device 12, a first program related to the generation process of the first image signal is incorporated into a first program memory (not shown). The first program is executed by a first control unit (not shown) formed by a first processor to realize the function of the image signal generation unit 12a. In the recognition processing processor device 14, a second program related to recognition processing, etc. is incorporated into a second program memory (not shown). The second program is executed by a second control unit (not shown) formed by a second processor to realize the functions of the recognition processing unit 14a, the recognition processing unit 14b, the first image switching signal generation unit 14c that generates the first image switching signal, and the second image switching signal generation unit 14d that generates the second image switching signal. In the display 16, a third program related to display control is executed by a third program memory (not shown) to realize the function of the display control unit 16b.

[0046] In the endoscope processor device 12, the image signal generating unit 12a generates a first image signal from the medical image, and sends the generated first image signal to the recognition processing processor device 14. In the recognition processing processor device 14, the recognition processing unit 14a performs recognition processing based on the first image signal. As the recognition processing performed by the recognition processing unit 14a, for example, it is preferably set to be a processing based on a learning model obtained by learning using NN (Neural Network), CNN (Convolutional Neural Network), Adaboost and random forest. That is, with respect to the input of the first image signal to the learning model, it is preferable to output the detection of the area of interest such as the lesion. In addition, as the recognition processing, the detection of the area of interest can be performed based on the feature quantity obtained by the color information of the first image signal, the gradient of the pixel value, etc. In addition, the gradient of pixel values, etc., represents changes based on, for example, the shape of the subject (most of the mucosa is undulating or locally concave or bulged, etc.), color (color such as whitening caused by inflammation, bleeding, redness or atrophy), tissue characteristics (thickness, depth, density or a combination of blood vessels, etc.), or structural characteristics (pit pattern, etc.).

[0047] Furthermore, the regions of interest detected during the recognition process include, for example, lesions such as cancer, treatment marks, surgical scars, bleeding sites, benign tumor sites, inflamed sites (including areas with changes such as bleeding or atrophy, in addition to so-called inflammation), marked sites marked with heat-induced burn marks or coloring with dyes, fluorescent agents, or the like, or biopsy sites where a biopsy (so-called biopsy) has been performed. Specifically, regions of interest include areas containing lesions, areas with the potential for lesions, areas where procedures such as biopsies have been performed, treatment instruments such as clamps or forceps, and dark areas (areas that are difficult to reach due to the back of wrinkles or the obscuration of the lumen), which require careful observation regardless of their potential for lesions. The recognition process detects as a region of interest an area that includes at least one of the following: lesions, treatment marks, surgical scars, bleeding sites, benign tumor sites, inflamed sites, marked sites, or biopsy sites.

[0048] The recognition processing unit 14b performs recognition processing on the first image signal based on the result of the recognition processing to generate a second image signal. Specifically, when the detection of the attention area is performed as the recognition processing, as shown in FIG. Figure 3 As shown, as a recognition processing step, a process is performed to add a bounding box BB surrounding the region of interest ROI to the first image signal PS1. This generates a second image signal PS2. The second image signal is transmitted to the display 16. The display 16 displays the bounding box BB surrounding the region of interest ROI as a result of the recognition processing.

[0049] The first image switching signal generating unit 14c generates a first image switching signal for switching the display on the display 16 from the second image signal to the first image signal. The first image switching signal is used to switch the display on the display 16 to the first image signal that does not reflect the result of the recognition process when the recognition process is stopped according to an instruction of a user or the like, thereby not displaying the result of the recognition process on the display 16. The first image switching signal is sent to the display 16. In addition, the first image switching signal is generated and sent to the display 16 only when the recognition process is stopped. In addition, the first image switching signal is composed of two signals, an OFF signal and an ON signal. When the recognition process is not stopped, the OFF signal for not switching the display between the second image signal and the first image signal is continuously sent to the display 16. When the recognition process is stopped, the ON signal for switching the display between the second image signal and the first image signal is sent to the display 16.

[0050] The second image switching signal generating unit 14d generates a second image switching signal for switching the display on the display 16 from the first image signal to the second image signal. The second image switching signal is used to restart the recognition process on the display 16 by switching the display on the display 16 to the second image signal reflecting the recognition process result when the first image signal is displayed on the display 16 in response to the first image switching signal and when the recognition process is restarted in response to an instruction from a user or the like. The second image switching signal is transmitted to the display 16.

[0051] In the display 16, the display control unit 16b displays the second image signal reflecting the recognition processing result on the display unit 16a without switching the display between the first image signal and the second image signal according to the first image switching signal. On the other hand, the display control unit 16b displays the second image signal reflecting the recognition processing result on the display unit 16a. Figure 4 As shown, in accordance with the display switching instruction based on the first image switching signal, the image display on the display unit 16a switches from displaying the second image signal to displaying the first image signal. In this case, the display unit 16a also displays that the result display of the recognition process is being stopped ("AI Stopped"). In addition to the display of "AI Stopped", the display that the execution of the processing for the recognition process is being stopped can also be displayed.

[0052] In this embodiment, since the first image signal and the second image signal are displayed in a switching manner on the display 16, it is sometimes difficult for the user to understand whether the recognition process is being executed. For example, although the region of interest ROI is displayed on the display 16, the bounding box BB is not displayed (see FIG. Figure 3 ), the user cannot determine whether the recognition process has not been executed, or whether the recognition process has failed to detect the region of interest ROI in terms of performance. In the event that the recognition process is stopped unexpectedly by the user, the support function does not operate, which sometimes leads to the risk of missing the region of interest. Therefore, as in the above-mentioned "AI stopped", by displaying the result of whether the recognition process is being performed on the display 16, the above-mentioned risk can be reduced. In addition, in Figure 4 In the embodiment, the result of the recognition processing is displayed as character information, indicating that the display is stopping. However, it may be graphic information, or it may be a structure in which the display format of the entire area of the image displayed on the display 16 is switched.

[0053] in addition, Figure 4The "AI" in the text represents Artificial Intelligence using a learning model. Furthermore, information regarding the fact that the recognition process is stopped is included in the first image switching signal and is preferably displayed superimposed on the first image signal.

[0054] Furthermore, when the display control unit 16b switches the display of the first image signal and the second image signal according to the second image switching signal, Figure 5 As shown, in accordance with the display switching instruction based on the second image switching signal, the image display on the display unit 16a is switched from the display of the first image signal to the display of the second image signal. In this case, by switching the display from the first image signal to the second image signal, the display indicating that the result of the recognition processing is being stopped ("AI Stopping") is turned off.

[0055] Furthermore, in the recognition processing processor 14, when the recognition processing is stopped, it is preferable that the recognition processing is stopped in accordance with at least one of the following: a user input to stop the recognition processing, the recognition processing being in an abnormal state, or the user's operation being in a specific operation state, thereby stopping the display of the recognition processing result. When the recognition processing is stopped by the user input to stop the recognition processing, as shown in FIG. Figure 6 As shown, the stop input is preferably performed using a user interface 30 connected to the recognition processing processor device 14 .

[0056] In addition, when the recognition process is performed, a delay is generated along with the recognition process time. This delay may have an adverse effect on the user at a moment when support based on the recognition process is not needed. For example, it is assumed that the support function for preventing omissions is not needed in the treatment role based on the doctor as the user. In addition, at a moment when delicate operations such as treatment are required, the adverse effect caused by the above delay may become larger. Therefore, at this moment, the user operates the user interface 30 to stop the recognition process. This stop of the recognition process is not only achieved in the first embodiment, but also in the second and third embodiments described later. During the period when the recognition process is stopped, the first image signal that does not reflect the result of the recognition process is displayed on the display. In addition, the recognition process is stopped in the recognition processing processor device 14, but it is also possible to switch the display from the second image signal to the first image signal without stopping the recognition process.

[0057] When the recognition process is stopped due to an abnormal state, Figure 7 As shown, it is preferable to stop the recognition process when an abnormal state is detected by the abnormal state detection unit 14e provided in the recognition processing processor device 14. The abnormal state may include a failure of the recognition processing processor device 14, etc.

[0058] When the recognition process is stopped according to the user's operation status being a specific operation status, such as Figure 8 As shown, the recognition process is preferably stopped when the operation state recognition unit 14f provided in the recognition processing processor device 14 recognizes a specific operation state. The specific operation state preferably includes a treatment action of a user using a treatment instrument for resecting a lesion, etc.

[0059] [Second embodiment]

[0060] In the first embodiment, the first image switching signal is sent to the display 16, and the display switching between the first image signal and the second image signal is performed on the display 16 side. However, in the second embodiment, the first image switching signal is sent to the endoscope processor device 12. In the second embodiment, as shown in FIG. Figure 9 As shown, the endoscope processor device 12 includes an image signal generating unit 12a that generates a first image signal from a medical image, a display control unit 12b, and a processing unit 12c for stopping the display. The recognition processing processor device 14 includes a recognition processing unit 14a, a recognition processing processing unit 14b, a first image switching signal generating unit 14c that generates a first image switching signal, and a second image switching signal generating unit 14d that generates a second image switching signal. The display 16 includes a display unit 16a. Except for the first image switching signal generating unit 14c and the second image switching signal generating unit 14d, the same symbols in the first embodiment and the second embodiment have almost the same functions in the first embodiment and the second embodiment. In addition, in the second embodiment, it is also preferable to have the user interface 30, abnormal state detection unit 14e and operation status recognition unit 14f of the first embodiment.

[0061] In the second embodiment, the first image switching signal generating unit 14c transmits the first image switching signal to the endoscope processor 12. Furthermore, the second image switching signal generating unit 14d transmits the second image switching signal to the endoscope processor 12. In the endoscope processor 12, when the display control unit 12b determines that the recognition process has stopped based on the first image switching signal from the recognition processing processor 14, it transmits a first image priority signal to the display 16 for causing the first image signal to be displayed with priority over the second image signal. Furthermore, when the display control unit 12b determines that the recognition process has resumed based on the second image switching signal from the recognition processing processor 14, it transmits a second image priority signal to the display 16 for causing the second image signal to be displayed with priority over the first image signal.

[0062] In the second embodiment, when the display of the first image signal and the second image signal is not switched on the display 16 according to the first image priority signal, the second image signal reflecting the recognition processing result is displayed on the display unit 16a. On the other hand, when the display of the first image signal and the second image signal is switched on the basis of the first image priority signal, the image display on the display unit 16a is switched from the display of the second image signal to the display of the first image signal according to the display switching instruction based on the first image switching signal (see Figure 4 In this case, the display unit 16a also displays the result of the recognition process indicating that it is being stopped ("AI is stopped").

[0063] Furthermore, when the display control unit 12b switches the display of the first image signal and the second image signal in accordance with the second image priority signal, the display control unit 12b switches the image display on the display unit 16a from the display of the first image signal to the display of the second image signal in accordance with the display switching instruction based on the second image priority signal (see FIG. Figure 5 In this case, by switching the display from the first image signal to the second image signal, the display indicating that the result of the recognition processing is being stopped ("AI is stopping") is turned off.

[0064] Furthermore, in the second embodiment, when the first image signal is displayed on the display unit 16a in accordance with a display switching instruction based on a first image switching signal, a first image signal after processing for stop display is generated by the processing unit 12c for stop display provided in the endoscope processor device 12 by performing a processing for stop display on the first image signal to indicate that recognition processing is being stopped. The processed first image signal is transmitted to the display unit 16. Subsequently, when the display is switched from the second image signal to the first image signal based on a first image priority signal, the display is switched to the processed first image signal after processing for stop display.

[0065] [Third embodiment]

[0066] In the first embodiment, the first image switching signal is sent to the display 16, and the display switching between the first image signal and the second image signal is performed on the display 16 side, but in the third embodiment, either the first image signal or the second image signal is sent to the display 16 according to the first image switching signal.

[0067] In the third embodiment, Figure 10As shown, the endoscope processor device 12 includes an image signal generating unit 12a that generates a first image signal from a medical image. The recognition processing processor device 14 includes a recognition processing unit 14a, a recognition processing processing unit 14b, a first image switching signal generating unit 14c that generates a first image switching signal, a second image switching signal generating unit 14d that generates a second image switching signal, a display control unit 14g, and a display stop processing unit 14h. The display 16 includes a display unit 16a. Except for the first image switching signal generating unit 14c and the second image switching signal generating unit 14d, the same symbols in the first embodiment and the third embodiment have almost the same functions in the first embodiment and the third embodiment.

[0068] In the third embodiment, in the recognition processing processor device 14, the display control unit 14g transmits the second image signal to the display 16 when the display control unit 14g determines that the recognition process is being executed based on the first image switching signal from the first image switching signal generating unit 14c. On the other hand, when the display control unit 14g determines that the recognition process is being stopped based on the first image switching signal, the display control unit 14g displays the first image signal on the display. Furthermore, when the display control unit 14g determines that the recognition process has been restarted based on the second image switching signal from the second image switching signal generating unit 14d, the display control unit 14g transmits the second image signal to the display.

[0069] In the third embodiment, when the display 16 receives the second image signal from the recognition processing processor 14, the second image signal is displayed on the display unit 16a. On the other hand, when the display 16 receives the first image signal instead of the second image signal from the recognition processing processor 14 due to the stop of the recognition processing, the first image signal is switched from the second image signal and displayed on the display unit 16a. In addition, when the recognition processing processor 14 stops the recognition processing, the result of the recognition processing is displayed on the display unit 16a indicating that the recognition processing is being stopped ("AI Stopping") (refer to Figure 4 On the other hand, when the recognition process is being executed, the display indicating that the result of the recognition process is being stopped ("AI is stopped") is turned off on the display unit 16a (refer to Figure 5 ).

[0070] Furthermore, in the third embodiment, when the recognition processing processor 14 displays the first video signal on the display unit 16a, the stop display processing unit 14h generates a first video signal after processing for stop display by performing stop display processing on the first video signal to indicate that the display is currently stopped as a result of the recognition processing. The processed first video signal is then transmitted to the display 16. Then, when the display 16 switches from the second video signal to the first video signal, the display switches to the processed first video signal.

[0071] In addition, the advantages and disadvantages of the first to third embodiments are described below. Figure 2 ) has the advantage that even if the recognition processing processor device 14 fails, the first image signal is displayed on the display 16 without interruption of the image. On the other hand, the display 16 needs to perform display switching control between the first image signal and the second image signal, which has the disadvantage of complicating the structure around the display 16.

[0072] Furthermore, in the second embodiment (reference Figure 9 ), as in the first embodiment, there is an advantage that, even if a failure occurs in the recognition processing processor device 14, the first image signal is displayed on the display 16 without interruption of the image. On the other hand, although the disadvantage of the first embodiment, namely, the complexity of the structure around the display 16, is eliminated, there is a disadvantage that a connection mechanism capable of transmitting signals other than the first image signal, such as the first image switching signal, is required between the endoscope processor device 12 and the recognition processing processor device 14.

[0073] Furthermore, in the third embodiment (reference Figure 10 ), unlike the first and second embodiments, there is an advantage: the image signal transmitted to the display 16 comes from only one system of the recognition processing processor device 14, so the connection mechanism is the simplest among the first to third embodiments. On the other hand, there is a disadvantage that if the recognition processing processor device 14 fails, it will be difficult to transmit an appropriate image signal to the display 16.

[0074] In addition, if Figure 11 As shown in FIG, the diagnosis support device 610 used in combination with the endoscope system 20 and other medical imaging equipment or PACS (Picture Archiving and Communication Systems) can include the medical image processing system 10 of the above embodiment and other modified examples. Figure 12As shown, for example, a medical business support device 630 connected to various inspection devices including the first inspection device 621, the second inspection device 622, ..., the Nth inspection device 633 including the endoscope system 20 via an arbitrary network 626 can include the medical image processing system 10 of the above-mentioned embodiment and other variations.

[0075] In addition, various devices or systems including the medical image processing system 10 and the endoscope system 20 can be used with the following various modifications and the like.

[0076] As the medical image, a normal light image obtained by irradiating light in a white band or irradiating light in a plurality of wavelength bands as the white band light can be used.

[0077] When an image obtained by irradiating light of a specific wavelength band is used as a medical image, a specific wavelength band narrower than a white wavelength band can be used.

[0078] The specific wavelength band is, for example, a blue band or a green band in the visible region.

[0079] In the case where the specific wavelength band is a blue band or a green band in the visible region, the specific wavelength band preferably includes a wavelength band above 390 nm and below 450 nm, or above 530 nm and below 550 nm, and the light of the specific wavelength band preferably has a peak wavelength within a wavelength band above 390 nm and below 450 nm, or above 530 nm and below 550 nm.

[0080] The specific wavelength band is, for example, a red band in the visible region.

[0081] In the case where the specific wavelength band is a red band in the visible region, the specific wavelength band preferably includes a wavelength band above 585 nm and below 615 nm, or above 610 nm and below 730 nm, and the light in the specific wavelength band preferably has a peak wavelength within a wavelength band above 585 nm and below 615 nm, or above 610 nm and below 730 nm.

[0082] The specific wavelength band includes, for example, a wavelength band in which the absorption coefficients of oxyhemoglobin and deoxyhemoglobin are different, and light of the specific wavelength band has a peak wavelength in the wavelength band in which the absorption coefficients of oxyhemoglobin and deoxyhemoglobin are different.

[0083] In the case where the specific wavelength band includes a wavelength band in which the absorption coefficients are different between oxygenated hemoglobin and reduced hemoglobin, and the light in the specific wavelength band has a peak wavelength in the wavelength band in which the absorption coefficients are different between oxygenated hemoglobin and reduced hemoglobin, the specific wavelength band preferably includes a wavelength band of 400±10nm, 440±10nm, 470±10nm, or 600nm to 750nm, and the light in the specific wavelength band preferably has a peak wavelength in a wavelength band of 400±10nm, 440±10nm, 470±10nm, or 600nm to 750nm.

[0084] When the medical image is an in-vivo image captured inside a living body, the in-vivo image can include information on fluorescence emitted by a fluorescent substance in the living body.

[0085] Furthermore, the fluorescence can be obtained by irradiating the inside of a living body with excitation light having a peak wavelength of 390 nm to 470 nm.

[0086] When the medical image is an in-vivo image captured inside a living body, the specific wavelength band can utilize a wavelength band of infrared light.

[0087] When the medical image is an internal image of a living body captured inside the living body, and a wavelength band of infrared light is used as the aforementioned specific wavelength band, the specific wavelength band preferably includes a wavelength band of 790 nm to 820 nm, or 905 nm to 970 nm, and the light of the specific wavelength band preferably has a peak wavelength in the wavelength band of 790 nm to 820 nm, or 905 nm to 970 nm.

[0088] The medical image processing system may include a special light image acquisition unit that acquires a special light image having a signal in a specific wavelength band based on a normal light image obtained by irradiating the patient with light in a white band or with light in multiple wavelength bands as the white band. In this case, the special light image can be used as a medical image.

[0089] The signal of the specific wavelength band can be obtained through an operation based on the color information of RGB or CMY included in the normal light image.

[0090] The medical image processing system may include a feature value image generating unit that generates a feature value image by performing calculations based on at least one of a normal light image obtained by irradiating a white band of light or irradiating a plurality of wavelength bands as white band light, and a special light image obtained by irradiating a specific wavelength band of light. In this case, the feature value image can be used as a medical image.

[0091] As for the endoscope system 20, a capsule endoscope can be used as the endoscope 24. In this case, the light source device 22 and a part of the endoscope processor device 12 can be mounted on the capsule endoscope.

[0092] In the above-described embodiment and variations, the hardware configuration of the processing units (processing units) that perform various processes, such as the image signal generating unit 12a, the display control unit 12b, the display stop processing unit 12c, the recognition processing unit 14a, the recognition processing unit 14b, the first image switching signal generating unit 14c, the second image switching signal generating unit 14d, the abnormal state detecting unit 14e, the operation status identifying unit 14f, the display control unit 14g, the display stop processing unit 14h, and the display control unit 16b, is composed of the following processors. These processors include general-purpose processors (CPUs) that execute software (programs) and function as various processing units; processors (PLDs) (programmable logic devices) whose circuit configuration can be modified after manufacturing, such as FPGAs (field programmable gate arrays); processors (special-purpose circuits) with circuit configurations specifically designed to perform various processes; and GPUs (graphical processing units) that perform image processing in parallel.

[0093] A processing unit can be composed of one of these various processors, or a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, a CPU and an FPGA, or a combination of a CPU and a GPU). In addition, multiple processing units can be composed of one processor. As an example of multiple processing units composed of one processor, first, as represented by computers such as clients and servers, there is a method of forming a processor by a combination of one or more CPUs and software, and the processor functions as multiple processing units. Second, as represented by a system on chip (System OnChip: SoC), there is a method of using a processor that uses an IC (Integrated Circuit: integrated circuit) chip to implement the functions of the entire system including multiple processing units. In this way, various processing units are composed of one or more of the above-mentioned various processors as a hardware structure.

[0094] Furthermore, the hardware configuration of these various processors is more specifically a circuit in the form of a combination of circuit elements such as semiconductor elements.

[0095] Explanation of symbols

[0096] 10-medical image processing system, 12-endoscope processor device, 12a-image signal generating unit, 12b-display control unit, 12c-processing unit for stopping display, 14-processor device for identification processing, 14a-identification processing unit, 14b-processing unit for identification processing, 14c-first image switching signal generating unit, 14d-second image switching signal generating unit, 14e-abnormal state detection unit, 14f-operation status identification unit, 14g-display control unit, 14h-processing unit for stopping display, 16-display, 16a-display unit, 16b-display control unit, 20-endoscope system, 22-light source device, 24-endoscope, 30-user interface, 610-diagnosis support device, 621-first inspection device, 622-second inspection device, 623-Nth inspection device, 626-network, 630-medical business support device.

Claims

1. A medical image processing system, wherein: The medical image processing system comprises: The first processor sequentially acquires medical images and generates a first image signal from the medical images; a second processor receiving the first image signal from the first processor, performing recognition processing on the first image signal, and performing recognition processing for displaying a result of the recognition processing on the first image signal to generate a second image signal; and monitor, The second processor generates a first image switching signal. The display displays either the second image signal or the first image signal switched from the second image signal according to the first image switching signal, and when the result display of the recognition processing based on the second image signal is stopped, displays that the result display of the recognition processing is stopped.

2. The medical image processing system according to claim 1, wherein: The medical image processing system comprises a third processor arranged on the display, The display receives the first image signal from the first processor and receives the second image signal from the second processor. When the display is displaying the second video signal, the third processor switches the display on the display from the second video signal to the first video signal in accordance with the first video switching signal.

3. The medical image processing system according to claim 1, wherein: The first processor, upon receiving the first image switching signal from the second processor, transmits a first image priority signal to the display for causing the first image signal to be displayed with priority over the second image signal. The display receives either the first image signal or the first image priority signal from the first processor, and receives the second image signal from the second processor. When the second video signal is displayed on the monitor, the display on the monitor is switched from the second video signal to the first video signal according to the first video priority signal.

4. The medical image processing system according to claim 3, wherein: When the first processor switches the display from the second image signal to the first image signal according to the first image priority signal, it generates a first image signal processed for stop display obtained by performing processing for stop display on the first image signal, and sends the first image signal processed for stop display as the first image signal to the display.

5. The medical image processing system according to claim 1, wherein: The second processor sends the second image signal to the display when it is determined based on the first image switching signal that the recognition process is being executed, and sends the first image signal to the display when it is determined based on the first image switching signal that the recognition process is being stopped. The display displays the second video signal when the second processor transmits the second video signal, and displays the first video signal when the second processor transmits the first video signal.

6. The medical image processing system according to claim 5, wherein: When the second processor displays the first image signal on the display according to the first image switching signal, it generates a first image signal processed for stop display obtained by performing processing for stop display on the first image signal, and sends the first image signal processed for stop display as the first image signal to the display.

7. The medical image processing system according to any one of claims 1 to 6, wherein: The second processor stops the recognition process in response to at least one of a user input to stop the recognition process, the recognition process being in an abnormal state, and the user's operation being in a specific operation state, thereby stopping the display of the recognition process result.

8. The medical image processing system according to claim 7, wherein: The specific operation conditions include treatment actions of the user using a treatment instrument.

9. The medical image processing system according to any one of claims 1 to 6, wherein: The second processor generates a second image switching signal when restarting the recognition process. The display displays a second video signal switched from the first video signal in accordance with the second video switching signal.

10. The medical image processing system according to claim 7, wherein: The second processor generates a second image switching signal when restarting the recognition process. The display displays a second video signal switched from the first video signal in accordance with the second video switching signal.

11. The medical image processing system according to claim 8, wherein: The second processor generates a second image switching signal when restarting the recognition process. The display displays a second video signal switched from the first video signal in accordance with the second video switching signal.

12. A processor device for recognition processing, connected to a first processor that sequentially acquires medical images and generates a first image signal from the medical images, and connected to a display, wherein: The recognition processing processor device includes a second processor, which receives the medical image from the first processor, performs recognition processing on the first image signal, and performs recognition processing processing on the first image signal for displaying the result of the recognition processing to generate a second image signal. The second processor generates a first image switching signal. When either the second image signal or the first image signal switched from the second image signal according to the first image switching signal is displayed on the display, and the result display of the recognition processing based on the second image signal is stopped, the result display of the recognition processing is displayed on the display as being stopped.

13. A working method of a medical image processing system, The medical image processing system comprises: The first processor sequentially acquires medical images and generates a first image signal from the medical images; a second processor receiving the first image signal from the first processor, performing recognition processing on the first image signal, and performing recognition processing for displaying a result of the recognition processing on the first image signal to generate a second image signal; and monitor, in, The working method of the medical image processing system comprises the following steps: The second processor generates a first image switching signal; The display displays either the second image signal or the first image signal switched from the second image signal according to the first image switching signal, and when the result display of the recognition processing based on the second image signal is stopped, displays that the result display of the recognition processing is stopped.

Images