Medical image viewer

Abstract

To support appropriate image interpretation by a user.SOLUTION: A medical information display device (viewer terminal 40) includes: an acquisition part (control part 41) that acquires lesion detection processing results (CAD results and error information) obtained by performing lesion detection processing on medical images using a computer; and a control part 41 that executes a prevention function for preventing inappropriate image interpretation by a user with respect to the medical images.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a medical image viewer. [Background technology]

[0002] Thanks to advances in computer technology, medical professionals have traditionally used devices equipped with computer-aided diagnosis (CAD) functions. This function analyzes digitally captured medical images, automatically detects lesions, and displays them on a screen to help doctors interpret the images. Furthermore, artificial intelligence (AI) is increasingly being used in lesion detection processing.

[0003] At present, the lesion detection results by AI are used only as a reference for doctors' interpretation of images, so there is no need to wait for the AI ​​to interpret the images. However, as regulations on doctors' overtime work become more stringent in the future, AI image interpretation will become even more widespread, and the results of AI image interpretation will become even more important. For example, even now, with triage-type AI, the workflow is such that doctors interpret images based on the AI's initial interpretation results, and the AI ​​is essentially responsible for the initial interpretation. Furthermore, if images are interpreted without receiving the AI's interpretation results, the quality cannot be guaranteed compared to interpretations using AI, and doctors may overlook lesions. As a result, we are entering a situation where we must wait for the AI's interpretation results.

[0004] Patent document 1 describes an apparatus equipped with the above-mentioned CAD, and describes that information indicating that the CAD detection processing result for a certain test is "not yet arrived" is displayed on a doctor's terminal device. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-115265 Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, for an examination in which the lesion detection process has not been completed, the doctor user can only know that the interpretation results have not yet arrived. If the analysis takes a long time, the results will arrive if the user waits, but if the analysis fails or if the result is not within the scope of the analysis, the results may not arrive even if the user waits. This leaves the user in a situation where it is unclear whether the results will arrive if the user waits, which hinders the user's ability to properly interpret the images.

[0007] An object of the present invention is to support a user in appropriate interpretation of images. [Means for solving the problem]

[0008] In order to solve the above problems, the medical image viewer according to the present invention comprises: an image acquisition unit for acquiring medical images; a WF information acquisition unit that acquires workflow information of a first interpretation in which the medical image is interpreted by a computer and a second interpretation in which the medical image is interpreted by a user after the first interpretation; a control unit that displays the medical image on a display unit during the second interpretation; a determination unit that determines a processing state of the first interpretation based on the workflow information, The control unit executes a prevention function for preventing the start of the second interpretation if the first interpretation has not been completed based on the determination result. [Effects of the Invention]

[0009] According to the present invention, it is possible to support a user in appropriate interpretation of images. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing the overall configuration of a medical image system. [Figure 2]FIG. 2 is a block diagram showing the functional configuration of the CAD device. [Figure 3] FIG. 2 is a block diagram showing a functional configuration of a server device. [Figure 4] FIG. 2 is a block diagram showing a functional configuration of a viewer terminal. [Figure 5] 10 is a flowchart showing a WF information display process. [Figure 6] FIG. 10 is an image of the WF information display screen. [Figure 7] FIG. 10 is an image of the WF information display screen. [Figure 8] FIG. 10 is an image of the WF information display screen. [Figure 9] 10 is a flowchart showing a WF information display process. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings, but the scope of the invention is not limited to the illustrated examples.

[0012] <Configuration of Medical Imaging System 100> FIG. 1 shows the system configuration of a medical image system 100 including a viewer terminal 40 as a medical information display device. As shown in FIG. 1, the medical image system 100 is configured by connecting a modality 10, a CAD device 20, a server device 30, and a viewer terminal 40 so as to be able to perform data communication via a network N such as a LAN (Local Area Network). Network N conforms to the DICOM (Digital Imaging and Communications in Medicine) standard.

[0013] The modality 10 takes an image of a patient, generates a file of image data of a medical image (hereinafter referred to as an image file), and transmits this image file to the CAD device 20 and the server device 30, respectively. The image file is attached with additional information such as patient information including patient ID, patient name, date of birth, gender, etc., and examination information including examination ID, examination date, examination time, etc. As modality 10, a CR (Computed Radiography) device, a CT (Computed Tomography) device, an MRI (Magnetic Resonance Imaging) device, etc. are used.

[0014] The CAD device 20 receives the image file of the medical image from the modality 10, performs image analysis of the medical image, and detects lesions. Then, the CAD device 20 generates a lesion detection processing result (CAD result and error information) indicating the detection result of the detected lesion. The image analysis of the medical image may be executed using AI or the like.

[0015] The server device 30 is a device that manages the above-mentioned image file and lesion detection processing result. Also, the server device 30 is a device that manages the reading result read by a user such as a doctor using the viewer terminal 40 for the image file and the lesion detection processing result by executing the WF (workflow) information display processing described later.

[0016] The viewer terminal 40 is a device that displays the above-mentioned image file and lesion detection processing result. A user such as a doctor reads the above-mentioned image file and lesion detection processing result using the viewer terminal 40 and inputs the reading result.

[0017] <Configuration of CAD Device 20> FIG. 2 shows the functional configuration of the CAD device 20. As shown in FIG. 2, the CAD device 20 includes a control unit 21, an operation unit 22, a display unit 23, a communication unit 24, a ROM (Read Only Memory) 25, and a storage unit 26, and each unit is connected by a bus 27.

[0018] The control unit 21 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc., and controls the processing operations of each unit of the CAD device 20 in an integrated manner. Specifically, the CPU reads out various processing programs stored in the ROM 25 or the storage unit 26 in response to an operation signal input from the operation unit 22 or an instruction signal received by the communication unit 24. Then, the CPU expands the programs in a work area formed in the RAM and performs various processes in cooperation with the programs. The control unit 21 generates the lesion detection processing results (CAD results and error information) and transmits the generated CAD results to the server device 30 via the communication unit 24. The control unit 21 functions as an image acquisition unit that acquires medical images. The control unit 21 functions as a detection processing unit that performs lesion detection processing on medical images using a computer.

[0019] The operation unit 22 is configured with a keyboard equipped with cursor keys, numeric input keys, and various function keys, etc., and a pointing device such as a mouse, and outputs operation signals input by key operations on the keyboard or mouse operations to the control unit 21.

[0020] The display unit 23 is configured by an LCD (Liquid Crystal Display), and displays various screens based on display data input from the control unit 21.

[0021] The communication unit 24 is an interface for transmitting and receiving data to and from external devices such as the modality 10 and the server device 30 .

[0022] The ROM 25 is configured by a non-volatile semiconductor memory or the like, and stores the control program, parameters and files required for executing the program, and the like.

[0023] The storage unit 26 is configured with a hard disk or the like, and stores various data. Specifically, a lesion detection program that detects lesions according to a lesion detection algorithm is stored in storage unit 26. Storage unit 26 also stores image files and CAD results.

[0024] <Configuration of server device 30> The server device 30 is configured by a PACS (Picture Archiving and Communication System). The server device 30 stores image files received from the modality 10 and CAD results received from the CAD device 20, and provides image files, CAD results, etc. in response to requests from external devices such as the viewer terminal 40.

[0025] Fig. 3 shows the functional configuration of the server device 30. As shown in Fig. 3, the server device 30 is configured to include a control unit 31, an operation unit 32, a display unit 33, a communication unit 34, a ROM 35, and a storage unit 36, and each unit is connected via a bus 37.

[0026] The control unit 31 is composed of a CPU, RAM, etc., and controls the processing operations of each unit of the server device 30 in an integrated manner. Specifically, the CPU reads out various processing programs stored in the ROM 35 or the storage unit 36 ​​in response to an operation signal input from the operation unit 32 or an instruction signal received by the communication unit 34. The CPU then loads the programs into a work area formed in the RAM and performs various processes in cooperation with the programs. The control unit 31 cooperates with the CAD device 20 and the viewer terminal 40 to execute a WF information display process, which will be described later.

[0027] The operation unit 32 is configured with a keyboard equipped with cursor keys, numeric input keys, and various function keys, etc., and a pointing device such as a mouse, and outputs operation signals input by key operations on the keyboard or mouse operations to the control unit 31.

[0028] The display unit 33 is configured by an LCD, and displays various screens based on display data input from the control unit 31.

[0029] The communication unit 34 is an interface for transmitting and receiving data to and from external devices such as the modality 10, the CAD device 20, and the viewer terminal 40.

[0030] The ROM 35 is configured by a non-volatile semiconductor memory or the like, and stores the control program, parameters and files required for executing the program, and the like.

[0031] The storage unit 36 ​​is configured with a hard disk or the like, and stores various data. Specifically, the storage unit 36 ​​stores an image file received from the modality 10 and a CAD result received from the CAD device 20 in association with each other. In addition, the storage unit 36 ​​stores WF (workflow) information and interpretation results in association with each other.

[0032] <Configuration of viewer terminal 40> The viewer terminal 40 is a medical information display device that displays medical images based on image files acquired from the server device 30, and is a device for interpreting the medical images. The viewer terminal 40 is configured by a general PC (Personal Computer).

[0033] Fig. 4 shows the functional configuration of the viewer terminal 40. As shown in Fig. 4, the viewer terminal 40 includes a control unit 41, an operation unit 42, a display unit 43, a communication unit 44, a ROM 45, and a storage unit 46, and each unit is connected via a bus 47.

[0034] The control unit 41 is composed of a CPU, RAM, etc., and controls the processing operations of each unit of the viewer terminal 40 in an integrated manner. Specifically, the CPU reads out various processing programs stored in the ROM 45 or the storage unit 46 in response to an operation signal input from the operation unit 42 or an instruction signal received by the communication unit 44. The CPU then expands the programs in a work area formed in the RAM and performs various processes in cooperation with the programs. The control unit 41 functions as an acquisition unit that acquires the result of a lesion detection process for a medical image using a computer. The control unit 41 functions as a control unit that executes a prevention function for preventing inappropriate interpretation by a user of a medical image.

[0035] The operation unit 42 includes a keyboard having cursor keys, numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs an operation signal input by a key operation on the keyboard or a mouse operation to the control unit 41.

[0036] The display unit 43 is configured by an LCD and displays various screens based on display data input from the control unit 41.

[0037] The communication unit 44 is an interface that performs data transmission and reception with an external device such as the server device 30.

[0038] The ROM 45 is configured by a non-volatile semiconductor memory or the like, and stores a control program, parameters and files necessary for executing the program, etc.

[0039] The storage unit 46 is configured by a hard disk or the like, and stores various data. For example, the storage unit 46 stores an image viewer program 461 for displaying a medical image on the display unit 43 when performing interpretation.

[0040] <WF information display process> Using FIG. 5, the WF information display process executed by the cooperation of the server device 30, the CAD device 20, and the viewer terminal 40 will be described. WF information is information representing the order of an executor or a device that executes the interpretation of a predetermined image file. Specifically, the WF information designates the interpretation (lesion detection) by the CAD device 20 as the primary interpretation, the interpretation using the viewer terminal 40 by a user such as a doctor as the secondary interpretation, the interpretation using the viewer terminal 40 by another user as the tertiary interpretation, and so on.

[0041] First, the control unit 41 of the viewer terminal 40 drafts WF information based on the user's operation of the operation unit 42 (step S1). In this embodiment, the WF information will be described assuming that the primary interpretation is performed by the CAD device 20 and the secondary interpretation is performed by a user such as a doctor.

[0042] Next, the control unit 41 of the viewer terminal 40 uses the communication unit 44 to transmit the WF information to the server device 30 (step S2).

[0043] Next, when the control unit 31 of the server device 30 receives the WF information using the communication unit 34, it links the WF information to the image file of the medical image to be interpreted and registers the WF information in the storage unit 36 ​​(step S3).

[0044] Next, the control unit 31 of the server device 30 uses the communication unit 34 to transmit the WF information to the CAD device 20 and the viewer terminal 40 of the user who will perform the second interpretation (step S4).

[0045] Next, the control unit 41 of the viewer terminal 40 receives (acquires) the WF information using the communication unit 44 (step S5). Next, the WF information display screen shown in FIG. 6 is displayed on the display unit 43, and the WF information is displayed (step S6; control step). In this embodiment, the interpretation by a user such as a doctor using the viewer terminal 40 is a secondary interpretation, which is performed after the primary interpretation by the CAD device 20, so the WF information is displayed as inactive, as shown in Fig. 6. Inactivity will be described later. Furthermore, since CAD processing (step S7), which will be described later, is being performed in parallel, the approval status column displays "analyzing."

[0046] Here, the WF information display screen shown in FIG. 6 will be described. Area A1 is an area that displays a list of WF information. When active WF information is selected in area A1 and pressed (e.g., double-clicked), a separate screen including medical images, patient information, and additional information is displayed. Active WF information can be selected and pressed, but inactive WF information is set so that it cannot be selected. For example, in the example of FIG. 6, active WF information is WF information that is not grayed out, and inactive WF information is WF information that is grayed out.

[0047] By displaying the WF information display screen as described above, users such as doctors can check the progress of the WF information, but cannot select or press the WF information, so they cannot start interpretation. This prevents users from interpreting images inappropriately.

[0048] In the above example, inappropriate interpretation by the user is prevented by deactivating the WF information, but it is also possible to activate the WF information and display a warning when it is selected and pressed. If the user wants to start interpretation after confirming the warning, they may be able to start interpretation and proceed with the WF.

[0049] Next, when the CAD device 20 receives the WF information using the communication unit 24, it acquires the image file linked to the WF information and executes CAD processing (step S7). If the CAD processing is a multiple lesion detection processing, the WF information display processing proceeds to the next step after all of the multiple lesion detection processing is completed.

[0050] Next, the CAD device 20 uses the communication unit 24 to transmit the CAD processing result or error information to the server device 30 (step S8). The error information is, for example, a communication failure in the processing results, a system failure, or a processing delay due to multiple lesion detection processes, and the error information is sent as "communication interruption / processing delay / system failure." Also, the error information is an analysis failure, and the error information is sent as "analysis failure / processing failure." Also, the error information is when the medical image is not a target image, and the error information is sent as "not to be analyzed / not to be processed."

[0051] Next, when the control unit 31 of the server device 30 receives the CAD processing result or the error information using the communication unit 34, it links the CAD processing result or the error information to the WF information and updates the WF information (step S9).

[0052] Next, the control unit 31 of the server device 30 uses the communication unit 34 to transmit the updated WF information to the viewer terminal 40 of the user who will perform the secondary interpretation (step S10).

[0053] Next, the control unit 41 of the viewer terminal 40 receives (acquires) the updated WF information using the communication unit 44 (step S11). Next, the display unit 33 updates and displays the WF information as shown in FIG. 7 or 8 (step S12). Specifically, the control unit 41 changes the WF information to an active state (a state where it is not grayed out) so that it can be selected and pressed. Also, the approval status field displays "Primary approval completed" if the CAD processing result is obtained normally in step S7, and displays the error information if error information is obtained in step S7. The display of the error information changes depending on the content of the error.

[0054] Next, when the user selects and presses (e.g., double-clicks) the WF information, a separate screen including the medical image, patient information, and additional information is displayed. The user checks the displayed medical image, patient information, and additional information, and performs interpretation. The user inputs the interpretation results using the operation unit 42 (step S13).

[0055] Next, the control unit 41 of the viewer terminal 40 transmits the interpretation results to the server device 30 using the communication unit 44 (step S14).

[0056] Next, when the control unit 31 of the server device 30 receives the interpretation result using the communication unit 34, the control unit 31 links the interpretation result to the WF information and updates the WF information (step S15). In this embodiment, the workflow ends with the second interpretation, and therefore the WF information display process ends.

[0057] <Other> As in the WF information display process shown in FIG. 9, in step S20, the control unit 41 of the viewer terminal 40 receives (acquires) the WF information using the communication unit 44, but in step S21, the control unit 41 may perform control so as not to display the WF information on the WF information display screen of the display unit 43. Then, in step S26, the control unit 41 of the viewer terminal 40 receives the updated WF information using the communication unit 44, and in step S27, the control unit 41 may display the WF information on the display unit 33 as shown in the WF information display screen of FIG. 7 or FIG. 8. That is, the WF information may be displayed at the timing when the image interpretation is performed. 9 are the same as the WF information display processing shown in FIG. 5, except for step S21 and step S27 described above. By displaying the WF information display screen in this way, users such as doctors cannot select or press the WF information because the WF information is not displayed in area A1, and therefore cannot start interpretation. This prevents inappropriate interpretation by users.

[0058] 5 and step S20 and step S21 in the WF information display process shown in Fig. 9 may not be executed, and the WF information may be transmitted to the viewer terminal 40 at the timing when interpretation is performed. That is, in the examples of Fig. 5 and Fig. 9, the WF information may be received (acquired) by the viewer terminal 40 in step S11 or step S26 after CAD processing. By displaying the WF information display screen in this way, users such as doctors cannot select or press the WF information because the WF information is not displayed in area A1, and therefore cannot start interpretation. This prevents inappropriate interpretation by users.

[0059] In addition, a reference button may be provided on the WF information display screen. The Browse button is used to search for any WF information. When the Browse button is pressed, a separate screen is displayed, and when any examination ID is entered, the WF information corresponding to that examination ID is searched for. This allows doctors and other users to check the WF information and confirm the progress of CAD processing, preventing them from interpreting images before the CAD processing is complete. It also prevents situations where doctors and other users have to wait even though an error has occurred in CAD processing and the CAD processing results cannot be obtained.

[0060] Furthermore, in the above, the control unit 21 of the CAD device 20 has the function of a detection processing unit that performs lesion detection processing on medical images using a computer, but the function of the detection processing unit may also be provided in the server device 30 or various information processing devices connected to the network N.

[0061] Furthermore, although the first interpretation is performed by the CAD device 20, the present invention is not limited to this example. The effects of the present invention are exhibited in cases where a doctor performs interpretation after the CAD device 20 performs interpretation.

[0062] <Effects> As described above, the medical information display device (viewer terminal 40) includes an acquisition unit (control unit 41) that acquires the lesion detection processing results (CAD results and error information) obtained by performing lesion detection processing on medical images using a computer, and the control unit 41 that executes a prevention function that prevents users from inappropriately interpreting medical images. This helps users interpret images appropriately.

[0063] Furthermore, as a preventive function, when the acquisition unit (control unit 41) has not acquired the lesion detection processing result, the control unit 41 causes the display unit to display information on whether or not to wait for the acquisition of the lesion detection processing result. This helps users interpret images appropriately.

[0064] As a preventive function, the control unit 41 also performs control to prohibit the user from interpreting the image until the lesion detection process is completed, and performs control to allow the user to interpret the image after the lesion detection process is completed. This helps users interpret images appropriately.

[0065] The control to prohibit the user from interpreting the image is a control by the control unit 41 not to display examinations related to medical images on the display unit. This helps users interpret images appropriately.

[0066] The control to prohibit the user from interpreting the image is a control in which the control unit 41 displays an examination related to the medical image on the display unit and prohibits the user from starting interpretation of the image. This helps users interpret images appropriately.

[0067] The control to prohibit the user from performing image interpretation is a control in which the control unit 41 displays a warning regarding the user's image interpretation on the display unit. This helps users interpret images appropriately.

[0068] In addition, the lesion detection process is a process of detecting multiple lesions, and the control unit 41 controls the process to prevent the user from reading the image until the multiple lesion detection processes are completed, and controls the process to allow the user to read the image after the multiple lesion detection processes are completed. This helps users interpret images appropriately.

[0069] In addition, the image display system (medical image system 100) is an image display system equipped with an image display device, and includes an image acquisition unit (control unit 21) that acquires medical images, a detection processing unit (control unit 21) that performs lesion detection processing on medical images using a computer, and a control unit 41 that executes a prevention function to prevent users from inappropriately interpreting medical images. This helps users interpret images appropriately.

[0070] The medical information display method also includes an acquisition step (steps S5, S6, S20, and S26) for acquiring the results of lesion detection processing performed on a medical image using a computer, and a control step (steps S6 and S21) for executing a prevention function to prevent inappropriate interpretation of the medical image by the user. This helps users interpret images appropriately.

[0071] The program also causes the computer of the medical information display device to function as an acquisition unit (control unit 41) that acquires the results of lesion detection processing performed using the computer to detect lesions in medical images, and as the control unit 41 that executes a prevention function to prevent users from inappropriately interpreting medical images. This helps users interpret images appropriately.

[0072] The above-described embodiment is an example of the medical information display device according to the present invention, and the present invention is not limited to this. The detailed configuration and operation of each part constituting the device can be appropriately changed without departing from the spirit of the present invention.

[0073] In the above description, examples using a ROM, a hard disk, or the like as a computer-readable medium storing a program for executing each process have been disclosed, but the present invention is not limited to these examples. As other computer-readable media, nonvolatile memories such as flash memories and portable recording media such as CD-ROMs can also be applied. Further, a carrier wave (carrier wave) may be applied as a medium for providing program data via a communication line.

Explanation of Signs

[0074] 10 Modality 20 CAD device 21 Control unit (image acquisition unit, detection processing unit) 22 Operation unit 23 Display unit 24 Communication unit 25 ROM 26 Storage unit 27 Bus 30 Server device 31 Control unit 32 Operation unit 33 Display unit 34 Communication unit 35 ROM 36 Storage unit 37 Bus 40 Viewer terminal 41 Control unit (acquisition unit) 42 Operation unit 43 Display unit 44 Communication unit 45 ROM 46 Storage unit 47 Bus 100 Medical image system N Network

Claims

1. an image acquisition unit for acquiring medical images; a WF information acquisition unit that acquires workflow information of a first interpretation in which the medical image is interpreted by a computer and a second interpretation in which the medical image is interpreted by a user after the first interpretation; a control unit that displays the medical image on a display unit during the second interpretation; a determination unit that determines a processing state of the first interpretation based on the workflow information, the control unit executes a prevention function of preventing the start of the second interpretation if the first interpretation has not been completed based on the determination result. Medical image viewer.

2. the control unit causes the display unit to display a WF information display screen that displays the determination result and the workflow information. The medical image viewer according to claim 1 .

3. The control unit causes a predetermined area of ​​the WF information display screen to function as a start button for the second interpretation. The medical image viewer according to claim 2 .

4. The prevention function deactivates the start button for the second interpretation. The medical image viewer according to claim 3 .

5. The prevention function is a control to disable the start of the second interpretation. The medical image viewer according to claim 1 .

6. The prevention function is a control to prevent an examination related to the medical image of the second interpretation from being displayed on the display unit. The medical image viewer according to claim 1 .

7. the prevention function is a control to display a warning regarding the second interpretation on the display unit. The medical image viewer according to claim 1 .

Images