Medical image display device and medical image display system

Abstract

To enhance efficiency in selecting comparison image data corresponding to interpretation image data.SOLUTION: A medical image display apparatus includes a determination section and a display control section. The determination section determines whether or not a position of a mouse cursor is superimposed on a display range of interpretation target medical image data arranged in a display screen of a display section. The display control section displays, when the determination section determines the position of the mouse cursor is superimposed on the display range, a candidate of comparison target medical image data corresponding to the interpretation target medical image data identified by the position of the mouse cursor in an interpretation adjacent region where the identified interpretation target medical image data is not superimposed and is adjacent to the identified interpretation target medical image data.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The embodiments disclosed in the present specification and drawings relate to a medical image display device and a medical image display system. [Background technology]

[0002] The interpretation work by an operator such as a doctor using a medical image display system includes a follow-up observation process. In the follow-up observation process, it is common to simultaneously display images such as medical image data to be interpreted and image data to be compared side by side. Traditionally, medical image data acquired by imaging using medical image diagnostic devices has been stored in a database within hospitals. The operator searches for medical image data to be interpreted (hereinafter referred to as "interpretation image data") and candidates for medical image data to be compared (hereinafter referred to as "comparison image data") using keyword search or the like.

[0003] Specifically, when the operator inputs keywords based on desired attributes (patient ID (Identification), examination UID (Unique Identification), series UID, examination area, imaging conditions, examination time, etc.) into a search field, the medical image display system searches the database and obtains interpreted image data and comparison image data candidates corresponding to the keywords.The medical image display system then displays the comparison image data candidates in a thumbnail field at a predetermined position at the top of the display screen, allowing the operator to select the desired comparison image data from the predetermined position. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-088709 Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to improve the efficiency of selecting comparison image data corresponding to interpretation image data. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]

[0006] A medical image display device according to an embodiment includes a determination unit and a display control unit. The determination unit determines whether the position of a mouse cursor overlaps a display range of medical image data of an interpretation target arranged on a display screen of the display unit. When the determination unit determines that the position of the mouse cursor overlaps, the display control unit displays candidates of medical image data of a comparison target corresponding to the identified medical image data of the interpretation target in an interpretation adjacent area that does not overlap with the medical image data of the interpretation target identified by the position of the mouse cursor and is adjacent to the identified medical image data of the interpretation target. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of a medical image display system equipped with a medical image display device according to an embodiment. [Figure 2] FIG. 2 is a schematic diagram showing the configuration and functions of the medical image display device according to the embodiment. [Figure 3] FIG. 3 is a diagram showing an example of the layout of a display screen in the medical image display device according to the embodiment. [Figure 4] FIG. 4 is a flowchart showing a method for displaying medical images in a medical image display system including the medical image display device according to the embodiment. [Figure 5] FIG. 5 is a diagram showing a method of displaying candidates for medical image data to be compared in the medical image display device according to the embodiment. [Figure 6] FIG. 6 is a diagram showing a display method of candidates for medical image data to be compared in the medical image display device according to the embodiment. [Figure 7] FIG. 7 is a diagram showing a display method of candidates for medical image data to be compared in a medical image display device according to a comparative example. [Figure 8] FIG. 8 is a diagram showing a display method of display layout candidates in a medical image display device according to a first modified example. [Figure 9] FIG. 9 is a diagram showing a display method of candidates for medical image data to be compared and candidates for display layouts in a medical image display device according to a second modified example. [Figure 10] FIG. 10 is a diagram showing a display method of candidates for medical image data to be compared and candidates for display layouts in a medical image display device according to a third modified example. [Figure 11] FIG. 11 is a diagram showing a display method of candidates for medical image data to be compared and candidates for display layouts in a medical image display device according to a third modified example. [Figure 12] FIG. 12 is a diagram showing a display method of candidates for medical image data to be compared and candidates for display layouts in a medical image display device according to a fourth modified example. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of a medical image display device and a medical image display system will be described in detail with reference to the drawings.

[0009] FIG. 1 is a schematic diagram showing the configuration of a medical image display system equipped with a medical image display device according to an embodiment.

[0010] FIG. 1 shows a medical image display system 1 equipped with a medical image display device (also referred to as an "image viewer") 10 according to an embodiment. The medical image display system 1 includes the medical image display device 10 and one or more medical image management devices (also referred to as "image servers") 20. The medical image display device 10 and the medical image management devices 20 are connected to each other via a network N so that they can communicate with each other. This connection can be an electrical connection via an electronic network. Here, the electronic network refers to a general information communication network that uses electrical communication technology, and includes wireless / wired hospital-based local area networks (LANs) and the Internet, as well as telephone communication line networks, optical fiber communication networks, cable communication networks, satellite communication networks, and the like.

[0011] The medical image display system 1 stores medical image data and shared objects acquired by a medical image diagnostic device (not shown) in a database, and searches for and displays the medical image data in response to operations by an operator such as a doctor. The medical image display system 1 is mainly used for interpretation. Generally, during interpretation, the interpretation image data is displayed side by side with comparison image data or other medical image data for follow-up observation. Medical image diagnostic devices include X-ray diagnostic devices such as computed radiography (CR) devices, X-ray computed tomography (CT) devices, magnetic resonance imaging (MRI) devices, ultrasound diagnostic devices, nuclear medicine diagnostic devices, etc. Medical image data includes CR image data acquired by a CR device, CT image data acquired by an X-ray CT device, MR image data acquired by an MRI device, ultrasound image data acquired by an ultrasound diagnostic device, nuclear medicine image data acquired by a nuclear medicine diagnostic device, etc. A shared object is data that includes the shooting conditions, information identifying the medical image data that was taken, and reference information identifying the medical image data that was referenced during shooting, and is generated corresponding to a series obtained by a series of shots.

[0012] The medical image display device 10 and the medical image management device 20 are configured by computers. The medical image management device 20 is, for example, a DICOM (Digital Imaging and Communications in Medicine) server, and is connected to devices such as the medical image display device 10 so as to be able to send and receive data via a network N. The medical image display device 10 causes the medical image management device 20 to search for medical image data corresponding to a predetermined patient ID, examination ID, and series ID using so-called Query / Retrieve, and acquires the medical image data from the medical image management device 20.

[0013] FIG. 2 is a schematic diagram showing the configuration and functions of the medical image display device 10. As shown in FIG.

[0014] As shown in FIG. 2, the medical image display device 10 includes a processing circuitry 11, a memory circuitry 12, an input interface 13, a display 14, and a network interface 15.

[0015] The processing circuitry 11 controls the operation of the medical image display device 10 in response to input operations received from an operator via the input interface 13. The processing circuitry 11 refers to a processor such as a dedicated or general-purpose CPU (Central Processing Unit), MPU (Micro Processor Unit), or GPU (Graphics Processing Unit), as well as an ASIC and a programmable logic device. Examples of programmable logic devices include a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA).

[0016] Furthermore, the processing circuit 11 may be configured as a single circuit or as a combination of multiple independent processing circuit elements. In the latter case, the memory circuit 12 may be provided individually for each processing circuit element, or a single memory circuit 12 may store programs corresponding to the functions of multiple processing circuit elements.

[0017] The memory circuitry 12 is configured with semiconductor memory elements such as RAM (Random Access Memory) and flash memory, a hard disk, an optical disk, etc. The memory circuitry 12 may be configured with portable media such as USB (Universal Serial Bus) memory and DVD (Digital Video Disk). The memory circuitry 12 stores various processing programs (including application programs and an OS (Operating System)) used in the processing circuitry 11, data required for executing the programs, etc. The OS may also include a GUI (Graphical User Interface) that makes extensive use of graphics to display information to the operator on the display 14 and allows basic operations to be performed via the input interface 13. The memory circuitry 12 is an example of a memory unit.

[0018] The input interface 13 includes an input device operable by an operator and an input circuit that inputs signals from the input device. The input device may be a trackball, a switch, a mouse, a keyboard, a touchpad that performs input operations by touching the operation surface, a touchscreen that combines the display screen and touchpad, a non-contact input device using an optical sensor, or a voice input device. When the operator operates the input device, the input circuit generates a signal corresponding to the operation and outputs it to the processing circuit 11. The medical image display device 10 may also include a touch panel in which the input device is integrated with the display 14. The input device is not limited to devices that include physical operating components such as a mouse and a keyboard. For example, an example of the input interface 13 may include a configuration in which the input circuit receives an electrical signal corresponding to an input operation from an external input device provided separately from the medical image display device 10 and outputs the electrical signal to the processing circuit 11. The input interface 13 is an example of an input unit.

[0019] The display 14 is a display device such as a liquid crystal display panel, a plasma display panel, or an organic EL (Electro Luminescence) panel. The display 14 is connected to the processing circuit 11 and displays various information and images generated under the control of the processing circuit 11. The display 14 is an example of a display unit.

[0020] The network interface 15 is configured with connectors that comply with parallel connection specifications or serial connection specifications. The network interface 15 controls communications according to each standard and has the function of connecting to a network N (shown in FIG. 1) via a telephone line, thereby allowing the medical image display device 10 to be connected to the network. The network interface 15 is an example of a communication unit.

[0021] Similarly to the medical image display device 10, the medical image management device 20 also includes a processing circuit, a memory circuit, a database (DB), an input interface, a display, and a network interface (not shown). The processing circuit, memory circuit, input interface, display, and network interface of the medical image management device 20 have the same configurations as the processing circuit 11, memory circuit 12, input interface 13, display 14, and network interface 15 of the medical image display device 10, respectively, and therefore will not be described here. The DB of the medical image management device 20 is a memory unit that stores medical image data and shared objects. The DB stores the medical image data and shared objects under the control of the processing circuit. Furthermore, under the control of the processing circuit of the medical image management device 20, the DB provides the medical image display device 10 with specific medical image data from the stored medical image data in accordance with a request from the medical image display device 10.

[0022] Next, the functions of the medical image display device 10 will be described with reference to Figures 2 and 3. Figure 3 is a diagram showing an example of the layout of the display screen.

[0023] The processing circuitry 11 of the medical image display device 10 reads and executes a computer program stored in the memory circuitry 12 or directly incorporated in the processing circuitry 11, thereby realizing an acquisition function 111, a first display control function 112, a judgment function 113, a second display control function 114, and a decision function 115. The following description will be given taking as an example a case where the functions 111 to 115 function as software by executing a computer program, but all or part of the functions 111 to 115 may be realized by a circuit such as an ASIC.

[0024] The acquisition function 111 includes a function for acquiring interpreted image data and corresponding candidates for comparison image data from the medical image management device 20 via the network N. Specifically, when the operator inputs keywords based on the attributes of the medical image data to be acquired (patient ID, examination UID, series UID, examination area, imaging conditions, examination time, etc.) in the search field R1 of the display screen G, the medical image display system 1 searches the DB of the medical image management device 20 and acquires medical image data corresponding to the keywords as interpreted image data. In addition, the acquisition function 111 acquires medical image data corresponding to the interpreted image data as candidates for comparison image data using a specification method described below.

[0025] The first display control function 112 includes a function of displaying the interpreted image data acquired by the search performed by the acquisition function 111 in the image field R2 of the display screen G.

[0026] The determination function 113 includes a function for determining whether the position of the mouse cursor overlaps the display range of the interpreted image data arranged in the image field R2 of the display screen G of the display 14. The determination function 113 may detect the position of the mouse cursor and determine that overlap has occurred when the detected position of the mouse cursor overlaps the display range of the interpreted image data. Alternatively, the determination function 113 may detect the position of the mouse cursor and determine that overlap has occurred when the detected position of the mouse cursor overlaps the display range of the interpreted image data (e.g., a button within the display range) and a selection instruction has been given via the input interface 13 (e.g., a single click or double click of the mouse button, or selection of an icon or button).

[0027] When the determination function 113 determines that the mouse cursor is positioned over the image data, the second display control function 114 displays candidate comparison image data corresponding to the identified image data in an area of ​​the display screen that does not overlap the image data identified by the mouse cursor position but is adjacent to the identified image data (hereinafter referred to as the "image adjacent area"). Here, "adjacent" means that the candidate comparison image data on the display screen may be adjacent to the image data on all sides. Alternatively, the candidate comparison image data on the display screen may be closer to the image data than the medical image data in the thumbnail field R3 (shown in FIG. 3 ), and the candidate comparison image data may be somewhat distant from the image data. Furthermore, the candidate comparison image data may be displayed on the same layer as the image data on the display screen, or on a layer in front of the image data. For example, when the candidate comparison image data is displayed on a layer in front of the image data, the second display control function 114 can display candidate comparison image data corresponding to the image data in a pop-up menu (the first pop-up menu, described later) located in the image adjacent area. Hereinafter, an example will be described in which the second display control function 114 displays candidates for comparison image data corresponding to the interpreted image data in a pop-up menu arranged in the interpreted image adjacent area.

[0028] The decision function 115 includes a function of deciding, as the comparison image data, a candidate selected via the mouse cursor from the comparison image data candidates displayed in the first pop-up menu by the second display control function 114. In this case, the second display control function 114 displays the decided comparison image data.

[0029] Next, a method for displaying medical images in the medical image display system 1 will be described.

[0030] 4 is a flowchart showing a method for displaying medical images, in which the reference numerals "ST" followed by numbers indicate the steps of the flowchart.

[0031] When the acquisition function 111 of the medical image display device 10 acquires the interpreted image data from the medical image management device 20 via the network N, the first display control function 112 displays the acquired interpreted image data in the image field R2 of the display screen G (step ST1). Specifically, when the operator inputs keywords based on the attributes of the medical image data to be acquired (patient ID, examination UID, series UID, examination region, imaging conditions, examination time, etc.) into the search field R1 of the display screen G, the medical image display system 1 searches the DB of the medical image management device 20 and acquires the medical image data corresponding to the keywords as interpreted image data.

[0032] The acquisition function 111 acquires candidates for comparison image data corresponding to the interpreted image data displayed in step ST1 (step ST2). Examples of comparison image data corresponding to the interpreted image data will be described later in "Method for identifying candidates for comparison image data."

[0033] The determination function 113 determines whether or not the position of the mouse cursor overlaps the display range of the interpreted image data arranged in the image field R2 of the display screen G of the display 14 (step ST3). If step ST3 returns NO, that is, if it is determined that the position of the mouse cursor does not overlap the display range of the interpreted image data, the determination function 113 waits until the position of the mouse cursor overlaps the display range of the interpreted image data.

[0034] On the other hand, if step ST3 determines that the mouse cursor is positioned over the display range of the interpreted image data, the second display control function 114 displays candidates for comparison image data corresponding to the interpreted image data in a first pop-up menu placed in the interpreted image adjacent area (step ST4).

[0035] 5 and 6 are diagrams showing a method for displaying candidates for comparison image data in the medical image display device 10 according to the embodiment. Note that in Fig. 5 and Fig. 6, the layout of the display screen G is the same as the layout of the display screen G shown in Fig. 3.

[0036] 5 and 6, a first pop-up menu M1 displays a plurality of comparison image data candidates in an interpretation adjacent area, which is an area that does not overlap with a specified interpretation image data (over which the mouse cursor C is placed) among the plurality of interpretation image data, but is adjacent to the specified interpretation image data. Each of the plurality of comparison image data candidates in the first pop-up menu M1 is displayed at a position closer to the specified interpretation image data (or the mouse cursor C) than the corresponding comparison image data candidate in the thumbnail field R3. The plurality of comparison image data candidates may be displayed in a U-shape or an L-shape around the specified interpretation image data, or may be displayed in a rectangle extending above, below, left, and right of the specified interpretation image data.

[0037] Here, the determination function 113 may detect the position of the mouse cursor C on the display screen and determine that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data (see FIG. 5). Alternatively, the determination function 113 may detect the position of the mouse cursor C on the display screen and determine that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data and a selection instruction (e.g., single-click or double-click of the mouse button, or selection of an icon or button) is given via the input interface 13. The operator can easily select desired comparison image data from multiple comparison image data candidates displayed in the first pop-up menu M1. Note that the type of medical image diagnostic device used, series UID, protocol name, etc. may be displayed around each comparison image data candidate in the first pop-up menu M1.

[0038] In addition, the judgment function 113 may detect the position of the mouse cursor C on the display screen and determine that overlap has occurred when the detected position of the mouse cursor overlaps with a button F within the display range of the interpreted image data and a selection instruction (e.g., single-click or double-click of the mouse button, or selection of an icon or button) is given via the input interface 13 (see Figure 6).

[0039] It should be noted that, since there is no need to select comparison image data from the thumbnail field R3 in the medical image display device 10, the image display in the thumbnail field R3 in FIGS. 5 and 6 can be omitted.

[0040] 7 is a diagram showing a display method of candidates for comparison image data in a conventional medical image display device as a comparative example of this embodiment. In FIG. 7, the layout of the display screen G' is the same as the layout of the display screen G shown in FIG.

[0041] As shown in Fig. 7, in a conventional medical image display device, for example, multiple comparison image data candidates are displayed as thumbnails in a thumbnail field located at a predetermined position in the upper right section of the display screen. When attempting to select specific comparison image data using this display screen, the operator must use the input interface 13 to move the mouse cursor C' from the lower section where the interpretation image data are arranged to the position of the medical image data to be processed in the thumbnail field at the upper right section (indicated by the dashed arrow in Fig. 7). This requires time to move the mouse cursor C', reducing interpretation efficiency.

[0042] 4, the determination function 115 determines the candidate selected via the mouse cursor from the candidates for comparison image data displayed in the first pop-up menu M1 (FIGS. 5 and 6) by the second display control function 114 as the comparison image data, and displays the comparison image data in the image field R2 (step ST5). Note that the number of comparison image data determined and displayed in step ST5 may be one or more.

[0043] The decision function 115 determines whether or not to end the comparative interpretation (step ST6). That is, the decision function 115 determines whether or not to change the interpreted image data selected in the image field R2 of the display screen G. If the determination in step ST6 is NO, that is, if it is determined that the comparative interpretation will not end, the decision function 113 waits until the position of the mouse cursor overlaps the display range of another interpreted image data.

[0044] On the other hand, if the determination in step ST6 is NO, that is, if it is determined that the comparative interpretation is to be ended, the medical image display system 1 ends the operation of the comparative interpretation of the image data acquired in step ST1.

[0045] As described above, according to the medical image display device 10, a first pop-up menu is displayed near the position of the interpreted image data, allowing selection from candidates for comparison image data, thereby making it possible to efficiently select comparison image data corresponding to the interpreted image data.

[0046] (First Modification) The second display control function 114 can also display display layout candidates in a pop-up menu (a second pop-up menu, which will be described later) arranged in the image interpretation adjacent area.

[0047] 8 is a diagram showing a method of displaying display layout candidates in a medical image display device 10 according to a first modified example. Note that in FIG. 8, the layout of the display screen G is the same as the layout of the display screen G shown in FIG.

[0048] As shown in Fig. 8, display layout candidates are displayed in a second pop-up menu M2 near the position of the identified interpreted image data (over which the mouse cursor C is placed) from among the multiple interpreted image data. Fig. 8 shows three display layout candidates with row x column ratios of 1 x 2 (two images side by side, left and right), 2 x 1 (two images side by side, top and bottom), and 2 x 2 (four images side by side, left and right, top and bottom).

[0049] Here, the determination function 113 detects the position of the mouse cursor C on the display screen and determines that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data (e.g., a button within the display range). Alternatively, the determination function 113 may detect the position of the mouse cursor C on the display screen and determine that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data (e.g., a button within the display range) and a selection instruction (e.g., a single click or double click of the mouse button, or selection of an icon or button) is given via the input interface 13. Note that although three display layouts are displayed in FIG. 8: two images side by side horizontally, two images side by side vertically, and four images side by side horizontally and vertically, the present invention is not limited to these. The operator can easily select a desired display layout from the multiple display layout options displayed in the second pop-up menu M2.

[0050] Following the determination of the comparison image data in step ST5 of Fig. 4, the determination function 115 determines, as the display layout, a candidate selected via the mouse cursor C from the display layout candidates displayed in the second pop-up menu M2. The second display control function 114 arranges (allocates) and displays the comparison image data determined in step ST5 of Fig. 4 and the identified interpretation image data in the determined display layout (for example, two images side by side, left and right). The order in which the comparison image data and the display layout are determined does not matter.

[0051] In addition, the second display control function 114 may be configured to switch between a display screen for determining the comparison image data (shown in Figures 5 and 6) and a display screen for determining the display layout by switching tabs.

[0052] Furthermore, since it is no longer necessary to select comparison image data from the thumbnail field R3 in the medical image display device 10, the image display in the thumbnail field R3 in FIG. 8 can be omitted.

[0053] As described above, according to the first variant of the medical image display device 10, in addition to the effects of the medical image display device 10 described above, it is possible to efficiently select the display layout of the interpretation image data and the corresponding comparison image data.

[0054] (Second Modification) The medical image display device 10 may be configured to simultaneously select the comparison image data and its display layout. In this case, the second display control function 114 displays a plurality of comparison image data candidates arranged in a plurality of display layout candidates in a pop-up menu (a third pop-up menu, which will be described later) in the image interpretation adjacent area. Then, the determination function 115 determines a candidate selected via the mouse cursor from the plurality of display layout candidates displayed in the third pop-up menu as the display layout, and determines one or more comparison image data candidates arranged in the display layout as the comparison image data.

[0055] 9 is a diagram showing a method for displaying candidates for comparison image data and candidates for display layout in a medical image display device 10 according to a second modified example. Note that in FIG. 9, the layout of the display screen G is the same as the layout of the display screen G shown in FIG.

[0056] As shown in Fig. 9, the specified interpreted image data and the comparison image data candidates arranged in the display layout candidates are displayed in a third pop-up menu M3 near the position of the interpreted image data specified (over which the mouse cursor C is placed) among the multiple interpreted image data. Fig. 9 shows three display layout candidates, namely, two images side by side horizontally, two images side by side vertically, and four images side by side horizontally and vertically, with the comparison image data candidates arranged in the layout. Note that the display layout is not limited to these three, and may be any layout in which one or more interpreted image data and one or more comparison image data candidates are arranged.

[0057] In the case of display layout candidates for two images arranged side by side horizontally and two images arranged top by bottom, the identified one set of interpreted image data and one candidate for comparison image data are arranged in the display layout candidate. For example, the third pop-up menu M3 shown in FIG. 9 includes display layout candidates U1 and U2 for two images arranged side by side horizontally and display layout candidates U3 and U4 for two images arranged top by top. In the display layout candidate U1 for two images arranged side by side horizontally, the identified one set of interpreted image data is arranged on the left, and one candidate for comparison image data (first comparison image data) is arranged on the right. In the display layout candidate U2 for two images arranged side by side horizontally, the identified one set of interpreted image data is arranged on the left, and one candidate for comparison image data (second comparison image data) is arranged on the right. In the display layout candidate U3 for two images arranged top by top, the identified one set of interpreted image data is arranged on the top, and the candidate for first comparison image data is arranged on the bottom. In the display layout candidate U4 for two images arranged top by top, the identified one set of interpreted image data is arranged on the top, and the candidate for second comparison image data is arranged on the bottom.

[0058] Furthermore, in the case of a display layout of four images arranged side by side, one above the other, the specified one interpreted image data and three candidates for comparison image data are arranged in that display layout. For example, the third pop-up menu M3 shown in Fig. 9 includes candidates U5 and U6 for the display layout of four images arranged side by side, one above the other. In candidate U5 for the display layout of four images arranged side by side, one above the other, the specified one interpreted image data is arranged in the upper left, and three candidates for comparison image data (first to third comparison image data) are arranged in the other positions. In candidate U6 for the display layout of four images arranged side by side, one above the other, the specified one interpreted image data is arranged in the upper left, and three candidates for comparison image data (fourth to sixth comparison image data) are arranged in the other positions.

[0059] In the case of a display layout in which four images are arranged side by side, left and right, top and bottom, a plurality of specified (e.g., two) sets of interpreted image data and a plurality of (e.g., two) candidates for comparison image data may be arranged in the display layout. In this case, the specified plurality of interpreted image data include the interpreted image data on which the mouse cursor C is placed, as well as data for which a selection instruction has been given in advance via the input interface 13 (e.g., by single-clicking or double-clicking the mouse button, or by selecting an icon or button).

[0060] Here, the determination function 113 may detect the position of the mouse cursor C on the display screen and determine that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data (see FIG. 9). Alternatively, the determination function 113 may detect the position of the mouse cursor C on the display screen and determine that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data (for example, a button within the display range) and a selection instruction has been given via the input interface 13 (for example, a single click or double click of the mouse button, or selection of an icon or button). The operator can easily select a desired display layout and desired comparison image data at the same time from multiple display layout candidates shown in the third pop-up menu M3.

[0061] It should be noted that, since there is no need to select comparison image data from the thumbnail field R3 in the medical image display device 10, the image display in the thumbnail field R3 in FIG. 9 can be omitted.

[0062] As described above, according to the second variant of the medical image display device 10, in addition to the effects of the medical image display device 10 described above, the number of steps required for allocation is reduced, and the selection of the display layout for the interpretation image data and the corresponding comparison image data can be made more efficient.

[0063] (Third Modification) In the second modified example described above, multiple display layouts and comparison image data may be individually selectable. This case will be described as a third modified example. The second display control function 114 displays multiple display layout candidates for displaying comparison image data candidates and multiple comparison image data candidates in a pop-up menu (a fourth pop-up menu described later) in the interpretation adjacent area. The determination function 115 then determines the candidate selected via the mouse cursor from the multiple comparison image data candidates displayed in the fourth pop-up menu as the comparison image data, and also determines the candidate selected via the mouse cursor from the multiple display layout candidates displayed in the fourth pop-up menu as the display layout.

[0064] 10 and 11 are diagrams showing a method for displaying candidates for comparison image data and candidates for display layout in a medical image display device 10 according to a third modified example. Note that in Fig. 10 and Fig. 11, the layout of the display screen G is the same as the layout of the display screen G shown in Fig. 3.

[0065] As shown in FIG. 10, a fourth pop-up menu M4 displays comparison image data candidates and display layout candidates near the position of a specified (overlaid by the mouse cursor C) image data among the multiple read image data. Each of the multiple comparison image data candidates in the fourth pop-up menu M4 is displayed closer to the specified read image data (or the mouse cursor C) than the corresponding comparison image data candidate in the thumbnail field R3. The multiple comparison image data candidates may be displayed in a U-shape or L-shape around the specified read image data, or may be displayed as a rectangle extending above, below, left, right, and right of the specified read image data. In addition, in the fourth pop-up menu M4 of FIG. 10, 11 comparison image data candidates are arranged at the top, and three display layout candidates—two images side by side, two images side by side, and four images side by side, left, right, top, and bottom—are arranged at the bottom.

[0066] Here, the determination function 113 may detect the position of the mouse cursor C on the display screen, and determine that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data (e.g., a button within the display range). Alternatively, the determination function 113 may detect the position of the mouse cursor C on the display screen, and determine that overlap has occurred when the detected position of the mouse cursor C overlaps the display range of the interpreted image data (e.g., a button within the display range) and a selection instruction has been given via the input interface 13 (e.g., a single click or double click of the mouse button, or selection of an icon or button). The operator can easily select a desired display layout using the upper side of the fourth pop-up menu M4, and can easily select desired comparison image data using the lower side.

[0067] The image data and the selected comparison image data may be displayed in a display layout selected from three display layout options shown in the fourth pop-up menu M4: two images side by side horizontally, two images side by side vertically, or four images side by side horizontally and vertically (see FIG. 11). In this case, the operator can easily select the desired comparison image data and the desired display layout by moving the desired comparison image data from the plurality of comparison image data options shown in the fourth pop-up menu M4 into the desired display layout. For example, as shown in FIG. 11, the operator uses the mouse cursor C on the display screen to move (e.g., drag and drop) the desired comparison image data into the display layout of four images side by side horizontally and vertically.

[0068] It should be noted that, since there is no need to select comparison image data from the thumbnail field R3 in the medical image display device 10, the image display in the thumbnail field R3 in FIGS. 10 and 11 can be omitted.

[0069] As described above, according to the third variant of the medical image display device 10, in addition to the effects of the medical image display device 10 described above, the number of steps required for allocation is reduced, and the selection of the display layout for the interpretation image data and the corresponding comparison image data can be made more efficient.

[0070] (Fourth Modification) In the first to third modified examples described above, a method for selecting and determining a display layout has been described. There are a wide variety of display layouts, and it is difficult to display all of them as a pull-down menu. Therefore, the second display control function 114 initially displays only display layouts with high priority among multiple display layouts in a pull-down menu, and displays display layouts with low priority using the extended function of the pull-down menu as a supplement (shown in FIG. 12 ). Display layouts with low priority may be displayed using a long press / extension, click extension, or double-click of a mouse button, or by clicking the right (or left) button of a mouse or pressing a GUI such as an extended button icon on the display screen. The priority may be determined on a medical institution (e.g., hospital) basis or on an operator basis.

[0071] The second display control function 114 may determine the priority from past usage history. In this case, the second display control function 114 performs processing to determine the display layout based on the operator (or hospital). This processing may use, for example, a lookup table (LUT) that associates the operator's identification information with the display layout. Machine learning may also be used for this processing. Furthermore, deep learning using a multi-layer neural network such as a convolutional neural network (CNN) or a convolutional deep belief network (CDBN) may be used as the machine learning.

[0072] Fig. 12 is a diagram showing a method for displaying candidates for comparison image data and candidates for display layout in a medical image display device 10 according to a fourth modified example. Fig. 12 shows a modified example of Fig. 9, but can also be applied to the cases of Fig. 8, Fig. 10, and Fig. 11. In Fig. 12, the layout of the display screen G is the same as the layout of the display screen G shown in Fig. 3.

[0073] As shown in FIG. 12, a fifth pop-up menu M5 is displayed near the position of a specified one of the multiple sets of image data (over which the mouse cursor C is located). Each of the multiple comparison image data candidates in the fifth pop-up menu M5 is displayed closer to the specified one (or the mouse cursor C) than the corresponding comparison image data candidate in the thumbnail field R3. FIG. 12 also shows three display layout options: two images arranged side-by-side, two images arranged top-and-bottom, and four images arranged side-by-side and top-and-bottom. The fifth pop-up menu M5 also includes an “Expand” button. By clicking the “Expand” button in the fifth pop-up menu M5, the operator can sequentially display display layouts other than the initially displayed display layout options, allowing the operator to easily select a desired display layout from among them.

[0074] It should be noted that since it is no longer necessary to select comparison image data from the thumbnail field R3 in the medical image display device 10, the image display in the thumbnail field R3 in FIG. 12 can be omitted.

[0075] As described above, according to the fourth variant of the medical image display device 10, in addition to the effects of the medical image display device 10 described above, the number of steps required for allocation is reduced, and the selection of the display layout for the interpretation image data and the corresponding comparison image data can be made more efficient.

[0076] (Method for identifying candidate comparison image data) The acquisition function 111 searches for and acquires candidate comparison image data based on (1) the usage status of the operator (operator, medical institution, etc.), (2) the specificity of the interpretation image data, (3) the specificity of the identified medical image data (comparison image data), and (4) user settings.

[0077] (1) Usage status on the operator side The acquisition function 111 searches for and acquires candidates for comparison image data based on the usage status on the operator side. The acquisition function 111 acquires candidates for comparison image data with high priority. The priority may be determined on a medical institution (e.g., hospital) basis or on an operator basis.

[0078] The acquisition function 111 may determine the priority from past usage history. In this case, the acquisition function 111 performs processing to determine candidates for comparison image data based on the operator (or hospital). This processing may use, for example, a lookup table that associates the operator's identification information with the candidates for comparison image data. This processing may also use machine learning. Furthermore, deep learning using a multilayer neural network such as CNN or a convolutional deep belief network may also be used as machine learning. Furthermore, highly accurate output data can be obtained by adding, as input data for the learning model, the purpose of the examination, the type of medical image diagnostic device, the examination area, the study description, the series description, the protocol, and the like, which are stored as supplementary information of DICOM, to the operator's identification information.

[0079] (2) Special characteristics of image data The acquisition function 111 acquires, as candidates for comparison image data, medical image data acquired by a medical image diagnostic device of the same or similar type as the medical image diagnostic device that acquired the interpreted image data. Whether the type of medical image diagnostic device is similar may be determined by a process of determining the type of similar medical image diagnostic device based on the type of medical image diagnostic device that acquired the interpreted image data. This process may use, for example, a lookup table that associates the type of medical image diagnostic device that acquired the interpreted image data with similar types of medical image diagnostic devices. This process may also use machine learning. Furthermore, deep learning using a multilayer neural network such as a CNN or a convolutional deep belief network may be used as machine learning.

[0080] Similarly, the acquisition function 111 acquires, as candidates for comparison image data, medical image data of an examination site that is the same as or similar to the examination site of the interpreted image data, or medical image data of an examination purpose that is the same as or similar to the examination purpose of the interpreted image data. Note that similar examination sites include sites that are used synonymously with the site of the interpreted image data, sites that match in parts such as the front and back, anatomical landmarks that are similar to anatomical landmarks of the interpreted image data (e.g., "chest" is similar because it is included in "whole body"), and sites that may be metastasized from the site of the interpreted image data.

[0081] The acquisition function 111 also acquires medical image data with an imaging direction (axial, sagittal, coronal, etc.) that is the same as or similar to the imaging direction of the interpreted image data as candidates for comparison image data. Whether the imaging direction is similar or not is determined by performing a process to determine a similar imaging direction based on the imaging direction in which the interpreted image data was acquired. This process may use, for example, a lookup table that associates the imaging direction of the interpreted image data with similar imaging directions. Machine learning may also be used for this process. Deep learning using a multilayer neural network, such as a CNN or a convolutional deep belief network, may also be used as the machine learning.

[0082] Similarly, the acquisition function 111 acquires medical image data corresponding to a contrast examination and a non-contrast examination when the interpreted image data corresponds to a contrast examination, CT image data that has undergone special reconstruction processing when the interpreted image data is CT image data, and MR image data generated by a specific protocol when the interpreted image data is MR image data as candidates for comparison image data.

[0083] (3) The particularity of the identified medical image data (candidates for comparison image data) Furthermore, the acquisition function 111 acquires, as candidates for comparison image data, medical image data generated under special conditions (for example, medical image data other than that defined in the hanging protocol, medical image data that is not normally produced, or medical image data with a caution mark), medical image data equivalent to an enlarged image (based on the Series Description), key images used in the previous examination, medical image data with measurements and annotations, and medical image data to be followed up (detected from the electronic medical record), regardless of the type of interpretation image data. The acquisition function 111 can also acquire medical image data within a specified period (user setting, medical knowledge judgment (excluding post-treatment completion periods, forcibly including periods with risk)) as candidates for comparison image data.

[0084] (4) User settings The acquisition function 111 acquires medical image data of a region designated by an operator or a medical institution (including a region that is likely to be overlooked by each operator) as a candidate for comparison image data, regardless of the type of interpreted image data.

[0085] The acquisition function 111 is an example of an acquisition unit. The first display control function 112 and the second display control function 114 are an example of a display control unit. The determination function 113 is an example of a determination unit. The decision function 115 is an example of a decision unit.

[0086] According to at least one of the embodiments described above, it is possible to efficiently select comparison image data corresponding to interpreted image data.

[0087] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0088] 1 Medical image display system 10 Medical image display device 20 Medical image management equipment 11 Processing circuit 111 Acquisition Function 112 First display control function 113 Judgment function 114 Second display control function 115 Decision Function

Claims

1. a determination unit that determines whether or not the position of a mouse cursor overlaps a display range of medical image data to be interpreted that is arranged on a display screen of the display unit; a display control unit that, when it is determined that the position of the mouse cursor overlaps, displays candidates of medical image data to be compared that correspond to the specified medical image data to be interpreted in an interpretation adjacent area that is an area that does not overlap with the medical image data to be interpreted that is specified by the position of the mouse cursor and is an area that is adjacent to the specified medical image data to be interpreted; A medical image display device having the same.

2. when it is determined that the mouse cursor is positioned overlapping, the display control unit displays candidates for medical image data to be compared corresponding to the identified medical image data to be interpreted in a pop-up menu arranged in the interpretation adjacent area. The medical image display device according to claim 1 .

3. a determining unit that determines a candidate selected via the mouse cursor from the candidates of medical image data to be compared displayed in the pop-up menu as the medical image data to be compared; the display control unit displays the medical image data to be compared. The medical image display device according to claim 2 .

4. the display control unit displays, in the pop-up menu, the medical image data to be interpreted and the medical image data candidates to be compared, arranged in a display layout candidate; a determination unit that determines a candidate selected via the mouse cursor from the candidate display layouts displayed in the pop-up menu as a display layout, and determines a candidate of medical image data to be compared arranged in the display layout as medical image data to be compared; The medical image display device according to claim 2 .

5. the display control unit displays, in the pop-up menu, display layout candidates and medical image data candidates to be compared; a determination unit that determines a candidate selected via the mouse cursor from candidates for medical image data to be compared displayed in the pop-up menu as medical image data to be compared, and also determines a candidate selected via the mouse cursor from candidates for display layouts displayed in the pop-up menu as a display layout; The medical image display device according to claim 2 .

6. when it is determined that the mouse cursor is positioned overlapping, the display control unit displays a candidate display layout in the image interpretation adjacent area. The medical image display device according to claim 1 .

7. when it is determined that the mouse cursor overlaps the image, the display control unit further displays the display layout candidates in a pop-up menu arranged in the image interpretation adjacent area. The medical image display device according to claim 6 .

8. The display control unit When it is determined that the mouse cursor is positioned overlapping, a first pop-up menu is displayed in the image interpretation adjacent area, displaying candidates for medical image data to be compared that correspond to the identified medical image data to be interpreted; when it is determined that the mouse cursor overlaps the image, a second pop-up menu is displayed in the image adjacent area, displaying further display layout candidates. The medical image display device according to claim 1 .

9. a determination unit that determines a candidate selected via the mouse cursor from the candidates of the display layout displayed in the second pop-up menu as the display layout; the display control unit arranges the medical image data to be interpreted and the medical image data to be compared in the display layout and displays them in the first pop-up menu. The medical image display device according to claim 8 .

10. the display control unit initially displays only display layout candidates having a high priority among the display layout candidates in a pull-down menu, and displays display layout candidates having a low priority among the display layout candidates in a supplementary pull-down menu by an extended function. The medical image display device according to any one of claims 4 to 9.

11. A medical image display system including a medical image display device and a medical image management device connected to each other via a network so as to be able to communicate with each other, The medical image display device includes: an acquisition unit that acquires medical image data from the medical image management device; a determination unit that determines whether or not the position of a mouse cursor overlaps a display range of medical image data to be interpreted that is arranged on a display screen of the display unit; a display control unit that, when it is determined that the position of the mouse cursor overlaps, displays candidates of medical image data to be compared that correspond to the specified medical image data to be interpreted in an interpretation adjacent area that is an area that does not overlap with the medical image data to be interpreted that is specified by the position of the mouse cursor and is an area that is adjacent to the specified medical image data to be interpreted; A medical image display system having:

Images