Display device and display device control method

Abstract

Provided are: a display device which can improve the image reading efficiency of a user with respect to an ultrasonic image; and a control method for said display device. This display device (1) comprises: one or a plurality of adjacent monitors (17) forming one screen; a memory (11) which stores a plurality of display layouts having a plurality of display areas for displaying a plurality of ultrasonic images on the one screen; a schematic diagram selection unit (12) which selects, on the basis of designation by a user, one among a plurality of schematic diagrams in which the breasts of a subject are divided into a plurality of regions; a display layout setting unit (13) which sets, on the one screen, the plurality of the display areas of the display layout corresponding to the selected schematic diagram; a photographing position reading unit (14) which reads a photographing position from the ultrasonic image; and an image arrangement unit (15) for arranging the ultrasonic image in the set display areas on the basis of the read photographing position.

Description

[Technical Field]

[0001] The present invention relates to a display device used for interpreting ultrasound images and a method for controlling the display device. [Background technology]

[0002] Conventionally, ultrasound images showing cross sections of a subject are captured using an ultrasound diagnostic device, and the subject is diagnosed based on the captured ultrasound images. During such a diagnosis, a user such as a doctor may interpret multiple frames of ultrasound images displayed on a display device. In order to improve the user's interpretation efficiency, a technique for classifying and sorting multiple frames of ultrasound images has been developed, as disclosed in Patent Document 1, for example. In Patent Document 1, when so-called B-mode (Brightness mode) images and color Doppler images of a subject's breast are captured as ultrasound images, the multiple frames of ultrasound images are classified into B-mode images and color Doppler images, and the ultrasound images are sorted and displayed based on the classification. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-100661 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when a subject's breast is examined, ultrasound images are usually taken at multiple shooting positions. Therefore, even when the technology disclosed in Patent Document 1 is used, the user must make an effort to determine which of the multiple ultrasound images obtained by the examination corresponds to which shooting position, resulting in a problem of low user interpretation efficiency.

[0005] The present invention has been made to solve such conventional problems, and aims to provide a display device and a control method for the display device that can improve the efficiency with which a user interprets ultrasound images. [Means for solving the problem]

[0006] In order to achieve the above object, the display device of the present invention is characterized by comprising one or a plurality of adjacent monitors forming one screen, a memory for storing a plurality of display layouts having a plurality of display areas for displaying a plurality of ultrasound images on one screen, a schematic diagram selection unit for selecting one of a plurality of schematic diagrams in which the subject's breast is divided into a plurality of areas based on a user's specification, a display layout setting unit for setting, on one screen, a plurality of display areas of the display layout corresponding to the schematic diagram selected by the schematic diagram selection unit, a shooting position reading unit for reading the shooting position of the ultrasound image from the ultrasound image, and an image placement unit for placing the ultrasound image in the display area set by the display layout setting unit based on the shooting position read by the shooting position reading unit.

[0007] The display layout setting section can set, on one screen, a plurality of display areas arranged at positions corresponding to a plurality of areas in the schematic diagram selected by the schematic diagram selecting section. Furthermore, the display layout setting unit can change a plurality of display areas that have already been set on one screen based on a user instruction.

[0008] The display device includes a finding determination unit that determines whether or not a finding is present in an ultrasound image, and the display layout setting unit can set multiple display areas with different display layouts on one screen when the finding determination unit determines that a finding is present and when the finding is absent.

[0009] In addition, based on user instructions, the display layout setting unit can set multiple display areas on one screen to display ultrasound images taken in the latest examination performed on the same subject side by side with ultrasound images taken in past examinations. In addition, based on user instructions, the display layout setting unit can also set multiple display areas on a single screen to display ultrasound images taken during an examination performed on the same subject and examination images obtained through an examination other than an ultrasound examination side by side.

[0010] Furthermore, the display layout setting unit sets, from among the plurality of display areas corresponding to both the left and right breasts of the subject, the plurality of display areas corresponding to one of the breasts based on the shooting positions read by the shooting position reading unit or instructions from the user, and can set the plurality of display areas corresponding to the other breast by left-right reversing the arrangement of the shooting positions corresponding to the plurality of set display areas. In addition, the display layout setting unit can set multiple display areas on one screen based on user instructions to display side-by-side B-mode images and color images taken during an ultrasound examination of the same subject.

[0011] The imaging position reading unit can read the imaging position of the ultrasound image by analyzing a schematic image that is displayed superimposed on the ultrasound image and indicates the position of the ultrasound probe relative to the breast during imaging. The imaging position reading unit can also read the imaging position of the ultrasound image based on the position of the ultrasound probe written in a tag attached to the ultrasound image.

[0012] The control method for a display device according to the present invention is characterized in that a plurality of display layouts having a plurality of display areas for displaying a plurality of ultrasound images on a single screen formed by one or a plurality of adjacent monitors are stored in a memory, one of a plurality of schematic diagrams in which the subject's breast is divided into a plurality of areas is selected based on a user's instruction, the plurality of display areas of the display layout corresponding to the selected schematic diagram are set on the single screen, the shooting position of the ultrasound image is read from the ultrasound image, and the ultrasound image is arranged in the set display area based on the read shooting position.

[0013] In the method for controlling a display device, a plurality of display areas can be set on one screen, the display areas being arranged at positions corresponding to a plurality of areas in a schematic diagram selected based on a user's instruction. Furthermore, in the method for controlling the display device, it is possible to change a plurality of display areas already set on one screen based on an instruction from the user.

[0014] In addition, in the control method for a display device, it is possible to determine whether or not there are findings in an ultrasound image, and to set multiple display areas with different display layouts on one screen when it is determined that there are findings and when it is determined that there are no findings.

[0015] In addition, in the control method for the display device, based on a user's instruction, multiple display areas can be set on one screen to display ultrasound images taken in the latest examination performed on the same subject and ultrasound images taken in past examinations side by side. In addition, in the control method for the display device, based on the user's instructions, multiple display areas can be set on one screen to display ultrasound images taken in an examination performed on the same subject and examination images obtained by an examination other than an ultrasound examination side by side.

[0016] Furthermore, in the control method for a display device, of the plurality of display areas corresponding to both the left and right breasts of a subject, the plurality of display areas corresponding to one of the breasts can be set based on the read shooting positions or user instructions, and the arrangement of the shooting positions corresponding to the plurality of set display areas can be reversed left and right, thereby setting the plurality of display areas corresponding to the other breast. In addition, in the control method for the display device, multiple display areas can be set on one screen based on user instructions to display side by side B-mode images and color images taken in an ultrasound examination performed on the same subject.

[0017] Furthermore, in the method for controlling the display device, the imaging position of the ultrasound image can be read by analyzing a schematic image that is displayed superimposed on the ultrasound image and indicates the position of the ultrasound probe relative to the breast during imaging. In addition, in the method for controlling the display device, the photographing position of the ultrasound image can be read based on the position of the ultrasound probe written in a tag attached to the ultrasound image. [Effects of the Invention]

[0018] According to the present invention, the display device comprises one or a plurality of adjacent monitors forming one screen, a memory for storing a plurality of display layouts having a plurality of display areas for displaying a plurality of ultrasound images on one screen, a schematic diagram selection unit for selecting one of a plurality of schematic diagrams in which the subject's breast is divided into a plurality of areas based on a user's specification, a display layout setting unit for setting, on one screen, a plurality of display areas of the display layout corresponding to the schematic diagram selected by the schematic diagram selection unit, a shooting position reading unit for reading the shooting position of the ultrasound image from the ultrasound image, and an image placement unit for placing the ultrasound image in the display area set by the display layout setting unit based on the shooting position read by the shooting position reading unit, thereby improving the user's efficiency in interpreting ultrasound images. [Brief explanation of the drawings]

[0019] [Figure 1]1 is a block diagram showing a configuration of a display device according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a diagram showing an example of a display layout in the first embodiment of the present invention. [Figure 3] FIG. 2 is a diagram showing an example of an ultrasound image displayed on a monitor in the first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing an example in which ultrasound images are arranged in a display area of ​​a display layout in the first embodiment of the present invention. [Figure 5] 5 is a flowchart showing the operation of the display device according to the first embodiment of the present invention. [Figure 6] FIG. 10 is a diagram showing another example of a display layout in the first embodiment of the present invention. [Figure 7] FIG. 3 is a diagram showing an example of a display layout set by a user in the first embodiment of the present invention. [Figure 8] FIG. 10 is a diagram showing another example of a display layout set by a user in the first embodiment of the present invention. [Figure 9] FIG. 2 is a diagram showing an example of a display layout in which an ultrasound image taken in the latest examination and an ultrasound image taken in a past examination are displayed together in the first embodiment of the present invention. [Figure 10] FIG. 2 is a diagram showing an example of a display layout in which a mammogram and an ultrasound image are displayed together in the first embodiment of the present invention. [Figure 11] FIG. 10 is a diagram showing a state in which only a display area corresponding to a breast on the right side of a display layout is set in accordance with the first embodiment of the present invention. [Figure 12] FIG. 10 is a block diagram showing a configuration of a display device according to a second embodiment of the present invention. [Figure 13] FIG. 10 is a diagram showing an example of a display layout when it is determined that there is a finding in the second embodiment of the present invention. [Figure 14] FIG. 10 is a diagram showing another example of a display layout when it is determined that there is a finding in the second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0020] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The following description of the components will be given based on a representative embodiment of the present invention, but the present invention is not limited to such an embodiment. In this specification, a numerical range expressed using "to" means a range that includes the numerical values ​​before and after "to" as the lower and upper limits. In this specification, the terms "same" and "identical" include a margin of error generally accepted in the technical field.

[0021] Embodiment 1 1 shows the configuration of a display device 1 according to a first embodiment of the present invention. The display device 1 includes a memory 11 and a schematic diagram selection unit 12, and a display layout setting unit 13 is connected to the memory 11 and the schematic diagram selection unit 12. The display device 1 also includes an external communication circuit 10 connected to an external device (not shown), and a shooting position reading unit 14 is connected to the external communication circuit 10. An image arrangement unit 15 is also connected to the display layout setting unit 13 and the shooting position reading unit 14. A display control unit 16 and a monitor 17 are also connected to the image arrangement unit 15, in turn. In addition, a device control unit 18 is connected to the external communication circuit 10, memory 11, schematic diagram selection unit 12, display layout setting unit 13, shooting position reading unit 14, image placement unit 15, and display control unit 16. In addition, an input device 19 is connected to the device control unit 18.

[0022] The schematic diagram selection unit 12, the display layout setting unit 13, the photographing position reading unit 14, the image arrangement unit 15, the display control unit 16, and the device control unit 18 constitute a processor 20 for the display device 1.

[0023] The display device 1 receives ultrasound images from an external ultrasound diagnostic device (not shown) or a server device (not shown), and is used by a user to interpret the received ultrasound images.

[0024] The memory 11 stores a plurality of display layouts each having a plurality of display areas for displaying a plurality of ultrasound images on one screen of the monitor 17. 2, the display layout L1 has eight display areas A1 to A8 for displaying ultrasound images. Of the eight display areas A1 to A8, the four display areas A1, A2, A5, and A6 located on the left side correspond to four regions obtained by dividing the right breast of a subject, as viewed from the front, into four parts, centered around the nipple. More specifically, display area A1 corresponds to the upper and outer region around the nipple, known as the UOQ (Upper Outer Quadrant). Display area A2 corresponds to the upper and inner region around the nipple, known as the UIQ (Upper Inner Quadrant). Display area A5 corresponds to the lower and outer region around the nipple, known as the LOQ (Lower Outer Quadrant). Display area A6 corresponds to the lower and inner region around the nipple, known as the LIQ (Lower Inner Quadrant).

[0025] Of the eight display areas A1 to A8, the four display areas A3, A4, A7, and A8 located on the right side correspond to the areas obtained by dividing the left breast of the subject into four parts centered around the nipple when viewed from the front. More specifically, display area A3 corresponds to the UIQ, display area A4 corresponds to the UOQ, display area A7 corresponds to the LIQ, and display area A8 corresponds to the LOQ.

[0026] Here, when examining a subject's breasts, several schematic diagrams are known that divide the subject's breasts into several regions in order to clearly indicate the imaging positions of the breasts. For example, there are a schematic diagram that divides each of the subject's left and right breasts into four regions, UOQ, UIQ, LOQ, and LIQ, each centered on the nipple; a schematic diagram that divides the subject's left and right breasts into a central region where the nipple is located and regions corresponding to the 1 o'clock to 12 o'clock directions around the nipple, when viewed from the front, and a schematic diagram that divides the subject's left and right breasts into concentric circles centered on the nipple when viewed from the front, and into several contour lines with the nipple as the apex when viewed from the side.

[0027] The memory 11 stores a plurality of display layouts corresponding to a plurality of schematic diagrams of breasts, i.e., a plurality of display layouts having a plurality of display areas corresponding to the regions of the breasts divided in the plurality of schematic diagrams of the breasts.

[0028] As the memory 11, for example, a recording medium such as a flash memory, an HDD (Hard Disc Drive), an SSD (Solid State Drive), an FD (Flexible Disc), an MO disk (Magneto-Optical disc), an MT (Magnetic Tape), a RAM (Random Access Memory), a CD (Compact Disc), a DVD (Digital Versatile Disc), an SD card (Secure Digital card), or a USB memory (Universal Serial Bus memory) can be used.

[0029] The schematic diagram selection unit 12 selects one of a plurality of types of schematic diagrams of the subject's breast based on a user's specification made via the input device 19. Information on the selected schematic diagram is sent to the display layout setting unit 13.

[0030] The display layout setting unit 13 sets, from among the plurality of display layouts stored in the memory 11, a plurality of display areas of a display layout corresponding to the schematic diagram selected by the schematic diagram selecting unit 12 as a display layout when displaying an ultrasound image on one screen of the monitor 17. Information on the plurality of display areas set by the display layout setting unit 13 is sent to the image arrangement unit 15.

[0031] The external communication circuit 10 communicates with external devices such as an external ultrasound diagnostic device, a storage device, or a server device (not shown) and acquires ultrasound images from the external devices under the control of the device control unit 18. The external communication circuit 10 can perform so-called wired communication or wireless communication with the external devices (not shown).

[0032] The imaging position reading unit 14 reads the imaging position of the breast in the ultrasound image from the ultrasound image acquired by the external communication circuit 10. The imaging position reading unit 14 acquires, for example, an ultrasound image U as shown in Fig. 3. A so-called schematic image S is superimposed on the ultrasound image U to indicate the imaging position in the subject's breast, and a probe mark PM indicating the position of the ultrasound probe when the ultrasound image U was acquired is placed on the schematic image S. The schematic image S in Fig. 3 indicates the imaging position of the right breast of the subject because the protrusion P1 representing the subject's armpit is placed on the left side of the circular shape.

[0033] The shooting position reading unit 14 can read the shooting position of the ultrasound image U, for example, by performing image analysis on the schematic image S on which the probe mark PM is placed and recognizing where the probe mark PM is placed on the schematic image S. In addition, if information regarding the shooting position is stored in the DICOM tag of the ultrasound image U, the shooting position reading unit 14 can also read the shooting position of the ultrasound image U by reading the information stored in the DICOM tag.

[0034] The image placement unit 15 automatically places ultrasound images in multiple display areas set by the display layout setting unit 13 based on the shooting positions read by the shooting position reading unit 14, and displays the ultrasound images placed in the multiple display areas on the monitor 17.

[0035] For example, when the display layout setting unit 13 sets eight display areas A1 to A8 in the display layout L1 shown in Fig. 2, ultrasound images captured at imaging positions corresponding to the eight display areas A1 to A8 are arranged as shown in Fig. 4. That is, an ultrasound image captured at the UOQ imaging position of the right breast is arranged in display area A1, an ultrasound image captured at the UIQ imaging position of the right breast is arranged in display area A2, an ultrasound image captured at the LOQ imaging position of the right breast is arranged in display area A5, and an ultrasound image captured at the LIQ imaging position of the right breast is arranged in display area A6. In addition, an ultrasound image taken at the UIQ imaging position of the left breast is placed in display area A3, an ultrasound image taken at the UOQ imaging position of the left breast is placed in display area A4, an ultrasound image taken at the LIQ imaging position of the left breast is placed in display area A7, and an ultrasound image taken at the LOQ imaging position of the left breast is placed in display area A8.

[0036] The device control unit 18 controls each part of the display device 1 according to a pre-recorded program or the like. The display control unit 16 performs predetermined processing on the ultrasound image and the like under the control of the device control unit 18 and displays the image on the monitor 17 .

[0037] The monitor 17 performs various displays under the control of the display control unit 16. The monitor 17 includes a display device such as an LCD (Liquid Crystal Display) or an organic EL display (Organic Electroluminescence Display).

[0038] The input device 19 is used by the user to perform input operations and is configured by devices such as a keyboard, a mouse, a trackball, a touchpad, and a touch panel, which allow the user to perform input operations.

[0039] The processor 20 having the schematic diagram selection unit 12, display layout setting unit 13, shooting position reading unit 14, image placement unit 15, display control unit 16 and device control unit 18 is composed of a CPU (Central Processing Unit) and a control program for causing the CPU to perform various processes, but may also be composed using an FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), GPU (Graphics Processing Unit) or other ICs (Integrated Circuits), or a combination of these.

[0040] In addition, the schematic diagram selection unit 12, display layout setting unit 13, shooting position reading unit 14, image placement unit 15, display control unit 16 and device control unit 18 of the processor 20 can also be partially or entirely integrated into a single CPU or the like.

[0041] Next, the operation of the display device 1 according to the first embodiment of the present invention will be described with reference to the flowchart shown in FIG.

[0042] In step S1, when the user designates one of a plurality of types of schematic diagrams representing the subject's breast via the input device 19, the schematic diagram selection unit 12 selects the schematic diagram designated by the user. For example, although not shown, a list of a plurality of types of schematic diagrams is displayed on the monitor 17, and the user can designate one of the plurality of types of schematic diagrams in the list via the input device 19. Information on the schematic diagram selected in this manner is sent to the display layout setting unit 13.

[0043] Next, in step S2, the display layout setting unit 13 sets, on one screen of the monitor 17, a plurality of display areas of a display layout corresponding to the type of schematic diagram selected in step S1, from among a plurality of display layouts stored in the memory 11. For example, if a type of schematic diagram in which the left and right breasts of the subject are divided into four parts centered on the nipples is selected in step S1, the display layout setting unit 13 can set, on one screen of the monitor 17, eight display areas A1 to A8 of a display layout L1 as shown in FIG.

[0044] The display layout L1 has four display areas A1, A2, A5 and A6 corresponding to the four imaging positions of the subject's right breast, UOQ, UIQ, LOQ and LIQ, and four display areas A3, A4, A7 and A8 corresponding to the four imaging positions of the subject's left breast, UOQ, UIQ, LOQ and LIQ.

[0045] In this way, the display layout setting unit 13 sets multiple display areas of the display layout corresponding to schematic diagrams of the breast on one screen of the monitor 17, so that when ultrasound images are displayed in the multiple set display areas, the user can intuitively and easily understand which ultrasound image corresponds to the shooting position.

[0046] In step S3, the photographing position reader 14 acquires an ultrasound image U as shown in FIG. 3 from an external ultrasound diagnostic device (not shown) or an external server device (not shown) via the external communication circuit 10.

[0047] Subsequently, in step S4, the photographing position reading unit 14 reads the photographing position of the ultrasound image U from the ultrasound image U acquired in step S3. The photographing position reading unit 14 can read the photographing position of the ultrasound image U by, for example, performing image analysis on the schematic image S on which the probe mark PM is arranged and recognizing the position of the probe mark PM on the schematic image S. Furthermore, if information related to the photographing position is stored in the DICOM tag of the ultrasound image U, the photographing position reading unit 14 can also read the photographing position of the ultrasound image U by reading the information stored in the DICOM tag.

[0048] In step S5, based on the display layout set in step S2 and the imaging positions of the ultrasound images read in step S4, the image arrangement unit 15 arranges the ultrasound images in display areas corresponding to the imaging positions, as shown in Fig. 4. In the example of Fig. 4, the ultrasound images taken at the corresponding imaging positions are arranged in eight display areas A1 to A8 of the display layout L1 shown in Fig. 2, respectively.

[0049] In this way, ultrasound images of the corresponding shooting positions are automatically arranged in the multiple display areas A1 to A8 of the set display layout L1, thereby saving the user the trouble of arranging the ultrasound images and allowing the user to interpret the ultrasound images efficiently.

[0050] Finally, in step S6, the image layout unit 15 causes the monitor 17 to display the ultrasound images that were laid out in the eight display areas A1 to A8 of the display layout L1 in step S5. This completes the operation of the display device 1 according to the flowchart of FIG.

[0051] As described above, according to the display device 1 of embodiment 1 of the present invention, a display layout corresponding to a schematic diagram of a breast specified by a user is automatically set, the shooting position is read from the ultrasound image, and the ultrasound image is automatically arranged in the display layout based on the shooting position and displayed on the monitor 17. This allows the user to intuitively understand where the ultrasound image corresponding to which shooting position is arranged, thereby improving the efficiency of interpretation of ultrasound images. Furthermore, since ultrasound images at shooting positions corresponding to multiple display areas of the display layout are automatically arranged, the user can avoid the trouble of arranging the ultrasound images according to the display layout, which also improves interpretation efficiency.

[0052] While the display layout L1 shown in Fig. 2 has been described, an example of a display layout stored in memory 11 is display layout L2 shown in Fig. 6, which corresponds to a schematic diagram in which the subject's left and right breasts are divided into a central region where the nipple is located and regions corresponding to the 1:00 to 12:00 positions on a clock, with the nipple at the center. Display layout L2 has nine display regions A11 to A19. Display region A11 corresponds to 10 or 11:00 on a clock, display region A12 corresponds to 12:00 on a clock, display region A13 corresponds to 1 or 2:00 on a clock, display region A14 corresponds to 9:00 on a clock, display region A15 corresponds to the central region where the nipple is located, display region A16 corresponds to 3:00 on a clock, display region A17 corresponds to 7 or 8:00 on a clock, display region A18 corresponds to 6:00 on a clock, and display region A19 corresponds to 4 or 5:00 on a clock.

[0053] In addition, although not shown, the memory 11 stores a plurality of display layouts corresponding to schematic diagrams in which the left and right breasts of the subject are divided into concentric circles with the nipple at the center when viewed from the front, and divided into a plurality of contour lines with the nipple at the top when viewed from the side, etc. Therefore, a display layout can be set according to the user's purpose or preference.

[0054] Furthermore, the display layout setting unit 13 can change multiple consular areas already set on one screen of the monitor 17 based on an input operation by the user via the input device 19. In this case, the display layout setting unit 13 can set, for example, the number of display areas included in the display layout, the arrangement positions of the display areas corresponding to each imaging position, and the magnification of the ultrasound image to be arranged within the display area, based on a user specification. For example, when a schematic diagram dividing the subject's left and right breasts into four is selected in the schematic diagram selection unit 12 and the user specifies the number of display areas in the display layout to be four, the display layout setting unit 13 can set a display layout L3 having four display areas A21 to A24, as shown in FIG. 7. In the display layout L3, the display area A21 corresponds to the imaging position of the UOQ of the right breast, the display area A22 corresponds to the imaging position of the UOQ of the left breast, the display area A23 corresponds to the imaging position of the LOQ of the right breast, and the display area A24 corresponds to the imaging position of the LOQ of the left breast.

[0055] 8 on one screen of the monitor 17. Display area A31 corresponds to the imaging position of the UIQ of the right breast, display area A32 corresponds to the imaging position of the UIQ of the left breast, display area A33 corresponds to the imaging position of the LIQ of the right breast, and display area A34 corresponds to the imaging position of the LIQ of the left breast.

[0056] Furthermore, the display layout setting unit 13 can also set, for example, the display areas A21 to A24 of the display layout L3 and the display areas A31 to A34 of the display layout L4 on one screen of the monitor 17. In this case, for example, after the ultrasound images arranged in the display areas A21 to A24 of the display layout L3 are displayed on the monitor 17, the ultrasound images arranged in the display areas A31 to A34 of the display layout L4 can be displayed on the monitor 17 in accordance with an instruction from the user via the input device 19. In this case, the user can sequentially interpret the ultrasound images arranged in the display areas A21 to A24 of the display layout L3 and the ultrasound images displayed in the display areas A31 to A34 of the display layout L4 to make a diagnosis of the subject.

[0057] In addition, the display layout setting unit 13 can also set eight display areas A41 to A48 of a display layout L5 on one screen of the monitor 17, for example, as shown in Figure 9, for displaying ultrasound images taken in the latest examination of the subject and ultrasound images taken in past examinations of the same subject. Display area A41 corresponds to the imaging position of the UOQ of the right breast taken in a previous examination, display area A42 corresponds to the imaging position of the UOQ of the right breast taken in the latest examination, display area A43 corresponds to the imaging position of the UIQ of the right breast taken in a previous examination, display area A44 corresponds to the imaging position of the UIQ of the right breast taken in the latest examination, display area A45 corresponds to the imaging position of the LOQ of the right breast taken in a previous examination, display area A46 corresponds to the imaging position of the LOQ of the right breast taken in the latest examination, display area A47 corresponds to the imaging position of the LIQ of the right breast taken in a previous examination, and display area A48 corresponds to the imaging position of the LIQ of the right breast taken in the latest examination.

[0058] The display layout setting unit 13 can set, based on the user's input operation via the input device 19, the past examination date and time when the ultrasound images to be placed in the display layout L5 were taken, the taking position of the ultrasound images to be displayed in the display areas A41 to A49 of the display layout L5, etc.

[0059] In this way, by setting up multiple display areas on one screen of monitor 17 for displaying ultrasound images taken in the latest examination and ultrasound images taken in past examinations of the same subject, the user can easily compare the latest examination results of the subject with the past examination results, thereby improving the efficiency of interpreting ultrasound images.

[0060] 10, the display layout setting unit 13 can set six display areas A51 to A56 of a display layout L6 for displaying ultrasound images taken by ultrasound examination and examination images taken by examinations other than ultrasound examination on one screen of the monitor 17. The display areas A51 to A56 in FIG. 10 are for displaying so-called mammography images and ultrasound images side by side on one screen.

[0061] Display area A51 corresponds to a mammography image of the right breast taken in the so-called MLO (Medio-lateral-Oblique) imaging position, display area A52 corresponds to a mammography image of the right breast taken in the so-called CC (Cranio-Caudal) imaging position, display area A53 corresponds to an ultrasound image of the right breast taken in the UOQ imaging position, display area A54 corresponds to an ultrasound image of the right breast taken in the UIQ imaging position, display area A55 corresponds to an ultrasound image of the right breast taken in the LOQ imaging position, and display area A56 corresponds to an ultrasound image of the right breast taken in the LIQ imaging position.

[0062] The display layout setting unit 13 can set a display layout for displaying so-called MRI (Magnetic Resonance Imaging) images or so-called CT (Computed Tomography) images instead of mammography images. The display layout setting unit 13 can also set multiple display areas on one screen of the monitor 17 for displaying multiple types of examination images taken by multiple types of examinations other than ultrasound examinations together with ultrasound images.

[0063] In this way, by setting up multiple display areas on one screen of monitor 17 for displaying ultrasound images taken during ultrasound examination of the same subject and examination images taken during examinations other than ultrasound examination, the user can easily compare the ultrasound images and examination images, thereby improving the efficiency of interpreting ultrasound images.

[0064] Furthermore, as shown in FIG. 11, for example, the display layout setting unit 13 sets a plurality of display areas corresponding to one of the subject's left and right breasts based on the shooting positions read by the shooting position reading unit 14 or a user instruction, and can set a plurality of display areas corresponding to the other breast by horizontally reversing the arrangement of the shooting positions corresponding to the set plurality of display areas.

[0065] 11, corresponding imaging positions are set in four display areas A61, A62, A65, and A66 located on the left side of the eight display areas A61 to A68. Display area A61 corresponds to the imaging position for UOQ of the right breast, display area A62 corresponds to the imaging position for UIQ of the right breast, display area A65 corresponds to the imaging position for LOQ of the right breast, and display area A66 corresponds to the imaging position for LIQ of the right breast.

[0066] At this time, the display layout setting unit 13 sets the imaging position of the UOQ of the left breast in the display area A64 arranged in a position symmetrical to the display area A61 with respect to the center line C, sets the imaging position of the UIQ of the left breast in the display area A63 arranged in a position symmetrical to the display area A62 with respect to the center line C, sets the imaging position of the LOQ of the left breast in the display area A68 arranged in a position symmetrical to the display area A65 with respect to the center line C, and sets the imaging position of the LIQ of the left breast in the display area A67 arranged in a position symmetrical to the display area A66 with respect to the center line C. In this way, the display layout setting unit 13 can set the eight display areas A1 to A8 of the display layout L1 shown in FIG. 2 on one screen of the monitor 17.

[0067] By setting the display layout in this manner, the user's input operations can be simplified, particularly when the display layout is set based on the user's input operations via the input device 19, allowing the user to perform interpretation more efficiently.

[0068] Furthermore, in an ultrasound examination of a subject, a so-called B-mode image and a color image such as a so-called color Doppler image may be captured as ultrasound images. In this case, the display layout setting unit 13 can set, for example, multiple display areas for displaying the B-mode image and the color image on one screen of the monitor 17. This allows the user to easily compare the B-mode image and the color image captured at the same imaging position, thereby improving the efficiency of interpretation of ultrasound images.

[0069] Furthermore, for example, among the eight display areas A1 to A8 of the display layout L1 as shown in FIG. 2, there may be cases where ultrasound images corresponding to some of the display areas have not been captured. In this case, since there are display areas in which ultrasound images are not arranged by the image arrangement unit 15, such display areas may be displayed as blank spaces when the ultrasound images are displayed on the monitor 17, for example. Even in this case, the user can intuitively grasp which ultrasound images displayed in the eight display areas A1 to A8 of the display layout L1 are ultrasound images of which imaging positions, thereby improving image interpretation efficiency. Furthermore, the user can intuitively grasp which positions of the subject's breast have been imaged and which positions have not been imaged.

[0070] Furthermore, although not shown, the display device 1 can also include multiple monitors arranged adjacent to each other instead of the single monitor 17. In this case, one screen is formed by the multiple monitors adjacent to each other, and the display layout setting unit 13 sets multiple display areas of the display layout corresponding to the schematic diagram selected by the schematic diagram selecting unit 12 on the single screen formed by the multiple monitors adjacent to each other. This allows the user to check multiple ultrasound images displayed on a larger single screen, further improving the efficiency of image interpretation.

[0071] 5, the schematic diagram selection unit 12 selects a schematic diagram designated by the user in step S1, but it can also continue to select a schematic diagram selected in a previous examination even if a new schematic diagram is not selected by the user. This saves the user the trouble of designating a schematic diagram.

[0072] Embodiment 2 In the first embodiment, multiple display areas are set in the display layout corresponding to the type of breast schematic diagram specified by the user, but multiple display areas can also be set taking into account the presence or absence of findings in the examined area of ​​the subject. Here, findings refer to areas in the subject's breast where abnormalities such as tumors are suspected.

[0073] FIG. 12 shows the configuration of a display device 1A according to the second embodiment. A display device 1A according to the second embodiment is configured by adding a finding determination unit 21 to the display device 1 according to the first embodiment shown in Fig. 1, providing a device control unit 18A instead of the device control unit 18, and providing a processor 20A including the finding determination unit 21 instead of the processor 20. The finding determination unit 21 is connected to the display layout setting unit 13 and the device control unit 18A.

[0074] The finding determination unit 21 acquires ultrasound images from an external ultrasound diagnostic device (not shown) or an external server device (not shown) via the external communication circuit 10, and determines whether or not there are any findings in the acquired ultrasound images.

[0075] The finding determination unit 21 can determine the presence or absence of a finding by, for example, performing image analysis on the ultrasound image and performing processing to recognize a finding included in the ultrasound image. The finding determination unit 21 can determine that a finding is present when a finding is recognized in the ultrasound image, and can determine that a finding is absent when a finding cannot be recognized in the ultrasound image.

[0076] The finding determination unit 21 can automatically recognize findings in ultrasound images using, for example, a so-called CAD (Computer-Aided Diagnosis) system. Also, the finding determination unit 21 can automatically recognize findings in ultrasound images using, for example, a method such as so-called machine learning.

[0077] In addition, when so-called annotations and measurement lines used to measure the size of the findings are added to the locations corresponding to the findings in the ultrasound image, the finding determination unit 21 can also recognize the findings by extracting the annotations and measurement lines.

[0078] Furthermore, when a finding is observed in an ultrasound examination, multiple ultrasound images may be taken at the imaging position where the finding was observed. Therefore, the finding determination unit 21 can determine that a finding is present when multiple ultrasound images taken at one imaging position are input from an external ultrasound diagnostic device (not shown) or an external server device (not shown), and can also determine that a finding is absent when at most one ultrasound image is input at one imaging position.

[0079] Here, examples of combinations of multiple ultrasound images taken at one imaging position include a combination of a B-mode image and a type of ultrasound image other than a B-mode image, such as a so-called Doppler image or a so-called elasticity image, and a combination of multiple ultrasound images taken at the same imaging position by changing the orientation of the ultrasound probe. Furthermore, the multiple ultrasound images taken at one imaging position also include multiple ultrasound images taken of the same region of the subject at slightly different imaging positions.

[0080] Furthermore, when a finding is observed in an ultrasound examination, an examination image may be taken by an examination other than an ultrasound examination at the imaging position where the finding was observed. Therefore, the finding determination unit 21 can determine that a finding is present when an examination image other than an ultrasound image is input from an external examination device (not shown) or an external server device (not shown), and can also determine that a finding is absent when only an ultrasound image is input.

[0081] In this way, information on the determination result of the findings determination unit 21, whether a finding is present or absent, is sent to the display layout setting unit 13. When the findings determination unit 21 determines that no findings are present, the display layout setting unit 13 sets, on one screen of the monitor 17, multiple display areas of the display layout corresponding to the schematic diagram of the breast selected by the schematic diagram selection unit 12, as in embodiment 1.

[0082] Furthermore, when the finding determination unit 21 determines that a finding is present, the display layout setting unit 13 sets multiple display areas on one screen of the monitor 17 with a display layout different from that when the finding is determined to be absent. For example, as shown in Fig. 13 , of the eight display areas A71 to A78 of the display layout L7, in the display area A78 corresponding to the imaging position where a finding was observed, the display layout setting unit 13 can set the display areas A71 to A78 so that multiple ultrasound images and examination images other than ultrasound images captured at this imaging position are displayed while being switched between, in accordance with an input operation by the user via the input device 19.

[0083] Furthermore, as shown in FIG. 14, for example, the display layout setting unit 13 can set the display areas A81 to A88 of the eight display areas A81 to A88 of the display layout L8 so that in the display area A88 corresponding to the shooting position where findings were observed, multiple ultrasound images and examination images other than ultrasound images taken at this shooting position are displayed side by side.

[0084] Furthermore, although not shown, the display layout setting unit 13 can set, for example, a plurality of display areas of a first display layout on one screen of the monitor 17, which is the same as the case where no findings are present except that one representative ultrasound image is set to be arranged in a display area corresponding to an imaging position where a finding was observed, and can also set a plurality of display areas of a second display layout on one screen of the monitor 17, which displays other ultrasound images taken at imaging positions where findings were observed and examination images other than ultrasound images side by side. In this case, after the ultrasound images arranged in the first display layout are displayed on the monitor 17, the ultrasound images and examination images other than ultrasound images arranged in the plurality of display areas of the second display layout can be displayed in accordance with an input operation by the user via the input device 19.

[0085] As described above, according to the display device 1A of the second embodiment of the present invention, the presence or absence of findings in the ultrasound image is determined by the findings determination unit 21, and the display layout setting unit 13 sets multiple display areas on one screen with different display layouts depending on the presence or absence of findings. This allows the user to not only intuitively grasp which of the multiple ultrasound images displayed on the monitor 17 are from which imaging positions, but also to easily check ultrasound images or examination images that include findings, thereby further improving the efficiency of image interpretation. [Explanation of symbols]

[0086] 1,1A display device, 11 memory, 12 schematic diagram selection unit, 13 display layout setting unit, 14 reading position reading unit, 15 image layout unit, 16 display control unit, 17 monitor, 18,18A device control unit, 19 input device, 20,20A processor, A1 to A8, A11 to A19, A21 to A24, A31 to A34, A41 to A48, A51 to A56, A61 to A68, A71 to A78, A81 to A88, C center line, L1 to L8 display layout, P1 protrusion, PM probe mark, S schema image, U ultrasound image.

Claims

1. one or more adjacent monitors forming a screen; a memory for storing a plurality of display layouts each having a plurality of display areas for displaying a plurality of ultrasound images on the single screen; a schematic diagram selection unit that selects one of a plurality of schematic diagrams obtained by dividing the breast of the subject into a plurality of regions based on a user's designation; a display layout setting unit that sets, on the one screen, a plurality of display areas of a display layout corresponding to the schematic diagram selected by the schematic diagram selection unit; an imaging position reading unit that reads an imaging position of the ultrasound image from the ultrasound image; an image layout unit that arranges the ultrasound images in a display area set by the display layout setting unit based on the imaging positions read by the imaging position reading unit, The display layout setting unit sets a plurality of display areas corresponding to one of the left and right breasts of the subject based on the imaging positions read by the imaging position reading unit or a user instruction, and sets a plurality of display areas corresponding to the other breast by horizontally reversing the arrangement of the imaging positions corresponding to the set plurality of display areas. Display device.

2. The display device according to claim 1 , wherein the display layout setting unit sets, on the single screen, a plurality of display areas arranged at positions corresponding to a plurality of areas in the schematic diagram selected by the schematic diagram selection unit.

3. 3. The display device according to claim 1, wherein the display layout setting section changes the plurality of display areas already set on the single screen based on an instruction from a user.

4. a finding determination unit that determines whether or not a finding is present in an ultrasound image; The display device according to any one of claims 1 to 3, wherein the display layout setting unit sets a plurality of display areas on the single screen with different display layouts when the finding determination unit determines that there is a finding and when the finding determination unit determines that there is no finding.

5. The display device according to any one of claims 1 to 4, wherein the display layout setting unit sets, based on a user's instruction, multiple display areas on the single screen for displaying ultrasound images taken in the latest examination performed on the same subject and ultrasound images taken in past examinations side by side.

6. The display device according to any one of claims 1 to 4, wherein the display layout setting unit sets multiple display areas on the single screen based on user instructions to display ultrasound images taken in an examination performed on the same subject and examination images obtained by an examination other than an ultrasound examination side by side.

7. The display device according to any one of claims 1 to 6, wherein the display layout setting unit sets multiple display areas on the single screen for displaying side-by-side B-mode images and color images taken in an ultrasound examination of the same subject, based on a user's instructions.

8. The display device according to any one of claims 1 to 7, wherein the shooting position reading unit reads the shooting position of the ultrasound image by analyzing a schematic image that is superimposed on the ultrasound image and indicates the position of the ultrasound probe relative to the breast at the time of shooting.

9. The display device according to any one of claims 1 to 7, wherein the imaging position reading unit reads the imaging position of the ultrasound image based on the position of the ultrasound probe written in a tag attached to the ultrasound image.

10. a plurality of display layouts each having a plurality of display areas for displaying a plurality of ultrasound images on a single screen formed by one or a plurality of adjacent monitors are stored in a memory; selecting one of a plurality of schematic diagrams in which the subject's breast is divided into a plurality of regions based on a user instruction; setting a plurality of display areas on the one screen in a display layout corresponding to the selected schematic diagram; reading the imaging position of the ultrasound image from the ultrasound image; The ultrasound image is arranged in a set display area based on the read photographing position; Among the plurality of display areas corresponding to both the left and right breasts of the subject, the plurality of display areas corresponding to one of the breasts are set based on the read imaging positions or a user instruction, and the arrangement of the imaging positions corresponding to the plurality of set display areas is reversed horizontally to set the plurality of display areas corresponding to the other breast. A method for controlling a display device.

11. 11. The method for controlling a display device according to claim 10, further comprising the step of: setting, on the single screen, a plurality of display areas arranged at positions corresponding to a plurality of areas in the schematic diagram selected based on an instruction from a user.

12. 12. The method for controlling a display device according to claim 10, further comprising changing the plurality of display areas already set on the single screen based on an instruction from a user.

13. Determine whether there are any findings in the ultrasound image; 13. The display device control method according to claim 10, wherein a plurality of display areas with different display layouts are set on the single screen when it is determined that there is a finding and when it is determined that there is no finding.

14. A control method for a display device according to any one of claims 10 to 13, wherein, based on a user's instruction, multiple display areas are set on the single screen for displaying side-by-side ultrasound images taken in the latest examination performed on the same subject and ultrasound images taken in past examinations.

15. A control method for a display device according to any one of claims 10 to 13, which sets up multiple display areas on the single screen for displaying ultrasound images taken in an examination performed on the same subject and examination images obtained by an examination other than an ultrasound examination side by side based on a user's instructions.

16. A control method for a display device according to any one of claims 10 to 15, wherein a plurality of display areas are set on the single screen for displaying side-by-side B-mode images and color images taken in an ultrasound examination of the same subject, based on a user's instruction.

17. A control method for a display device according to any one of claims 10 to 16, wherein the imaging position of the ultrasound image is read by analyzing a schematic image that is superimposed on the ultrasound image and indicates the position of the ultrasound probe relative to the breast at the time of imaging.

18. 17. The method for controlling a display device according to claim 10, wherein the imaging position of the ultrasound image is read based on the position of the ultrasound probe written in a tag attached to the ultrasound image.

Images