Medical image acquisition guide device, medical image acquisition guide system, and computer program product

Abstract

The present invention addresses the problem of obtaining a medical image acquisition guide device, a medical image acquisition guide system, and a computer program product which are capable of performing ultrasonic imaging in a state in which a breast is pressed by a pressing member in a shorter time than in the prior art. A console (50), which is a medical image acquisition guide device, is provided with a projection processing unit (51D) that, when imaging a radiation image and an ultrasonic image of a breast in a state in which the breast is pressed by a pressing member, performs a process in which the projection processing unit (51D) performs a process in which the projection processing unit (51D) performs a process in which the projection processing unit (51D) projects the radiation image and the ultrasonic image when imaging the ultrasonic image. A guide image for guiding at least one of a scanning region and a scanning direction by an ultrasonic probe is projected on the opposite side of the compression member from the side where the breast is compressed, on the basis of an effective width, which is a region in which ultrasonic waves can be transmitted and received, on the ultrasonic probe for capturing the ultrasonic image.

Description

Technical Field

[0001] The present invention relates to a medical image acquisition guidance device, a medical image acquisition guidance system and a computer program product. Background Art

[0002] In radiographic images from mammography, breast cancer lesions (tumors, calcifications, etc.) and the mammary gland appear white. Therefore, in breasts with high mammary density, lesions caused by breast cancer are hidden in the mammary gland area and difficult to detect. On the other hand, ultrasound images are suitable for capturing breasts with high mammary density, but mammary density varies from person to person.

[0003] Therefore, conventionally, the following techniques are used as techniques for simultaneously utilizing examinations based on mammography and ultrasound results.

[0004] Patent Document 1 discloses a medical image diagnosis system that aims to associate radiographic images and ultrasonic images for easy visual recognition in a medical image diagnosis system that uses both radiographic rays and ultrasonic waves to diagnose breasts.

[0005] The medical image diagnostic system comprises: a medical imaging apparatus that acquires a radiographic image of the subject projected onto a projection plane by irradiating the subject with radiation, transmits ultrasound toward the subject, receives ultrasound echoes reflected by the subject, thereby acquiring ultrasonic slice images of the subject along slice planes substantially orthogonal to the projection plane, and generates first image data representing a plurality of ultrasonic slice images along the plurality of slice planes, second image data representing at least one radiographic image, and position data representing positions of the plurality of slice planes on the projection plane; a medical image storage apparatus that associates and stores the first image data, the second image data, and the position data generated by the medical imaging apparatus; and a medical image display apparatus that displays at least one ultrasonic slice image along at least one slice plane based on the first image data read from the medical image storage apparatus, and displays at least one radiographic image indicated by a marker representing the position of the at least one slice plane on the projection plane based on the second image data and the position data read from the medical image storage apparatus.

[0006] Patent Document 1: Japanese Patent Application Laid-Open No. 2009-82402

[0007] When capturing radiographic images and ultrasonic images while the breast is being compressed by a compression member, the time during which the breast is compressed by the compression member needs to be shortened as much as possible in consideration of the burden on the subject.

[0008] However, the technology disclosed in Patent Document 1 has a problem in that scanning with an ultrasonic probe is performed manually, which requires a relatively long time.

[0009] This is because, generally, when ultrasonic images are manually captured using an ultrasonic probe, the ultrasonic image acquired in one scan is limited to an image of a portion of the entire breast, and therefore multiple scans are required.

[0010] In particular, in examinations that use both radiographic and ultrasonic images, there is a need to overlay these images for interpretation. In this case, an ultrasonic image of the entire breast is required. However, when ultrasonic images are taken multiple times for this purpose, some of the imaged areas may be omitted. In this case, the omitted area must be photographed again. Summary of the Invention

[0011] The present invention has been made in view of the above circumstances, and its object is to provide a medical image acquisition guidance device, a medical image acquisition guidance system, and a program that can perform ultrasonic imaging in a state where the breast is compressed by a compression member in a shorter time than the conventional technology.

[0012] To achieve the above-mentioned object, a medical image acquisition guidance device according to a first embodiment of the present invention includes a processor that performs the following processing: when capturing a radiographic image and an ultrasonic image of a breast in a state of being compressed by a compression member, when capturing the ultrasonic image, a guidance image based on at least one of a scanning area and a scanning direction of the ultrasonic probe is projected onto a side of the compression member opposite to the side compressing the breast, based on an effective width, an area on the ultrasonic probe that is capable of transmitting and receiving ultrasonic waves, on the ultrasonic probe used to capture the ultrasonic image.

[0013] Regarding the medical image acquisition guidance device of the second embodiment of the present invention, in the medical image acquisition guidance device of the first embodiment, the processor further performs the following processing: an ultrasonic image obtained by scanning based on an ultrasonic probe is associated with and saved with at least one of a scanning area and a scanning direction in the scan used to obtain the ultrasonic image.

[0014] Regarding the medical image acquisition guidance device of the third aspect of the present invention, in the medical image acquisition guidance device of the second aspect, the processor determines at least one of the actual scanning area and scanning direction using the detection result of the position sensor that detects the position of the ultrasonic probe.

[0015] Regarding the medical image acquisition guidance device of the fourth embodiment of the present invention, in the medical image acquisition guidance device of the second embodiment or the third embodiment, when the scanning area is associated with the ultrasonic image and saved, the processor further performs a first display processing of displaying the radiographic image corresponding to the ultrasonic image together with the image representing the scanning area, i.e., the scanning area image, and when the user specifies the scanning area represented by the scanning area image displayed by the first display processing, the processor further performs a second display processing of displaying the ultrasonic image corresponding to the scanning area.

[0016] Regarding the medical image acquisition guidance device of the fifth embodiment of the present invention, in the medical image acquisition guidance device of the first embodiment or the second embodiment, when scanning based on the ultrasonic probe is performed multiple times in order to capture a single ultrasonic image, the processor determines the scanning areas corresponding to the adjacent scans so that the adjacent areas overlap within a predetermined range.

[0017] In the medical image acquisition guidance device according to a sixth aspect of the present invention, in the medical image acquisition guidance device according to the first or second aspect, the guidance image is an image including at least one of a line, a graphic, a mark, and a character.

[0018] Regarding the medical image acquisition guidance device of the seventh embodiment of the present invention, in the medical image acquisition guidance device of the first embodiment or the second embodiment, the processor projects the guidance image on an area of ​​the compression component that is located on the side opposite to the side that compresses the breast and is excluding the scanning area of ​​the ultrasonic probe.

[0019] Regarding the medical image acquisition guidance device of the 8th embodiment of the present invention, in the medical image acquisition guidance device of the 1st embodiment or the 2nd embodiment, the processor determines the scanning area by at least one of the width of the shell of the ultrasonic probe, the effective width of the ultrasonic probe, the width of the compression part, and the acquisition area of ​​the image representing the breast in the radiographic image.

[0020] Regarding the medical image acquisition guidance device of the 9th embodiment of the present invention, in the medical image acquisition guidance device of the 1st embodiment or the 2nd embodiment, the processor acquires the effective width at any one of the times when the power of the medical image acquisition guidance device is turned on, when the ultrasonic probe is installed, and when the setting for acquiring an image representing the breast is selected.

[0021] Furthermore, in order to achieve the above-mentioned object, a medical image acquisition guidance system according to a tenth embodiment of the present invention includes: the medical image acquisition guidance device according to the present invention; and a display unit that displays radiographic images and ultrasonic images acquired based on processing by the medical image acquisition guidance device.

[0022] Furthermore, to achieve the above-mentioned object, the computer program product according to the eleventh embodiment of the present invention causes a computer to execute the following processing: when capturing a radiographic image and an ultrasonic image of a breast in a state of being compressed by a compression member, when capturing the ultrasonic image, a guidance image based on at least one of a scanning area and a scanning direction of the ultrasonic probe is projected onto a side of the compression member opposite to the side compressing the breast, based on an effective width, which is an area on the ultrasonic probe capable of transmitting and receiving ultrasonic waves, on the ultrasonic probe used to capture the ultrasonic image.

[0023] Effects of the Invention

[0024] According to the present invention, ultrasonic imaging can be performed in a shorter time than in the conventional art while the breast is compressed by the compression member. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a diagram showing an example of a schematic configuration of a medical image acquisition guidance system according to an embodiment.

[0026] Figure 2 It is a side view showing an example of the appearance of the medical image acquisition apparatus according to the embodiment.

[0027] Figure 3 It is a three-view diagram showing an example of a schematic structure of a pressing member according to the embodiment.

[0028] Figure 4 This is a block diagram showing an example of the hardware configuration of the console according to the embodiment.

[0029] Figure 5 This is a block diagram showing an example of the functional configuration of a console according to the embodiment.

[0030] Figure 6 It is a schematic diagram showing an example of the structure of the probe information database according to the embodiment.

[0031] Figure 7 It is a schematic diagram showing an example of the structure of the registration information database involved in the embodiment.

[0032] Figure 8 This is a flowchart showing an example of projection processing according to the embodiment.

[0033] Figure 9 This is a schematic diagram for explaining a method for deriving a scanning area according to an embodiment.

[0034] Figure 10 This is a diagram showing an example of a guide image according to the embodiment.

[0035] Figure 11This is a diagram showing an example of a scanning state by an ultrasonic probe corresponding to a guide image according to the embodiment.

[0036] Figure 12 This is a diagram showing another example of the guide image according to the embodiment.

[0037] Figure 13 This is a diagram showing another example of the guide image according to the embodiment.

[0038] Figure 14 This is a diagram showing another example of the guide image according to the embodiment.

[0039] Figure 15 This is a diagram showing an example of a display state of a body mark according to an embodiment.

[0040] Figure 16 This is a flowchart showing an example of image display processing according to the embodiment.

[0041] Figure 17 It is a diagram showing an example of a display state of a radiation image display screen according to the embodiment.

[0042] Figure 18 It is a diagram showing an example of a display state of an ultrasonic superimposed image display screen according to the embodiment.

[0043] Figure 19 It is a diagram for explaining the synthesis of ultrasonic images according to the embodiment.

[0044] Figure 20A It is a partially enlarged view for explaining the synthesis of ultrasonic images according to the embodiment.

[0045] Figure 20B It is a partially enlarged view for explaining the synthesis of ultrasonic images according to the embodiment.

[0046] Figure 21 This is a diagram for explaining another method of deriving the scanning area and the number of scans according to the embodiment. DETAILED DESCRIPTION

[0047] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0048] First, refer to Figure 1 , the structure of a medical image acquisition guidance system 1 to which the technology of the present invention is applied will be described. Figure 1 This is a diagram showing an example of a schematic configuration of the medical image acquisition guidance system 1 according to the present embodiment.

[0049] like Figure 1As shown, the medical image acquisition guidance system 1 includes a medical image acquisition device 10 and a console 50. The medical image acquisition device 10 and the console 50, as well as the console 50 and an external RIS (Radiology Information System) 6, are configured to be connectable via a wired or wireless network. The console 50 corresponds to the medical image acquisition guidance device in the technology of the present invention.

[0050] In the medical image acquisition guidance system 1 according to this embodiment, the console 50 receives imaging instructions and the like from the RIS 6 and controls the medical image acquisition device 10 based on the imaging instructions and user instructions. The medical image acquisition device 10 irradiates the breast, which is compressed between the imaging table 16 and the compression member 40 (described later), with radiation R to capture radiographic images. Furthermore, the medical image acquisition device 10 captures ultrasonic images of the breast, which is compressed by the compression member 40.

[0051] Next, refer to Figure 2 , a schematic structure of the medical image acquisition device 10 involved in this embodiment is described. Figure 2 1 is a side view showing an example of the appearance of the medical image acquisition device 10 according to the present embodiment, and is a view when the medical image acquisition device 10 is viewed from the right side of the subject. Figure 2 As shown, the medical image acquisition apparatus 10 includes a radiation source 17R, a radiation detector 28, an imaging platform 16 disposed between the radiation source 17R and the radiation detector 28, and a compression member 40 for compressing the breast between the imaging platform 16. In the medical image acquisition apparatus 10, a user such as a doctor or a technician positions the subject's breast on an imaging surface 16A of the imaging platform 16.

[0052] The medical image acquisition device 10 includes an arm 12, a base 14, and a shaft 15. The arm 12 is held by the base 14 so as to be movable in the vertical direction (Z direction). The shaft 15 connects the arm 12 to the base 14. The arm 12 is rotatable relative to the base 14 about the shaft 15 as the rotation axis. Furthermore, the arm 12 can also be rotatable relative to the base 14 about the shaft 15 as the rotation axis at the upper portion having the radiation irradiation portion 17 and the lower portion having the imaging platform 16.

[0053] The arm 12 includes a radiation irradiation unit 17 and an imaging platform 16. The radiation irradiation unit 17 includes a radiation source 17R, and is configured to change the irradiation field of radiation (e.g., X-rays) irradiated from the radiation source 17R. The irradiation field can be changed, for example, by a user operating the operation unit 26 or by the control unit 20 depending on the type of compression member 40 installed.

[0054] The imaging platform 16 includes a control unit 20, a storage unit 22, an interface (I / F) unit 24, an operating unit 26, and a radiation detector 28. The control unit 20 controls the overall operation of the medical image acquisition device 10 under the control of the console 50. The control unit 20 includes a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory) (not shown). The ROM pre-stores various programs executed by the CPU, including programs for controlling the generation of radiographic and ultrasonic images. The RAM temporarily stores various data.

[0055] The storage unit 22 stores data of radiographic images and ultrasonic images, and various other information. The storage unit 22 is implemented by a storage medium such as a HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory.

[0056] The I / F unit 24 communicates various information with the console 50 via wired or wireless communication. Specifically, the I / F unit 24 receives information related to the control of the medical image acquisition apparatus 10 from the console 50. Furthermore, the I / F unit 24 transmits radiographic and ultrasonic image data to the console 50.

[0057] The operation unit 26 is a component provided on the imaging platform 16 or the like and operable by the user with the hands or feet, and is, for example, a switch, a button, a touch panel, or the like.

[0058] The radiation detector 28 is disposed within the imaging platform 16 and detects radiation R that has passed through the breast and the imaging platform 16, generates a radiographic image based on the detected radiation R, and outputs image data representing the generated radiographic image. The type of radiation detector 28 is not particularly limited; for example, it may be an indirect conversion radiation detector that converts radiation R into light and then converts the converted light into electric charge, or it may be a direct conversion radiation detector that directly converts radiation R into electric charge.

[0059] Furthermore, a compression unit 48 is connected to the arm 12. A support portion 46 that supports the compression member 40 is detachably mounted on the compression unit 48. The support portion 46 (compression member 40) is moved in the vertical direction (Z direction) by a driving unit (not shown) included in the compression unit 48.

[0060] The compression member 40 is disposed between the radiation source 17R and the imaging platform 16 , and puts the breast into a compressed state by sandwiching the breast between the radiation source 17R and the imaging platform 16 . Figure 3 3D views of an example of the pressing member 40 are shown in FIG. Figure 3 The three views include a top view of the compression member 40 viewed from the upper side (radiation irradiation unit 17 side), a side view viewed from the subject side, and a side view viewed from the right side of the subject. Figure 3 As shown, the pressing member 40 includes a pressing portion 42 and a supporting portion 46 .

[0061] The support portion 46 includes a mounting portion 47 and an arm 49. The mounting portion 47 mounts the compression member 40 to the medical image acquisition apparatus 10, specifically, to the driving portion of the compression unit 48. The arm 49 supports the compression portion 42.

[0062] The compression part 42 has a concave cross-sectional shape, with a substantially flat bottom 43 surrounded by a wall 44 of approximately uniform height. To facilitate positioning and confirming the compression status during breast compression, the compression part 42 is preferably formed from an optically transparent or translucent material. Furthermore, the compression part 42 is preferably formed from a material that is highly transmissive to radiation R and ultrasound waves. Furthermore, the compression part 42 is preferably formed from a material with excellent strength, such as drop resistance and compression strength.

[0063] Examples of such materials include resins such as polymethylpentene (PMP), polycarbonate (PC), acrylic acid, polypropylene (PP), and polyethylene terephthalate (PET). In particular, polymethylpentene has an acoustic impedance that affects ultrasound transmittance and reflectance, which is closer to that of the human body (breast) than other materials, reducing the amount of noise imparted to ultrasound images. Therefore, polymethylpentene is a preferred material for the compression portion 42.

[0064] Furthermore, the medical image acquisition device 10 may be configured to be capable of being replaced with a variety of different compression members 40. Specifically, compression members 40 of different materials, sizes, and shapes may be installed, depending on the patient's physique (e.g., breast size), breast tissue composition (e.g., fat mass and mammary gland mass), and imaging type (e.g., magnification imaging and point imaging). For example, compression members corresponding to the size of the breast, compression members for axillary imaging, compression members for magnification imaging, and so-called point imaging compression members that only capture radiographic images of areas with lesions may be used. In other words, the compression member 40 is not limited to compressing the entire breast and may also be a compression member smaller than the breast that compresses a portion of the breast.

[0065] Furthermore, a gel-like or liquid-like ultrasonically transmissive medium may be applied to the upper surface 43A of the bottom 43 of the compression member 40 and / or the breast contact surface 43B. For example, a known ultrasonic examination gel having an acoustic impedance close to that of the human body (breast) can be used as this medium. Specifically, the medical image acquisition device 10 can acquire an ultrasonic image of the breast, which is compressed by the compression member 40 coated with the gel-like or liquid-like ultrasonically transmissive medium, through the compression member 40. In this case, air can be prevented from entering the interface between the ultrasonic emitting surface of the ultrasonic probe 30 and the upper surface 43A and / or the interface between the contact surface 43B and the breast, thereby reducing the difference in acoustic impedance at each interface and thereby reducing the proportion of noise contributing to the ultrasonic image.

[0066] On the other hand, the medical image acquisition guidance system 1 according to this embodiment includes an ultrasonic probe 30 separately from the medical image acquisition device 10. Furthermore, in the medical image acquisition guidance system 1 according to this embodiment, an ultrasonic probe 30 is used that is connected to the medical image acquisition device 10 via a wired connection (not shown), but the present invention is not limited to this. Alternatively, an ultrasonic probe having wireless communication functionality may be used as the ultrasonic probe 30, and connected to the medical image acquisition device 10 via this wireless communication functionality.

[0067] The ultrasonic probe 30 is used to obtain an ultrasonic image of the breast, which is compressed by the compression member 40. Manual scanning is performed on the upper surface 43A of the bottom portion 43 of the compression member 40. Ultrasonic waves are irradiated toward the breast via the compression member 40, and reflected waves from the breast are received. Furthermore, the ultrasonic probe 30 includes a converter (not shown) that converts the received reflected waves from the breast into an ultrasonic image, and the ultrasonic image is obtained through the converter.

[0068] Specifically, the ultrasonic probe 30 includes an ultrasonic transducer array. An ultrasonic transducer array is a structure in which multiple ultrasonic transducers are arranged in a one-dimensional or two-dimensional manner. The ultrasonic transducer can also be a transducer formed by forming electrodes at both ends of a piezoelectric body, such as a piezoelectric ceramic represented by lead zirconate titanate (PZT), a piezoelectric single crystal represented by lead magnesium niobate-lead titanate (PMN-PT), or a polymer piezoelectric element represented by polyvinylidene fluoride (PVDF). Furthermore, for example, the ultrasonic transducer can be a CMUT (Capacitive Micro-machined Ultrasound Transducer).

[0069] Furthermore, the medical image acquisition guidance system 1 according to this embodiment can be interchangeably installed with multiple different types of ultrasonic probes 30. Specifically, ultrasonic probes 30 with different performance and sizes can be installed based on the patient's physique (e.g., breast size), breast tissue structure (e.g., fat content and mammary gland volume), and imaging type (e.g., magnification imaging versus spot imaging). For example, a linear array probe with a center frequency of approximately 7.5 MHz (for superficial areas, etc.), a convex array probe with a center frequency of approximately 3.5 MHz (for the abdomen, etc.), and a sector probe with a center frequency of approximately 2.5 MHz (for the heart, etc.) can be used.

[0070] Meanwhile, a projector 80 is built into the upper portion of the arm 12. The projector 80 includes a projection unit 80A located near the radiation exit port of the radiation irradiation unit 17. The projector 80 primarily projects images representing various information (hereinafter also referred to as "projected images") onto the upper surface of the compression member 40. However, when the compression member 40 is removed, the projected image can be projected onto the upper surface of the imaging platform 16 or onto the breast when it is not compressed by the compression member 40. Projector 80 can be any known projector, such as a liquid crystal projector, a DLP (Digital Light Processing) (registered trademark) projector, or a laser projector.

[0071] Furthermore, the breast imaging method used by the medical image acquisition device 10 is not particularly limited. For example, it can be cranio-caudal (CC) imaging, medio-lateral oblique (MLO) imaging, magnified imaging of a portion of the breast, or point imaging. CC imaging involves clamping the breast in the vertical direction (Z direction) between the imaging platform 16 and the compression member 40 to capture the breast in a compressed state. MLO imaging involves clamping the breast between the imaging platform 16 and the compression member 40 with the arm 12 tilted at a rotation angle of 45 degrees or more and less than 90 degrees relative to the base 14 to capture the breast in a compressed state, including the axillary area.

[0072] Furthermore, for example, the medical image acquisition device 10 can also perform tomosynthesis. In tomosynthesis, radiation R is irradiated toward the breast from each of multiple irradiation positions at different irradiation angles via the radiation source 17R, thereby capturing multiple radiographic images of the breast. Specifically, in tomosynthesis, the angles of the imaging platform 16, the compression member 40, and the breast are fixed while the rotation angle of the radiation irradiation unit 17 relative to the base 14 is varied to perform imaging.

[0073] Furthermore, in the medical image acquisition apparatus 10 , the subject's breast can be positioned not only when the subject is standing (standing state) but also when the subject is sitting on a chair, wheelchair, or the like (sitting state).

[0074] The console 50 sets the upper limit of the compressive force applied to the breast by the compressing member 40 according to the type of the compressing member 40 attached to the medical image acquisition apparatus 10. Furthermore, the console 50 controls the medical image acquisition apparatus 10 to acquire radiographic images and ultrasonic images based on imaging instructions received from the RIS 6 and user instructions.

[0075] The medical image acquisition device 10 according to this embodiment can acquire both radiographic and ultrasonic images while the breast is compressed by the compression member 40. This facilitates alignment of these images, and by overlaying and displaying the two images, the ability to identify lesions can be improved.

[0076] Next, the console 50 according to this embodiment will be described.

[0077] First, refer to Figure 4 , an example of the hardware structure of the console 50 is described. Figure 4As shown, the console 50 includes a CPU 51 serving as a processor, a nonvolatile storage unit 52, and a memory 53 serving as a temporary storage area. Furthermore, the console 50 includes a display 54 serving as a display unit such as a liquid crystal display, an operation unit 55 such as a touch panel, a keyboard, and a mouse, and an interface unit 56. The interface unit 56 communicates with the medical image acquisition device 10, the RIS6, and other external devices via wired or wireless communication. The CPU 51, storage unit 52, memory 53, display 54, operation unit 55, and interface unit 56 are interconnected via a bus 58 such as a system bus and a control bus, enabling the exchange of various information.

[0078] The storage unit 52 is implemented using a storage medium such as an HDD, SSD, or flash memory. The storage unit 52 stores a projection processing program 52A and an image display processing program 52B. The CPU 51 reads the projection processing program 52A and the image display processing program 52B from the storage unit 52 as appropriate, expands them into the memory 53, and executes the expanded programs. For example, a personal computer, a server computer, a smartphone, a tablet terminal, a wearable terminal, etc. can be appropriately used as the console 50.

[0079] Furthermore, a probe information database 52C and a registered information database 52D are stored in the storage unit 52. The probe information database 52C and the registered information database 52D will be described in detail later.

[0080] Next, refer to Figure 5 , an example of the functional structure of the console 50 is described. Figure 5 As shown, the console 50 includes a probe information acquisition unit 51A, a scan information derivation unit 51B, a guide image creation unit 51C, a projection processing unit 51D, a determination unit 51E, a storage processing unit 51F, a first display processing unit 51G, and a second display processing unit 51H. When the CPU 51 executes a projection processing program 52A, the CPU 51 functions as the probe information acquisition unit 51A, the scan information derivation unit 51B, the guide image creation unit 51C, the projection processing unit 51D, the determination unit 51E, and the storage processing unit 51F. Furthermore, when the CPU 51 executes an image display processing program 52B, the CPU 51 functions as the first display processing unit 51G and the second display processing unit 51H.

[0081] When capturing radiographic and ultrasonic images of a breast compressed by the compression member 40, the probe information acquisition unit 51A of this embodiment acquires information including the effective width of the ultrasonic probe 30 (hereinafter referred to as "probe information") during ultrasonic imaging. Here, the "effective width" refers to the width of the area on the ultrasonic probe 30 that can transmit and receive ultrasonic waves.

[0082] Furthermore, the scan information deriving unit 51B according to this embodiment derives information indicating at least one of the scan area and the scan direction of the ultrasonic probe 30 (hereinafter referred to as "scan information") based on the effective width in the acquired probe information. Furthermore, while the scan information deriving unit 51B according to this embodiment derives both the scan area and the scan direction, this is not limiting. For example, the scan information deriving unit 51B may derive only one of the scan area and the scan direction.

[0083] Then, the guide image creating unit 51C according to the present embodiment creates a guide image for guiding at least one of the scanning area and the scanning direction, using at least one of the scanning area and the scanning direction indicated by the derived scanning information.

[0084] The projection processing unit 51D according to this embodiment projects the created guide image onto the upper surface 43A of the bottom portion 43 of the compression member 40 , which is the side opposite to the side compressing the breast.

[0085] Furthermore, the determination unit 51E according to this embodiment determines at least one of the actual scanning area and scanning direction using the detection results of a position sensor (not shown) that detects the position of the ultrasonic probe 30. Furthermore, the storage processing unit 51F according to this embodiment performs processing to associate and store an ultrasonic image obtained by scanning using the ultrasonic probe 30 with at least one of the scanning area and scanning direction determined by the determination unit 51E in the scan used to obtain the ultrasonic image.

[0086] In this embodiment, a magnetic sensor composed of a magnetic generator and a magnetic position sensor is used as the position sensor, but the present invention is not limited thereto. For example, an optical position sensor or an electrical position sensor may be used as the position sensor.

[0087] Thus, in this embodiment, at least one of the scanning area and the scanning direction stored by the storage processing unit 51F is detected by a position sensor, but the present invention is not limited to this. For example, an optical camera that captures the upper surface of the compression member 40 may be provided, and at least one of the scanning area and the scanning direction may be detected using image analysis technology on the image captured by the optical camera.

[0088] Furthermore, while an ultrasonic image obtained when the ultrasonic probe 30 is in contact with the compression member 40 is a normal image, an ultrasonic image obtained when the ultrasonic probe 30 is separated from the compression member 40 is an image in which multiple echoes are repeated from the upper surface 43A of the bottom 43 of the compression member 40. Therefore, for example, a method may be employed in which a change in the state of an ultrasonic image obtained by scanning with the ultrasonic probe 30 is used to detect whether the ultrasonic probe 30 has been separated from the compression member 40, and this detection result is used to detect at least one of the scanning area and scanning direction.

[0089] On the other hand, when the scan region is associated with the ultrasonic image and stored, the first display processing unit 51G according to this embodiment performs a first display process for displaying a radiographic image corresponding to the ultrasonic image together with a scan region image representing the scan region. Furthermore, when the user specifies a scan region represented by the scan region image displayed by the first display process, the second display processing unit 51H according to this embodiment performs a second display process for displaying the ultrasonic image corresponding to the scan region.

[0090] Here, when the scan based on the ultrasonic probe 30 is performed multiple times in order to capture a single ultrasonic image, the scan information derivation unit 51B involved in this embodiment determines the scan areas corresponding to adjacent scans so that the adjacent areas overlap within a predetermined range. The overlapping range at this time is preferably set to approximately between 5mm and 10mm. This is because an overlap of about 5mm is required to reliably scan the ultrasonic probe 30 through finger operation. If safety is further considered, an overlap of about 10mm is required. On the other hand, if it exceeds 10mm, the number of scans will increase excessively. In addition, the width of the probe element of the ultrasonic probe 30 (equivalent to the effective width mentioned above) is generally set to approximately 35mm to 50mm, and the range of 5mm to 10mm is equivalent to approximately 10% to 30% of the width of the probe element.

[0091] In this embodiment, an image including lines, marks, and characters is used as the guide image, but the present invention is not limited thereto. For example, an image including a graphic may be used as the guide image, or an image including one of these lines, graphics, marks, and characters, or an image including a combination of these, but not all of them, may be used as the guide image.

[0092] In this embodiment, the probe information acquiring unit 51A acquires the effective width when the ultrasonic probe 30 is attached to the medical image acquisition device 10. However, the present invention is not limited to this embodiment. For example, the effective width may be acquired at any of the following times: when the medical image acquisition device 10 or the console 50 is powered on, or when a setting for acquiring an image representing the breast is selected.

[0093] Next, refer to Figure 6 , the probe information database 52C involved in this embodiment is described. Figure 6 It is a schematic diagram showing an example of the structure of the probe information database 52C according to the present embodiment.

[0094] The probe information database 52C according to this embodiment is a database for registering the above-mentioned probe information, which is information related to the size of a preset type of ultrasonic probe applicable to the medical image acquisition device 10. For example, Figure 6 As shown in FIG. 1 , the probe ID (Identification) and the probe information are associated with each other and stored in the probe information database 52C according to the present embodiment.

[0095] The probe ID is pre-assigned to each ultrasound probe to identify each applicable ultrasound probe in the medical image acquisition device 10. Furthermore, the probe information indicates the dimensions of the corresponding ultrasound probe, including the probe element width and the housing width. The probe element width indicates the effective width of the corresponding ultrasound probe, while the housing width indicates the width of the housing of the corresponding ultrasound probe.

[0096] exist Figure 6 In the example shown, an ultrasound probe assigned the probe ID "P001" has a probe element width (effective width) of 50 mm and a shell width of 52 mm. Therefore, this ultrasound probe has a shell area of ​​1 mm at each end of the area capable of transmitting and receiving ultrasound waves.

[0097] Next, refer to Figure 7 , the registration information database 52D involved in this embodiment is explained. Figure 7 It is a schematic diagram showing an example of the structure of the registration information database 52D according to the present embodiment.

[0098] The registration information database 52D involved in this embodiment is a database that registers radiographic images and ultrasonic images acquired by the medical image acquisition device 10. As an example, Figure 7As shown, the radiographic images and the registration information are associated with each other and stored in the registration information database 52D according to the present embodiment.

[0099] The radiographic image is information representing the radiographic image itself acquired by imaging with the medical image acquisition device 10. Furthermore, the registration information is information related to an ultrasonic image acquired by imaging with the ultrasonic probe 30 in the same state as that in which the corresponding radiographic image was acquired, and includes information regarding the probe ID of the ultrasonic probe 30, the ultrasonic image, the scanning area, and the scanning direction.

[0100] That is, the effective width of the ultrasonic probe applicable to the medical image acquisition apparatus 10 according to this embodiment is shorter than the depth direction ( Figure 2 Therefore, in order to obtain an ultrasonic image corresponding to all areas of the upper surface 43A, multiple scans are required.

[0101] The ultrasound image, scanning area and scanning direction in the above registration information are the information registered for each of the multiple scans. Figure 7 In the illustrated example, a case is illustrated where the ultrasonic probe 30 to which the probe ID “P001” is assigned is used to perform imaging of ultrasonic images corresponding to imaging of the radiographic image A four times.

[0102] In this embodiment, a moving ultrasound image is used as the ultrasound image registered in the registration information database 52D, but the present invention is not limited thereto. For example, a still ultrasound image may be registered as the ultrasound image in the registration information database 52D.

[0103] Next, refer to Figures 8 to 18 , the function of the medical image acquisition guidance system 1 according to this embodiment will be described. Figures 8 to 15 The role of the console 50 when executing the projection processing will be described. In the console 50, the CPU 51 executes the projection processing program 52A to execute the projection processing program. Figure 8The projection processing shown. In the medical image acquisition device 10, after capturing a radiographic image while the breast is compressed by the compression member 40, the projection processing according to this embodiment is executed when a user, such as a doctor or technician, connects the ultrasonic probe 30 to the medical image acquisition device 10 and issues a start instruction via the operation unit 55 to capture an ultrasonic image corresponding to the radiographic image. To avoid complication, the description herein assumes that a probe information database 52C has already been constructed and that the radiographic images obtained by the imaging have been registered in the registration information database 52D.

[0104] In step S100, the CPU 51 receives information identifying the currently connected ultrasonic probe 30 (probe ID in this embodiment) from the medical image acquisition device 10. The CPU 51 then obtains probe information corresponding to the received probe ID by reading it from the probe information database 52C.

[0105] In step S102, the CPU 51 derives the above-mentioned scanning information (in this embodiment, information indicating the scanning area and scanning direction). Figure 9 , the specific derivation method of the scanning area involved in this embodiment is described. Figure 9 It is a schematic diagram for explaining the method of deriving the scanning area according to the present embodiment.

[0106] like Figure 9 As shown, first, the CPU 51 virtually sets the area dividing line 60, which is a line representing the end of the scanning area based on the ultrasonic probe 30 and is a line closest to the chest wall side of the subject, to the 0th (zero) area dividing line 60, and sets the position of the 0th area dividing line 60 to 0 mm.

[0107] Next, the CPU 51 calculates the position of the region dividing line 60 corresponding to the first scanning region by the ultrasonic probe 30 according to the following formula (1). In formula (1), PW represents the width (effective width) of the probe element of the ultrasonic probe 30, HW represents the width of the housing of the ultrasonic probe 30, and L1 represents the position of the region dividing line 60 corresponding to the first scanning region.

[0108] L1=PW+(HW-PW) / 2 (1)

[0109] The CPU 51 then calculates the position of the region dividing line 60 corresponding to the second and subsequent scan areas of the ultrasonic probe 30 using the following equation (2), conditional on the condition that the width W in the depth direction of the upper surface 43A of the bottom portion 43 of the compression member 40 is not exceeded. In equation (2), BL represents the position of the region dividing line 60 corresponding to the previous scan area, DW represents the overlap width with the adjacent scan area when scanning with the ultrasonic probe 30, and Ln represents the position of the region dividing line 60 corresponding to the scan area for the nth scan.

[0110] Ln=BL+(PW-DW) (2)

[0111] For example, when the width W in the depth direction on the upper surface 43A of the bottom 43 of the compression component 40 is 240 mm, the width PW of the probe element of the ultrasonic probe 30 is 50 mm, the width HW of the shell of the ultrasonic probe 30 is 52 mm, and the overlapping width DW with the adjacent scanning area when scanning with the ultrasonic probe 30 is 5 mm, the positions of the area dividing lines 60 are shown in Table 1 below.

[0112] [Table 1]

[0113] Regional dividing line Position (mm) Line 0 0 Line 1 51 Line 2 96 Line 3 141 Line 4 186 Line 5 231

[0114] Furthermore, in this embodiment, as the scanning direction, a first mode in which the scanning direction is switched every time scanning is prepared, and a mode in which the scanning direction is switched from the first mode to the second ... Figure 9 The second mode of the direction from the left end side to the right end side and the second mode of the direction from the left end side to the right end side in all scans Figure 9 In this embodiment, the user pre-determines which of the three modes to use. However, this is not limiting and the CPU 51 may determine an appropriate scanning direction based on the purpose of ultrasound imaging, the patient's condition, and the like.

[0115] In step S104, the CPU 51 uses the scan information obtained through the above processing to create information representing a guide image set to a preset structure. In step S106, the CPU 51 controls the projector 80 to project the guide image represented by the created information onto the upper surface 43A of the bottom 43 of the pressing member 40. Through this control, the guide image is projected onto the upper surface 43A of the bottom 43 of the pressing member 40. Figure 10 An example of the guide image involved in this embodiment is shown in FIG. Figure 10 , a case where the number of area dividing lines 60, that is, the number of scans is four is exemplified.

[0116] like Figure 10As shown, in the guide image according to the present embodiment, each scanning area based on multiple scans of the ultrasonic probe 30 is divided by area dividing lines 60 (in Figure 10 In the example shown, there are four divisions (four divisions). In addition, in this guide image, a number 62 indicating the operation order and an arrow 64 indicating the scanning direction are projected for each division. Therefore, by referring to the guide image, the user can understand the scanning area and scanning direction of the ultrasonic probe 30. As a result, as an example, Figure 11 As shown, scanning is performed using the ultrasonic probe 30. Figure 11 , a case where the ultrasonic probe 30 is in the middle of the first scan is illustrated.

[0117] In addition, Figures 10 and 11 In the example, the guide image when the second mode is selected as the scanning direction is shown, but it is not limited to this. For example, when the first mode is selected as the scanning direction, as an example, the projection Figure 12 This guide image illustrates a case where the odd-numbered scanning direction is from the left end to the right end, and the even-numbered scanning direction is from the right end to the left end.

[0118] And, as an example, Figure 13 As shown in FIG, a scanning start line 66 indicating the scanning start position based on the ultrasonic probe 30 and a scanning end line 68 indicating the scanning end position may be projected as a guide image. Figure 13 As shown in FIG. 6 , it is also possible to set the area dividing line 60 between the scanning start line 66 and the scanning end line 68 not to be projected. According to this method, it is possible to avoid the area dividing line 60 from hindering the user's visual recognition. In addition, as an example, Figure 14 As shown, it is also possible to add a scanning start line 66 and a scanning end line 68 as a guide image. Figure 11 or Figure 12 This is a matter of course in the way the projection is performed in the images shown.

[0119] In step S108 , the CPU 51 waits until one scan by the ultrasonic probe 30 is completed based on the position of the ultrasonic probe 30 obtained by the above-mentioned position sensor.

[0120] In step S110, the CPU 51 derives information indicating the actual scanning area and scanning direction of the ultrasonic probe 30 based on the position of the ultrasonic probe 30 obtained by the position sensor. The CPU 51 then stores (registers) the derived information, along with the ultrasonic image obtained by the scanning with the ultrasonic probe 30, and the probe ID of the ultrasonic probe 30 in a corresponding storage area of ​​the registration information database 52D. The probe ID registration performed here only needs to be performed at the end of the first scan.

[0121] In step S112 , the CPU 51 determines whether all scans by the ultrasonic probe 30 have been completed. If the determination is negative, the process returns to step S108 .

[0122] Through the processing of steps S108 to S112 described above, information on the ultrasonic image of the substantially same region as the corresponding radiographic image is registered in the registration information database 52D.

[0123] On the other hand, when an affirmative determination is made in step S112 , that is, when all scans by the ultrasonic probe 30 are completed, the process proceeds to step S114 , and the CPU 51 stops projecting the guide image and then ends the projection process.

[0124] Furthermore, while the above projection processing is being executed, the ultrasonic image acquired by scanning with the ultrasonic probe 30 is displayed in real time on the display 54 of the console 50 as a dynamic image at approximately 10 images / second. Examples of display methods for the overlapping region of adjacent ultrasonic images include displaying only one image or displaying a weighted average of both images. Furthermore, within this method, an image identical to the projected guide image can be superimposed on the ultrasonic image and displayed on the display 54.

[0125] Meanwhile, the medical image acquisition apparatus 10 or the console 50 may include a freeze key that is pressed to switch the display state of the ultrasound image displayed on the monitor 54 between a moving image and a still image. In this case, the operation of switching the display state of the ultrasound image using the freeze key during scanning by the ultrasound probe 30 is generally as follows.

[0126] At the start of a scan, press the Default or Freeze key to set the ultrasound image display to a moving image. → Perform the first scan. → At the end of the scan, press the Freeze key to set the ultrasound image display to a still image. → Interpret the still image. → At the end of the interpretation, press the Freeze key to set the ultrasound image display to a moving image. → Perform the second scan. Repeat the Freeze key operation in the same manner until the scan is complete.

[0127] At this time, it is also possible to adopt the following method: in parallel with the above-mentioned projection processing, on a part of the display 54 of the console 50, as an example, Figure 15 As shown, a body mark 54A is displayed, and a region dividing line 70, a number 72, an arrow 74, and a scanning start line 76 having the same functions as the region dividing line 60, the number 62, and the arrow 64 described above are displayed for the body mark 54A. Figure 15 As shown, for each of the plurality of scans, a number 72 , an arrow 74 , and a scan start line 76 related to the corresponding scan may be displayed at the time when the corresponding scan is performed.

[0128] Next, refer to Figures 16 to 18 The function of the console 50 when executing the image display processing will be described. In the console 50, the CPU 51 executes the image display processing program 52B to execute the image display processing program 52B. Figure 16 The image display processing shown. The image display processing according to this embodiment is executed when a user, such as a doctor or technician, issues a start instruction via the operation unit 55 to display radiographic images and ultrasonic images acquired by the medical image acquisition apparatus 10. To avoid complication, the description herein assumes that a registration information database 52D has already been constructed and that information indicating the radiographic images to be displayed by this image display processing has already been specified.

[0129] In step S200 , the CPU 51 reads out the radiographic image indicated by the designated information (hereinafter referred to as “display target radiographic image”) and the registration information corresponding to the display target radiographic image from the registration information database 52D.

[0130] In step S202, the CPU 51 uses the read information to control the display 54 so as to display a radiographic image display screen having a preset configuration. In step S204, the CPU 51 waits until predetermined information is input. Figure 17 ] An example of a display state of the radiation image display screen according to this embodiment is shown in FIG.

[0131] like Figure 17 As shown, on the radiographic image display screen according to the present embodiment, a display target radiographic image is displayed, and a scanning region image 54B indicating a corresponding scanning region is also displayed.

[0132] Therefore, when the user wishes to display an ultrasonic image corresponding to any scan area in the displayed display target radiographic image, the user specifies the corresponding scan area via the operation unit 55. Furthermore, when the user wishes to end image display, the user specifies the end button 54D via the operation unit 55. When the user specifies any scan area or the end button 54D, step S204 is determined to be affirmative, and the process proceeds to step S206.

[0133] In step S206, the CPU 51 determines whether any scan area has been designated by the user. If the determination is positive, the process proceeds to step S208. In step S208, the CPU 51 controls the display 54 to replace the previous screen with an ultrasonic superimposed image display screen in which an ultrasonic image corresponding to the scan area designated by the user (hereinafter referred to as a "designated ultrasonic image") is superimposed on the designated scan area of ​​the display target radiographic image, and then returns to step S204. Figure 18 2 shows an example of a display state of the ultrasonic superimposed image display screen according to the present embodiment.

[0134] like Figure 18 As shown, in the ultrasonic superimposed image display screen of this embodiment, a designated ultrasonic image corresponding to a scan area designated by the user is displayed superimposed on the corresponding area of ​​the radiographic image. Therefore, by referring to the ultrasonic superimposed image display screen, the user can compare the designated ultrasonic image with the radiographic image of the area adjacent to the designated ultrasonic image.

[0135] On the other hand, if a negative determination is made in step S206 , it is deemed that the end button 54D has been designated by the user, and the process proceeds to step S210 . The CPU 51 ends the display of the image displayed at that time, and then ends the present image display process.

[0136] Alternatively, a method may be adopted in which a composite ultrasonic image is generated by synthesizing the ultrasonic images of each scan area registered in the registration information database 52D. Figure 19 and Figure 20A 、 Figure 20B , a method for generating a synthetic ultrasonic image is described. Figure 19 FIG. 1 is a diagram for explaining the synthesis of ultrasonic images according to the present embodiment. Figure 20A 、 Figure 20B It is a partially enlarged view for explaining the synthesis of ultrasonic images according to the present embodiment.

[0137] As an example, Figure 19As shown, when an ultrasonic probe 30 is used to perform multiple scans, the timing of obtaining ultrasonic images often deviates between scans due to differences in scanning speed, etc. Therefore, in this embodiment, pattern matching is performed between ultrasonic images in the overlapping region between adjacent scans, and the ultrasonic image corresponding to the overlapping region with the highest degree of consistency is determined as the ultrasonic image to be synthesized.

[0138] For example, as an example, Figure 20A As shown in FIG. 1 , when the other ultrasonic image having the highest degree of coincidence with the overlapping region of the ultrasonic image 90A corresponding to the overlapping region is the ultrasonic image 92A, the ultrasonic image 90A and the ultrasonic image 92A are synthesized. Figure 20B As shown, when the other ultrasonic image having the highest degree of coincidence in the overlapping region with one ultrasonic image 92B is ultrasonic image 90A, ultrasonic image 92B is synthesized with ultrasonic image 90A even if ultrasonic image 90A has already been synthesized with another ultrasonic image.

[0139] The synthesized ultrasonic image obtained by the above synthesis can be used to generate an image of an arbitrary cross section in the breast, a three-dimensional image, and the like.

[0140] As described above, according to this embodiment, when capturing radiographic and ultrasonic images of a breast compressed by a compression member, a guidance image, based on at least one of the scanning area and scanning direction of the ultrasonic probe, is projected onto the side of the compression member opposite to the side compressing the breast, based on the effective width, an area on the ultrasonic probe capable of transmitting and receiving ultrasonic waves, during the ultrasonic imaging process. This allows for faster ultrasound imaging of the breast compressed by the compression member compared to conventional techniques.

[0141] Furthermore, according to this embodiment, an ultrasonic image obtained by scanning with an ultrasonic probe is associated with at least one of the scanning area and scanning direction used in the scanning to obtain the ultrasonic image and stored. This allows the ultrasonic image corresponding to a position specified in the radiographic image to be displayed.

[0142] Furthermore, according to this embodiment, at least one of the actual scanning area and scanning direction is determined using the detection result of the position sensor that detects the position of the ultrasonic probe. Therefore, the user does not need to input at least one of the actual scanning area and scanning direction.

[0143] Furthermore, according to this embodiment, when the scan area is associated with the ultrasonic image and stored, a first display process is further performed to display a radiographic image corresponding to the ultrasonic image together with a scan area image, which is an image representing the scan area. Furthermore, when the user specifies a scan area represented by the scan area image displayed by the first display process, a second display process is further performed to display the ultrasonic image corresponding to the scan area. Therefore, it is possible to display an ultrasonic image corresponding to the radiographic image based on the radiographic image.

[0144] Furthermore, according to this embodiment, the scan areas corresponding to adjacent scans are determined so that the adjacent areas overlap within a predetermined range. Therefore, a single ultrasonic image can be obtained more reliably than when this overlap is not performed.

[0145] Furthermore, according to this embodiment, an image including at least one of lines, graphics, marks, and characters is used as the guide image. Therefore, a guide image based on the type of image used can be projected.

[0146] Furthermore, according to this embodiment, the guide image is projected onto the area of ​​the compression member opposite to the breast compression side and outside the ultrasound probe's scanning area. This prevents the guide image from being obscured by ultrasound probe scanning.

[0147] Furthermore, according to this embodiment, the scanning area is determined based on at least one of the width of the ultrasonic probe housing, the effective width of the ultrasonic probe, and the width of the compression member. Therefore, the scanning area can be determined using pre-acquired physical quantities.

[0148] Furthermore, according to this embodiment, the effective width is acquired at any of the following times: when the medical image acquisition guidance device (console 50) is powered on, when the ultrasound probe is installed, or when the setting for acquiring breast images is selected. Therefore, the guidance image can be projected at the appropriate time.

[0149] In the above embodiment, the CPU 51 provided in the console 50 is used as the processor of the present invention, but the present invention is not limited thereto. For example, the CPU provided in the control unit 20 of the medical image acquisition device 10 may be used as the processor of the present invention.

[0150] Furthermore, in the above embodiment, the scanning area and the number of scans performed by the ultrasonic probe 30 are determined based on the depth-direction width W of the upper surface 43A of the bottom portion 43 of the compression member 40. However, the present invention is not limited thereto. For example, the scanning area and the number of scans performed by the ultrasonic probe 30 may be determined based on the breast area determined from the radiographic image. Figure 21 This is a diagram for explaining another method of deriving the scanning area and the number of scans according to this embodiment.

[0151] like Figure 21 As shown in FIG, in this case, the scanning area and the number of scans are determined so as to scan only the area where the breast is present, rather than scanning the entire area of ​​width W. Figure 21 In the example shown, the number of scans is 3.

[0152] Furthermore, while the above embodiment describes the case where scan information is registered in the registration information database 52D, the present invention is not limited thereto. For example, scan information may be registered in a private tag of an image defined in DICOM (Digital Imaging and Communications in Medicine), a universal standard for medical images.

[0153] Furthermore, in the above-described embodiment, for example, various processors described below can be used as the hardware configuration of processing units that perform various processes, such as the probe information acquisition unit 51A, the scan information derivation unit 51B, the guide image creation unit 51C, the projection processing unit 51D, the determination unit 51E, the storage processing unit 51F, the first display processing unit 51G, and the second display processing unit 51H. As described above, these various processors include general-purpose processors, i.e., CPUs, that execute software (programs) and function as various processing units. These processors also include processors whose circuit configuration can be modified after manufacture, such as FPGAs (Field Programmable Gate Arrays), and processors with circuit configurations specifically designed to perform specific processes, i.e., dedicated circuits, such as programmable logic devices (PLDs) and ASICs (Application Specific Integrated Circuits).

[0154] A processing unit may be composed of one of these various processors, or a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Furthermore, multiple processing units may be composed of one processor.

[0155] As examples of multiple processing units composed of a single processor, there are two approaches: first, a processor composed of a combination of one or more CPUs and software, as exemplified by computers such as clients and servers, functions as multiple processing units. Second, a processor that implements the functions of a system including multiple processing units on a single IC (Integrated Circuit) chip, as exemplified by system-on-chip (SoC), is used. In this manner, various processing units are configured as hardware using one or more of the various processors described above.

[0156] Furthermore, as the hardware configuration of these various processors, more specifically, a circuit (circuitry) formed by combining circuit elements such as semiconductor elements can be used.

[0157] Furthermore, in the above embodiment, the projection processing program 52A and the image display processing program 52B are pre-stored (installed) in the storage unit 52 of the console 50, but the present invention is not limited to this. These programs may also be provided by recording them on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory device. Furthermore, these programs may also be downloaded from an external device via a network.

[0158] Based on the above description, the invention described in the following supplementary notes can be grasped.

[0159] [Note 1]

[0160] A medical image acquisition guidance device, comprising at least one processor,

[0161] The processor performs the following processing:

[0162] When capturing a radiographic image and an ultrasonic image of a breast in a state of being compressed by a compression member, when capturing the ultrasonic image, a guidance image based on at least one of a scanning area and a scanning direction of the ultrasonic probe used to capture the ultrasonic image is projected onto a side of the compression member opposite to the side compressing the breast, based on an effective width, an area on the ultrasonic probe capable of transmitting and receiving ultrasonic waves.

[0163] [Note 2]

[0164] The medical image acquisition guidance device according to Supplementary Note 1, wherein:

[0165] The processor further performs the following processing:

[0166] An ultrasonic image obtained by scanning with the ultrasonic probe is associated with at least one of the scanning region and the scanning direction in the scanning for obtaining the ultrasonic image, and is stored.

[0167] [Note 3]

[0168] The medical image acquisition guidance device according to Supplementary Note 2, wherein:

[0169] The processor determines at least one of the actual scanning area and the scanning direction using a detection result of a position sensor that detects a position of the ultrasonic probe.

[0170] [Note 4]

[0171] The medical image acquisition guidance device according to Supplement 2 or 3, wherein:

[0172] When the scan area is associated with the ultrasonic image and stored, the processor further performs a first display process of displaying the radiographic image corresponding to the ultrasonic image together with a scan area image that is an image representing the scan area.

[0173] Furthermore, when the user designates the scan region represented by the scan region image displayed by the first display process, the processor further performs a second display process of displaying the ultrasonic image corresponding to the scan region.

[0174] [Note 5]

[0175] The medical image acquisition guidance device according to any one of Supplementary Notes 1 to 4, wherein:

[0176] When scanning by the ultrasonic probe is performed in a plurality of times in order to capture a single ultrasonic image, the processor determines the scanning regions corresponding to adjacent scans so that the adjacent regions overlap within a predetermined range.

[0177] [Note 6]

[0178] The medical image acquisition guidance device according to any one of Supplementary Notes 1 to 5, wherein:

[0179] The guide image is an image including at least one of a line, a graphic, a mark, and a character.

[0180] [Note 7]

[0181] The medical image acquisition guidance device according to any one of Supplementary Notes 1 to 6, wherein:

[0182] The processor projects the guide image on a region of the compression member that is located on a side opposite to a side compressing the breast and that is excluding a scanning region of the ultrasound probe.

[0183] [Note 8]

[0184] The medical image acquisition guidance device according to any one of Supplementary Notes 1 to 7, wherein:

[0185] The processor determines the scanning area based on at least one of a width of a housing of the ultrasound probe, an effective width of the ultrasound probe, a width of the compression member, and an acquisition area of ​​an image representing a breast in the radiographic image.

[0186] [Note 9]

[0187] The medical image acquisition guidance device according to any one of Supplementary Notes 1 to 8, wherein:

[0188] The processor acquires the effective width at any one of the time when the medical image acquisition guidance device is powered on, when the ultrasonic probe is attached, and when a setting for acquiring an image representing the breast is selected.

[0189] [Note 10]

[0190] A medical image acquisition guidance system, comprising:

[0191] The medical image acquisition guidance device according to any one of Supplementary Notes 1 to 9; and

[0192] The display unit displays the radiographic image and the ultrasonic image acquired through processing by the medical image acquisition guidance device.

[0193] [Note 11]

[0194] A computer program product causes a computer to execute the following processing:

[0195] When capturing a radiographic image and an ultrasonic image of a breast in a state of being compressed by a compression member, when capturing the ultrasonic image, a guidance image based on at least one of a scanning area and a scanning direction of the ultrasonic probe used to capture the ultrasonic image is projected onto a side of the compression member opposite to the side compressing the breast, based on an effective width, an area on the ultrasonic probe capable of transmitting and receiving ultrasonic waves.

[0196] Description of Reference Numerals

[0197] 1- Medical image acquisition guidance system, 6- RIS, 10- Medical image acquisition device, 12- Arm, 14- Base, 15- Axis, 16- Imaging platform, 16A- Imaging surface, 17- Radiation irradiation unit, 17R- Radiation source, 20- Control unit, 22, 52- Storage unit, 24, 56- I / F unit, 26, 55- Operation unit, 28- Radiation detector, 30- Ultrasonic probe, 40- Compression component, 42- Compression unit, 43- Bottom, 43A- Upper surface, 43B- Contact surface, 44- Wall, 46- Support unit, 47- Mounting unit, 48- Compression unit, 49- Arm, 50- Console, 51- CPU, 51A- Probe information acquisition unit, 51B- Scanning information export unit, 51C- Guidance image creation unit, 51D- Projection processing unit, 51E- Determination unit, 51F- Storage processing unit, 5 1G-1st display processing unit, 51H-2nd display processing unit, 52-storage unit, 52A-projection processing program, 52B-image display processing program, 52C-probe information database, 52D-registration information database, 53-memory, 54-display, 54A-body mark, 54B-scanning area image, 57-image display program, 58-bus, 60-area dividing line, 62-number, 64-arrow, 66-scanning start line, 68-scanning end line, 70-area dividing line, 72-number, 74-arrow, 76-scanning start line, 80-projector, 80A-projection unit, 90A-ultrasonic image, 90B-ultrasonic image, 92A-ultrasonic image, 92B-ultrasonic image, DW-overlap width, HW-width, L1-position, Ln-position, PW-width, R-radiation line.

Claims

1. A medical image acquisition guidance device comprising a processor, The processor performs the following processing: When capturing a radiographic image and an ultrasonic image of a breast in a state of being compressed by a compression member, when capturing the ultrasonic image, a guidance image based on at least one of a scanning area and a scanning direction of the ultrasonic probe used to capture the ultrasonic image is projected onto a side of the compression member opposite to the side compressing the breast, based on an effective width, an area on the ultrasonic probe capable of transmitting and receiving ultrasonic waves.

2. The medical image acquisition guidance device according to claim 1, wherein: The processor further performs the following processing: An ultrasonic image obtained by scanning with the ultrasonic probe is associated with at least one of the scanning region and the scanning direction in the scanning for obtaining the ultrasonic image, and is stored.

3. The medical image acquisition guidance device according to claim 2, wherein: The processor determines at least one of the actual scanning area and the scanning direction using a detection result of a position sensor that detects the position of the ultrasonic probe.

4. The medical image acquisition guidance device according to claim 2 or 3, wherein: When the scan area is associated with the ultrasonic image and stored, the processor further performs a first display process of displaying the radiographic image corresponding to the ultrasonic image together with a scan area image that is an image representing the scan area. Furthermore, when the scan region indicated by the scan region image displayed by the first display process is designated by the user, the processor further performs a second display process of displaying the ultrasonic image corresponding to the scan region.

5. The medical image acquisition guidance device according to claim 1 or 2, wherein: When scanning by the ultrasonic probe is performed in a plurality of times in order to capture a single ultrasonic image, the processor determines the scanning regions corresponding to adjacent scans so that the adjacent regions overlap within a predetermined range.

6. The medical image acquisition guidance device according to claim 1 or 2, wherein: The guide image is an image including at least one of a line, a graphic, a mark, and a character.

7. The medical image acquisition guidance device according to claim 1 or 2, wherein: The processor projects the guide image on a region of the compression member that is located on a side opposite to a side compressing the breast and that is excluding a scanning region of the ultrasound probe.

8. The medical image acquisition guidance device according to claim 1 or 2, wherein: The processor determines the scanning area based on at least one of a width of a housing of the ultrasound probe, an effective width of the ultrasound probe, a width of the compression member, and an acquisition area of ​​an image representing a breast in the radiographic image.

9. The medical image acquisition guidance device according to claim 1 or 2, wherein: The processor acquires the effective width at any one of the time when the medical image acquisition guidance device is powered on, when the ultrasonic probe is attached, and when a setting for acquiring an image representing the breast is selected.

10. A medical image acquisition guidance system, comprising: The medical image acquisition guidance device according to claim 1 or 2; and A display unit displays the radiographic image and ultrasonic image acquired by the processing of the medical image acquisition guidance device.

11. A computer program product causing a computer to execute the following processing: When capturing a radiographic image and an ultrasonic image of a breast in a state of being compressed by a compression member, when capturing the ultrasonic image, a guidance image based on at least one of a scanning area and a scanning direction of the ultrasonic probe used to capture the ultrasonic image is projected onto a side of the compression member opposite to the side compressing the breast, based on an effective width, an area on the ultrasonic probe capable of transmitting and receiving ultrasonic waves.

Images