Information processor, image generation system, and program

Abstract

To provide an information processor capable of performing processing utilizing a difference in property of lesion between the state of being compressed by a compression member and the state of not being compressed thereby, an image generation system, and a program.SOLUTION: A console 50 comprises an estimation part 60 that estimates a property relating to a lesion in the state of not being compressed by a compression member, on the basis of the result of measurement for the lesion of the breast in the state of making the breast compressed by the compression member, when a radiation image and an ultrasonic image are taken for the breast in the state of being compressed by the compression member.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an image generation system, and a program. [Background technology]

[0002] Patent document 1 discloses a medical imaging system that, when X-ray and ultrasound examinations are performed as separate examinations of the same subject part, enables the ultrasound examination examiner to easily and accurately recognize the position in the subject part that corresponds to the area of ​​interest on the medical image obtained in the X-ray examination.

[0003] The medical imaging system includes a display means for displaying one or more medical images obtained by X-ray imaging of a subject part, a designation means for designating an area of ​​interest from the medical image, and a derivation means for deriving a deformation amount caused by compression of the subject part during imaging, which corresponds to the position of the area of ​​interest in the medical image.The medical imaging system also includes an estimation means for estimating a position of the area of ​​interest when the subject part is viewed from the front based on an angle at which an X-ray imaging device is tilted when the medical image is captured, the position of the area of ​​interest in the medical image, and the deformation amount caused by compression of the subject part during imaging, which corresponds to the position of the area of ​​interest, a generation means for generating estimated clinical position information indicating the position of the area of ​​interest when the subject part is viewed from the front, which is estimated by the estimation means, and a display control means for displaying the generated estimated clinical position information on the display means.

[0004] Furthermore, Patent Document 2 discloses a medical imaging device that images the mammary glands and breasts while compressing the breast with a compression plate, and aims to clarify tumor areas by imaging the elastic properties within the tissue.

[0005] The medical imaging device includes an imaging table on which a subject is placed, a compression plate having a first surface for compressing the subject and a second surface opposite to the first surface, and compressing the subject between the imaging table and the compression plate moving mechanism for moving the compression plate in a first direction substantially perpendicular to the first surface or a second direction substantially parallel to the first surface. The medical imaging device also includes a first means for generating radiation or ultrasound, detecting the radiation that has passed through the subject or the ultrasound reflected by the subject to generate a signal, and a second means for controlling the compression plate moving mechanism so that the compression plate compresses the subject in the first direction between the imaging table and the compression plate, and controlling the compression plate moving mechanism so that the compression plate vibrates the subject in the second direction, and generating an image signal representing an image of the subject based on the signal generated by the first means.

[0006] Furthermore, Patent Document 3 discloses an ultrasonic diagnostic device that aims to provide information on the degree of variation in displacement of various parts of a living body in response to a compression force, thereby further improving the accuracy and reliability of tissue differentiation.

[0007] This ultrasonic diagnostic apparatus includes a transmitting means for repeatedly scanning an ultrasonic beam on a subject, a receiving means for receiving a reflected echo signal of the ultrasonic beam from the subject, and a frame data acquiring means for acquiring frame data consisting of the reflected echo signal corresponding to a scanning plane of the ultrasonic beam as the pressure in the subject changes.The ultrasonic diagnostic apparatus also includes a displacement measuring means for determining displacements at a plurality of measurement points on the scanning plane based on a pair of the frame data acquired at different times, a displacement variation image generating means for generating a displacement variation image showing the degree of variation in the displacements at the measurement points, and a display means for displaying the displacement variation image. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2016-59743 A [Patent Document 2] JP 2009-178185 A [Patent Document 3] JP 2006-305160 A Summary of the Invention [Problem to be solved by the invention]

[0009] When the breast is compressed by a compression member, the properties of a lesion present in the breast change compared to when the breast is not compressed.

[0010] However, the techniques described in Patent Documents 1 to 3 do not take into account the difference in the characteristics of a lesion when compressed and when not compressed, and therefore have the problem that they cannot perform processing that utilizes the difference in characteristics.

[0011] The present disclosure has been made in consideration of the above circumstances, and aims to provide an information processing device, an image generation system, and a program that can perform processing utilizing the difference in the characteristics of a lesion when compressed and when not compressed by a compression member. [Means for solving the problem]

[0012] In order to achieve the above object, an information processing device of a first aspect of the present disclosure includes at least one processor, which, when taking radiological images and ultrasound images of a breast compressed by a compression member, infers characteristics of a lesion when not compressed by a compression member based on measurement results of a lesion in the breast when the breast is compressed by the compression member.

[0013] An information processing device of a second aspect of the present disclosure is the information processing device of the first aspect, wherein the measurement result is the size of the lesion when the breast is compressed by a compression member, and the property is the size of the lesion when not compressed.

[0014] An information processing device of a third aspect of the present disclosure is an information processing device of the second aspect, in which a processor performs processing to assist in categorizing the tumor using the estimated size of the tumor when not compressed, when the lesion is a tumor.

[0015] An information processing device of a fourth aspect of the present disclosure is the information processing device of the second or third aspect, in which the processor estimates the size of the lesion in a non-compressed state in three mutually intersecting directions.

[0016] An information processing device of a fifth aspect of the present disclosure is an information processing device of the second or third aspect, in which a processor estimates the size of the lesion when not compressed when the size of the lesion is equal to or greater than a predetermined threshold.

[0017] An information processing device of a sixth aspect of the present disclosure is an information processing device of the first aspect, in which the measurement result is a measurement result of how the lesion deforms when the compression pressure applied by the compression member is changed, and the property is at least one of the size of the lesion when not compressed and a state indicating whether the lesion is liquid or not.

[0018] An information processing device according to a seventh aspect of the present disclosure is the information processing device according to the sixth aspect, wherein the change in compression pressure is performed at a location where a lesion is suspected.

[0019] In order to achieve the above object, an image generation system according to an eighth aspect of the present disclosure includes the information processing device according to the first aspect, and an image generation device that generates an image used in the information processing device.

[0020] In addition, in order to achieve the above-mentioned object, the program of the ninth aspect of the present disclosure causes a computer to execute a process in which, when radiological images and ultrasound images are taken of a breast compressed by a compression member, the characteristics of a lesion in the breast when it is not being compressed by a compression member are inferred based on the measurement results of the lesion in the breast when the breast is compressed by the compression member. Effect of the Invention

[0021] According to the present disclosure, it is possible to carry out processing that utilizes the difference in the properties of a lesion when compressed by a compression member and when not compressed. [Brief description of the drawings]

[0022] [Figure 1] FIG. 1 is a diagram illustrating an example of a schematic configuration of an image generating system according to an embodiment. [Diagram 2] FIG. 1 is a side view illustrating an example of an appearance of an image generating device according to an embodiment. [Diagram 3] 1A to 1C are three orthogonal views illustrating an example of a schematic configuration of a compression member according to an embodiment. [Figure 4] 1A to 1C are three orthogonal views illustrating an example of a schematic configuration of a compression member according to an embodiment. [Diagram 5] FIG. 2 is a block diagram showing an example of a hardware configuration of a console according to the embodiment. [Figure 6] FIG. 2 is a block diagram showing an example of a functional configuration of a console according to the embodiment. [Figure 7] FIG. 1 is a schematic diagram for explaining category classification of tumor masses according to an embodiment. [Figure 8] FIG. 4 is a schematic diagram showing an example of the configuration of a correction coefficient database according to the first embodiment. [Figure 9] 5 is a flowchart showing an example of information processing according to the first embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a first size display screen according to the embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a second size display screen according to the embodiment. [Figure 12] 10 is a flowchart showing an example of information processing according to the second embodiment. [Figure 13] FIG. 13 is a diagram for explaining a method for deriving the size of a tumor mass when no compression is applied according to the second embodiment, and shows an example of the storage result of the size of a tumor mass when the compression pressure applied by a compression member is reduced. [Figure 14] FIG. 13 is a diagram showing an example of a first size display screen according to a modified example of the embodiment. [Figure 15] FIG. 13 is a schematic diagram showing an example of a configuration of a correction coefficient database according to a modified example of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0024] [First embodiment] First, the configuration of an image generation system 1 to which the technology of the present disclosure is applied will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of a schematic configuration of an image generation system 1 according to the present embodiment.

[0025] 1, the image generation system 1 includes an image generation device 10 and a console 50. The image generation device 10 and the console 50, and the console 50 and an external RIS (Radiology Information System) 6 are configured to be connectable via a wired or wireless network.

[0026] In the image generating system 1 according to this embodiment, the console 50 acquires an imaging order and the like from the RIS 6, and controls the image generating device 10 in accordance with the imaging order and user instructions and the like. The image generating device 10 captures a radiological image by irradiating radiation R onto a breast compressed between an imaging table 16 and a compression member 40, both of which will be described later. The image generating device 10 also acquires an ultrasound image of the breast in a compressed state via the compression member 40.

[0027] Next, a schematic configuration of the image generating device 10 according to this embodiment will be described with reference to Fig. 2. Fig. 2 is a side view showing an example of the appearance of the image generating device 10 according to this embodiment, and is a view of the image generating device 10 as seen from the right side of the subject. As shown in Fig. 2, the image generating device 10 includes a radiation source 17R, a radiation detector 28, an imaging table 16 arranged between the radiation source 17R and the radiation detector 28, a compression member 40 that compresses the breast between the imaging table 16, and an ultrasonic probe 30. In the image generating device 10, the subject's breast is positioned on the imaging surface 16A of the imaging table 16 by a user such as a doctor or an engineer.

[0028] The image generating device 10 includes an arm unit 12, a base 14, and a shaft unit 15. The arm unit 12 is held by the base 14 so as to be movable in the up-down direction (Z direction). The shaft unit 15 connects the arm unit 12 to the base 14. The arm unit 12 is rotatable relative to the base 14 around the shaft unit 15 as a rotation axis. Furthermore, the arm unit 12 may be configured such that an upper portion including a radiation irradiation unit 17 and a lower portion including an imaging stand 16 are rotatable relative to the base 14 around the shaft unit 15 as a rotation axis, separately.

[0029] The arm 12 includes a radiation irradiator 17 and an imaging stand 16. The radiation irradiator 17 includes a radiation source 17R and is configured to be able to change the irradiation field of radiation (e.g., X-rays) irradiated from the radiation source 17R. The irradiation field may be changed, for example, by a user operating the operation unit 26, or may be changed by the control unit 20 depending on the type of the attached compression member 40.

[0030] The imaging stand 16 includes a control unit 20, a memory unit 22, an I / F (Interface) unit 24, an operation unit 26, and a radiation detector 28. The control unit 20 controls the overall operation of the image generating device 10 under the control of a console 50. The control unit 20 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. (not shown). The ROM stores various programs in advance, including a program executed by the CPU for controlling the generation of radiological images and ultrasonic images. The RAM temporarily stores various data.

[0031] Data of radiological images and ultrasound images, various other information, etc. are stored in the storage unit 22. The storage unit 22 is realized by a storage medium such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory.

[0032] The I / F unit 24 communicates various information with the console 50 via wired communication or wireless communication. Specifically, the I / F unit 24 receives information related to the control of the image generating device 10 from the console 50. In addition, the I / F unit 24 transmits data of radiological images and ultrasound images to the console 50.

[0033] The operation unit 26 is a part provided on the imaging stand 16 or the like that can be operated by the user with the hands or feet, and is, for example, a switch, a button, a touch panel, or the like.

[0034] The radiation detector 28 is disposed inside the imaging table 16, detects radiation R that has passed through the breast and the imaging table 16, generates a radiographic image based on the detected radiation R, and outputs image data representing the generated radiographic image. The type of radiation detector 28 is not particularly limited, and may be, for example, an indirect conversion type radiation detector that converts radiation R into light and then converts the converted light into an electric charge, or a direct conversion type radiation detector that directly converts radiation R into an electric charge.

[0035] Further, a probe unit 38 and a compression unit 48 are connected to the arm portion 12. A support portion 36 that detachably supports the ultrasonic probe 30 is attached to the probe unit 38. The support portion 36 (ultrasonic probe 30) is moved in the vertical and horizontal directions (X-, Y-, and Z-directions) by a drive portion (not shown) provided in the probe unit 38. The support portion 36 is preferably formed of a material that transmits radiation R.

[0036] The ultrasonic probe 30 is for obtaining an ultrasonic image of the breast compressed by the compression member 40, and is disposed between the radiation source 17R and the compression member 40, irradiating the breast with ultrasonic waves via the compression member 40 and receiving waves reflected from the breast. The probe unit 38 also includes a converter (not shown) that converts the waves reflected from the breast received by the ultrasonic probe 30 into an ultrasonic image, and the ultrasonic image is obtained by the converter.

[0037] Specifically, the ultrasonic probe 30 includes an ultrasonic transducer array. The ultrasonic transducer array is configured such that a plurality of ultrasonic transducers are arranged one-dimensionally or two-dimensionally. The ultrasonic transducer may be formed by forming electrodes on both ends of a piezoelectric body such as, for example, a piezoelectric ceramic represented by lead zirconate titanate (PZT), a piezoelectric single crystal represented by lead magnesium niobate-lead titanate (PMN-PT), or a polymeric piezoelectric element represented by polyvinylidene difluoride (PVDF). For example, the ultrasonic transducer may be a capacitive micro-machined ultrasonic transducer (CMUT).

[0038] Furthermore, the image generating device 10 may be configured so that a plurality of different types of ultrasonic probes 30 can be attached interchangeably. Specifically, ultrasonic probes 30 with different performance and dimensions may be attached according to the subject's physique (e.g., breast size), breast tissue composition (e.g., fat mass and mammary gland mass), and type of imaging (e.g., magnified imaging and spot imaging). For example, a linear probe (for superficial, etc.) with a center frequency of about 7.5 MHz, a convex probe (for abdominal, etc.) with a center frequency of about 3.5 MHz, and a sector probe (for cardiac, etc.) with a center frequency of about 2.5 MHz may be used.

[0039] A support part 46 that supports the compression member 40 is detachably attached to the compression unit 48. The support part 46 (compression member 40) is moved in the up-down direction (Z direction) by a drive part (not shown) provided in the compression unit 48.

[0040] The compression member 40 is disposed between the radiation source 17R and the imaging table 16, and puts the breast into a compressed state by sandwiching the breast between the radiation source 17R and the imaging table 16. Fig. 3 shows three views of an example of the compression member 40. The three views in Fig. 3 include a top view of the compression member 40 seen from above (the radiation irradiation unit 17 side), a side view seen from the subject side, and a side view seen from the right side of the subject. As shown in Fig. 3, the compression member 40 includes a compression section 42 and a support section 46.

[0041] The support portion 46 includes an attachment portion 47 and an arm 49. The attachment portion 47 attaches the compression member 40 to the image generating device 10, specifically, to a drive portion of a compression unit 48. The arm 49 supports the compression portion 42.

[0042] The compression unit 42 has a generally flat bottom 43 surrounded by walls 44 of generally uniform height, and has a concave cross-sectional shape. The compression unit 42 is preferably made of an optically transparent or translucent material in order to confirm the positioning and compression state during breast compression. The compression unit 42 is also preferably made of a material that is highly transmissive to radiation R and ultrasound. The compression unit 42 is also preferably made of a material that is highly strong, for example in terms of drop strength and compression strength.

[0043] Examples of such materials that can be used include resins such as polymethylpentene (PMP), polycarbonate (PC), acrylic, polypropylene (PP), and polyethylene terephthalate (PET). In particular, polymethylpentene has an acoustic impedance that affects the transmittance and reflectance of ultrasonic waves that is closer to that of the human body (breast) than other materials, and can reduce the proportion of noise that is imparted to ultrasonic images. Therefore, polymethylpentene is suitable as the material for the compression portion 42.

[0044] Moreover, the image generating device 10 may be configured so that a plurality of different types of compression members 40 can be attached interchangeably. Specifically, compression members 40 of different materials, sizes, and shapes may be attached depending on the subject's physique (e.g., breast size), breast tissue composition (e.g., fat mass and mammary gland mass), and type of imaging (e.g., magnification imaging and spot imaging). For example, a compression member according to the size of the breast, a compression member for axillary imaging, a compression member for magnification imaging, and a compression member for so-called spot imaging that captures a radiographic image of only an area where a lesion is present may be used. That is, the compression member 40 is not limited to one that compresses the entire breast, and may be one that is smaller than the breast and compresses only a part of the breast.

[0045] FIG. 4 shows a three-view diagram of a compression member 40S for small breasts as an example of another form different from the compression member 40 in FIG. 3. The three-view diagram in FIG. 4 includes a top view of the compression member 40S as seen from above (the radiation irradiation unit 17 side), a side view as seen from the subject side, and a side view as seen from the right side of the subject. The compression member 40S includes a compression section 42 and a support section 46, similar to the compression member 40 in FIG. 3. In the compression member 40S, the bottom section 43 is not flat, and the attachment section 47 side is higher than the chest wall side (the side away from the attachment section 47). In addition, the wall section 44 does not have a uniform height, and the height of a part on the chest wall side is lower than the height of the other parts. Due to this shape, the compression member 40S makes it easy to position and compress even small breasts.

[0046] In this manner, at least one of the compression member 40 for compressing the breast and the ultrasonic probe 30 for acquiring ultrasonic images can be made detachable in the image generating device 10. In this case, the image generating device 10 may detect the type of the compression member 40 and the ultrasonic probe 30 that are attached.

[0047] For example, a plurality of pins, the arrangement of which differs for each type of compression member 40, may be provided on the attachment portion 47 of the compression member 40 as identification information, and the identification information may be read by a sensor (e.g., a photointerrupter) that is provided on the compression unit 48 and is capable of detecting the arrangement of the pins. Also, for example, a marker (e.g., a barcode, a two-dimensional code, etc.) that corresponds to the type of compression member 40 may be provided at an arbitrary position on the compression member 40 as identification information, and the identification information may be read by a sensor (e.g., a CCD (Charge Coupled Device) sensor, etc.) that can detect the marker.

[0048] Also, for example, a radio frequency identification (RFID) tag having identification information according to the type of compression member 40 may be provided at an arbitrary position of the compression member 40, and the identification information may be read by an RFID reader capable of reading the RFID tag. Also, for example, the weight of each type of compression member 40 may be associated with the identification information and stored in advance in the storage unit 22, the weight of the attached compression member 40 may be measured by a sensor capable of detecting the weight, and the identification information (type of compression member 40) may be specified based on the measured value.

[0049] Similarly, for the ultrasonic probe 30, the type of the attached ultrasonic probe 30 may be identified according to, for example, a pin, a marker, an RFID tag, weight, or the like.

[0050] Furthermore, the image generating device 10 detects the compression pressure applied to the breast by the compression member 40. For example, when the compression member 40 compresses the breast, a reaction force equal to the compression pressure is applied to the drive section of the compression member 40. Using this, a strain gauge (e.g., a load cell or the like) that detects the reaction force applied to the drive section may be provided in the compression unit 48, and the reaction force detected by the strain gauge may be detected as the compression pressure. Alternatively, for example, a semiconductor pressure sensor, a capacitance pressure sensor, or the like may be used to detect the compression pressure. Alternatively, for example, various sensors that detect the compression pressure may be provided on the compression member 40 side instead of on the compression unit 48 side.

[0051] Furthermore, the image generating device 10 detects the distance (hereinafter referred to as "compression thickness") between the imaging surface 16A of the imaging table 16 and the contact surface 43B of the bottom 43 of the compression portion 42 of the compression member 40 when the compression member 40 is compressing the breast. For example, the compression thickness may be detected using a distance sensor using laser light, ultrasonic waves, or the like. Alternatively, the compression thickness may be detected from the position of the support portion 46 in the vertical direction.

[0052] In addition, a gel or liquid medium having ultrasonic transmission properties may be applied to the upper surface 43A of the bottom part 43 of the compression member 40 and / or the contact surface 43B with the breast. For example, a known jelly for ultrasonic examination having an acoustic impedance close to that of the human body (breast) may be applied as such a medium. That is, the image generating device 10 may acquire an ultrasonic image of the breast compressed by the compression member 40 in a state in which the gel or liquid medium having ultrasonic transmission properties is applied thereto, via the compression member 40. In this case, it is possible to suppress the intrusion of air into the interface between the ultrasound emission surface of the ultrasonic probe 30 and the upper surface 43A and / or the interface between the contact surface 43B and the breast, and it is possible to reduce the difference in acoustic impedance at each interface, thereby reducing the proportion of noise imparted to the ultrasonic image.

[0053] The imaging method of the breast by the image generating device 10 is not particularly limited. For example, it may be cranio-caudal (CC) imaging, medio-lateral oblique (MLO) imaging, magnified imaging and spot imaging for imaging a part of the breast. CC imaging is a method of imaging the breast in a compressed state by sandwiching the breast between the imaging table 16 and the compression member 40 in the vertical direction (Z direction). MLO imaging is a method of imaging the breast in a compressed state including the axillary part by sandwiching the breast between the imaging table 16 and the compression member 40 with the arm unit 12 tilted so that the rotation angle with respect to the base 14 is equal to or greater than 45 degrees and less than 90 degrees.

[0054] Furthermore, for example, the image generating device 10 may perform tomosynthesis imaging. In tomosynthesis imaging, radiation R is irradiated from the radiation source 17R toward the breast from a plurality of irradiation positions each having a different irradiation angle, and a plurality of radiation images of the breast are captured. That is, in tomosynthesis imaging, the angles of the imaging table 16, the compression member 40, the breast, etc. are kept fixed, and imaging is performed by changing the rotation angle of the radiation irradiator 17 relative to the base 14.

[0055] In addition, the image generating device 10 may be capable of positioning the subject's breasts not only when the subject is standing (standing position), but also when the subject is sitting in a chair, wheelchair, etc. (sitting position).

[0056] The console 50 sets an upper limit of the compression pressure applied to the breast by the compression member 40 according to the type of compression member 40 attached to the image generating device 10. The console 50 also controls the image generating device 10 so as to acquire a radiographic image according to the imaging order acquired from the RIS 6 and a user's instruction, etc. The console 50 also controls the position of the ultrasound probe 30 so as to acquire an ultrasound image in accordance with the position of the region of interest included in the radiographic image captured by the image generating device 10.

[0057] As described above, the image generating device 10 according to this embodiment has the probe unit 38 provided between the radiation emitting section 17 and the compression unit 48, and can acquire both radiographic and ultrasonic images while the breast is compressed by the compression member 40. This makes it easy to align these images, and can improve the ability to differentiate and determine lesions by displaying both images superimposed on each other, for example.

[0058] Next, the console 50 according to the present embodiment will be described.

[0059] An example of a hardware configuration of the console 50 will be described with reference to Fig. 5. As shown in Fig. 5, the console 50 includes a CPU 51, a non-volatile storage unit 52, and a memory 53 as a temporary storage area. The console 50 also includes a display 54 such as a liquid crystal display, an operation unit 55 such as a touch panel, a keyboard, and a mouse, and an I / F unit 56. The I / F unit 56 performs wired or wireless communication with the image generating device 10, the RIS 6, and other external devices. The CPU 51, the storage unit 52, the memory 53, the display 54, the operation unit 55, and the I / F unit 56 are connected to each other via a bus 58 such as a system bus and a control bus so that they can exchange various information with each other.

[0060] The storage unit 52 is realized by a storage medium such as an HDD, an SSD, or a flash memory. An information processing program 52A is stored in the storage unit 52. The CPU 51 reads out the information processing program 52A from the storage unit 52, deploys it in the memory 53, and executes the deployed information processing program 52A. As the console 50, for example, a personal computer, a server computer, a smartphone, a tablet terminal, a wearable terminal, or the like can be appropriately applied.

[0061] Furthermore, a correction coefficient database 52B is stored in the storage unit 52. The correction coefficient database 52B will be described in detail later.

[0062] Furthermore, the storage unit 52 stores image data of radiographic images and ultrasound images acquired by the image generating device 10, as well as various other information. The image data of radiographic images and ultrasound images may be stored in association with at least one of an imaging order and imaging information. The imaging information may be, for example, at least one of subject information and imaging type included in the imaging order, photographer information indicating the photographer who performed the imaging (e.g., a user such as a doctor or technician), and date and time information indicating the date and time when the imaging was performed.

[0063] Next, an example of a functional configuration of the console 50 will be described with reference to Fig. 6. As shown in Fig. 6, the console 50 includes an estimation unit 60, a process execution unit 62, and a display control unit 64. The CPU 51 executes the information processing program 52A, so that the CPU 51 functions as the estimation unit 60, the process execution unit 62, and the display control unit 64.

[0064] In the case where radiological images and ultrasonic images are taken of the breast compressed by the compression member 40, the estimation unit 60 according to this embodiment estimates the characteristics of the lesion when the breast is not compressed by the compression member 40 (hereinafter simply referred to as "when not compressed") based on the measurement results of the lesion in the breast when the breast is compressed by the compression member 40 (hereinafter also referred to as "when compressed"). Then, the display control unit 64 according to this embodiment controls the display 54 to display a screen according to the estimation results by the estimation unit 60. Note that, in this embodiment, a mass is applied as the target lesion, but this is not limited thereto. For example, various lesions other than masses such as calcification and spicules may be applied as the target lesion.

[0065] Incidentally, the developers of the technology disclosed herein have found that as the compression pressure on the breast increases, the size of the lesion during compression becomes larger in the horizontal direction (the direction intersecting the direction in which compression pressure is applied) and smaller in the vertical direction (the direction in which compression pressure is applied) compared to the size of the lesion during non-compression.

[0066] Therefore, in this embodiment, the size of the lesion when compressed is applied as the measurement result, and the size of the lesion when not compressed is applied as the property. That is, the estimation unit 60 according to this embodiment estimates the size of the lesion when not compressed based on the size of the lesion in the breast when compressed. In this embodiment, in order to estimate the size of the lesion when not compressed, a correction coefficient, which will be described in detail later, is applied, which can be multiplied by the size of the lesion measured when compressed to obtain the size of the lesion when not compressed.

[0067] Furthermore, in the case where the lesion is a tumor mass, the processing execution unit 62 according to this embodiment executes processing to assist in categorizing the tumor mass using the estimated size of the tumor mass when not compressed (hereinafter referred to as "category classification assistance processing"). That is, currently, in the case where a tumor mass is detected in the breast, the tumor mass is categorized according to the schematic diagram shown in FIG. 7 as an example. Note that FIG. 7 is a schematic diagram for explaining the categorization of tumor masses according to this embodiment, and is taken from the Ultrasound Guideline "Determining Benign or Malignant from US Findings of Tumor-Forming Lesions" compiled by the Japan Association of Breast and Thyroid Ultrasound (JABTS).

[0068] Tumors are classified into five categories, from Category 1 to Category 5, with Category 1 being no abnormality, Category 2 being benign, Category 3 being benign but malignancy cannot be ruled out (probability of cancer is 5% to 10%), Category 4 being suspected of being malignant (probability of cancer is 30% to 50%), and Category 5 being malignant (probability of cancer is almost 100%).

[0069] As described above, the estimation unit 60 according to this embodiment estimates the size of the lesion when no compression is performed. Therefore, when the lesion is a tumor, the process execution unit 62 according to this embodiment executes a category classification support process using the size of the tumor estimated by the estimation unit 60 in accordance with the category classification shown in Fig. 7 as an example.

[0070] As shown in Figure 7 as an example, in order to categorize a tumor, some items such as the state of rupture of the tumor border, which require a doctor's judgment, are also necessary. Therefore, in the category classification support process of this embodiment, the doctor is asked to input such items to determine the final category.

[0071] In this embodiment, the measurement result is the result of measuring how the lesion is deformed by changing the compression pressure applied by the compression member 40, and the property is a state indicating whether the lesion is liquid or not. Furthermore, in this embodiment, the change in compression pressure is performed at a position where a lesion is suspected.

[0072] That is, a tumor is filled with cells and has a relatively high rigidity. In contrast, liquids such as cysts have a characteristic of being less rigid than a tumor. In this embodiment, the estimation unit 60 estimates whether the lesion is liquid or not by estimating the rigidity of the lesion from the deformation of the lesion (in this embodiment, the amount of change in size of the lesion) when the compression pressure applied by the compression member 40 is changed, and then estimates whether the lesion is liquid or a tumor based on the rigidity.

[0073] The estimation unit 60 according to this embodiment estimates the size of the lesion when it is not compressed, when the size of the lesion is equal to or larger than a predetermined threshold. That is, as a result of intensive studies by the developers of the technology disclosed herein, it has been found that the amount of change in size of the lesion when compressed from when it is not compressed increases as the lesion becomes larger. Therefore, the estimation unit 60 according to this embodiment estimates the size of the lesion when it is not compressed from the size of the lesion when it is compressed only when the size of the lesion (in this embodiment, the larger of the horizontal size and the vertical size) is equal to or larger than a predetermined threshold.

[0074] 7, the concern when the lesion is a tumor is that the size of the tumor when uncompressed is 5 mm or more, which may be in the range of category 3 to category 5. Therefore, the threshold value of 5 mm is applied in this embodiment, but is not limited thereto. For example, the threshold value may be appropriately input by the user depending on the condition of the image generating device 10, the condition of the subject, etc.

[0075] Next, the correction coefficient database 52B according to this embodiment will be described with reference to Fig. 8. Fig. 8 is a schematic diagram showing an example of the configuration of the correction coefficient database 52B according to this embodiment.

[0076] The correction coefficient database 52B according to the present embodiment is a database in which information indicating the above-mentioned correction coefficients used when estimating the size of a lesion when not compressed from the size of the lesion when compressed is registered. As an example, as shown in Fig. 8, the correction coefficient database 52B according to the present embodiment stores information on the compression pressure, the compression thickness, and the correction coefficients in association with each other.

[0077] The compression pressure and the compression thickness are information indicating the compression pressure and compression thickness, respectively. The correction coefficient is information indicating a coefficient for converting the size of a lesion (a tumor in this embodiment) into the size in a non-compressed state when the compression member 40 compresses the breast to the corresponding compression pressure and compression thickness.

[0078] As shown in Fig. 8, in this embodiment, the correction coefficients are registered corresponding to two directions, the horizontal direction and the vertical direction of the mass. For example, when the compression pressure on the breast is 40N and the compression thickness is 60mm, the horizontal size of the mass is multiplied by 0.98 and the vertical size is multiplied by 1.01 to obtain the horizontal and vertical sizes when not compressed.

[0079] In the image generating system 1 according to this embodiment, in order to obtain the correction coefficients to be registered in the correction coefficient database 52B, for example, the horizontal and vertical sizes of the tumor mass when the actual breast is not compressed and when it is compressed that have been obtained in the past are accumulated, and these values ​​are used to obtain the correction coefficients for each direction.

[0080] Next, the operation of the console 50 according to this embodiment will be described with reference to FIG. 9. In the console 50, the CPU 51 executes the information processing program 52A, thereby executing the information processing shown in FIG. 9. This information processing is executed, for example, when a user issues an instruction to start execution via the operation unit 55. In addition, in order to avoid confusion, a correction coefficient database 52B has already been constructed, and information indicating the compression pressure and compression thickness at the time of capturing a radiation image of the breast (hereinafter referred to as "setting information") is acquired from the RIS by the console 50. In addition, in this embodiment, a case will be described in which a user such as a doctor or technician positions a subject's breast (hereinafter referred to as a "target breast") on the imaging surface 16A of the imaging table 16, an appropriate ultrasonic probe 30 is attached to the probe unit 38, and the probe unit 38 is positioned at a predetermined initial position at the start of a scan (in this embodiment, horizontal movement).

[0081] In step S10, the CPU 51 instructs the image generating device 10 to start compressing the target breast with the compression member 40 by instructing the image generating device 10 to make the compression pressure and compression thickness by the compression member 40 become values ​​indicated by the setting information. In step S12, the CPU 51 waits until the compression of the target breast by the compression member 40 is completed (the compression pressure and compression thickness become values ​​indicated by the setting information). Through the above processing, the compression state of the target breast by the compression member 40 becomes the compression state.

[0082] In step S14, the CPU 51 controls the image generating device 10 to capture a radiographic image. Through this control, the image generating device 10 captures a radiographic image of the target breast compressed by the compression member 40 in the state indicated by the setting information, and generates image data indicating the radiographic image obtained by the radiographic image capture. As described above, various information required for capturing the radiographic image at this time is obtained from the RIS.

[0083] In step S16, the CPU 51 controls the image generating device 10 to capture an ultrasound image. By this control, the image generating device 10 starts scanning with the ultrasound probe 30, captures an ultrasound image, and starts displaying the ultrasound image obtained by the capture in real time on the display 54. In response to this display, the user refers to the displayed ultrasound image, and when the position of the ultrasound probe 30 becomes a noteworthy position such as a position where something that is likely to be a tumor (hereinafter referred to as a "pseudo tumor") is reflected in the center of the ultrasound image, inputs instruction information to stop the scan of the ultrasound probe 30 via the operation unit 55, etc. Here, although there are cases where the pseudo tumor is not reflected in the ultrasound image, the case where the pseudo tumor is reflected in the ultrasound image will be described below for convenience.

[0084] Therefore, in step S18, the CPU 51 waits until the instruction information is input, and in step S20, the CPU 51 acquires the horizontal and vertical sizes of the temporary mass (hereinafter referred to as "compressed size") and stores the acquired sizes in the storage unit 52. In this embodiment, the compressed size of the temporary mass is acquired by having the user specify the positions of the horizontal and vertical end points of the temporary mass with respect to the ultrasound image displayed on the display 54 at this time, and the CPU 51 derives the distance between the specified positions. However, this is not limited to the above embodiment, and for example, the CPU 51 may extract the temporary mass from the ultrasound image displayed on the display 54 at this time using pattern matching or an image extraction model previously machine-learned to derive the compressed size, thereby automatically acquiring the compressed size.

[0085] In step S22, the CPU 51 controls the image generating device 10 to release the compression state by the compression member 40 and change the compression pressure on the target breast to a predetermined lower limit value (hereinafter referred to as "decompression"). By this decompression, the compression pressure on the target breast by the compression member 40 is gradually reduced from the compression pressure indicated by the setting information (50 N in this embodiment) to the lower limit value of the compression pressure (20 N in this embodiment).

[0086] Therefore, in step S24, the CPU 51 waits until the decompression is completed, and in step S26, the CPU 51 acquires the size of the provisional tumor at this point (hereinafter, referred to as the "size at the time of decompression") in the same manner as in the process of step S20.

[0087] In step S28, the CPU 51 uses the compressed size and the decompressed size to determine whether the provisional mass is a mass as described above, and if the determination is affirmative, proceeds to step S30. In this embodiment, if the difference between the horizontal size of the compressed size and the horizontal size of the decompressed size is equal to or less than a predetermined threshold value (0.5 mm, for example), the provisional mass is determined to be a mass, but this is not limiting. For example, if the difference between the vertical size of the compressed size and the vertical size of the decompressed size is equal to or less than the threshold value, the provisional mass may be determined to be a mass.

[0088] In step S30, the CPU 51 determines whether the compressed size (in this embodiment, the larger of the horizontal size and the vertical size) is equal to or larger than a predetermined size, and proceeds to step S32 if the determination is affirmative. Note that in this embodiment, the predetermined size is 4.17 mm (=5 / 1.2), assuming that the compressed size is obtained when the non-compressed size is 5 mm or more and the maximum correction coefficient is 1.2. However, it goes without saying that the present invention is not limited to this embodiment.

[0089] In step S32, the CPU 51 executes a process of correcting the compressed size to the non-compressed size. At this time, the CPU 51 reads out the horizontal and vertical correction coefficients corresponding to the compression pressure and compression thickness indicated by the setting information, i.e., the compression pressure and compression thickness when obtaining the compressed size, from the correction coefficient database 52B. Then, the CPU 51 multiplies the horizontal size and vertical size of the compressed size by the corresponding correction coefficients, thereby deriving the corrected tumor size, i.e., the non-compressed tumor size.

[0090] In step S34, the CPU 51 controls the display 54 to display a first size display screen having a predetermined configuration using the tumor mass size when compressed and the tumor mass size when not compressed derived by the process of step S32, and then proceeds to step S38. An example of the first size display screen according to this embodiment is shown in FIG.

[0091] As shown in Fig. 10, the first size display screen according to this embodiment displays an ultrasound image (both horizontal and vertical cross-sectional images in the example shown in Fig. 10) at the time when decompression is completed. Also, the first size display screen according to this embodiment displays the size when compressed and the size of the tumor mass after correction by the correction coefficient, i.e., the size of the tumor mass when not compressed, separately in the horizontal and vertical directions. Note that in Fig. 10, the size when compressed is displayed as "distance".

[0092] As shown in FIG. 10, the size of the tumor mass when not compressed is smaller in the horizontal direction than when compressed, and is larger in the vertical direction than when compressed.

[0093] On the other hand, if the determination in step S28 is negative, or if the determination in step S30 is negative, the process proceeds to step S36, where the display 54 is controlled to display a second size display screen having a predetermined configuration, and then the process proceeds to step S38. Fig. 11 shows an example of the second size display screen according to this embodiment.

[0094] As shown in Fig. 11, the second size display screen according to this embodiment displays ultrasound images (horizontal and vertical cross-sectional images in the example shown in Fig. 11) at the time when decompression is completed. Also, the second size display screen according to this embodiment displays the size of the common tumor mass in the horizontal and vertical directions when compressed and when not compressed. Note that in Fig. 11, the size of the common tumor mass is displayed as "distance."

[0095] As shown in Fig. 11, when the pseudo-tumor mass is a tumor mass, the size of the tumor mass displayed on the second size display screen is smaller than the threshold value (4.17 mm in this embodiment). Note that, for convenience, the ultrasound images are shown as the same image in Fig. 10 and Fig. 11, but in reality, they are different images.

[0096] In step S38, the CPU 51 executes the above-mentioned category classification support process, and then ends this information processing.

[0097] As described above, the console 50 as an information processing device according to this embodiment includes an estimation unit 60 that, when capturing radiographic and ultrasonic images of a breast compressed by a compression member, estimates the characteristics of a lesion when not compressed by a compression member based on the measurement results of the lesion in the breast when the breast is compressed by the compression member. Therefore, processing can be performed that utilizes the difference in the characteristics of the lesion when compressed and when not compressed by the compression member.

[0098] Furthermore, according to the console 50 of this embodiment, the size of the lesion when the breast is compressed by a compression member is applied as the measurement result, and the size of the lesion when not compressed is applied as the property. Therefore, by utilizing the difference in the property of the lesion between when compressed by a compression member and when not compressed, the size of the lesion when not compressed can be estimated from the size of the lesion when compressed.

[0099] Furthermore, according to the console 50 of this embodiment, when the lesion is a tumor, a process is executed to assist in categorizing the tumor using the estimated size of the tumor when uncompressed. This makes it easier to categorize the tumor than when the size of the tumor when uncompressed is measured and input one by one.

[0100] Furthermore, according to the console 50 of this embodiment, when the size of the lesion is equal to or larger than a predetermined threshold, the size of the lesion in the non-compressed state is estimated, thereby making it possible to avoid unnecessary estimation of the size of the lesion.

[0101] Furthermore, according to the console 50 of this embodiment, the measurement result is the result of measuring how the lesion deforms when the compression pressure of the compression member is changed, and the property is the state indicating whether the lesion is liquid or not. Therefore, it is possible to infer whether the pseudo-mass is a mass or liquid by utilizing the deformation of the lesion in response to the change in compression pressure of the compression member.

[0102] Furthermore, the console 50 according to the present embodiment changes the compression pressure at the location where a lesion is suspected, so that it is possible to more accurately determine whether the pseudo-mass is a mass or liquid.

[0103] [Second embodiment] In the first embodiment, an example of the case where the size of the lesion when not compressed is estimated using a correction coefficient is described. In the second embodiment, an example of the case where the size of the lesion when not compressed is estimated according to the state of change in the size of the lesion when decompression is performed is described. That is, the estimation unit 60 according to this embodiment measures how the tumor is deformed by changing the compression pressure by the compression member 40, and estimates the size of the lesion when not compressed using the deformation.

[0104] Since the configuration of the image generating system 1 according to this embodiment is substantially the same as that of the image generating system 1 according to the first embodiment, the operation of the console 50 according to this embodiment when executing information processing will be described below with reference to FIG. 12. FIG. 12 is a flowchart showing an example of information processing according to this embodiment. Among the steps shown in FIG. 12, the steps performing the same processing as those shown in FIG. 9 are given the same step numbers as in FIG. 9, and their description will be omitted. In addition, in the following, in order to avoid confusion, a case will be described in which only the horizontal size is applied as the target for estimating the size of the tumor mass when not compressed, but the same applies to estimating the vertical size.

[0105] The information processing according to this embodiment differs from the information processing according to the first embodiment only in that the processing of step S23 is added and that the processing of step S33 is applied instead of the processing of step S32.

[0106] That is, in step S23, the CPU 51 acquires the size of the provisional mass at this time (in this embodiment, the horizontal size) in the same manner as in the process of step S20 described above, and stores the size together with the corresponding compression pressure in the memory unit 52. By repeatedly executing this process while decompression is being performed, the compression pressure and the horizontal size of the provisional mass for each predetermined period during the period from the start of decompression to the end of decompression are stored in the memory unit 52 in chronological order, as shown in Fig. 13 as an example.

[0107] During decompression, the ultrasound image itself becomes defective halfway through decompression due to poor contact between the breast and compression member 40. The example shown in Fig. 13 is an example in which the compression pressure changes from 50N to 20N during decompression. In the example shown in Fig. 13, ultrasound images are obtained normally until the compression pressure reaches 30N, so the size of the pseudo-tumor can be obtained, but once the compression pressure reaches 20N, the size of the pseudo-tumor cannot be obtained.

[0108] Therefore, in step S33, the CPU 51 reads out all the compression pressures and sizes of the pseudo-tumor mass stored in the memory unit 52, and uses this information to estimate the size of the tumor mass when no compression is applied. That is, in the example shown in Fig. 13, the size of the pseudo-tumor mass decreases by 0.1 mm every time the compression pressure decreases by 10 N, and it can be seen that there is a proportional relationship between the compression pressure and the size of the pseudo-tumor mass. Therefore, in this case, the CPU 51 reduces the size of the pseudo-tumor mass by 0.1 mm every time the compression pressure decreases by 10 N, and as a result, estimates the size of the tumor mass when no compression is applied, i.e., when the compression pressure is 0, to be 10.0 mm.

[0109] As described above, according to the console 50 of this embodiment, the measurement result is the deformation of the lesion caused by changing the compression pressure of the compression member, and the size of the lesion when not compressed is used as the characteristic. Therefore, in this embodiment, the deformation of the lesion in response to changes in compression pressure can be used to estimate the size of the lesion.

[0110] In the above embodiments, the CPU 51 provided in the console 50 is applied as the processor of the technology of the present disclosure, but the present disclosure is not limited to this. For example, the CPU of the control unit 20 provided in the image generating device 10 may be applied as the processor of the technology of the present disclosure.

[0111] In the above first embodiment, the two-dimensional size in the horizontal and vertical directions is used as the size of the lesion, but the present invention is not limited to this. For example, a three-dimensional size in the depth direction in addition to the horizontal and vertical directions, that is, sizes in three directions that intersect with each other, may be used as the size of the lesion.

[0112] An example of the first size display screen according to this embodiment is shown in Fig. 14. As shown in Fig. 14, in this embodiment, the size of the tumor mass when compressed and the size of the tumor mass after correction by the correction coefficient, i.e., the size of the tumor mass when not compressed, are displayed separately in the horizontal, vertical, and depth directions. In Fig. 14, the size of the tumor mass when compressed is displayed as "tumor diameter", and the size in each direction is displayed as the horizontal size x the depth size x the vertical size.

[0113] As shown in FIG. 14, the size of the tumor mass when not compressed is smaller in the horizontal and depth directions than when compressed, and the vertical size is larger than when compressed.

[0114] In the above-described first embodiment, the method of estimating the size of the lesion when not compressed is described as using a correction coefficient according to the compression pressure and compression thickness, but the present invention is not limited to this. For example, the size of the lesion when not compressed may be estimated using a simpler correction coefficient according to only the compression pressure.

[0115] Fig. 15 is a schematic diagram showing an example of the configuration of the correction coefficient database 52B according to this embodiment. As shown in Fig. 15, in this embodiment, the correction coefficients are registered in advance in association with only the compression pressure. Therefore, according to this embodiment, the size of the lesion in the absence of compression can be estimated more easily and in a shorter time than with the console 50 according to the first embodiment.

[0116] In the above-described first embodiment, the size of the lesion when not compressed is estimated by calculation using a correction coefficient, but the present invention is not limited to this. For example, the size of the lesion when not compressed may be estimated by table conversion using a table in which the size of the lesion when compressed and the size of the lesion when not compressed are registered in association with each other.

[0117] In addition, in each of the above embodiments, the ultrasonic probe 30 is automatically moved when generating an ultrasonic image, but the present invention is not limited to this. For example, instead of the ultrasonic probe 30, a conventionally known probe such as a one-dimensional probe or a two-dimensional probe may be applied, and an ultrasonic image may be generated by manually moving the ultrasonic probe.

[0118] In addition, in each of the above embodiments, the size of the lesion and the state indicating whether the lesion is liquid or not are applied as the characteristics of the technology of the present disclosure, but the present disclosure is not limited thereto. For example, the clarity of the boundary of the lesion, the contrast variation of the internal structure of the lesion, the aspect ratio of the size of the lesion in the horizontal direction, the vertical direction, and the depth direction, etc. may be applied as the characteristics of the technology of the present disclosure. Here, as an example, the above-mentioned contrast variation is used to estimate whether the lesion is liquid (cyst) or a mass, since a cyst is liquid and therefore tends to be uniform, while a mass is cellular and therefore tends to be non-uniform. In addition, the above-mentioned asbestos ratio is used to estimate the possibility that the mass is malignant, taking into account that the larger the asbestos ratio, the more likely the mass is to be malignant.

[0119] In each of the above embodiments, the following various processors can be used as the hardware structure of the processing unit that executes various processes, such as the estimation unit 60, the process execution unit 62, and the display control unit 64. As described above, the above various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processes, such as an ASIC (Application Specific Integrated Circuit), etc.

[0120] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0121] As an example of configuring multiple processing units with one processor, first, there is a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units, as represented by computers such as client and server. Second, there is a form in which a processor is used to realize the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip, as represented by a system on chip (SoC). In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0122] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0123] In each of the above embodiments, the information processing program 52A is pre-stored (installed) in the storage unit 52 of the console 50, but the present invention is not limited to this. The information processing program 52A may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. The information processing program 52A may be downloaded from an external device via a network.

[0124] From the above description, the invention described in the following appendix can be understood.

[0125] [Appendix 1] at least one processor; The processor, When radiological and ultrasonic images are taken of a breast compressed by a compression member, a characteristic of the lesion in the breast when not compressed by the compression member is estimated based on a measurement result of the lesion in the breast when the breast is compressed by the compression member. Information processing device. [Appendix 2] the measurement result is a size of the lesion when the breast is compressed by the compression member; The characteristic is the size of the lesion when uncompressed. 2. An information processing device according to claim 1. [Appendix 3] The processor, if the lesion is a mass, performing a process using the estimated uncompressed size of the mass to assist in categorizing the mass; 3. An information processing device according to claim 2. [Appendix 4] The processor, The size of the lesion in the non-compressed state is estimated in three mutually intersecting directions; 4. The information processing device according to claim 2 or 3. [Appendix 5] The processor, If the size of the lesion is equal to or greater than a predetermined threshold, an estimate of the size of the lesion in the non-compressed state is performed. An information processing device according to any one of Supplementary Note 2 to Supplementary Note 4. [Appendix 6] the measurement result is a measurement result of how the lesion is deformed by changing the compression pressure applied by the compression member, The property is at least one of the size of the lesion when not compressed and a state indicating whether the lesion is liquid or not. 2. An information processing device according to claim 1. [Appendix 7] The change in compression pressure is performed at the location of the suspected lesion. 7. The information processing device according to claim 6. [Appendix 8] An information processing device according to any one of Supplementary Note 1 to Supplementary Note 7; an image generating device for generating an image to be used in the information processing device; 1. An image generation system comprising: [Appendix 9] When radiological and ultrasonic images are taken of a breast compressed by a compression member, a characteristic of the lesion in the breast when not compressed by the compression member is estimated based on a measurement result of the lesion in the breast when the breast is compressed by the compression member. A program that causes a computer to carry out processing. [Explanation of symbols]

[0126] 1. Image Generation System 6 RIS 10 Image generating device 12 Arm section 14 Foundation 15 Shaft 16 Photo stand 16A Shooting surface 17 Radiation Irradiation Section 17R radiation source 20 Control section 22 Memory section 24 I / F section 26 Control section 28 Radiation Detector 30 Ultrasound Probe 36 Support part 38 Probe Unit 40, 40S Compression member 42 Compression area 43 Bottom 43A Top 43B Contact surface 44 Wall 46 Support part 47 Mounting part 48 Compression Unit 49 Arm 50 Console 51 CPU 52 Storage section 52A Information Processing Program 52B Correction Factor Database 53 Memory 54 Display 55 Operation section 56 I / F section 58 Bus 60 Guessing part 62 Processing Execution Unit 64 Display control section R Radiation

Claims

1. At least one processor; The processor, When radiological and ultrasonic images are taken of a breast compressed by a compression member, a characteristic of the lesion in the breast when not compressed by the compression member is estimated based on a measurement result of the lesion in the breast when the breast is compressed by the compression member. Information processing device.

2. the measurement result is a size of the lesion when the breast is compressed by the compression member; The characteristic is the size of the lesion when uncompressed. The information processing device according to claim 1 .

3. The processor, if the lesion is a mass, performing a process using the estimated uncompressed size of the mass to assist in categorizing the mass; The information processing device according to claim 2 .

4. The processor, The size of the lesion in the non-compressed state is estimated in three mutually intersecting directions.

4. The information processing device according to claim 2.

5. The processor, If the size of the lesion is equal to or greater than a predetermined threshold, an estimate of the size of the lesion in the non-compressed state is performed.

4. The information processing device according to claim 2.

6. the measurement result is a measurement result of how the lesion is deformed by changing the compression pressure applied by the compression member, The property is at least one of the size of the lesion when not compressed and a state indicating whether the lesion is liquid or not. The information processing device according to claim 1 .

7. The change in compression pressure is performed at the location of the suspected lesion. The information processing device according to claim 6.

8. The information processing device according to claim 1 ; an image generating device for generating an image to be used in the information processing device; 1. An image generation system comprising:

9. When radiological and ultrasonic images are taken of a breast compressed by a compression member, a characteristic of the lesion in the breast when not compressed by the compression member is estimated based on a measurement result of the lesion in the breast when the breast is compressed by the compression member. A program that causes a computer to carry out processing.

Images