Medical information processing device, mammography device, and medical information processing method

Abstract

To support setting of a mammary gland region.SOLUTION: A mammography apparatus 1 comprises an image acquisition part 25b and a reference information display part 25c. The image acquisition part 25b acquires a breast image expressing a breast B of an analyte. The reference information display part 25c displays, in a region different from a mammary gland region included in the breast image, reference information with an image feature amount corresponding to the mammary gland region. The reference information display part 25c displays a region of interest as the reference information in a greater pectoral muscle included in the breast image.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The embodiments disclosed in this specification and the drawings relate to a medical information processing apparatus, a mammography apparatus, and a medical information processing method.

Background Art

[0002] There is a known technique for evaluating the breast composition of breast images taken by a mammography apparatus. Breast compositions include, for example, very high density, non-uniform high density, scattered breast tissue, and fatty classifications. Since the detection sensitivity of lesions (such as calcifications and tumors) included in breast images varies depending on the classification of breast composition, it is necessary to appropriately set the breast region in order to correctly evaluate the breast composition.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to assist in setting the breast region. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problems. Each problem corresponding to each configuration shown in the embodiments described later can also be regarded as another problem.

Means for Solving the Problems

[0005] The medical information processing apparatus according to the embodiment includes an image acquisition unit and a reference information display unit. The image acquisition unit acquires a breast image representing the breast of a subject. The reference information display unit displays reference information having an image feature amount corresponding to the breast region in a region different from the breast region included in the breast image.

Brief Description of the Drawings

[0006] [Figure 1] Figure 1 is a block diagram showing an example of the configuration of a mammography device. [Figure 2] Figure 2 is a flowchart showing an example of the process performed by the processing circuit shown in Figure 1. [Figure 3] Figure 3 shows an example of a breast image displaying the mammary gland region. [Figure 4] Figure 4 shows an example of how reference information is displayed within the pectoralis major muscle region in response to the display of the mammary gland region. [Figure 5] Figure 5 shows an example of how the breast structure evaluation results are displayed. [Figure 6] Figure 6 shows an example of a breast image displaying reference information. [Figure 7] Figure 7 shows an example of how the mammary gland region is displayed on the breast image depending on the display of reference information. [Figure 8] Figure 8 shows an example of how a breast image is displayed when either the mammary gland region or the reference information is changed. [Figure 9] Figure 9 is a schematic diagram of the first breast image showing the first mammary gland region and reference information. [Figure 10] Figure 10 is a schematic diagram of the second breast image showing the second mammary gland region. [Figure 11] Figure 11 is a schematic diagram of a breast image showing the mammary gland region and region of interest corresponding to the candidate features. [Figure 12] Figure 12 is a schematic diagram of a breast image with a slider displayed. [Figure 13] Figure 13 is a block diagram showing an example of the configuration of a medical information processing device. [Modes for carrying out the invention]

[0007] The following describes the medical information processing device, mammography device, and medical information processing method according to each embodiment with reference to the drawings.

[0008] (First embodiment) Figure 1 is a block diagram showing an example of the configuration of a mammography device 1. The mammography device 1 has an imaging unit 10 and a console unit 20.

[0009] The imaging unit 10 compresses the subject's breast B and performs X-ray imaging (mammography). The imaging unit 10 irradiates breast B with X-rays from one direction and detects the X-rays that have passed through breast B.

[0010] The console unit 20 acquires an X-ray image (mammary image) of breast B by processing the X-ray detection signal detected by the imaging unit 10. The console unit 20 evaluates the mammary structure of the acquired mammary image.

[0011] The imaging unit 10 includes an X-ray irradiation unit 11, a high-voltage generation unit 12, an X-ray detector 13, a mounting stage 14, a compression plate 15, an X-ray source support unit 16, a mounting stage support unit 17, and a base unit 18.

[0012] The X-ray irradiation unit 11 irradiates the breast B, which is placed on the mounting stage 14, with X-rays. The X-ray irradiation unit 11 comprises an X-ray source and an X-ray diaphragm. The X-ray source generates X-rays based on a high voltage applied by the high voltage generation unit 12. The X-ray diaphragm comprises, for example, a pair of diaphragm blades each on the top and bottom and left and right sides (a total of four blades). The diaphragm blades are provided in a flat plate shape using a material such as lead to shield X-rays, and form an opening that narrows the irradiation field (irradiation range) of the X-rays generated by the X-ray source. The diaphragm blades are also moved horizontally by control of the console unit 20 to change the size and shape of the irradiation field. The X-rays that have passed through the opening formed by the X-ray diaphragm irradiate the subject's breast B. In this way, the X-ray irradiation unit 11 irradiates the breast B with X-rays. The X-ray irradiation unit 11 is an example of an X-ray irradiation unit.

[0013] The high-voltage generation unit 12 generates a high voltage under the control of the console unit 20 and applies the generated high voltage to the X-ray irradiation unit 11 (X-ray source). The method of applying the high voltage from the high-voltage generation unit 12 to the X-ray irradiation unit 11 can be, for example, an inverter method, a single-voltage transformer method, a three-phase transformer method, or a capacitor method.

[0014] The X-ray detector 13 is composed of, for example, a flat panel detector (FPD) or the like. The X-ray detector 13 is provided inside the mounting table 14. The X-ray detector 13 detects the X-rays irradiated from the X-ray irradiation unit 11 and transmitted through the compression plate 15 and the breast B. The X-ray detector 13 supplies a detection signal corresponding to the detected X-ray dose to the console unit 20. In this way, the X-ray detector 13 outputs a detection signal corresponding to the X-rays transmitted through the breast B. The X-ray detector 13 is an example of an X-ray detection unit.

[0015] The mounting table 14 is a housing on which the breast B is mounted. The mounting table 14 is supported by the mounting table support portion 17. The compression plate 15 is formed of, for example, a material such as resin that transmits X-rays. The compression plate 15 is movably supported by the mounting table support portion 17 at a position facing the mounting table 14. The compression plate 15 moves in a direction of approaching and separating from the mounting table 14 (the Y-axis direction shown in FIG. 1) and compresses the breast B mounted on the mounting table 14. In this way, the compression plate 15 compresses the breast B between itself and the mounting table 14.

[0016] The X-ray source support portion 16 supports the X-ray irradiation unit 11 and is connected and supported to the base portion 18 via a shaft portion (not shown) provided between the X-ray source support portion 16 and the base portion 18. The shaft portion is rotatably provided by the base portion 18, and the X-ray source support portion 16 rotates about the axis of the shaft portion (the Z-axis direction shown in FIG. 1) in accordance with the rotation of the shaft portion. Further, the X-ray source support portion 16 moves in the height direction (the Y-axis direction shown in FIG. 1) in accordance with the operation of the base portion 18.

[0017] The mounting table support 17 supports the mounting table 14 and is connected to and supported by the base 18 via a shaft provided between it and the base 18. The shaft is rotatably provided by the base 18, and the mounting table support 17 rotates around the axis of the shaft (the Z-axis direction shown in Figure 1) in accordance with the rotation of the shaft. The X-ray source support 16 and the mounting table support 17 are each rotatably provided independently around the axis of the shaft. The shaft connected to the mounting table support 17 may be the same as or different from the shaft connected to the X-ray source support 16. Furthermore, the mounting table support 17 moves in the height direction (the Y-axis direction shown in Figure 1) in accordance with the movement of the base 18. The base unit 18 moves in the height direction (Y-axis direction as shown in Figure 1) under the control of the console unit 20. In addition, the base unit 18 rotates the shaft connected to it under the control of the console unit 20.

[0018] On the other hand, the console unit 20 includes a memory 21, a display 22, an input interface 23, a network interface 24, and a processing circuit 25.

[0019] Memory 21 is implemented by semiconductor memory elements such as RAM (Random Access Memory) and flash memory, or by hard disks, optical discs, etc. Memory 21 stores various data necessary for processing performed by the processing circuit 25, and various data obtained after processing by the processing circuit 25. Memory 21 stores various information such as the X-ray image of breast B (mammary image) and the conditions for capturing the mammary image. Memory 21 also stores a program that causes the processing circuit 25 to function as an imaging control unit 25a, an image acquisition unit 25b, a reference information display unit 25c, and an evaluation unit 25d when executed by the processing circuit 25. Memory 21 also stores trained models that extract the mammary gland region, the pectoralis major muscle region, and the region where mammary gland tissue is presumed to have originally existed (original mammary gland region) within the mammary image.

[0020] The display 22 is implemented by, for example, a liquid crystal display or a CRT (Cathode Ray Tube) display. The display 22 displays various information under the control of the processing circuit 25. The display 22 displays, for example, breast images or a GUI (Graphical User Interface) that accepts various operations from users such as radiologists.

[0021] The input interface 23 can be implemented by, for example, a foot switch, mouse, keyboard, trackball, switch, button, joystick, etc. The input interface 23 accepts various input operations from the user and outputs electrical signals corresponding to the accepted input operations to the processing circuit 25. The input interface 23 accepts operations such as performing X-ray imaging (mammography), moving the compression plate 15 up and down, and setting X-ray imaging conditions.

[0022] The network interface 24 is implemented by, for example, a network card, network adapter, or NIC (Network Interface Controller). Under the control of the processing circuit 25, the network interface 24 communicates with external devices such as PACS (Picture Archiving and Communication Systems) via the network NW. The network NW refers to the entire information and communication network utilizing electronic communication technology, and includes hospital backbone LANs (Local Area Networks), wireless LANs, wired LANs and other internet networks, as well as telephone communication lines, fiber optic communication networks, cable communication networks, and satellite communication networks.

[0023] The processing circuit 25 is composed of, for example, a processor. The processing circuit 25 controls the entire mammography apparatus 1 by controlling each part of the mammography apparatus 1. The processing circuit 25 also functions as an imaging control unit 25a, an image acquisition unit 25b, a reference information display unit 25c, and an evaluation unit 25d by reading and executing a program stored in the memory 21. The image acquisition unit 25b is an example of an image acquisition unit. The reference information display unit 25c is an example of a reference information display unit. The evaluation unit 25d is an example of an evaluation unit.

[0024] In the mammography apparatus 1 configured as described above, the console unit 20 performs the process of causing the imaging unit 10 to take X-ray images of the breast B. The console unit 20 also acquires the X-ray image (breast image) of the breast B taken by the imaging unit 10 and performs the process of evaluating the breast structure. Breast structure can be classified into categories such as extremely dense, heterogeneously dense, scattered glandular tissue, and fatty.

[0025] The detection sensitivity of lesions (calcifications, lumps, etc.) contained in breast images varies depending on the breast structure; therefore, to correctly evaluate breast structure, it is necessary to appropriately define the glandular region. However, simply displaying the glandular region on the breast image makes it difficult to determine whether the glandular region is appropriately defined. The processing circuit 25 performs a process to display reference information having image features corresponding to the glandular region in a region different from the glandular region contained in the breast image.

[0026] The processing operations performed by the mammography device 1 will be explained below with reference to Figure 2. Figure 2 is a flowchart showing an example of the processing performed by the processing circuit 25 in Figure 1.

[0027] The processing circuit 25 reads and executes the program stored in the memory 21. As a result, the processing circuit 25 functions as an image capture control unit 25a, an image acquisition unit 25b, a reference information display unit 25c, and an evaluation unit 25d.

[0028] The imaging control unit 25a performs X-ray imaging (mammography) of the subject's breast B in response to user operations such as those of a radiologic technologist.

[0029] Specifically, the imaging control unit 25a moves the X-ray source support unit 16 and the mounting table support unit 17 in a predetermined direction for imaging in esotropia (MLO: Medio Lateral Oblique) in response to user operations via the input interface 23. After the X-ray source support unit 16 and the mounting table support unit 17 are moved in the direction for MLO imaging, the user places the breast B on the mounting table 14, and the imaging control unit 25a moves the compression plate 15 in response to user operations via the input interface 23, compressing the breast B placed on the mounting table 14 with the compression plate 15.

[0030] Subsequently, the imaging control unit 25a generates a high voltage in the high voltage generation unit 12 in response to user operation via the input interface 23, causing X-rays to be irradiated from the X-ray irradiation unit 11. The X-rays irradiated from the X-ray irradiation unit 11 pass through the compression plate 15 and the breast B and are detected by the X-ray detector 13. The imaging control unit 25a receives a detection signal from the X-ray detector 13 corresponding to the amount of X-rays detected by the X-ray detector 13, and generates a breast image representing the subject's breast B by performing image processing on the detection signal. Image processing includes, for example, correction of sensitivity non-uniformity between channels in the X-ray detector 13, and correction for extreme signal reduction or data loss due to strong X-ray absorbers such as metals.

[0031] The image acquisition unit 25b acquires the breast image generated by the imaging control unit 25a (step ST11) and sets the glandular region included in the breast image (step ST12). The image acquisition unit 25b also displays the set glandular region on the breast image. Figure 3 is a schematic diagram of a breast image in which the glandular region has been set. As shown in Figure 3, the image acquisition unit 25b displays, for example, the contour of the set glandular region Ma (the boundary between glandular tissue and fat) on the breast image MG.

[0032] As a method for setting the mammary gland region Ma, for example, the image acquisition unit 25b reads a trained model from memory 21 that extracts the mammary gland region from a breast image upon input of the breast image. This trained model is, for example, a model trained based on a dataset of breast images and the mammary gland region contained in the breast image (a dataset with breast images as input data and mammary gland region as training data). The image acquisition unit 25b inputs the acquired breast image MG into the trained model and sets the mammary gland region output by the trained model as the mammary gland region Ma contained in the breast image MG.

[0033] The image acquisition unit 25b may determine a brightness value that distinguishes between mammary gland and fat based on a histogram of brightness values ​​in the region where mammary gland may exist in the breast image MG, and set the mammary gland region Ma included in the breast image MG based on this brightness value. Alternatively, the image acquisition unit 25b may set the mammary gland region Ma included in the breast image MG in response to user operation via the input interface 23.

[0034] The reference information display unit 25c acquires image features corresponding to the mammary gland region Ma displayed by the image acquisition unit 25b (step ST13). Image features corresponding to the mammary gland region Ma include, for example, brightness values ​​that indicate the contour of the mammary gland region Ma (boundary between mammary gland and fat), the average value (average brightness value) of the brightness values ​​of the entire mammary gland region Ma, the mode, the median, etc. Here, the reference information display unit 25c acquires the brightness value indicating the contour of the mammary gland region Ma as the image feature corresponding to the mammary gland region Ma.

[0035] The reference information display unit 25c displays reference information in a region different from the region where the mammary gland region Ma is set (step ST14). Figure 4 is a schematic diagram of a breast image with reference information R displayed. Reference information R is a region of interest having a predetermined size or shape (circular, polygonal, etc.). The region different from the region where the mammary gland region Ma is set is, for example, the pectoralis major muscle region P of the subject. The reference information display unit 25c displays reference information R in the pectoralis major muscle region P.

[0036] As a method for setting the pectoralis major region P, the reference information display unit 25c determines the brightness value that distinguishes the pectoralis major from fat based on a histogram of brightness values ​​in the region where the pectoralis major may be present in the breast image MG, and sets the pectoralis major region P included in the breast image MG based on this brightness value.

[0037] The reference information acquisition unit 25c may also extract the pectoralis major region using a pre-trained model. In this case, the reference information acquisition unit 25c reads a pre-trained model for extracting the pectoralis major region from the breast image from the memory 21. This pre-trained model is, for example, a model trained on a dataset of breast images and the pectoralis major region contained in those breast images (a dataset with breast images as input data and the pectoralis major region as training data, etc.). The reference information acquisition unit 25c inputs the acquired breast image MG into the pre-trained model and sets the pectoralis major region output by the pre-trained model as the pectoralis major region P contained in the breast image MG.

[0038] The reference information display unit 25c displays reference information R at a position in the set pectoralis major region P that has an image feature corresponding to the mammary gland region Ma (step ST14). For example, in this case, in the pectoralis major region P, reference information R is displayed at a position where the average brightness value of the entire region of interest (average brightness value of the region of interest) is the brightness value that indicates the contour of the mammary gland region Ma (a position that has an image feature corresponding to the mammary gland region Ma). In this way, the reference information display unit 25c displays reference information R in a region different from the region in which the mammary gland region Ma is set (pectoralis major region P) in response to the mammary gland region Ma being set by the image acquisition unit 25b. By referring to the reference information R displayed in the pectoralis major region P, the user can determine whether the mammary gland region Ma displayed on the breast image MG is set appropriately.

[0039] Subsequently, the evaluation unit 25d evaluates the breast structure based on the mammary gland region Ma (step ST15). Figure 5 is a schematic diagram of the breast image displaying the evaluation results of the breast structure. The evaluation unit 25d sets the region Mb on the breast image MG in which it is assumed that mammary glands originally existed (original mammary gland region). The original mammary gland region Mb is, for example, the region that was previously mammary gland but has changed into fat due to the effects of aging, etc., and the mammary gland region Ma at the time of X-ray imaging of breast B. Note that the portion consisting only of fat in the obvious posterior mammary space is excluded from the original mammary gland region Mb. As another example, the region excluding the pectoralis major muscle region P may be set as the original mammary gland region.

[0040] The evaluation unit 25d determines a threshold value, which is the brightness value that distinguishes the original mammary gland region Mb from other regions, based on a histogram of the brightness values ​​of pixels in the region where a breast may exist (mammary region M) on the mammary image MG, and sets the original mammary gland region Mb included in the mammary image MG based on this threshold value.

[0041] The evaluation unit 25d may also extract the original mammary gland region Mb contained in the breast image MG using a trained model. In this case, the evaluation unit 25d reads a trained model for extracting the original mammary gland region in the breast image from memory 21. This trained model is, for example, a model trained on a dataset of breast images and the original mammary gland region contained in the breast image (a dataset with breast images as input data and original mammary gland regions as training data, etc.). The evaluation unit 25d inputs the acquired breast image MG into the trained model and sets the original mammary gland region Mb extracted by the trained model.

[0042] The evaluation unit 25d then calculates the glandular ratio of breast B based on the glandular region Ma and the original glandular region Mb. For example, the glandular ratio can be determined by the following formula (1). Breast tissue ratio [%] = (Number of pixels in breast tissue region Ma / Number of pixels in original breast tissue region Mb) × 100 ... Equation (1)

[0043] The evaluation unit 25d evaluates, for example, a glandular tissue ratio of 80% or more but less than 80% as "extremely dense," 50% or more but less than 80% as "heterogeneously dense," 10% or more but less than 50% as "scattered glandular tissue," and less than 10% as "fatty." The evaluation unit 25d may, for example, evaluate a glandular tissue ratio of 50% or more as "dense" instead of "extremely dense" and "heterogeneously dense." Figure 5 is a schematic diagram of a breast image displaying the evaluation results of the breast composition. As shown in Figure 5, the evaluation unit 25d displays the evaluation results of the breast composition and the glandular tissue ratio in the evaluation display area B1.

[0044] As described above, according to the mammography device 1 of the first embodiment, reference information R having image features corresponding to the glandular region Ma (here, brightness values ​​indicating the contour of the glandular region Ma) is displayed in the pectoralis major muscle region P (a region different from the glandular region Ma) included in the breast image MG. By referring to the reference information R displayed in the pectoralis major muscle region P, the user can determine whether the glandular region Ma displayed in the breast image MG is appropriately set. In this way, the mammography device 1 can assist in determining the glandular region.

[0045] In the above embodiment, an example was described in which the luminance value indicating the contour of the mammary gland region Ma is acquired as an image feature corresponding to the mammary gland region Ma. However, the reference information display unit 25c may acquire, instead of the luminance value indicating the contour of the mammary gland region Ma, the average value of the luminance value of the entire mammary gland region Ma (average luminance value of the mammary gland region Ma), the mode, the median, etc., in the mammary gland region Ma as image feature quantities corresponding to the mammary gland region Ma.

[0046] Furthermore, in the above embodiment, an example was described in which reference information R is displayed in the pectoralis major muscle region P at a position where the average brightness value of the entire region of interest (average brightness value of the region of interest) corresponds to the brightness value that indicates the contour of the mammary gland region Ma (a position having an image feature corresponding to the mammary gland region Ma). However, the reference information display unit 25c may also display reference information R at a position where the mode, median, etc., in the region of interest has an image feature corresponding to the mammary gland region Ma, instead of the average brightness value of the region of interest.

[0047] Furthermore, the reference information display unit 25c may switch the display of reference information R on the display 22 in response to user operations via the input interface 23. This allows the user to display reference information R on the display 22 when they wish to check it. The processing circuit 25 may also switch the display of the mammary gland region Ma, the original mammary gland region Mb, and the evaluation display region B1 on the display 22 in response to user operations via the input interface 23. This allows the user to selectively display the information they wish to check on the mammary image MG on the display 22.

[0048] Furthermore, the evaluation unit 25d may store the breast image MG, including reference information R and breast structure evaluation results, in the memory 21 or in an external server (such as a PACS server) connected via the network interface 24.

[0049] Furthermore, although this embodiment describes an example in which reference information R is set in the pectoralis major muscle region P after setting the mammary gland region Ma, it is not limited to this. As a method for setting reference information R, for example, as shown in Figure 6, the reference information display unit 25c sets reference information R in the pectoralis major muscle region P in response to user operation via the input interface 23. Reference information R is a region of interest, and its size or shape (circular, polygonal, etc.) may be predetermined or arbitrary.

[0050] Furthermore, instead of setting the reference information P according to user operation, the reference information display unit 25c may set the reference information R based, for example, on the average brightness value of the pectoralis major region P extracted from the breast image MG by a trained model. Specifically, the reference information display unit 25c sets the reference information R at a position in the pectoralis major region P where the average brightness value of the region of interest represented by the reference information R is equal to the average brightness value of the pectoralis major region P.

[0051] Then, as shown in Figure 7, the image acquisition unit 25b sets the mammary gland region Ma in the breast image MG. For example, the image acquisition unit 25b sets the mammary gland region Ma based on the average brightness value of the region of interest represented by the reference information R (in this case, the average brightness value of the pectoralis major muscle region P). Specifically, the image acquisition unit 25b uses the average brightness value of the region of interest represented by the reference information R as the brightness value that indicates the contour of the mammary gland region Ma (the boundary between mammary gland and fat), and sets the mammary gland region Ma in the breast image MG based on this brightness value. In this way, depending on the reference information R set by the reference information display unit 25c, the image acquisition unit 25b may set and display the mammary gland region Ma in the breast image MG.

[0052] (Second embodiment) This embodiment describes how to change the mammary gland region Ma and reference information R set in the breast image MG.

[0053] For example, as shown in Figures 4 and 7, after the mammary gland region Ma and reference information R are displayed, the image acquisition unit 25b accepts an operation to change the mammary gland region Ma displayed on the display 22. The image acquisition unit 25b changes at least one of the position and size of the mammary gland region Ma in response to user operation, for example, via the input interface 23. For example, as shown in Figure 8, the image acquisition unit 25b changes the mammary gland region Ma to mammary gland region Ma' in response to user operation.

[0054] The reference information acquisition unit 25c changes at least one of the position and size of the reference information R in response to a change in the mammary gland region Ma. For example, if the mammary gland region Ma is changed to mammary gland region Ma' by the image acquisition unit 25b, the reference information acquisition unit 25c changes the reference information R to reference information R'. In other words, when the mammary gland region Ma is changed to mammary gland region Ma', the reference information acquisition unit 25c newly sets and displays the reference information R' corresponding to the changed mammary gland region Ma' in the pectoralis major region P.

[0055] Specifically, the reference information display unit 25c acquires image features corresponding to the mammary gland region Ma' modified by the image acquisition unit 25b. These image features include, for example, luminance values ​​indicating the contour of the mammary gland region Ma', as well as the average luminance value, mode, and median of the mammary gland region Ma'. Here, similar to the first embodiment, the reference information display unit 25c acquires luminance values ​​indicating the contour of the mammary gland region Ma' as the image features corresponding to the mammary gland region Ma'.

[0056] The reference information display unit 25c sets reference information R' having image features corresponding to the mammary gland region Ma' in the pectoralis major region P. Specifically, similar to the first embodiment, the reference information display unit 25c displays reference information R' in the pectoralis major region P at a position where the average brightness value of the region of interest is the brightness value indicating the contour of the mammary gland region Ma' (a position having image features corresponding to the mammary gland region Ma'). Alternatively, the reference information display unit 25c may display reference information R at a position where the mode, median, etc., in the region of interest has image features corresponding to the mammary gland region Ma, instead of the average brightness value of the region of interest. In this way, when the mammary gland region Ma set in the breast image MG is changed to the mammary gland region Ma', the reference information R displayed in the pectoralis major region P is automatically changed to reference information R'.

[0057] In this embodiment, an example of a case where an operation to change the mammary gland region Ma is accepted has been described, but an operation to change the reference information R may also be accepted. In this case, the reference information display unit 25c changes at least one of the position and size of the reference information R in response to a user operation via the input interface 23, for example. In this case, for example, as shown in Figure 8, the reference information display unit 25c changes the reference information R to reference information R'.

[0058] The image acquisition unit 25b changes at least one of the position and size of the mammary gland region Ma in response to a change in the reference information R. In this way, when the reference information R set for the pectoralis major muscle region P is changed to reference information R', the mammary gland region Ma displayed in the breast image MG is automatically changed to the mammary gland region Ma'.

[0059] As described above, according to the mammography device 1 of the second embodiment, when one of the breast tissue region Ma and reference information R displayed on the breast image MG is changed, the other breast tissue region Ma and reference information R are automatically changed. This allows the user to determine whether the changed breast tissue region Ma' is set appropriately by referring to the changed reference information R'.

[0060] (Third embodiment) In this embodiment, an example is described in which reference information having image features corresponding to the mammary gland region contained in one breast image is displayed on another breast image.

[0061] The imaging control unit 25a performs tomosynthesis imaging of the subject's breast B in response to user input. Specifically, the imaging control unit 25a moves the X-ray source support unit 16 and the mounting platform support unit 17 in a predetermined MLO imaging direction in response to user input via the input interface 23. After the X-ray source support unit 16 and the mounting platform support unit 17 are moved in the MLO imaging direction, the user places the breast B on the mounting platform 14, and the imaging control unit 25a moves the compression plate 15 in response to user input via the input interface 23, compressing the breast B placed on the mounting platform 14 with the compression plate 15.

[0062] Subsequently, in response to user operations via the input interface 23, the imaging control unit 25a controls the high-voltage generator 12 and the X-ray source support unit 16 to irradiate the X-ray irradiation unit 11 with X-rays multiple times at predetermined angular intervals and ranges. The X-rays irradiated from the X-ray irradiation unit 11 pass through the compression plate 15 and the breast B and are sequentially detected by the X-ray detector 13. The imaging control unit 25a sequentially receives detection signals from the X-ray detector 13 corresponding to the detected X-ray amount and generates a tomosynthesis image by performing image processing on the detection signal. The tomosynthesis image includes at least two breast images representing the subject's breast B.

[0063] The image acquisition unit 25b acquires the tomosynthesis image generated by the imaging control unit 25a. The image acquisition unit 25b also sets the mammary gland region Ma1 in one of the two or more mammary gland images MG1 included in the tomosynthesis image, as shown in Figure 9.

[0064] Similar to the first embodiment, the reference information display unit 25c sets reference information R1 in the pectoralis major muscle region P (a region different from the mammary gland region) included in the breast image MG1, in response to the mammary gland region Ma1 being set in the breast image MG1.

[0065] Furthermore, the reference information display unit 25c displays reference information R2 on the other breast image MG2 of the two or more breast images included in the tomosynthesis image, as shown in Figure 10, in response to the setting of the mammary gland region Ma in the breast image MG1. The reference information R2 has image features corresponding to the mammary gland region Ma. The other breast image MG2 is a breast image representing a region different from the mammary gland region Ma. This breast image may be any breast image other than breast image MG1 included in the tomosynthesis image, or it may be a predetermined breast image.

[0066] As described above, according to the mammography device 1 of the third embodiment, for tomosynthesis images (images including at least two breast images), reference information R2 having image features corresponding to the glandular region Ma set in one breast image MG1 can be set and displayed in another breast image MG2. As a result, the user can determine whether the glandular region Ma in breast image MG1 is appropriately set by referring to the reference information R2 displayed in breast image MG2.

[0067] In the above embodiment, an example was described in which reference information R2 is displayed on another breast image MG2 in response to the setting of the mammary gland region Ma in one breast image MG1, but the system is not limited to this. For example, the reference information display unit 25c may set reference information R1 in a region different from the mammary gland region of breast image MG1 (pectoralis major region P), and set reference information R2 having image features corresponding to the mammary gland region on breast image MG2. In this case, the image acquisition unit 25b may set the mammary gland region Ma in breast image MG1 in response to the setting of reference information R1, similar to the first embodiment. This allows the user to determine whether the mammary gland region Ma in breast image MG1 is appropriately set by referring to the reference information R2 displayed on breast image MG2.

[0068] Furthermore, although the above embodiment described a tomosynthesis image as an example of an image containing one breast image and another breast image, it is not limited to this. For example, one breast image and the other breast image may be X-rayed in different imaging directions. Specifically, one breast image may be X-rayed in the MLO imaging direction, and the other breast image may be X-rayed in the CC (Cranio-Caudal) imaging direction. If the grayscale of one breast image MG1 and the other breast image MG2 are different, reference information R2 is set using a corrected value of the image features of the first mammary gland region Ma. In this case, the image acquisition unit 25b finds, for example, a grayscale conversion relation that matches the grayscale of one breast image MG1 to the grayscale of the other breast image MG2. Then, the image acquisition unit 25b sets reference information R2 corresponding to the corrected value of the image features of the first mammary gland region Ma using the said relation.

[0069] In each of the embodiments and modifications described above, the user may select a candidate image feature (candidate feature) for the mammary gland region, and reference information representing that candidate feature may be displayed. The candidate feature may be, for example, a statistical quantity such as the mean, median, maximum, minimum, or mode of the brightness value of each pixel in the pectoralis major region P, or a value that is a combination of such statistical quantities.

[0070] Figure 11 is a schematic diagram of a breast image displaying mammary gland regions and reference information corresponding to multiple candidate features. The image display unit 25b obtains information on whether the user has selected candidate feature 1 and candidate feature 2 via the checkboxes in the selection region B2. The image acquisition unit 25b identifies the pectoralis major muscle region P on the breast image MG and calculates statistical values ​​of the brightness values ​​of each pixel in the pectoralis major muscle region P corresponding to candidate feature 1 and candidate feature 2, respectively.

[0071] When the image acquisition unit 25b acquires information that the user has selected candidate feature quantity 1, it displays pixels on the breast image MG that have a brightness value equal to or greater than the statistic corresponding to candidate feature quantity 1 as the mammary gland region Ma1. Similarly, the image acquisition unit 25b displays the mammary gland region Ma2. When the reference information display unit 25c acquires information that the user has selected candidate feature quantity 1, it displays reference information R1 that represents the statistic corresponding to candidate feature quantity 1. Reference information R1 is, for example, a region of interest whose size and shape are predetermined. The reference information display unit 25c displays reference information R1 at a position where the average brightness value of each pixel in the region of interest represents the statistic corresponding to candidate feature quantity 1. Similarly, the reference information display unit 25c displays reference information R2.

[0072] This allows users to refer to reference information corresponding to each of several pre-prepared candidate features to determine whether the mammary gland region corresponding to each candidate feature is appropriately set. This enables users to select the candidate feature best suited to setting the mammary gland region from among the multiple candidate features.

[0073] (Fourth embodiment) In the above embodiment, the case where the reference information R is a region of interest was described, but the display form of the reference information R is not limited to this. For example, the reference information R may be a GUI using a slider. In this case, for example, as shown in Figure 12, the reference information display unit 25c displays the reference information R in the direct line region of the mammary image MG, rather than in the pectoralis major region P. The direct line region is the region where X-rays that do not penetrate the subject are detected, and is different from the mammary gland region Ma. When the GUI is used as the reference information R, the reference information R may be displayed in a region other than the direct line region, or in a region (window) on the display 22 that is different from the region (window) in which the mammary image MG is displayed.

[0074] Furthermore, when the slider is used as reference information R, the reference information R includes a luminance value display unit S1 and a movable unit S2. The luminance value display unit S1 is, for example, a color bar representing the range of luminance values ​​of the pectoralis major muscle region P. The upper end of the luminance value display unit S1 represents the maximum luminance value of the pectoralis major muscle region P, and the lower end of the luminance value display unit S1 represents the minimum luminance value of the pectoralis major muscle region P. The movable unit S2 is displayed in the luminance value display unit S1 at a position that represents image features corresponding to the mammary gland region Ma (for example, luminance values ​​indicating the contour of the mammary gland region Ma, or the average luminance value, mode, median, etc. of the mammary gland region Ma). This allows the user to visually grasp the image features corresponding to the mammary gland region Ma. The luminance value display unit S1 may also represent the luminance values ​​with a scale.

[0075] Furthermore, even when the slider is used as reference information R, the reference information R and the mammary gland region Ma displayed on the breast image MG may be linked to each other. Specifically, as described in the second embodiment, if at least one of the position and size of the mammary gland region Ma is changed by user operation via the input interface 23, the reference information acquisition unit 25c may move the movable part S2 of the reference information R (slider) to a position that represents the image feature quantity corresponding to the changed mammary gland region Ma. Also, if the movable part S2 of the reference information R (slider) is moved by user operation via the input interface 23, the image acquisition unit 25b may set a new mammary gland region Ma based on the position of the movable part S2 after the move.

[0076] The GUI-based reference information R may also be, for example, an Edit Box that accepts numerical input from the user, which accepts user operations via the input interface 23 and changes the image features corresponding to the mammary gland region Ma.

[0077] Other examples of reference information may include Pixel Labels and Bounding Boxes. A Pixel Label is a label, either True or False, assigned to each pixel. In this case, the reference information display unit 25c, for example, labels pixels in the pectoralis major region P that have the average brightness value of the pectoralis major region P with True, and labels pixels with brightness values ​​different from the average brightness value of the pectoralis major region P with False. Then, the reference information display unit 25c sets the pixels labeled False to a specific display color. This specific display color could be, for example, the minimum brightness value of the pectoralis major region P or the minimum brightness value of the breast image MG. As a result, the pixels labeled True in the pectoralis major region P are relatively emphasized. Alternatively, only the pixels labeled True may be colored semi-transparently. This allows the user to understand the area where the pixels labeled True are distributed. A Bounding Box is, for example, a rectangular area surrounding the pixels labeled True in the Pixel Label.

[0078] (Fifth embodiment) In the embodiments described so far, examples have been given in which medical information processing is performed using the mammography device 1, but the medical information processing may also be performed using a device other than the mammography device 1. In other words, the medical information processing device is not limited to the case in which the mammography device 1 is used to realize the medical information processing device, but may also be realized using a device other than the mammography device 1, such as a workstation.

[0079] Figure 13 is a block diagram showing an example of the configuration of the medical information processing device 2 according to the fifth embodiment. The medical information processing device 2 according to this embodiment includes a memory 51, a display 52, an input interface 53, a network interface 54, and a processing circuit 55, which correspond to the memory 21, display 22, input interface 23, network interface 24, and processing circuit 25 of the first embodiment, respectively.

[0080] The processing circuit 55 functions as an image acquisition unit 55a, a reference information display unit 55b, and an evaluation unit 55c by reading and executing a program stored in the memory 51. The image acquisition unit 55a is an example of an image acquisition unit. The reference information display unit 55b is an example of a reference information display unit. The evaluation unit 55c is an example of an evaluation unit.

[0081] The image acquisition unit 55a acquires a breast image representing the subject's breast B from the mammography device 1 or PACS 3, which are connected via the network interface 54. The PACS 3 is a system that manages various medical image files, including breast images generated by the mammography device 1. The reference information display unit 55b and the evaluation unit 55c have the functions of the reference information display unit 25c and the evaluation unit 25d in the above-described embodiments and modified examples, respectively. Thus, the medical information processing device 2 has functions corresponding to the mammography device 1 in the above-described embodiments and modified examples.

[0082] According to the medical information processing device 2, as described in the example of the first embodiment, reference information having image features corresponding to the mammary gland region can be displayed in a region different from the mammary gland region.

[0083] According to the medical information processing device 2, as described in the example of the second embodiment, at least one of the position and size of the displayed mammary gland region is changed in response to user operation. Subsequently, at least one of the position and size of the reference information can be changed in response to the change in the mammary gland region.

[0084] According to the medical information processing device 2, as in the example described in the third embodiment, multiple breast images are acquired, and when a mammary gland region is displayed on one breast image, the mammary gland region can be displayed on a different breast image from the one in question. Furthermore, when a mammary gland region is set on the one breast image, reference information can be displayed in a region different from the mammary gland region.

[0085] According to the medical information processing device 2, as described in the example of the fourth embodiment, the display format of the reference information R is not limited to the region of interest.

[0086] In each embodiment and each modified example, various data may be stored not in the memory (memories 21, 55) (or in addition to the memory) but in an external memory that the device (mammography device 1, medical information processing device 2) can communicate with. The external memory is controlled by a cloud server, for example, by accepting read and write requests from the cloud server that manages the external memory.

[0087] In each embodiment and each modified example, the processing circuit (processing circuits 25, 55) may be composed of a combination of multiple independent processors, with each processor executing a program to realize each function of the processing circuit. Furthermore, although Figures 1 and 12 describe a single memory (memory 21, memory 51) storing programs corresponding to each processing function of the processing circuit, multiple memories may be distributed and arranged so that the processing circuit reads the corresponding program from each individual memory.

[0088] In the above explanation, the term "processor" refers to circuits such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), or a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), or a Field Programmable Gate Array (FPGA)). When the processor is a CPU, for example, it performs its functions by reading and executing programs stored in memory (memory 21, memory 51). On the other hand, when the processor is an ASIC, instead of storing the program in memory, the function is directly incorporated as a logic circuit within the processor's circuitry.

[0089] According to at least one embodiment described above, it is possible to assist in determining the mammary gland region.

[0090] While several embodiments have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be carried out in a variety of other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of symbols]

[0091] 1. Mammography device 2. Medical Information Processing Device 11 X-ray irradiation section 13 X-ray detector 14. Mounting platform 15 Compression plate 25a Image capture control unit 25b Image acquisition section 25c Reference information display section 25d Evaluation Department 55a Image acquisition unit 55b Reference information display section 55c Evaluation Department MG breast images MG1 Breast image MG2 Other breast images Ma, Ma', Ma1, Ma2 mammary gland area P Pectoralis major region R, R', R1, R2 Reference information

Claims

1. An image acquisition unit that acquires breast images representing the subject's breasts, The system includes a reference information display unit that displays reference information having image features corresponding to the mammary gland region in a region different from the mammary gland region included in the breast image, The reference information display unit displays, as reference information, a region of interest having image features corresponding to the mammary gland region in a region different from the mammary gland region. Medical information processing device.

2. The reference information display unit displays the region of interest within the pectoralis major muscle region of the subject included in the breast image. The medical information processing device according to claim 1.

3. The aforementioned reference information display unit displays a GUI (Graphical User Interface) representing image features corresponding to the mammary gland region in a region different from the mammary gland region, as reference information. A medical information processing device according to any one of claims 1 to 2.

4. The image acquisition unit sets the mammary gland region in the breast image, The reference information display unit displays reference information having image features corresponding to the mammary gland region in a region different from the region in which the mammary gland region is set. A medical information processing device according to any one of claims 1 to 3.

5. An image acquisition unit that acquires breast images representing the subject's breasts, The system includes a reference information display unit that displays reference information having image features corresponding to the mammary gland region in a region different from the mammary gland region included in the breast image, The image acquisition unit sets the mammary gland region in the breast image, The reference information display unit displays reference information having image features corresponding to the mammary gland region in a region different from the region in which the mammary gland region is set. Medical information processing device.

6. The image acquisition unit sets the mammary gland region in the breast image, The reference information display unit sets the reference information in a region different from the region in which the mammary gland region has been set, in accordance with the setting of the mammary gland region by the image acquisition unit. The medical information processing device according to claim 5.

7. The aforementioned reference information display unit sets reference information in a region different from the mammary gland region. The image acquisition unit, in response to the reference information being set by the reference information display unit, sets the mammary gland region having image features corresponding to the reference information in the breast image. The medical information processing device according to claim 5.

8. The image acquisition unit changes at least one of the position and size of the displayed mammary gland region in response to user operation. The reference information display unit changes at least one of the position and size of the reference information in accordance with the change in the mammary gland region. A medical information processing device according to any one of claims 5 to 7.

9. The reference information display unit changes at least one of the position and size of the displayed reference information in response to user operation. The image acquisition unit changes at least one of the position and size of the mammary gland region in accordance with the change in the reference information. A medical information processing device according to any one of claims 5 to 7.

10. The system further includes an evaluation unit that evaluates the breast structure based on the aforementioned mammary gland region. The medical information processing device according to claim 1.

11. The breast image includes at least two breast images representing the breast of the subject, The medical information processing device further includes a reference information acquisition unit that displays reference information having image features corresponding to a glandular region included in one of the two or more breast images on another breast image of the two or more breast images, which represents a region different from the glandular region. A medical information processing device according to any one of claims 1 to 4.

12. The image acquisition unit sets the mammary gland region in the first breast image, The reference information display unit sets reference information having image features corresponding to the mammary gland region in the other breast image, in response to the mammary gland region being set in the first breast image by the image acquisition unit. The medical information processing device according to claim 11.

13. The reference information display unit sets first reference information having image features corresponding to the mammary gland region in a region different from the mammary gland region of one breast image, and sets second reference information having image features corresponding to the first reference information in the other breast image. The medical information processing device according to claim 11.

14. The image feature is a brightness value indicating the contour of the mammary gland region, the average value of the brightness values ​​of the entire mammary gland region, the mode of the brightness values ​​of the entire mammary gland region, or the median value of the brightness values ​​of the entire mammary gland region. The medical information processing device according to claim 1.

15. A platform on which the subject's breasts are placed, A compression plate that compresses the breast between the mounting platform and the breast, An X-ray irradiation unit that irradiates the breast with X-rays, An X-ray detection unit that outputs a detection signal corresponding to the X-rays that have passed through the breast, An image acquisition unit that acquires a breast image representing the breast based on the detection signal, The system includes a reference information display unit that displays reference information having image features corresponding to the mammary gland region in a region different from the mammary gland region included in the breast image, The reference information display unit displays, as reference information, a region of interest having image features corresponding to the mammary gland region in a region different from the mammary gland region. Mammography equipment.

16. A platform on which the breast of the subject is placed, A compression plate that compresses the breast between the mounting platform and the breast, An X-ray irradiation unit that irradiates the breast with X-rays, An X-ray detection unit that outputs a detection signal corresponding to the X-rays that have passed through the breast, An image acquisition unit that acquires a breast image representing the breast based on the detection signal, The system includes a reference information display unit that displays reference information having image features corresponding to the mammary gland region in a region different from the mammary gland region included in the breast image, The image acquisition unit sets the mammary gland region in the breast image, The reference information display unit displays reference information having image features corresponding to the mammary gland region in a region different from the region in which the mammary gland region is set. Mammography equipment.

17. The processing unit, Obtain a breast image representing the subject's breast, In a region different from the mammary gland region included in the aforementioned breast image, a region of interest having image features corresponding to the said mammary gland region is displayed as reference information. Medical information processing method.

18. The processing unit, Obtain a breast image representing the subject's breast, A mammary gland region is set in the aforementioned breast image, Reference information having image features corresponding to the breast region is displayed in a region different from the region in which the breast region is defined. Medical information processing method.

Images