Medical image processing device, ultrasound diagnostic device, and program

Abstract

To reduce the labor required for collection of ultrasonic images.SOLUTION: A medical image processing device according to an embodiment comprises: a conversion unit; and a determination unit. The conversion unit performs position conversion such that a position of an area of interest set in a mammography image obtained by imaging the breast of a subject and an inspection position on the body of the subject in an ultrasonic inspection are expressed on the plane in the same scale. The determination unit determines whether or not the position of the area of interest matches the inspection position on the plane. The determination unit stores or outputs the ultrasonic image corresponding to the inspection position when determining that the position of the area of interest matches the inspection position.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in the present specification and drawings relate to a medical image processing apparatus, an ultrasound diagnostic apparatus, and a program. [Background technology]

[0002] In recent years, in the field of medical image diagnosis, a diagnosis of a subject is made by comprehensively judging medical images obtained from various imaging devices. For example, a diagnostic method is adopted in which a first examination is performed to check the presence or absence of a lesion in a subject using a first imaging device (e.g., a mammography device, etc.), and if the presence of a lesion is suspected, a second examination is performed to examine the state of the lesion in detail using a second imaging device (e.g., an ultrasound diagnostic device, etc.).

[0003] In the secondary examination described above, the technician or doctor who operates the second imaging device must manually operate the second imaging device, align the imaging range with the lesion, and perform imaging processing while visually checking the results of the primary examination. This makes operating the second imaging device cumbersome, and the examination takes time. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-27450 A Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments disclosed in this specification and the drawings is to reduce the time and effort required to collect ultrasound images. However, the problem to be solved by the embodiments disclosed in this specification and the drawings is not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0006] The medical image processing device of the embodiment has a conversion unit and a determination unit. The conversion unit performs position conversion so that the position of a region of interest set in a mammography image of a subject's breast and an examination position on the subject's body in an ultrasound examination are expressed on a plane of the same scale. The determination unit determines whether or not the position of the region of interest and the examination position match on the plane. If the determination unit determines that the position of the region of interest and the examination position match, it saves or outputs an ultrasound image corresponding to the examination position. [Brief description of the drawings]

[0007] [Figure 1] 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus 1 according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of echo scan guide information ESG according to the first embodiment. [Figure 3A] FIG. 4 is a diagram showing how the CC axis is specified for a mammography image according to the first embodiment. [Figure 3B] FIG. 2 is a diagram showing how MLO axes are specified for a mammography image according to the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of an acquisition screen for an ultrasound image US according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of body mark information BM according to the first embodiment. [Figure 6] 4 is a flowchart showing an example of a processing flow of the ultrasound diagnostic apparatus 1 according to the first embodiment. [Figure 7] FIG. 2 is a diagram showing a state in which the MLO axis and the CC axis are mapped onto body mark information BM according to the first embodiment. [Figure 8] FIG. 4 is a diagram showing how an imaging position is determined with respect to body mark information BM according to the first embodiment. [Figure 9] 5A to 5C are views for explaining a determination process performed by a determination function 106 according to the first embodiment. [Figure 10]FIG. 2 is a diagram showing an example of an acquisition screen for an ultrasound image US according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing a state in which an error range of an imaging position is set on body mark information BM according to the first embodiment. [Figure 12] FIG. 11 is a block diagram showing an example of the configuration of a medical image processing apparatus 9 according to a second embodiment. [Figure 13] FIG. 13 is a diagram showing an intersection position AR-css where the MLO axis and the CC axis intersect on the body mark information BM according to the third embodiment. [Figure 14] FIG. 13 is a diagram showing a state in which a plurality of sets of MLO and CC axes are mapped onto body mark information BM according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, a medical image processing apparatus, an ultrasonic diagnostic apparatus, and a program will be described with reference to the drawings.

[0009] (First embodiment) [Ultrasound diagnostic equipment configuration] FIG. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic device 1 according to the first embodiment. The ultrasound diagnostic device 1 is disposed in a medical institution such as a hospital. The ultrasound diagnostic device 1 is operated by an operator such as a technician or a doctor to capture medical images of the inside of a patient's body. The ultrasound diagnostic device 1 is connected to a mammography device 3, a terminal device 5, a medical image storage device 7, and a computer-aided diagnosis / detection (CAD) device 8 via a communication network NW so as to be able to transmit and receive data. The ultrasound diagnostic device 1 is an example of a "medical image processing device" or an "ultrasonic diagnostic device". The CAD device 8 is an example of a "medical image processing device". The mammography device 3 and the medical image storage device 7 are examples of an "external device".

[0010] The communication network NW refers to any information and communication network that uses electrical communication technology. The communication network NW includes wireless / wired LANs such as hospital backbone LANs (Local Area Networks) and the Internet, as well as telephone communication line networks, optical fiber communication networks, cable communication networks, and satellite communication networks.

[0011] The mammography device 3, for example, irradiates the breast of a subject with X-rays and detects the X-rays that have passed through the breast to generate a mammography image. The mammography device 3 transmits the generated mammography image to the ultrasound diagnostic device 1, the terminal device 5, the medical image storage device 7, the CAD device 8, etc., via the communication network NW.

[0012] The terminal device 5 displays, for example, ultrasound images received from the ultrasound diagnostic device 1, mammography images received from the mammography device 3, or ultrasound images and mammography images acquired from the medical image storage device 7. The terminal device 5 is operated by a doctor who makes a diagnosis using medical images such as ultrasound images and mammography images.

[0013] The medical image storage device 7 stores medical images such as ultrasound images received from the ultrasound diagnostic device 1 and mammography images received from the mammography device 3 in association with information about the subject, imaging conditions, and the like.

[0014] CAD device 8 is a mammography CAD that supports mammography examinations, an ultrasound CAD that supports ultrasound examinations, etc. Mammography CAD, for example, automatically detects areas suspected of being lesions from mammography images and sets a region of interest including the detected areas. Ultrasound CAD, for example, automatically detects areas suspected of being lesions from ultrasound images. The functions of CAD device 8 may be incorporated into ultrasound diagnostic device 1.

[0015] The ultrasound diagnostic device 1 includes, for example, a device main body 10 and an ultrasound probe 20. The ultrasound probe 20 is operated, for example, by an operator and pressed against a part of a subject (a region to be examined or diagnosed). The ultrasound probe 20 transmits (irradiates) ultrasound to the subject, for example, to obtain an image of the inside of the subject. The ultrasound probe 20 receives echoes (reflected waves) of the transmitted ultrasound. The ultrasound probe 20 then generates signal data of the received echoes (hereinafter referred to as "echo data") and outputs the echo data to the device main body 10.

[0016] The device main body 10 includes, for example, a processing circuit 100, a communication interface 110, an input interface 120, a display 130, and a memory 140. The communication interface 110 communicates with an external device such as a terminal device 5 via a communication network NW. The communication interface 110 includes, for example, a communication interface such as a NIC (Network Interface Card).

[0017] The input interface 120 accepts various input operations from the operator of the ultrasound diagnostic apparatus 1, converts the accepted input operations into electrical signals, and outputs the electrical signals to the processing circuit 100. For example, the input interface 120 includes a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, etc. The input interface 120 may be, for example, a user interface that accepts voice input from a microphone or the like.

[0018] In this specification, the input interface is not limited to an interface having physical operation parts such as a mouse, a keyboard, etc. For example, an example of the input interface also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs the electrical signal to a control circuit.

[0019] The display 130 displays various types of information. For example, the display 130 displays an image generated by the processing circuit 100, a GUI (Graphical User Interface) for receiving various input operations from an operator, and the like. For example, the display 130 is a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT) display, an organic EL (Electro Luminescence) display, or the like. When the input interface 120 is a touch panel, the display function of the display 130 may be incorporated into the input interface 120.

[0020] The processing circuit 100 includes, for example, an acquisition function 101, a shooting condition setting function 102, an image generation function 103, a conversion function 104, a decision function 105, a judgment function 106, a display control function 107, and an output function 108. The processing circuit 100 realizes these functions by, for example, a hardware processor (computer) executing a program stored in a memory 140 (storage circuit). The acquisition function 101 is an example of an "acquisition unit". The shooting condition setting function 102 is an example of an "shooting condition setting unit". The conversion function 104 is an example of a "conversion unit". The decision function 105 is an example of a "decision unit". The judgment function 106 is an example of a "judgment unit". The output function 108 is an example of an "output unit".

[0021] The hardware processor means a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD), or a field programmable gate array (FPGA)). Instead of storing the program in the memory 140, the program may be directly built into the circuit of the hardware processor. In this case, the hardware processor realizes the function by reading and executing the program built into the circuit. The above program may be stored in the memory 140 in advance, or may be stored in a non-transitory storage medium such as a DVD or a CD-ROM, and may be installed in the memory 140 from the non-transitory storage medium by mounting the non-transitory storage medium in a drive device (not shown) of the ultrasound diagnostic apparatus 1. The hardware processor is not limited to being configured as a single circuit, but may be configured as a single hardware processor by combining multiple independent circuits to realize each function. Also, multiple components may be integrated into a single hardware processor to realize each function.

[0022] The acquisition function 101 acquires echo data output by the ultrasound probe 20. The acquisition function 101 also acquires mammography images MI, echo scan guide information ESG, and the like from the mammography device 3 and the medical image storage device 7 via the communication interface 110, and stores them in the memory 140.

[0023] The echo scan guide information ESG is information indicating a region of interest set for a mammography image MI captured by the mammography device 3. This region of interest includes, for example, a location in the mammography image MI where a lesion has been confirmed or a location where a lesion is suspected (hereinafter also referred to as a "lesion location"). This region of interest is set, for example, after the mammography examination and before the ultrasound examination, by a technician or a doctor (image interpretation doctor) who performed the mammography examination. Alternatively, this region of interest may be set automatically by a mammography CAD. Such echo scan guide information ESG is used to confirm the same lesion location as the region of interest (lesion location) pointed out in the mammography image MI during the ultrasound examination. The echo scan guide information ESG is an example of a "region of interest."

[0024] Fig. 2 is a diagram showing an example of echo scan guide information ESG according to the first embodiment. The echo scan guide information ESG includes information on the position of the nipple n, the start and end points of the MLO (Mediolateral-Oblique) axis, the relative position between the MLO axis and the nipple n, the start and end points of the CC (Cranio-Caudal) axis, the relative position between the CC axis and the nipple n, the upper end a of the breast, the lower end b of the breast, the right end c of the breast, the left end d of the breast, the angle of the support table of the mammography device 3, the position of the flank SI, and the like, for example, regarding the breast BR of the subject. As shown in Fig. 2, the echo scan guide information ESG is displayed on a schematic diagram that typically shows the breast.

[0025] That is, the echo scan guide information ESG (region of interest) includes a first region of interest (MLO axis) set in a first mammography image of the breast BR taken from a first direction, and a second region of interest (CC axis) set in a second mammography image of the breast BR taken from a second direction.

[0026] 3A and 3B are diagrams showing how the CC axis and the MLO axis are specified by an engineer or the like for a mammography image according to the first embodiment. FIG. 3A is a mammography image MI-1 obtained by imaging the breast BR of a subject from the top-bottom direction. FIG. 3B is a mammography image MI-2 obtained by imaging the breast BR of a subject from an oblique direction. The engineer or the like who performed the mammography examination checks, for example, the mammography image MI-1 and operates an input interface to identify a point P-CC, which is a lesion location. The axis in the cranial-caudal direction of the breast BR passing through the point P-CC thus identified is set as the CC axis in FIG. 2. The engineer or the like also checks, for example, the mammography image MI-2 and operates an input interface to identify a point P-MLO, which is a lesion location. The axis in the medial-lateral oblique direction of the breast BR passing through the point P-MLO thus identified is set as the MLO axis in FIG. 2. Note that only one of the MLO axis and the CC axis may be set.

[0027] The imaging condition setting function 102 sets imaging conditions based on input operations by the operator via the input interface 120. The imaging conditions include the setting of a measurement starting point for identifying the position of the ultrasound probe 20 during ultrasound examination. The imaging conditions also include various parameters related to image adjustment. The imaging conditions also include information such as the type of ultrasound probe 20 used for imaging and whether or not a stress echo examination is performed. That is, the imaging condition setting function 102 performs settings for identifying the examination position on the subject's body that the ultrasound probe 20 is in contact with during ultrasound examination, based on position information of a predetermined part on the subject's body.

[0028] The image generating function 103 generates an ultrasound image UI, which is an image showing the inside of the subject, based on the echo data acquired by the acquiring function 101 , and stores the image in the memory 140 .

[0029] The conversion function 104 performs coordinate conversion so that the coordinates of the echo scan guide information ESG acquired by the acquisition function 101 and the coordinates of the body mark information automatically set during the ultrasound examination are expressed on the same plane coordinates (plane of the same scale). The body mark information indicates the position on the subject's body with which the ultrasound probe 20 is in contact during the ultrasound examination. That is, the conversion function 104 performs position conversion so that the position of the region of interest set in a mammography image of the subject's breast and the examination position on the subject's body in the ultrasound examination are expressed on a plane of the same scale. The conversion function 104 performs position conversion so that the position of the region of interest and the examination position on the subject's body with which the ultrasound probe is in contact during the ultrasound examination are expressed on a plane of the same scale.

[0030] FIG. 4 is a diagram showing an example of an acquisition screen of an ultrasound image US according to the first embodiment. FIG. 5 is a diagram showing an example of body mark information BM according to the first embodiment. As shown in FIG. 4, when an ultrasound examination is performed, a body mark BM is displayed on the display 130 in addition to an ultrasound image US. As shown in FIG. 5, the body mark information BM includes information on the breast BR of the subject, such as the position of the nipple N, the upper end A of the breast, the lower end B of the breast, the right end C of the breast, the left end D of the breast, the position O of the ultrasound probe 20, and the relative position between the position of the ultrasound probe 20 and the position of the nipple N. As shown in FIG. 5, the body mark information BM is displayed on a schematic diagram that shows a schematic breast. When the position of the ultrasound probe 20 is represented on the body mark information BM by a line having a predetermined width according to the shape of the ultrasound probe 20, the body mark information BM includes information on the start point and the end point of the line. Note that the body mark information BM may not be represented by a diagram, but may be represented by coordinates indicating the relative position of the ultrasound probe 20 on the subject, which are calculated based on the characteristics of the subject's body type, etc.

[0031] The conversion function 104 maps the coordinates on the echo scan guide information ESG to the coordinates on the body mark information BM. Alternatively, the conversion function 104 maps the coordinates on the body mark information BM to the coordinates on the echo scan guide information ESG, or the conversion function 104 maps the coordinates on the echo scan guide information ESG and the coordinates on the body mark information BM to other specific coordinates. The details of the conversion function 104 will be described later.

[0032] The determination function 105 determines positions on the subject's body where ultrasound images are to be captured (hereinafter referred to as "imaging positions"), for example, based on an input operation by an operator via the input interface 120. The determination function 105 may also determine the number and positions of the imaging positions based on a predetermined guideline. The imaging positions are an example of an "acquisition position." That is, the determination function 105 determines the acquisition positions of the ultrasound images within the region of interest. The determination function 105 determines the acquisition positions within the first region of interest and the second region of interest. Details of the determination function 105 will be described later.

[0033] The determination function 106 determines whether or not the current position (examination position) of the ultrasound probe 20 coincides with the determined imaging position during the ultrasound examination. When the determination function 106 determines that the current position of the ultrasound probe 20 coincides with the determined imaging position, the determination function 106 associates the ultrasound image UI generated by the image generation function 103 with information on the subject, imaging conditions, and the like, and stores it in the memory 140. That is, the determination function 106 determines whether or not the position of the region of interest set in the mammography image coincides with the examination position on the subject's body in the ultrasound examination on a plane of the same scale. The determination function 106 determines whether or not the position of the region of interest coincides with the examination position on the subject's body where the ultrasound probe 20 is in contact during the ultrasound examination. When the determination function 106 determines that the position of the region of interest coincides with the examination position, the determination function 106 saves or outputs the ultrasound image corresponding to the examination position.

[0034] The display control function 107 controls the display on the display 130 of various information such as a mammography image MI, echo scan guide information ESG, body mark information BM, an ultrasound image UI, and a GUI for accepting various input operations from the operator.

[0035] The output function 108 outputs the ultrasound image UI stored in the memory 140 to the terminal device 5 or the like using the communication interface 110 via the network NW.

[0036] The memory 140 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, a hard disk, or an optical disk. These non-transient storage media may be realized by other storage devices connected via a communication network NW, such as a network attached storage (NAS) or an external storage server device. The memory 140 may also include a non-transient storage medium such as a read only memory (ROM) or a register. The memory 140 stores, for example, a mammography image MI, echo scan guide information ESG, an ultrasound image UI, and the like. In addition, the memory 140 stores programs, parameter data, and other data used by the processing circuit 100.

[0037] [Processing flow] Next, a description will be given of an example of processing performed by the ultrasonic diagnostic apparatus 1. Fig. 6 is a flowchart showing an example of the flow of processing performed by the ultrasonic diagnostic apparatus 1 according to the first embodiment.

[0038] First, the acquisition function 101 acquires echo scan guide information ESG from the mammography apparatus 3 or the medical image storage apparatus 7 via the communication interface 110 (step S100).

[0039] Next, the imaging condition setting function 102 sets imaging conditions based on the input operation of the operator via the input interface 120 (step S102). The imaging condition setting function 102 sets a measurement starting point for identifying the position of the ultrasound probe 20 during ultrasound examination (i.e., body mark information BM). The imaging condition setting function 102 sets some predetermined parts on the body of the subject as measurement starting points. In general, the body mark information BM corresponding to the position of the ultrasound probe 20 can be calculated by calculating the coordinates of three parts of the subject. In this embodiment, in consideration of the ease and accuracy of setting the coordinate starting point, the coordinates of the position of the nipple are calculated as the measurement starting point in addition to the four points of the upper, lower, left, and right of the breast of the subject. Specifically, the operator presses the ultrasound probe 20 against each of the four points of the upper, lower, left, and right of the breast of the subject and the position of the nipple, measures the coordinates of each position, and registers the measurement starting point. Note that the position of the nipple does not have to be used as the measurement starting point.

[0040] Next, the conversion function 104 performs position conversion so that the coordinates of the echo scan guide information ESG acquired by the acquisition function 101 and the coordinates of the body mark information BM set by the imaging condition setting function 102 are expressed on the same coordinate plane (step S104). For example, the conversion function 104 maps the coordinates of the echo scan guide information ESG to the coordinates of the body mark information BM.

[0041] An example will be described in which the coordinates of the echo scan guide information ESG shown in Fig. 2 are mapped to the coordinates of the body mark information BM shown in Fig. 5. First, the conversion function 104 calculates the radius r of the breast BR, which is the distance between the position of the nipple n on the echo scan guide information ESG shown in Fig. 2 and the breast end point. The conversion function 104 calculates the distance between the position of the nipple n and any one of the end points of the upper end a, the lower end b, the right end c, and the left end d as the radius r. For example, when using the distance between the nipple position n and the left end d, the conversion function 104 calculates the radius r using the following formula (1).

[0042] r=n x -d x (1)

[0043] In the above formula (1), the subscript x indicates the x coordinate in the xy space coordinate defined on the echo scan guide information ESG. In this case, the x-axis of the xy space coordinate is the direction along the line connecting the left end d and the right end c of the breast BR, and the y-axis is the direction along the line connecting the upper end a and the lower end b of the breast BR. The conversion function 104 may calculate the distance between the nipple position n and each of the upper end a, the lower end b, the right end c, and the left end d, and calculate the average of these distances as the radius r.

[0044] Next, the conversion function 104 calculates the radius R of the breast BR, which is the distance between the position of the nipple N on the body mark information BM shown in Fig. 5 and the breast end point. The conversion function 104 calculates the distance between the position of the nipple N and any one of the end points of the upper end A, the lower end B, the right end C, and the left end D as the radius R. For example, when using the distance between the nipple position N and the left end D, the conversion function 104 calculates the radius R by the following formula (2).

[0045] R=N x -D x (2)

[0046] In the above formula (2), the subscript x indicates the x coordinate in the xy space coordinate system defined on the body mark information BM. In this case, the x-axis of the xy space coordinate system is the direction along the line connecting the left end D and the right end C of the breast BR, and the y-axis is the direction along the line connecting the upper end A and the lower end B of the breast BR. Note that the conversion function 104 may calculate the distance between the position N of the nipple N and each of the upper end A, the lower end B, the right end C, and the left end D, and calculate the average of these distances as the radius R.

[0047] Next, the conversion function 104 calculates the ratio k between the radius r on the echo scan guide information ESG and the radius R on the body mark information BM by the following formula (3).

[0048] k = R / r (3)

[0049] Next, the conversion function 104 converts the coordinates of the echo scan guide information ESG into the coordinates of the body mark information BM based on the ratio k. That is, the conversion function 104 converts all the coordinates of the echo scan guide information ESG into the coordinates of the body mark information BM and maps them by multiplying the matrix E of the coordinates of the echo scan guide information ESG by the ratio k according to the following formula (4). Fig. 7 is a diagram showing a state in which the MLO axis and the CC axis are mapped on the body mark information BM according to the first embodiment.

[0050] G = kE (4)

[0051] Next, the determination function 105 determines imaging positions for capturing ultrasound images for the body mark information BM on which the MLO and CC axes are mapped (step S106). For example, the determination function 105 determines imaging positions based on an input operation by an operator via the input interface 120. For example, when the operator inputs the number of ultrasound images to be captured, t, the determination function 105 determines t / 2 imaging positions for each of the MLO and CC axes on the body mark information BM.

[0052] Fig. 8 is a diagram showing how imaging positions are determined for body mark information BM according to the first embodiment. In the example shown in Fig. 8, the operator inputs the number of ultrasound images to be acquired, t=24, and the determination function 105 determines 12 imaging positions AP-m positioned at equal intervals on the MLO axis, and determines 12 imaging positions AP-c positioned at equal intervals on the CC axis. A set of coordinates of the imaging positions AP-m set on the MLO axis is defined as a matrix M, and a set of coordinates of the imaging positions AP-c set on the CC axis is defined as a matrix C.

[0053] The determination function 105 may determine the number and positions of the imaging positions based on a predetermined guideline. The determination function 105 may also determine which of the MLO axis and the CC axis is to be used as a priority axis for setting the imaging positions based on a predetermined guideline or an input by the operator. After the imaging positions are determined as described above, the operator starts imaging processing of an ultrasound image of the subject using the ultrasound probe 20. For example, the operator uses the ultrasound probe 20 to perform scanning on the entire region of the subject's breast.

[0054] Next, the determination function 106 determines whether or not the current position of the ultrasonic probe 20 during the ultrasonic examination coincides with the imaging position specified on the body mark information BM (step S108). Specifically, the determination function 106 first calculates the current position of the ultrasonic probe 20. Then, the determination function 106 determines whether or not the current position thus calculated coincides with the imaging position.

[0055] 9 is a diagram for explaining the determination process by the determination function 106 according to the first embodiment. The current position of the ultrasound probe 20 (the center point of the ultrasound probe 20) indicated in the body mark information BM is assumed to be O. The determination function 106 continuously determines whether or not the current position O (coordinate position) of the ultrasound probe 20 coincides with any of the imaging positions set on the MLO axis and the imaging positions (coordinate positions) set on the CC axis. For example, the determination function 106 stores matrices M and C in the main storage device of the ultrasound diagnostic device 1, and compares the current position O of the ultrasound probe 20 with each element of the matrices M and C one by one.

[0056] When the determination function 106 determines that the current position O of the ultrasound probe 20 and the imaging position match, the determination function 106 associates the ultrasound image UI generated by the image generation function 103 with information on the subject, imaging conditions, etc., and stores the ultrasound image UI in the memory 140 (step S110). On the other hand, when the determination function 106 determines that the current position O of the ultrasound probe 20 and the imaging position do not match, the determination function 106 does not store the ultrasound image in the memory 140.

[0057] In addition, if the determination function 106 determines that the position of the area of ​​interest and the examination position match, the acquisition function 101 may further acquire a mammography image corresponding to the area of ​​interest from the mammography device 3 or a medical image storage device 7 (external device).

[0058] 10 is a diagram showing an example of an acquisition screen of an ultrasound image US displayed on the display 130 during an ultrasound examination according to the first embodiment. In addition to the ultrasound image US, this acquisition screen displays body mark information BM on which the MLO axis and CC axis are mapped. By checking such a screen, the operator can scan the breast of the subject while checking the positional relationship between the current position O of the ultrasound probe 20 and the imaging position.

[0059] Next, the determination function 106 determines whether or not the acquisition of ultrasound images at all the imaging positions set on the MLO axis and the imaging positions set on the CC axis has been completed (step S112). When the determination function 106 determines that the acquisition of ultrasound images at all the imaging positions has not been completed, the process returns to the above step S108, and again determines whether or not the current position O of the ultrasound probe 20 matches the imaging position, and repeats the subsequent processes.

[0060] On the other hand, when the determination function 106 determines that the acquisition of ultrasound images at all imaging positions is completed, the display control function 107 causes the display 130 to display a completion screen indicating that the acquisition of ultrasound images at all imaging positions is completed (step S114). By checking the completion screen displayed on the display 130, the operator can confirm that the acquisition of ultrasound images at all imaging positions is completed.

[0061] In addition to the imaging position set on the MLO axis and the imaging position set on the CC axis, an ultrasound image of an error range of each imaging position may be acquired. The error range is set based on, for example, an average error of an ultrasound probe or coordinate conversion. Alternatively, the error range may be set based on, for example, an input operation by an operator via the input interface 120. Fig. 11 is a diagram showing a state in which an error range of an imaging position is set on the body mark information BM according to the first embodiment. As shown in Fig. 11, an error range AR-m is set for the MLO axis, and an error range AR-c is set for the CC axis.

[0062] For example, if the error value is e, the following equations (5) and (6) are used to calculate each element of matrices M and C. e and C e are matrices M and C each including an error. The matrix E is an n-matrix that increases or decreases from 0 in the smallest unit (for example, 1 unit) to the above error. The determination function 106 determines the n M e and C e The above-mentioned determination process is performed.

[0063] M e,1 =M1±E1 · · · M e,n =M n ±E n (5)

[0064] C e,1 =C1±E1 · · · C e,n =C n ±E n (6)

[0065] Next, the output function 108 outputs the ultrasound image UI stored in the memory 140 to the terminal device 5 via the network NW based on, for example, an input operation by the operator via the input interface 120 (step S116). The output function 108 outputs the ultrasound image UI to the terminal device 5 in a format such as BMP, JPEG, DICOM, etc. The output function 108 may also output the ultrasound image UI to the terminal device 5 in a video format that continuously displays the ultrasound image UI. The output function 108 may also output the ultrasound image UI to the medical image storage device 7, the CAD device 8, a printing device (not shown), or a portable storage medium (not shown) such as a DVD or USB. With the above, the processing of this flowchart is completed.

[0066] According to the first embodiment described above, the effort required for collecting ultrasound images can be reduced. The operator of the ultrasound diagnostic device 1 simply presses the ultrasound probe against the entire breast of the subject, and an ultrasound image corresponding to the echo scan guide information is automatically captured and stored. This simplifies the imaging process of the ultrasound image, reduces the effort, and shortens the examination time. Furthermore, a doctor or the like who uses the ultrasound image captured in this way to make a diagnosis can reduce the effort of searching for a target ultrasound image suitable for diagnosis, and can also shorten the diagnosis time. Furthermore, a doctor can reduce the risk of overlooking an important ultrasound image.

[0067] Second Embodiment The second embodiment will be described below. In the above-mentioned first embodiment, the ultrasound diagnostic device 1 is described as limiting the ultrasound images of the imaging target by real-time processing during the ultrasound examination and providing them to the terminal device 5 and the like. In contrast, in the second embodiment, the medical image processing device selects all ultrasound images captured by the ultrasound diagnostic device 1 afterwards and provides them to the terminal device 5 and the like. In the following description, differences from the first embodiment will be mainly described, and points in common with the first embodiment will be omitted. In the description of the second embodiment, parts that are the same as those in the first embodiment will be described with the same reference numerals.

[0068] 12 is a block diagram showing an example of the configuration of a medical image processing device 9 according to the second embodiment. The medical image processing device 9 is connected to an ultrasound diagnostic device 1, a mammography device 3, a terminal device 5, and a medical image storage device 7 via a network NW so as to be able to transmit and receive data. The functions of the medical image processing device 9 may be incorporated into the terminal device 5. The medical image processing device 9 is an example of a "medical image processing device".

[0069] The medical image processing device 9 includes, for example, a processing circuit 200. The processing circuit 200 includes, for example, an acquisition function 201, a conversion function 202, a decision function 203, a judgment function 204, and an output function 205. The acquisition function 201 is an example of an "acquisition unit". The conversion function 202 is an example of a "conversion unit". The decision function 203 is an example of a "decision unit". The judgment function 204 is an example of a "judgment unit". The output function 205 is an example of an "output unit".

[0070] The acquisition function 201 acquires an ultrasound image, for example, from the ultrasound diagnostic device 1 or the medical image storage device 7. The acquisition function 201 also acquires echo scan guide information ESG, for example, from the ultrasound diagnostic device 1, the mammography device 3, or the medical image storage device 7.

[0071] The conversion function 202 is equivalent to the conversion function 104 in the above-described ultrasound diagnostic device 1. That is, the conversion function 202 performs position conversion so that the coordinates of the echo scan guide information ESG acquired by the acquisition function 201 and the coordinates of the body mark information associated with the ultrasound image are expressed on the same coordinate plane.

[0072] The determination function 203 is equivalent to the determination function 105 in the above-described ultrasound diagnostic device 1. That is, the determination function 203 determines positions on the subject's body from which ultrasound images are to be acquired (hereinafter referred to as "acquisition positions"), for example, based on an input operation by an operator via an input interface (not shown) of the medical image processing device 9. The determination function 105 may also determine the number and positions of the acquisition positions based on a predetermined guideline.

[0073] The determination function 204 is equivalent to the determination function 106 in the above-described ultrasound diagnostic device 1. That is, the determination function 204 determines whether or not the position of the ultrasound probe 20 indicated by the coordinates of the body mark information matches the determined acquisition position. When the determination function 204 determines that the position of the ultrasound probe 20 matches the determined acquisition position, it extracts an ultrasound image corresponding to the determined acquisition position as an output target. That is, the determination function 204 determines whether or not the position of the region of interest matches an examination position on the body of the subject associated with the captured ultrasound image.

[0074] The output function 205 is equivalent to the output function 108 in the above-described ultrasound diagnostic device 1. That is, the output function 205 outputs an extracted ultrasound image to the terminal device 5 via the network NW based on, for example, an input operation by an operator via an input interface (not shown) of the medical image processing device 9.

[0075] According to the second embodiment described above, an ultrasound image corresponding to the echo scan guide information is automatically extracted and output, which reduces the effort required for collecting ultrasound images.

[0076] (Third embodiment) The third embodiment will be described below. In the above-mentioned first embodiment, it has been described that the ultrasound images of the imaging positions set on the MLO axis and the imaging positions set on the CC axis are provided to the terminal device 5 and the like. In contrast, in the third embodiment, only the ultrasound image corresponding to the position where the MLO axis and the CC axis intersect is extracted and provided to the terminal device 5 and the like. In the following description, differences from the first embodiment will be mainly described, and the description of the points in common with the first embodiment will be omitted. In the description of the third embodiment, the same parts as those in the first embodiment will be described with the same reference numerals.

[0077] The output function 108 extracts an ultrasound image UI corresponding to the position where the MLO axis and the CC axis intersect from the ultrasound images UI stored in the memory 140 based on, for example, an input operation by the operator via the input interface 120. The output function 108 outputs the extracted ultrasound image UI to the terminal device 5 via the network NW. That is, the output function 108 outputs an ultrasound image corresponding to an overlapping region between the first region of interest (MLO axis) and the second region of interest (CC axis) from among the stored ultrasound images.

[0078] 13 is a diagram showing an intersection position AR-css where the MLO axis and the CC axis intersect on the body mark information BM according to the third embodiment. The output function 108 extracts an ultrasound image corresponding to such an intersection position AR-css as a representative ultrasound image, and outputs it to the terminal device 5. For example, the output function 108 refers to information on an imaging position associated with an ultrasound image UI in the memory 140, extracts elements (which may include a predetermined error range) whose coordinate positions match those of elements included in the matrix M and elements included in the matrix C, and extracts an ultrasound image corresponding to the extracted element.

[0079] The output function 108 may add label information to the ultrasound image corresponding to the crossing position AR-css and output it together with other ultrasound images to the terminal device 5. In addition, instead of the output function 108 extracting only the ultrasound image corresponding to the crossing position AR-css, the determination function 106 may determine whether or not the current position O of the ultrasound probe 20 and the crossing position AR-css match, and store the ultrasound image UI in the memory 140 only when they match.

[0080] According to the third embodiment described above, by extracting only the ultrasound image corresponding to the intersection position AR-css as a representative ultrasound image and outputting it to the terminal device 5, the doctor making the diagnosis can reduce the number of ultrasound images to be checked, thereby further shortening the diagnosis time.

[0081] (Fourth embodiment) The fourth embodiment will be described below. In the above-mentioned first embodiment, an ultrasound image of an imaging position set on one pair of MLO and CC axes focusing on one lesion location is provided to the terminal device 5 or the like. In contrast, in the fourth embodiment, ultrasound images of imaging positions set on a plurality of pairs of MLO and CC axes focusing on a plurality of lesion locations are provided to the terminal device 5 or the like. In the following description, differences from the first embodiment will be mainly described, and points in common with the first embodiment will be omitted. In the description of the fourth embodiment, parts that are the same as those in the first embodiment will be described with the same reference numerals.

[0082] FIG. 14 is a diagram showing a state where a plurality of sets of MLO axes and CC axes according to the fourth embodiment are mapped on the body mark information BM. In the example shown in FIG. 14, a set of MLO1 axis and CC1 axis corresponding to a first lesion location and a set of MLO2 axis and CC2 axis corresponding to a second lesion location are mapped on the body mark information BM. The determination function 106 determines whether or not the current position of the ultrasound probe 20 coincides with the imaging positions set on the MLO axes and CC axes corresponding to such a plurality of lesion locations during the ultrasound examination, and can collect ultrasound images corresponding to the plurality of lesion locations collectively. That is, the region of interest includes a plurality of regions of interest corresponding to each of the plurality of lesion locations. When the determination function 106 determines that the positions of the plurality of regions of interest coincide with the examination position, it saves or outputs the ultrasound image corresponding to the examination position.

[0083] According to the fourth embodiment described above, ultrasound images corresponding to a plurality of lesion locations can be collected together, and the effort required for collecting ultrasound images can be reduced.

[0084] Fifth embodiment The fifth embodiment will be described below. In the above-mentioned first embodiment, the ultrasound image UI stored in the memory 140 is described as being provided to the terminal device 5 or the like. In contrast, in the fifth embodiment, some ultrasound images in which a lesion has been detected by the CAD device 8 (ultrasound CAD) are extracted as representative ultrasound images from the ultrasound image UI stored in the memory 140, and are provided to the terminal device 5 or the like. In the following description, differences from the first embodiment will be mainly described, and points in common with the first embodiment will be omitted. In the description of the fifth embodiment, parts that are the same as those in the first embodiment will be described with the same reference numerals.

[0085] The CAD device 8 (ultrasound CAD) acquires an already captured ultrasound image UI from the ultrasound diagnostic device 1 or the medical image storage device 7. The CAD device 8 uses the coordinates of the body mark information to extract an ultrasound image in which a lesion has been detected as a representative image from among the ultrasound image UIs, and transmits the representative image to the ultrasound diagnostic device 1. The output function 108 of the ultrasound diagnostic device 1 provides the ultrasound image thus extracted by the CAD device 8 to the terminal device 5 or the like. The output function 108 may also assign label information to the ultrasound image extracted by the CAD device 8, and output the ultrasound image together with other ultrasound images to the terminal device 5. That is, the output function 108 outputs an ultrasound image in which a lesion has been detected by a computer-aided diagnosis device, among the stored ultrasound images.

[0086] According to the fifth embodiment described above, by outputting only the ultrasound images extracted by the CAD device 8 to the terminal device 5, the doctor making the diagnosis can reduce the number of ultrasound images to be checked, thereby further shortening the diagnosis time.

[0087] Sixth embodiment The sixth embodiment will be described below. In the above-mentioned first embodiment, an ultrasonic examination is performed by manually operating the ultrasonic probe 20. In contrast, in the sixth embodiment, an ultrasonic diagnostic device that performs automatic scanning is used. In the following description, differences from the first embodiment will be mainly described, and descriptions of commonalities with the first embodiment will be omitted. In the description of the sixth embodiment, the same parts as those in the first embodiment will be described with the same reference numerals.

[0088] Based on the automatic scan control, the ultrasound diagnostic device 1 associates ultrasound images (image collection) of the entire breast of the subject with the body mark information BM and stores them in the memory 140. For example, based on an input operation by an operator via the input interface 120, the output function 108 refers to the body mark information BM associated with the ultrasound image from among the ultrasound images stored in the memory 140 (or converts the body mark coordinates from the human body coordinates), extracts an ultrasound image corresponding to the imaging position, and outputs it to the terminal device 5. That is, the output function 108 outputs an ultrasound image in which the examination position of the subject associated with the ultrasound image coincides with the position of the region of interest among the ultrasound images captured based on the automatic scan control.

[0089] According to the sixth embodiment described above, even when an ultrasound diagnostic device that performs automatic scanning is used, the effort required to collect ultrasound images can be reduced by outputting only the ultrasound images corresponding to the imaging position to the terminal device 5.

[0090] Seventh embodiment The seventh embodiment will be described below. In the above-mentioned first embodiment, the echo scan guide information ESG set by the technician who performed the mammography examination, the doctor (image interpretation doctor), etc. is used. In contrast, in the seventh embodiment, the echo scan guide information ESG generated from the results of analysis by the CAD device 8 (mammography CAD) is used. In the following description, the differences from the first embodiment will be mainly described, and the points in common with the first embodiment will be omitted. In the description of the seventh embodiment, the same parts as those in the first embodiment will be described with the same reference numerals.

[0091] The acquisition function 101 acquires echo scan guide information ESG generated from the analysis result by the CAD device 8 (mammography CAD). The conversion function 104, the decision function 105, and the judgment function 106 use the echo scan guide information ESG acquired from the CAD device 8 to perform the above various processes.

[0092] According to the seventh embodiment described above, by using the echo scan guide information ESG generated from the results of analysis by the CAD device 8, the technician, doctor (radiography interpreter), etc. who performed the mammography examination no longer needs to generate the echo scan guide information ESG, thereby simplifying the examination procedure.

[0093] According to at least one of the embodiments described above, there is provided a conversion unit (104, 202) that performs position conversion so that the position of the region of interest set in a mammography image of a subject's breast and the examination position on the subject's body in an ultrasound examination are represented on a plane of the same scale, and a determination unit (106, 204) that determines whether the position of the region of interest and the examination position match on the above plane, and when the determination unit (106, 204) determines that the position of the region of interest and the examination position match, it saves or outputs an ultrasound image corresponding to the examination position, thereby reducing the effort required to collect ultrasound images.

[0094] The above-described embodiment can be expressed as follows. processing circuitry; The processing circuitry includes: performing position transformation so that the position of a region of interest set in a mammography image of a breast of a subject and an examination position on the body of the subject in an ultrasound examination are expressed on a plane of the same scale; determining whether a position of the region of interest coincides with the inspection position on the plane; When it is determined that the position of the region of interest coincides with the examination position, an ultrasound image corresponding to the examination position is stored or output. Medical imaging equipment.

[0095] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0096] 1. Ultrasound diagnostic equipment 3. Mammography equipment 5 Terminal Equipment 7 Medical image storage device 8 CAD equipment 9 Medical image processing equipment 10. Device body 20 Ultrasound Probe 100 Processing circuit 110 Communication Interface 120 Input Interface 130 Display 140 Memory 101 Acquisition Function 102 Shooting condition setting function 103 Image generation function 104 Conversion Function 105 Decision Function 106 Judgment function 107 Display control function 108 Output Function 200 Processing circuit 201 Acquisition Function 202 Conversion Function 203 Decision Function 204 Judgment function 205 Output Function

Claims

1. a conversion unit that performs position conversion so that the position of a region of interest set in a mammography image of the subject's breast and the examination position on the subject's body in the ultrasound examination are represented on a plane of the same scale, thereby generating body mark information that indicates the examination position on the subject's body where the ultrasound probe is in contact during the ultrasound examination, where the position of the region of interest is mapped; A determination unit that determines an acquisition position of an ultrasound image within the region of interest on the body mark information; a determination unit that determines whether or not the acquisition position determined on the body mark information coincides with the examination position during the ultrasonic examination; Equipped with When the determination unit determines that the determined acquisition position and the examination position match, the determination unit stores or outputs an ultrasound image corresponding to the examination position. Medical imaging equipment.

2. the region of interest includes a first region of interest set in a first mammography image obtained by photographing the breast from a first direction, and a second region of interest set in a second mammography image obtained by photographing the breast from a second direction; The determination unit determines the acquisition position within the first region of interest and the second region of interest. The medical image processing device according to claim 1 .

3. The mammography system further includes a computer-aided diagnosis device that automatically detects a lesion location from the mammography image and sets the region of interest including the detected lesion location. The medical image processing device according to claim 1 .

4. An acquisition unit that acquires information about the region of interest from an external device. The medical image processing apparatus according to claim 1 .

5. and a photographing condition setting unit that performs settings for specifying an examination position on the body of the subject with which the ultrasonic probe is in contact during the ultrasonic examination, based on position information of a predetermined part on the body of the subject. The medical image processing apparatus according to claim 1 .

6. When it is determined that the acquisition position determined by the determination unit coincides with the examination position, the acquisition unit further acquires a mammography image corresponding to the region of interest from the external device. The medical image processing device according to claim 4 .

7. and an output unit that outputs an ultrasound image corresponding to an overlapping region between the first region of interest and the second region of interest from among the stored ultrasound images. The medical image processing device according to claim 2 .

8. The region of interest includes a plurality of regions of interest corresponding to a plurality of lesion locations, When the determination unit determines that the acquisition positions of the ultrasound images in the plurality of regions of interest coincide with the examination positions, the determination unit stores or outputs the ultrasound images corresponding to the examination positions. The medical image processing apparatus according to claim 1 .

9. An output unit is further provided for outputting an ultrasound image in which a lesion location is detected by a computer-aided diagnosis device from among the stored ultrasound images. The medical image processing apparatus according to claim 1 .

10. an output unit that outputs an ultrasound image captured based on automatic scan control, in which an examination position of the subject associated with the ultrasound image coincides with the determined acquisition position; The medical image processing apparatus according to claim 1 .

11. The region of interest includes a first region of interest set in a first mammography image obtained by photographing the breast from a first direction, and a second region of interest set in a second mammography image obtained by photographing the breast from a second direction; the determination unit determines, for the first region of interest and the second region of interest, the acquisition positions whose number corresponds to the number of acquired ultrasound images input by an operator; The medical image processing device according to claim 1 .

12. A medical image processing apparatus comprising: Ultrasound diagnostic equipment.

13. The computer of the medical image processing device performing position transformation so that the position of a region of interest set in a mammography image of the subject's breast and the examination position on the subject's body in the ultrasound examination are represented on a plane of the same scale, thereby generating body mark information indicating the examination position on the subject's body where the ultrasound probe is in contact during the ultrasound examination, on which the position of the region of interest is mapped; determining an acquisition position of an ultrasound image within the region of interest on the body mark information; During the ultrasonic examination, it is determined whether or not the acquisition position determined on the body mark information coincides with the examination position; When it is determined that the determined acquisition position and the examination position match, an ultrasound image corresponding to the examination position is stored or output. program.

Images