Method for marking region of interest in mammogram, system, and method of alignment

Abstract

To provide improved methods and systems for marking regions of interest mammograms and aligning the mammograms.SOLUTION: A method is provided for marking a region of interest in a mammogram, the method comprising: receiving a first mammogram of a patient, the first mammogram comprising a first nipple tip and being a first projection; identifying a first nipple line in the first mammogram; identifying a region of interest in the first mammogram; identifying a reference line in the first mammogram, the reference line being perpendicular to the first nipple line and extending from the first nipple line through the region of interest; calculating a distance d, the distance d extending from the first nipple tip to the reference line along the first nipple line; receiving a second mammogram of the patient, the second mammogram comprising a second nipple tip and being a second projection; identifying a second nipple line in the second mammogram; and providing, on the second mammogram, a region-of-interest marker, the region-of-interest marker extending perpendicular from the second nipple line by the distance d from the second nipple tip along the second nipple line.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The disclosed subject matter relates to systems and methods for manipulating images, and more particularly mammograms. The systems and methods described herein can mark areas of interest and align mammograms using nipple lines. [Background technology]

[0002] In medical imaging, Picture Archiving and Communication Systems (PACS) are a combination of computers and networks dedicated to the storage, retrieval, presentation and distribution of images. Medical information can be stored in a variety of formats, but a common format for image storage is DICOM (Digital Imaging and Communications in Medicine). DICOM is a standard that allows, among other things, the transfer of medical images and associated metadata from imaging modalities (e.g., X-ray (or its digital counterparts, such as computed radiography (CR) and digital radiography (DR)), computed tomography (CT) and magnetic resonance imaging (MRI) machines) to remote storage or client devices for viewing or other uses.

[0003] When viewing medical images, e.g., mammogram images stored in DICOM format, it may be important for a user to identify corresponding regions of interest in two different images. For example, when viewing a single breast taken with two different projections (e.g., craniocaudal (CC) and mediolateral oblique (MLO) projections), a user may be interested in identifying a region of interest in the first image and having the corresponding region of interest automatically marked in the second image. Typically, this is performed by determining the distance from a reference, such as the nipple. For example, an arc-shaped reference line with a center point on the nipple can be drawn on each image. Arc-shaped lines with similar radii drawn on two different images can be interpreted as the same distance from the nipple in each image. However, such a process is imperfect, at least because the CC and MLO projections are taken from different angles, the x-rays are taken along straight lines rather than arcs, and the breast may be compressed in the CC images.

[0004] Additionally, being able to align two images can be beneficial to a user. For example, when comparing a past and current examination, a user needs to align the images. Traditional methods of alignment involve pixel matching. However, such alignment can be inefficient, difficult, and imperfect. Summary of the Invention [Problem to be solved by the invention]

[0005] Therefore, there is a need for improved methods and systems for marking mammograms of areas of interest and for registering mammograms.

[0006] The objectives and advantages of the disclosed subject matter will be set forth in and will be obvious from the description which follows, as well as will be learned by practice of the disclosed subject matter. Additional advantages of the disclosed subject matter will be realized and attained by the methods and systems particularly pointed out in the written description and claims hereof, as well as the appended drawings. [Means for solving the problem]

[0007] To achieve these and other advantages, and in accordance with the purposes of the disclosed subject matter, the disclosed subject matter, as embodied and broadly described, is directed to a system and method for marking a region of interest in a mammogram. The method includes receiving a first mammogram of the patient, the first projection including a first nipple tip, identifying a first nipple line in the first mammogram, identifying a region of interest in the first mammogram, identifying a reference line in the first mammogram that is perpendicular to the first nipple line and extends from the first nipple line through the region of interest, calculating a distance d extending from the first nipple tip along the first nipple line to the reference line, receiving a second mammogram of the patient, the second projection including a second nipple tip, identifying a second nipple line in the second mammogram, and providing a region of interest marker in the second mammogram that extends perpendicular to the second nipple line at a distance d from the second nipple tip along the second nipple line.

[0008] In accordance with the disclosed subject matter, the first nipple line can be perpendicular to the chest wall. The method can further include receiving a user input identifying the chest wall. The second nipple line can be perpendicular to the chest wall. The method can further include receiving a user input identifying the chest wall. The first projection can be one of a craniocaudal view and a mediolateral oblique view. The second projection can be the other of a craniocaudal view and a mediolateral oblique view.

[0009] In accordance with the disclosed subject matter, the method can include receiving a user input indicative of a location of a first teat tip.The method can include receiving a user input indicative of a location of a second teat tip.

[0010] The disclosed subject matter relates to a system that includes one or more processors and a non-transitory memory coupled to the processor and including instructions executable by the processor, the processor operable to execute the instructions to receive a first mammogram of a patient, the first mammogram including a first nipple tip, identify a first nipple line in the first mammogram, identify a region of interest in the first mammogram, identify a reference line in the first mammogram that is perpendicular to the first nipple line and extends from the first nipple line through the region of interest, calculate a distance d that extends from the first nipple tip along the first nipple line to the reference line, receive a second mammogram of the patient, the second mammogram including a second nipple tip, identify a second nipple line in the second mammogram, and provide a region of interest marker in the second mammogram that extends perpendicularly from the second nipple line along the second nipple line at a distance d from the second nipple tip.

[0011] As described herein, the disclosed subject matter relates to a system and method for registering two mammogram images, the method including receiving a first mammogram of a patient including a first nipple tip having a first vertical coordinate and a first horizontal coordinate, identifying a first nipple line in the first mammogram having a first angle, receiving a second mammogram of the patient including a second nipple tip having a second vertical coordinate and a second horizontal coordinate, identifying a second nipple line in the second mammogram having a second angle, vertically shifting the second mammogram by a first difference between the second vertical coordinate and the first vertical coordinate, horizontally shifting the second mammogram by a second difference between the second horizontal coordinate and the first horizontal coordinate, and rotating the second mammogram by a third difference between the second angle and the first angle.

[0012] The disclosed subject matter relates to a system that includes one or more processors and a non-transitory memory coupled to the processor and including instructions executable by the processor, the processor operable to execute the instructions to receive a first mammogram of a patient including a first nipple tip having a first vertical coordinate and a first horizontal coordinate, identify a first nipple line in the first mammogram having a first angle, receive a second mammogram of the patient including a second nipple tip having a second vertical coordinate and a second horizontal coordinate, identify a second nipple line in the second mammogram having a second angle, vertically shift the second mammogram by a first difference between the second vertical coordinate and the first vertical coordinate, horizontally shift the second mammogram by a second difference between the second horizontal coordinate and the first horizontal coordinate, and rotate the second mammogram by a third difference between the second angle and the first angle. [Brief description of the drawings]

[0013] [Figure 1] 1 illustrates a hierarchy of medical image records that can be manipulated in accordance with the disclosed subject matter. [Diagram 2] 1 illustrates the architecture of an image manipulation system in accordance with the disclosed subject matter. [Diagram 3] 1 shows a mammogram image in accordance with the disclosed subject matter. [Figure 4A] 1 illustrates mammogram image processing for identifying the chest wall line in accordance with the subject matter of the present disclosure. [Figure 4B] 1 illustrates mammogram image processing for identifying the chest wall line in accordance with the subject matter of the present disclosure. [Figure 4C] 1 illustrates mammogram image processing for identifying the chest wall line in accordance with the subject matter of the present disclosure. [Figure 4D] 1 illustrates mammogram image processing for identifying the chest wall line in accordance with the subject matter of the present disclosure. [Figure 5A] 1 illustrates mammogram image processing to identify nipple location in accordance with the disclosed subject matter. [Figure 5B]1 illustrates mammogram image processing to identify nipple location in accordance with the disclosed subject matter. [Figure 5C] 1 illustrates mammogram image processing to identify nipple location in accordance with the disclosed subject matter. [Figure 6] 1 shows a mammogram with a posterior nipple line (PNL) and a region of interest in accordance with the disclosed subject matter. [Figure 7] 7 shows the mammogram of FIG. 6 showing distance d in accordance with the disclosed subject matter. [Figure 8] 7 shows a mammogram with CC projection of the breast in the mammogram of FIG. 6 in accordance with the disclosed subject matter. [Figure 9] 9 shows the mammogram of FIG. 8 showing region of interest markers in accordance with the disclosed subject matter. [Figure 10] 1 shows a mammogram in accordance with the disclosed subject matter. [Figure 11] 10 shows a mammogram of the same breast as FIG. 10 taken approximately two years earlier according to the disclosed subject matter. [Figure 12] 1 shows a flow chart illustrating a method for marking a region of interest in a mammogram in accordance with the disclosed subject matter. [Figure 13] 1 shows a flow chart illustrating a method for registering two mammogram images in accordance with the disclosed subject matter. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Reference will now be made in detail to various exemplary embodiments of the disclosed subject matter, which are illustrated in the accompanying drawings. For purposes of illustration and not limitation, the systems and methods are described herein in the context of manipulating images, particularly digital medical images (also referred to as medical images), such as DICOM images, and more particularly mammograms. However, the methods and systems described herein can be used to manipulate any digital images. As used herein and in the appended claims, singular forms such as "a," "an," "the," and singular nouns are intended to include the plural, unless the context clearly indicates otherwise. Thus, the term medical image, as used herein, can refer to one medical image or multiple medical images. 1 for purposes of explanation and not limitation, as referred to herein, a medical image record may include a single DICOM Service Object Pair (SOP) Instance (also referred to as a DICOM Instance, DICOM Image, and Image) 1 (e.g., 1A-1H), one or more DICOM SOP Instances 1 in one or more Series 2 (e.g., 2A-2D), one or more Series 2 in one or more Studies 3 (e.g., 3A, 3B), and one or more Studies 3. A DICOM SOP Instance 1 (e.g., 1A-1H) may be a mammogram.

[0015] 1-11 for illustration and not limitation, the disclosed system 100 can be configured to manipulate images. For example, the system 100 can be configured to mark regions of interest in mammograms and / or register mammograms, such as DICOM images (e.g., 1A-1H). The system 100 can include one or more computing devices defining a server 30 and a user workstation 60. The user workstation 60 can be coupled to the server 30 by a network. The network can be, for example, a local area network (LAN), a wireless LAN (WLAN), a virtual private network (VPN), or any other network that allows for any radio frequency or wireless type of connection. For example, the other radio frequency or wireless connections may include, but are not limited to, one or more network access technologies, such as Global System for Mobile Communications (GSM), Universal Mobile Telecommunications System (UMTS), General Packet Radio Service (GPRS), Enhanced Data GSM Environment (EDGE), Long Term Evolution (LTE), LTE Advanced, Third Generation Partnership Project (3GPP) technologies including 3G technologies, Internet of Things (IOT), Fifth Generation (5G), or New Radio (NR) technologies. Other examples may include Wideband Code Division Multiple Access (WCDMA), Bluetooth, IEEE 802.11b / g / n or any other 802.11 protocol, or any other wired or wireless connection.

[0016] The workstation 60 may take the form of any known client device. For example, the workstation 60 may be a computer, such as a laptop or desktop computer, a personal data or digital assistant (PDA), or any other user equipment or tablet, such as a mobile device or mobile portable media player. The server 30 may be a service point that provides processing, database, and communication facilities. For example, the server 30 may include a dedicated rack-mounted server, a desktop computer, a laptop computer, a set-top box, an integrated device that combines various features, such as features of two or more of the aforementioned devices, and the like. The server 30 may vary widely in configuration or capabilities, but may include one or more processors, memories, and / or transceivers. The server 30 may also include one or more mass storage devices, one or more power sources, one or more wired or wireless network interfaces, one or more input / output interfaces, and / or one or more operating systems.

[0017] A user may be anyone authorized to access the workstation 60 and / or server 30, including a medical professional, a medical technician, a researcher, or a patient. In some embodiments, a user authorized to use the workstation 60 and / or communicate with the server 30 may have a username and / or password that can be used to log in to or access the workstation 60 and / or server 30.

[0018] The workstation 60 may include a GUI 65, a memory 61, a processor 62, a transceiver 63, and an input / output (I / O) 64. Medical image records (such as mammograms 10) received by the workstation 60 may be processed using one or more processors 62. The processor 62 may be any hardware or software used to execute computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer to change its function to a special purpose, special purpose computer, application specific integrated circuit (ASIC) or other programmable digital data processing device such that the instructions executed through the processor of the workstation 60 or other programmable data processing device perform the functions / operations specified in the block diagrams or operational blocks, thereby transforming the function according to the embodiments herein. The processor 62 may be a portable embedded microcontroller or microcomputer. For example, the processor 62 may be embodied by any computing or data processing device, such as a central processing unit (CPU), a digital signal processor (DSP), an ASIC, a programmable logic device (PLD), a field programmable gate array (FPGA), a digitally enhanced circuit, or the like, or a combination thereof. The processor 62 may be implemented as a single controller, or multiple controllers or processors. The input / output 64 may be any suitable input / output, such as a mouse or a keyboard. In accordance with the disclosed subject matter, the input / output 64 may be integrated with the GUI 65 in the form of a touch screen. The input / output 64 may be implemented as a single input / output 64 or multiple input / outputs 64.

[0019] The workstation 60 can use the transceiver 63 to send and receive medical image records (such as mammograms 10) from the server 30. The transceiver 63 can be a transmitter or receiver alone, or both a transmitter and a receiver, or a unit or device configurable for both transmission and reception. In other words, the transceiver 63 can include any hardware or software that allows the workstation 60 to communicate with the server 30. The transceiver 63 can be either a wired transceiver or a wireless transceiver. If wireless, the transceiver 63 can be implemented as a remote radio head that is not located on the device itself but on a mast. Although FIG. 2 shows only a single transceiver 63, the workstation 60 can include one or more transceivers 63. The memory 61 can be a non-volatile storage medium or any other suitable storage device, such as a non-transitory computer readable medium or storage medium. For example, memory 61 may be a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), an erasable programmable ROM (EPROM), an electrically erasable programmable PROM (EEPROM), flash memory, or other solid state memory technology. Memory 61 may also be a compact disk read only optical memory (CD-ROM), a digital versatile disk (DVD), any other optical storage, a magnetic cassette, a magnetic tape, a magnetic disk storage, or other magnetic storage, or any other physical or material medium that can be used to tangibly store desired information, data, or instructions and that can be accessed by a computer or processor. Memory 61 may be removable or non-removable.

[0020] Referring to FIG. 3, four mammograms 10A-10D are shown for illustration and not limitation. Mammograms 10A-10D may be DICOM images (e.g., 1J). Mammogram 10A is an MLO image of the right breast, mammogram 10B is an MLO image of the left breast, mammogram 10C is a CC image of the right breast of mammogram 10A, and mammogram 10D is a CC image of the left breast of mammogram 10B. Each image is of the same patient (an anonymous woman born in 1964). Mammograms 10A and 10C include a left nipple 111A, and mammograms 10B and 10C include a right nipple 111B. The locations of the left nipple 111A and right nipple 111B can be identified by a user (e.g., by pointing and clicking on the locations), by a machine learning algorithm (e.g., by training to identify the locations of the nipples 111 (e.g., 111A, 111B) on a series of images and then automatically identifying the locations), by a combination of a machine learning algorithm and user input, or by other suitable means.

[0021] Mammograms 10A and 10B show chest wall 113 (shown as a dotted line). The chest wall is always perpendicular to one side in CC images (mammograms 10C and 10D). The location of chest wall 113 can also be identified by a user (e.g., by pointing and clicking two spots to identify the chest wall line), a machine learning algorithm, or other suitable means. By way of example, and referring to FIGS. 4A-4D for illustration and not limitation, the chest wall can be identified based on pixel values. For example, white areas in mammogram 10I that are greater than a certain pixel threshold (e.g., 128) can be identified. For example, a black and white image, such as that shown in FIG. 4B, can be generated based on pixels greater than the threshold. For example, white pixels adjacent to one side or corner, such as region 121, can be identified and a third image, such as that shown in FIG. 4C, can be generated. Line 122 (FIG. 4D) can be generated. For example, line 122 can be the line closest to the center of the straight line of the image to include all the white pixels. As another example, the line 122 may be the longest straight line that contains all the white pixels. The line 122 may represent the chest wall 113. Additionally or alternatively, the pixels may be used to identify the location of the nipple. With reference to FIGS. 5A-5C, by way of example and not limitation, the location of the nipple may be identified based on pixel values. For example, white areas of the mammogram 10I that are greater than a particular pixel padding value (e.g., 0) may be identified. For example, a black and white image, such as that shown in FIG. 5B, may be generated based on the pixels that are greater than the padding value. The point farthest from the breast area and the breast line 122 may be identified (e.g., using the line 123), and that point may be used as the location of the nipple.

[0022] Each mammogram 10 includes a nipple line (PNL) 114 (e.g., 114A-114D). The PNL 114 extends through each nipple 111 and perpendicular to the chest wall 113 (or the side of the image in a mammogram in a CC projection). Mammograms 10B and 10D include a region of interest 110, which may indicate a potential tumor or other anatomical feature. Region of interest 110A may be identified by a user (e.g., by pointing and clicking two spots to identify the chest wall line), by a machine learning algorithm, or by other suitable means. Mammogram 10D also includes a region of interest marker 115, which is shown as two dotted lines but may be any suitable marking, such as a shaded region, a dashed line, a box, or a circle. Additionally, more than one region of interest marker 115 may be provided on a mammogram.

[0023] 6-9, by way of example and not limitation, mammogram 10E is an MLO projection and mammogram 10F is a CC projection of the same breast shown in mammogram 10E. In operation, system 100 may provide region of interest marker 115A in mammogram 10F based on identification of region of interest 110A in mammogram 10E. Mammogram 10E may be displayed in GUI 65. First, the location of nipple 111C may be identified. For example, a user may click on the location of nipple 111C. The location of chest wall 113A may also be identified. For example, a user may click on at least two points 116A, 116B along the chest wall. These points 116A, 116B may be used to identify the location of chest wall 113A, which may be considered as a straight line passing through points 116A, 116B. PNL 114E can be identified by drawing a line through nipple 111C and perpendicular to chest wall 113A. Region of interest 110A can also be identified, for example, by a user clicking on the region of interest.

[0024] As shown in FIG. 7, for purposes of illustration and not limitation, the system 100 may identify a reference line 117A in the mammogram 10E. The reference line 117A may extend perpendicular to the PNL 114E through the region of interest 110A. The nipple 111C, the region of interest 110A, and the PNL 114E may form a triangle with an apex at the intersection of the reference line 117A with the nipple 111C. The system 100 may determine a distance d that extends from the nipple 111C to the reference line 117A along the PNL 114E. For example, the distance d may be determined using the formula: Distance = (Unit Vector of PNL * (Location of Region of Interest - Location of Nipple 111C). The unit vector of the PNL may be determined as follows: The chest wall 113A may be defined as a unit vector calculated by two points 116A (x1, y1) and 116B (x2, y2) on the chest wall 113A line. The distance may be calculated according to Equation 1.

[0025]

number

[0026] The unit vector of the chest wall may be ((x1-x2) / d, (y1-y2) / d). The unit vector of the PNL may be 90 degrees from the unit vector of the chest wall and may be ((y1-y2) / d, -(x1, x2) / d). Although a particular method of determining the distance d, any suitable method may be used to determine the distance d. A reference line 117A may be displayed on the mammogram 10E and its position may be adjusted by a user, for example, by dragging the reference line 117A along the PNL 114E.

[0027] Mammogram 10F may be displayed on GUI 65. Mammograms 10E and 10F may be displayed on GUI 65 simultaneously (e.g., side-by-side) or consecutively. The location of nipple 111C in mammogram 10F may be identified in a manner similar to that described above. PNL 114F may be identified by drawing a line through nipple 111C and perpendicular to an edge of mammogram 10E. System 100 may determine distance d along PNL 114F. System 100 may further determine two points 118A, 118B along PNL 114F that are equidistant from distance d along PNL 114F. Mammogram 10F may be provided with region of interest marker 115A (shown as two dotted lines) that extend perpendicularly from points 118A, 118B to PNL 114F. Thus, the user understands that region of interest 110 is located within the dotted line of region of interest marker 115A. Although shown as two dotted lines, the region of interest marker 115A can be provided in any suitable manner by extending perpendicularly from the nipple 111C away from the PNL 114F by a distance d. The algorithm considers the mammogram direction to be perpendicular to the PNL 114, so the region of interest marker 115 can be a more accurate arc drawn from the nipple 111 than traditionally. If the image is a composite 2D image with map information, a rectangle can be used as the region of interest marker 115. The map information can store depth or frame information for each pixel. From the location where the user clicks, the system 100 can convert it to breast depth information. The system 100 can calculate a target position from the depth information to indicate the region of interest marker 115 (such as a rectangle).

[0028] As discussed above, the system 100 provides region of interest markers 115 for mammograms 10 taken from different projections. Although described as identifying a region of interest 110 on an MLO image and providing a region of interest marker 115 on a CC image, the reverse can also be done. In accordance with the disclosed subject matter, the system 100 can provide a region of interest marker 115 for a second mammogram 10 taken in the same projection but at a different date and time. A region of interest marker 115 can be provided for one mammogram (e.g., 10H) based on identifying a region of interest 110 in the manner described above.

[0029] Although described as determining the distance d to place the region of interest marker 115, other suitable methods may be used. By way of example, ratios may be used to account for changes in breast area or compression. For example, a ratio of the distance d to the total length of the PNL 114 may be determined. The location of the region of interest marker 115 in the second mammogram 10 may then be determined based on the total length of the PNL 114 in the second mammogram 10 and the ratio.

[0030] In accordance with the disclosed subject matter, the system 100 can align first and second mammograms 10 that are projected in the same way but taken at different times. For illustration and not limitation, with reference to Figures 10 and 11, mammogram 10G is an MLO projection and mammogram 10H is an MLO projection of the same breast taken approximately two years ago. The system 100 can determine the location of the nipple 111D as described above and can draw the PNL 114G on the mammogram 10G. The system 100 can similarly determine the location of the nipple 111D and the PNL 114H in the mammogram 10H. The system 100 can align the two mammograms by shifting the mammogram 10H to align the nipple 111D in each mammogram 10G, 10H. For example, the system 100 may vertically shift the mammogram 10H by the difference between the vertical coordinate of the nipple 111D in the mammogram 10H and the vertical coordinate of the nipple 111D in the mammogram 10G. Similarly, the system 100 may horizontally shift the mammogram 10H by the difference between the horizontal coordinate of the nipple 111D in the mammogram 10H and the horizontal coordinate of the nipple 111D in the mammogram 10G. The mammogram 10H may be rotated by the difference between the angle 119A of the PNL 114H and the angle 119B of the PNL 114G. For example, the angle 119A may be determined relative to the horizontal line 120. This process may allow the user to more easily align the mammogram 10 within each of the mammograms 10G, 10H. The mammograms 10G and 10H may be displayed simultaneously (e.g., side-by-side) or consecutively on the GUI 65.

[0031] FIG. 12 illustrates an exemplary method 1000 for marking a region of interest in a mammogram. The method may begin at step 1010, where the method includes receiving a first mammogram of the patient, the first projection including a first nipple tip. At step 1020, the method may include identifying a first nipple line in the first mammogram. At step 1030, the method may include identifying a region of interest in the first mammogram. At step 1040, the method may include identifying a reference line in the first mammogram that is perpendicular to the first nipple line and extends from the nipple line through the region of interest. At step 1050, the method may include calculating a distance d that extends from the first nipple tip along the first nipple line to the reference line. At step 1060, the method may include receiving a second mammogram of the patient, the second projection including a second nipple tip. At step 1070, the method may include identifying a second nipple line in the second mammogram. At step 1080, the method may include providing a region of interest marker on the second mammogram extending perpendicularly from the second nipple line at a distance d from the second nipple tip along the second nipple line. In accordance with the disclosed subject matter, the method may repeat one or more steps of the method of FIG. 12 as desired. Although the disclosure has described and illustrated certain steps of the method of FIG. 12 as being performed in a particular order, the disclosure contemplates performing any suitable steps of the method of FIG. 12 in any suitable order. Additionally, although the disclosure has described and illustrated an exemplary method of marking a region of interest in a mammogram that includes certain steps of the method of FIG. 12, the disclosure contemplates any suitable method of marking a region of interest in a mammogram that includes any suitable steps, which may include all, some, or none of the steps of the method of FIG. 12, as desired.Additionally, although this disclosure describes and illustrates particular components, devices, or systems performing particular steps of the method of FIG. 12, this disclosure contemplates any suitable combination of any suitable components, devices, or systems performing any suitable steps of the method of FIG.

[0032] FIG. 13 illustrates an exemplary method 2000 for registering two mammogram images. The method may begin at step 2010, where the method includes receiving a first mammogram of a patient, the first mammogram including a first nipple tip having a first vertical coordinate and a first horizontal coordinate. At step 2020, the method may include identifying a first nipple line in the first mammogram having a first angle. At step 2030, the method may include receiving a second mammogram of the patient, the second nipple tip having a second vertical coordinate and a second horizontal coordinate. At step 2040, the method may include identifying a second nipple line in the second mammogram having a second angle. At step 2050, the method may include vertically shifting the second mammogram by a difference between the second vertical coordinate and the first vertical coordinate. In step 2060, the method may include shifting the second mammogram horizontally by the difference between the second horizontal coordinate and the first horizontal coordinate. In step 2070, the method may include rotating the second mammogram by the difference between the second angle and the first angle. In accordance with the disclosed subject matter, the method may repeat one or more steps of the method of FIG. 13 as desired. Although the disclosure has described and illustrated certain steps of the method of FIG. 13 as occurring in a particular order, the disclosure contemplates performing any suitable steps of the method of FIG. 13 in any suitable order. Additionally, although the disclosure has described and illustrated an exemplary method of registering two mammogram images that includes certain steps of the method of FIG. 13, the disclosure contemplates any suitable method of registering two mammogram images that includes any suitable steps, which may include all, some, or none of the steps of the method of FIG. 13, as desired. Additionally, although this disclosure describes and illustrates particular components, devices, or systems performing particular steps of the method of FIG. 13, this disclosure contemplates any suitable combination of any suitable components, devices, or systems performing any suitable steps of the method of FIG. 13.

[0033] The subject matter and operations described herein can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware (including the structures disclosed herein and their structural equivalents), or in one or more combinations thereof. Embodiments of the subject matter described herein can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions, encoded on a computer storage medium for execution by or to control the operation of a data processing apparatus.

[0034] A computer storage medium may be or may be included in a computer readable storage device, a computer readable storage substrate, a random access or serial access memory array or device, or a combination of one or more of these. Further, a computer storage medium is not a propagating signal, but a computer storage medium may be a source or destination of computer program instructions encoded in an artificially generated propagating signal. A computer storage medium may also be or may be included in one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices).

[0035] The term "processor" encompasses all kinds of apparatus, devices and machines for processing data, including, by way of example, a programmable processor, a computer, a system on a chip, or a combination of the above. An apparatus may include special purpose logic circuitry, such as an FPGA or an ASIC. In addition to hardware, an apparatus may also include code that creates an execution environment for the computer program in question, such as code that constitutes a processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of these. The apparatus and execution environment may implement a variety of different computing model infrastructures, such as web services, distributed computing, and grid computing infrastructures.

[0036] A computer program (also known as a program, software, software application, script, or code) can be written in any type of programming language, including compiled or interpreted, declarative or procedural, and can be deployed in any form, such as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program can correspond to a file in a file system, but need not. A program can be stored as part of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program, or in several associated files (e.g., files that store one or more modules, subprograms, or portions of code). A computer program can be deployed to run on one computer or on several computers that are located at one site or distributed across several sites and interconnected by a communications network.

[0037] The processes and logic flows described herein may be performed by one or more programmable processors executing one or more computer programs to perform operations by manipulating input data to generate output. The processes and logic flows may also be performed by, and an apparatus may be implemented as, special purpose logic circuitry, such as an FPGA or ASIC.

[0038] Processors suitable for executing a computer program may include, by way of example and not limitation, both general purpose and special purpose microprocessors. Devices suitable for storing computer program instructions and data may include all forms of non-volatile memory, media, and memory devices, including, by way of example and not limitation, semiconductor memory devices such as EPROM, EEPROM, and flash memory devices, magnetic disks such as internal hard disks or removable disks, magneto-optical disks, and CD-ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuitry.

[0039] Additionally, as noted above in connection with certain embodiments, certain components may communicate with certain other components over a network, such as, for example, a local area network or the Internet. To the extent not expressly stated above, the disclosed subject matter is intended to encompass each transaction, including both sending and receiving. With respect to the features described above, one skilled in the art will readily appreciate that when one component transfers, transmits, or otherwise makes available to another component, the other component receives or acquires, whether or not expressly stated.

[0040] In addition to the specific embodiments claimed below, the disclosed subject matter also relates to other embodiments having the dependent features claimed below and any other possible combinations of the dependent features disclosed above. Thus, the specific features presented in the dependent claims and disclosed above can be combined with each other in other possible combinations. Thus, the foregoing description of specific embodiments of the disclosed subject matter has been presented for purposes of illustration and description. The description is not intended to be exhaustive and is not intended to limit the disclosed subject matter to the disclosed embodiments.

[0041] It will be apparent to those skilled in the art that various modifications and variations can be made in the methods and systems of the disclosed subject matter without departing from the spirit or scope of the disclosed subject matter. Thus, the disclosed subject matter is intended to cover such modifications and variations that come within the scope of the appended claims and their equivalents. [Explanation of symbols]

[0042] 10A~10I Mammogram 30 Servers 31 Server Processors 61 Memory 62 processors 63 Transceiver 64 Input / Output (I / O) 65 GUI 100 Systems 110 Areas of Interest 111, 111A~111D nipple 113, 113A battlements 114A~114H Nipple line 115 Region of Interest Markers 116A, 116B, 118A, 118B points 117A Reference line 119A, 119B angle 120 horizontal line

Claims

1. 1. A method for marking a region of interest in a mammogram, comprising the steps of: receiving a first mammogram of the patient, the first mammogram including a first nipple tip and being a first projection; identifying a first nipple line in the first mammogram; Identifying a region of interest in the first mammogram; Identifying a reference line in the first mammogram that is perpendicular to the first nipple line and extends from the first nipple line through the region of interest; Calculating a distance d extending from the first nipple tip along the first nipple line to the reference line; receiving a second mammogram of the patient, the second mammogram including a second nipple tip and being a second projection; identifying a second nipple line in the second mammogram; providing a region of interest marker on the second mammogram extending perpendicularly from the second nipple line at a distance d from the second nipple tip along the second nipple line; The method includes:

2. The method of claim 1 , wherein the first nipple line is perpendicular to the chest wall.

3. The method of claim 2 , further comprising receiving a user input identifying the chest wall.

4. The method of claim 1 , wherein the second nipple line is perpendicular to the chest wall.

5. The method of claim 4 , further comprising receiving a user input identifying the chest wall.

6. The method of claim 1 , wherein the first projection comprises one of a cranio-caudal view and a medio-lateral oblique view.

7. The method of claim 6 , wherein the second projection comprises the other of the craniocaudal view and the mediolateral oblique view.

8. The method of claim 1 , further comprising receiving a user input indicating a location of the first nipple tip.

9. The method of claim 1 , further comprising receiving a user input indicating a location of the second nipple tip.

10. and one or more processors; and a non-transitory memory coupled to the processors and including instructions executable by the processors, the processor executing the instructions to receiving a first mammogram of the patient, the first mammogram including a first nipple tip and being a first projection; identifying a first nipple line in the first mammogram; Identifying a region of interest in the first mammogram; identifying a reference line in the first mammogram that is perpendicular to the first nipple line and extends from the first nipple line through the region of interest; Calculating a distance d extending from the first nipple tip along the first nipple line to the reference line; receiving a second mammogram of the patient, the second mammogram including a second nipple tip and being a second projection; Identifying a second nipple line in the second mammogram; providing a region of interest marker on the second mammogram extending perpendicularly from the second nipple line at a distance d from the second nipple tip along the second nipple line; It is operable as follows: system.

11. 1. A method for registering two mammogram images, comprising: receiving a first mammogram of a patient including a first nipple tip having a first vertical coordinate and a first horizontal coordinate; Identifying a first nipple line in the first mammogram, the first nipple line having a first angle; receiving a second mammogram of the patient including a second nipple tip having a second vertical coordinate and a second horizontal coordinate; identifying a second nipple line in the second mammogram having a second angle; vertically shifting the second mammogram by a first difference between the second vertical coordinate and the first vertical coordinate; shifting the second mammogram horizontally by a second difference between the second horizontal coordinate and the first horizontal coordinate; rotating the second mammogram by a third difference between the second angle and the first angle; The method includes:

12. The method of claim 11 , wherein the first nipple line is perpendicular to the chest wall.

13. The method of claim 12 , further comprising receiving a user input identifying the chest wall.

14. The method of claim 11 , wherein the second nipple line is perpendicular to the chest wall.

15. The method of claim 14 , further comprising receiving a user input identifying the chest wall.

16. The method of claim 11 , wherein the first mammogram includes a cranio-caudal view and the second mammogram includes a cranio-caudal view.

17. 12. The method of claim 11, wherein the first mammogram includes an endo-external oblique view and the second mammogram includes an endo-external oblique view.

18. The method of claim 11 , further comprising receiving a user input indicating a location of the first nipple tip.

19. The method of claim 11 , further comprising receiving a user input indicating a location of the second nipple tip.

20. and one or more processors; and a non-transitory memory coupled to the processors and including instructions executable by the processors, the processor executing the instructions to receiving a first mammogram of a patient, the first mammogram including a first nipple tip having a first vertical coordinate and a first horizontal coordinate; identifying a first nipple line in the first mammogram, the first nipple line having a first angle; receiving a second mammogram of the patient, the second mammogram including a second nipple tip having a second vertical coordinate and a second horizontal coordinate; identifying a second nipple line in the second mammogram having a second angle; vertically shifting the second mammogram by a first difference between the second vertical coordinate and the first vertical coordinate; shifting the second mammogram horizontally by a second difference between the second horizontal coordinate and the first horizontal coordinate; rotating the second mammogram by a third difference between the second angle and the first angle; It is operable as follows: system.

Images