Biopsy Needle Visualization

Through ultrasound technology and image analysis, the characteristics and tissue characteristics of the biopsy needle are identified and predicted position indicators are generated, which solves the problem of difficulty in positioning during the biopsy process and improves the accuracy and operation efficiency of the biopsy needle.

CN111867479BActive Publication Date: 2024-11-22HOLOGIC INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980020152.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-05-04
Filing Date
2019-05-03
Publication Date
2024-11-22
Estimated Expiration
2039-05-03

AI Technical Summary

Technical Problem

During the biopsy process, existing ultrasound guidance technology is difficult to accurately locate the position of the biopsy needle after firing, resulting in medical professionals relying on experience and intuition, which increases operational difficulty and error.

Method used

Ultrasound technology combines image analysis and user input to identify the characteristics and tissue characteristics of the biopsy needle to generate indicators for predicting position, helping medical professionals to accurately locate the position of the biopsy needle after firing.

Benefits of technology

It improves the positioning accuracy of biopsy needles, reduces repeated operations, and reduces the requirements for experienced surgeons. It is suitable for biopsy needles of different brands and models.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111867479B_ABST
    Figure CN111867479B_ABST
Patent Text Reader

Abstract

Methods and systems for providing guidance for operation of a biopsy needle based on ultrasound imaging. Ultrasound waves are emitted and detected by an ultrasound transducer to generate image data. A biopsy needle is identified within the generated image data, and the biopsy needle may be in a pre-fire configuration. Based on the identification of the biopsy needle, the method and system may determine a predicted position of the biopsy needle based at least in part on biopsy needle characteristics. The predicted position of the biopsy needle may be a predicted position of the biopsy needle when the biopsy needle is in its post-fire configuration. At least one indicator may be displayed indicating the determined predicted position.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application was filed as a PCT international patent application on May 3, 2019, and claims priority to and the benefit of U.S. Provisional Patent Application Serial No. 62 / 666,869, entitled “Biopsy Needle Visualization,” filed on May 4, 2018, the disclosure of which is incorporated herein by reference in its entirety. Background Art

[0003] Biopsy is a procedure for extracting tissue from a patient's target location for further inspection. For example, a lesion or mass can be identified in the patient's body, and a sample of the lesion or mass is desired for further testing, analysis or inspection. During some biopsy procedures (such as percutaneous core biopsy), a surgeon or medical specialist inserts a biopsy needle into the patient's body through an incision in the patient's skin. In order to accurately aim at and / or visualize lesions with a biopsy needle, various imaging modalities are used, including using ultrasound technology to view the image of the needle at the subcutaneous position. Although this use of ultrasound technology is useful, previous ultrasound-guided biopsy techniques provide visual indications, but the additional information about lesions or biopsy needles is limited, and the medical professional performing the biopsy procedure is almost not provided with guidance or insight. Therefore, the biopsy procedure relies heavily on the skills, experience and intuition of medical professionals.

[0004] It is with respect to these and other general considerations that aspects disclosed herein have been made.Also, while relatively specific problems may be discussed, it should be understood that the examples should not be limited to solving specific problems identified in the background or elsewhere in this disclosure. Summary of the invention

[0005] Examples of the present disclosure describe systems and methods for locating implanted markers through ultrasound technology along with additional combinations of other modalities.

[0006] In one aspect, the technology relates to a method for providing guidance for the operation of a biopsy needle. The method includes: emitting an array of ultrasonic sound waves from an ultrasonic transducer of an ultrasonic probe; detecting reflected ultrasonic sound waves by the ultrasonic transducer, wherein the reflected ultrasonic sound waves include at least a portion of the array of ultrasonic sound waves after being reflected from a patient's body; and generating image data based on the reflected ultrasonic sound waves. The method also includes identifying, by a processor, at least a portion of a biopsy needle in a patient's body within the generated image data. The method also includes determining, by the processor, a predicted position of an aspect of the biopsy needle based at least in part on the identification of the biopsy needle, based at least in part on one or more biopsy needle characteristics stored in a memory operably connected to the processor. In addition, the method includes: displaying an ultrasonic image based on the generated image data on a display operably connected to the processor; and displaying at least one indicator of the predicted position of the aspect of the biopsy needle on the ultrasonic image.

[0007] In an example, identifying a biopsy needle includes identifying a biopsy needle in a pre-firing configuration, and the predicted position of the biopsy needle is the predicted position of the biopsy needle in a post-firing configuration. In another example, displaying at least one indicator for the predicted position of the biopsy needle includes displaying at least one of a tip indicator indicating a predicted biopsy needle tip position or a hole indicator indicating a predicted biopsy needle hole position. In yet another example, identifying a biopsy needle includes receiving user input identifying a biopsy needle in an ultrasound image. In yet another example, identifying a biopsy needle includes analyzing, by a processor, image data generated using an image analysis technique to identify the biopsy needle. In yet another example, the method further includes determining a deflection probability of the needle tip position based on at least one of: (1) experimental data for a type of biopsy needle, and (2) one or more stored characteristics of the biopsy needle, the characteristics including at least one of a needle length, a needle gauge, a needle wall thickness, a needle material composition, a needle tip geometry, a throw length, and a needle firing mechanism characteristic.

[0008] In another example, one or more stored characteristics of the biopsy needle are based on user input regarding the type of the biopsy needle. In yet another example, the input regarding the type of the biopsy needle includes the model and manufacturer of the biopsy needle. In yet another example, the method further includes determining the deflection probability is also based on tissue characteristics within the patient along the firing trajectory of the biopsy needle. In yet another example, the tissue characteristics are based on input identifying the tissue characteristics.

[0009] In another example, the method further includes determining tissue characteristics by the following steps: determining, by a processor, a firing trajectory of the biopsy needle based on the generated image data; receiving elastic imaging data of the tissue along at least a portion of the firing trajectory for the biopsy needle; and determining the tissue characteristics based on the received elastic imaging data. In yet another example, the method further includes displaying a deflection probability indicator on the ultrasound image, wherein the deflection probability indicator indicates a range of post-firing tip positions based on the determined deflection probability. In yet another example, the deflection probability indicator is one of an ellipse, a rectangle, a square, a triangle, or a circle. In yet another example, the deflection probability indicator indicates a range of probabilities of post-firing tip positions.

[0010] In another example, the deflection probability indicator includes a heat map. In yet another example, the method further includes determining that the predicted position is outside the ultrasound image; and displaying an alarm in response to determining that the predicted position is outside the ultrasound image. In yet another example, the method further includes determining a maximum pre-fire biopsy needle depth for which the predicted post-fire biopsy needle tip position remains within the ultrasound image; and displaying a maximum needle depth indicator, wherein the maximum needle depth indicator indicates the determined maximum pre-fire biopsy needle depth. In yet another example, the maximum needle depth indicator is a line segment perpendicular to the firing trajectory of the biopsy needle.

[0011] In another example, the method further includes: determining that the biopsy needle has moved out of the imaging plane of the ultrasound image; and in response to determining that the biopsy needle has moved out of the imaging plane of the ultrasound image, performing at least one of the following operations: displaying an alarm indicating that the biopsy needle has moved out of the imaging plane of the ultrasound image; or changing the beam form emitted from the ultrasound probe to compensate for the biopsy needle moving out of the imaging plane. In yet another example, determining that the biopsy needle has moved out of the imaging plane of the ultrasound image further includes: determining a first apparent depth of the biopsy needle at a first time; determining a second apparent depth of the biopsy needle at a second time after the first time, the second apparent depth being greater than the first apparent depth; determining a third apparent depth of the biopsy needle at a third time after the second time, the third apparent depth being less than the second apparent depth; and determining that the biopsy needle has moved out of the imaging plane of the ultrasound image based on the third apparent depth being less than the second apparent depth and the second apparent depth being greater than the first apparent depth.

[0012] In another example, the tip indicator is a graphical element having a shape based on the geometry of the tip of the biopsy needle. In yet another example, the hole indicator includes two line segments perpendicular to the firing trajectory of the biopsy needle. In yet another example, the tip indicator and the hole indicator are displayed simultaneously.

[0013] In one aspect, the technology relates to a system comprising: an ultrasound probe including an ultrasound transducer configured to transmit an array of ultrasound sound waves and detect reflected ultrasound sound waves, wherein the reflected ultrasound sound waves include at least a portion of the array of ultrasound sound waves after being reflected within a patient; a display; at least one processor operably connected to the display and the ultrasound probe; and a memory operably connected to the at least one processor storing instructions that, when executed by the at least one processor, perform a set of operations. The set of operations includes generating image data based on the reflected ultrasound sound waves; identifying, by the processor, a biopsy needle within the patient within the generated image data; determining, by the processor, a predicted location of an aspect of the biopsy needle based on one or more stored characteristics of the biopsy needle based at least in part on the identification of the biopsy needle; displaying an ultrasound image based on the generated image data on a display operably connected to the processor; and displaying at least one indicator for the predicted location of the aspect of the biopsy needle on the ultrasound image.

[0014] In one aspect, the technology relates to a method for providing guidance for manipulation of a biopsy needle. The method includes displaying a user interface for selecting a type of biopsy needle to be used for a biopsy procedure; receiving input in the user interface indicating the type of biopsy needle to be used for the biopsy procedure; determining needle characteristics of the biopsy needle based on the input indicating the type of biopsy needle, wherein the needle characteristics include at least one of needle length, needle gauge, needle wall thickness, needle material composition, needle tip geometry, and needle firing mechanism characteristics; determining a deflection probability of a post-firing tip position of the biopsy needle based on the determined needle characteristics; emitting an array of ultrasonic sound waves from an ultrasonic transducer of an ultrasonic probe; detecting reflected ultrasonic sound waves by the ultrasonic transducer, wherein the reflected ultrasonic sound waves include at least a portion of the array of ultrasonic sound waves after reflection from a patient's body; generating an ultrasonic image based on the reflected ultrasonic sound waves; identifying the biopsy needle within the generated ultrasonic image; and displaying a deflection probability indicator on the ultrasonic image based on the identification of the biopsy needle and the determined deflection probability of the post-firing tip position of the biopsy needle, wherein the deflection probability indicator indicates a range of predicted post-firing tip positions based on the determined deflection probability.

[0015] In an example, the input in the user interface indicates a brand and model of a biopsy needle. In another example, determining the needle characteristics of the biopsy needle includes querying a database containing needle characteristics based on the input received from the user interface. In yet another example, the method of claim 25, wherein the deflection probability indicator is one of an ellipse, a circle, a square, a rectangle, or a triangle. In yet another example, the deflection probability indicator indicates a range of probabilities of post-firing tip positions. In yet another example, the deflection probability indicator includes a heat map indicating a range of probabilities of post-firing tip positions.

[0016] In another example, determining the probability of deflection is also based on tissue characteristics within the patient along the firing trajectory of the biopsy needle. In yet another example, the tissue characteristics are based on user input identifying the tissue characteristics. In yet another example, the method further includes determining the tissue characteristics by the following steps: determining the firing trajectory of the biopsy needle based on the generated ultrasound image; receiving elastic imaging data of the tissue along at least a portion of the firing trajectory for the biopsy needle; and determining the tissue characteristics based on the received elastic imaging data. In yet another example, determining the probability of deflection is based on a mathematical analysis for determining the deflection of the needle having the determined needle characteristics. In another example, the method includes aggregating ultrasound image data for inserting the biopsy needle into the patient multiple times; training a machine learning tool based on the aggregated ultrasound image data; and wherein determining the probability of deflection is determined at least in part using the trained machine learning tool.

[0017] In one aspect, the system relates to: an ultrasound probe including an ultrasound transducer configured to transmit an array of ultrasound sound waves and detect reflected ultrasound sound waves, wherein the reflected ultrasound sound waves include at least a portion of the array of ultrasound sound waves after being reflected within a patient's body; a display; at least one processor operably connected to the display and the ultrasound probe; and a memory operably connected to the at least one processor storing instructions that perform a set of operations when executed by the at least one processor. The operation set includes displaying a user interface on a display for selecting the type of biopsy needle to be used for a biopsy procedure; receiving input in the user interface indicating the type of biopsy needle to be used for the biopsy procedure; determining needle characteristics of the biopsy needle based on the input indicating the type of biopsy needle, wherein the needle characteristics include at least one of needle length, needle gauge, needle wall thickness, needle material composition, needle tip geometry, and needle firing mechanism characteristics; determining a deflection probability of a post-firing tip position of the biopsy needle based on the determined needle characteristics; generating an ultrasound image based on reflected ultrasonic sound waves; identifying the biopsy needle in the generated ultrasound image; and displaying a deflection probability indicator on the ultrasound image based on the identification of the biopsy needle and the determined deflection probability of the post-firing tip position of the biopsy needle, wherein the deflection probability indicator indicates a range of predicted post-firing tip positions based on the determined deflection probability.

[0018] This summary is provided to introduce some concepts in a simplified form, which will be further described in the detailed description below. This summary is neither intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Additional aspects, features, and / or advantages of examples will be set forth in part in the description below, and in part will become clear from the description, or may be learned through practice of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Non-limiting and non-exhaustive examples are described with reference to the following figures.

[0020] Figure 1A An example of a biopsy needle visualization system is depicted.

[0021] Figure 1B An example of a biopsy needle visualization system is depicted with a biopsy needle in a pre-firing configuration.

[0022] Figure 1C An example of a biopsy needle visualization system is depicted with the biopsy needle in a post-fired configuration.

[0023] Figure 1D An example of a biopsy needle in a pre-fired configuration is depicted.

[0024] Figure 1E Depicts the firing process Figure 1D Example of a biopsy needle.

[0025] Figure 1F Depicted in fired configuration Figure 1D-1E Example of a biopsy needle.

[0026] Figure 1G An example of a suitable operating environment for incorporation into a biopsy needle visualization system is depicted.

[0027] Figure 2 An example ultrasound image including a biopsy needle prediction indicator is depicted.

[0028] Figure 3A An example method for visualization of a biopsy needle is depicted.

[0029] Figure 3B Another example method for visualization of a biopsy needle is depicted.

[0030] Figure 3C Another example method for visualization of a biopsy needle is depicted.

[0031] Figure 4 An example method for detecting out-of-plane displacement of a biopsy needle is depicted. DETAILED DESCRIPTION

[0032] Proper positioning of the biopsy needle is important for a successful biopsy procedure. In the event that the biopsy needle is not properly positioned, the biopsy procedure may need to be repeated until the desired sample is obtained. Incorrect positioning may also result in repeated steps during the procedure, additional samples being obtained during the same procedure, and / or the patient having to return for other subsequent biopsy procedures. However, as different biopsy needles are used, proper positioning of the biopsy needle becomes more difficult. As an example, some biopsy needles are spring-loaded and have other "firing" mechanisms that cause a portion of the biopsy needle to extend to capture a sample. For example, an outer sleeve of the biopsy needle can be inserted into a patient's body, and after a release mechanism is triggered, an inner sleeve having a hole is fired from within the outer sleeve to cause the inner sleeve to extend further into the patient's body to capture the sample. Examples of such biopsy needles include the Hologic Biopsy Needle from Marlborough, Massachusetts. Biopsy equipment and Biopsy device. Even with such an ultrasound image of a biopsy needle in a subcutaneous position, the post-fire position of the biopsy needle is still unknown. That is, while a portion of the biopsy needle in its pre-fire configuration can be seen on the ultrasound image, the final position of the biopsy needle in its post-fire configuration cannot necessarily be discerned from the ultrasound image alone.

[0033] Many biopsy procedures, even those with prior ultrasound technology, rely heavily on the skills, experience, and intuition of the medical professional performing the biopsy procedure. While some well-trained and experienced medical professionals are able to roughly estimate where the biopsy needle may be located in the post-fire position, less experienced medical professionals may have difficulty making such an approximation. In addition, biopsy needles vary between different brands and models, which further increases the unpredictability of the process. For example, one biopsy needle may deflect more than another when fired, and this deflection may also depend on the specific tissue that the biopsy needle will pass through when fired. For those experienced surgeons, these deflections are extremely difficult to predict, if not impossible. In addition, there are differences in the nature and composition of the patient's breast tissue, which can cause some unpredictability in the final position of the biopsy needle after firing.

[0034] To alleviate those problems, the present technology provides, among other things, a biopsy needle visualization system that provides more accurate and useful feedback during a biopsy procedure to allow a medical professional to more accurately position a biopsy needle. As an example, a biopsy needle visualization system can provide a marker of a predicted position and / or location of a biopsy needle in its post-firing configuration based on its pre-firing configuration. The predicted position of the biopsy needle can preferably be displayed as an overlay on a live or real-time ultrasound image of the biopsy needle and as a target position for the biopsy needle. Therefore, additional guidance is provided for medical professionals to perform more accurate sampling of tissue using a biopsy needle. For example, if a surgeon sees that the predicted position is not the target position, the medical professional can adjust the biopsy needle to the exact position. The predicted position of the biopsy needle can be displayed as a collection of biopsy prediction indicators that can indicate the predicted position of the tip of the biopsy needle and the hole of the biopsy needle. The prediction can also be based on the characteristics of the biopsy needle currently used to perform a biopsy. Thus, the guidance provided to the surgeon is specific to the particular biopsy needle being used, thereby allowing the medical professional to perform a biopsy even if he or she has never used that particular needle before. The composition of the patient's breast tissue that the medical professional can determine or indicate during the procedure can also be used to determine the predicted location of the biopsy needle, thereby providing a more accurate prediction. Thus, the techniques described herein provide improved performance for both experienced and less experienced surgeons.

[0035] Figure 1A An example of a biopsy needle visualization system 100 is depicted. The biopsy needle visualization system 100 includes an ultrasound probe 102 that includes an ultrasound transducer 104. The ultrasound transducer 104 is configured to transmit an array of ultrasound waves 106. The ultrasound transducer 104 converts electrical signals into ultrasound sound waves 106. The ultrasound transducer 104 can also be configured to detect ultrasound sound waves, such as ultrasound sound waves that have been reflected from an internal portion of a patient. In some examples, the ultrasound transducer 104 can incorporate capacitive transducers and / or piezoelectric transducers, as well as other suitable transducing technologies.

[0036] The ultrasound transducer 104 is also operably connected (eg, wired or wireless) to a display 110. The display 110 may be part of a computing system that includes a processor and memory configured to generate and analyze ultrasound images. Figure 1GFurther discussion of suitable computing systems is provided. Display 110 is configured to display an ultrasound image based on ultrasound imaging of the patient. The ultrasound imaging performed in biopsy needle visualization system 100 is primarily B-mode imaging, which results in a two-dimensional ultrasound image of a cross section of a portion of the patient's body. The brightness of the pixels in the resulting image generally corresponds to the amplitude or intensity of the reflected ultrasound waves. Other ultrasound imaging modes may also be used. Although the term "transceiver" is used herein, the term is intended to cover transmitters, receivers, and transceivers, and any combination thereof.

[0037] Figure 1B An example of the biopsy needle visualization system 100 is depicted with the biopsy needle 124 in a pre-firing configuration. The ultrasound probe 102 is in contact with a portion of the patient 112, such as a breast of the patient 112. Figure 1B , the ultrasound probe 102 is used to image a portion of a patient 112 containing a lesion 114. A biopsy device 122 having a biopsy needle 124 is inserted into the body of the patient 112. The biopsy needle 124 is depicted in its pre-fired configuration. In order to image the portion of the patient 112 containing the biopsy needle 124, the ultrasound transducer 104 transmits an array of ultrasound sound waves 106 into the body of the patient 112. When the biopsy needle 124 is in the field of view, a portion of the ultrasound sound waves 106 are reflected from the internal features of the patient 112 and the biopsy needle 124 and return to the ultrasound probe 102 as reflected ultrasound sound waves 120. The reflected ultrasound sound waves 120 can be detected by the ultrasound transducer 104. For example, the ultrasound transducer 104 receives the reflected ultrasound sound waves 120 and converts the ultrasound sound waves 120 into electrical signals that can be processed and analyzed to generate ultrasound image data on the display 110.

[0038] Figure 1C An example of the biopsy needle visualization system 100 is depicted with the biopsy needle 124 in a post-fired configuration. Figure 1C The biopsy needle visualization system 100 depicted in Figure 1B 114, except that the biopsy needle 124 is in a post-fired configuration. In the post-fired configuration, the biopsy needle has a throwing portion 126 extending from the biopsy needle 124. In some examples, the throwing portion 126 can be an inner cannula of the biopsy needle 124. The throwing portion 126 also includes a hole 130 for collecting tissue from the lesion 114. The hole 130 is located between the biopsy needle tip 128 and the portion of the biopsy needle 124 in the pre-fired configuration of the biopsy needle 124.

[0039] As from Figure 1B-1CAs can be seen, the biopsy needle 124 is inserted into the patient's body in a direction toward the lesion 114. When the biopsy needle 124 in its pre-fire configuration reaches a specific point in the patient's body 112, the biopsy needle 124 is fired. The firing of the biopsy needle 124 is often triggered by pressing or otherwise manipulating a trigger located on the biopsy device 122. When the biopsy needle 124 is fired, the throwing portion 126 extends from the biopsy needle 124. In the depicted example, it is desired that the hole 130 of the throwing portion 126 is located at the lesion 114 so that a tissue sample from the lesion 114 can be collected. As discussed above, determining the correct position and positioning of the biopsy needle 124 in the pre-fire configuration to achieve the desired hole 130 and tip 128 position in the post-fire configuration is both important and difficult. By generating an ultrasound image that includes the biopsy needle 124 during a biopsy procedure, analysis can be performed on the image to provide additional guidance regarding the positioning of the needle, as described below with reference to Figure 2-4 Further discussion.

[0040] Figures 1D-1F An example of a biopsy needle 124 at various stages during the firing process is depicted and discussed simultaneously. In particular, Figure 1D Depicted is the biopsy needle 124 in a pre-fired configuration, Figure 1E The biopsy needle 124 is depicted during the firing process, and Figure 1F The biopsy needle 124 is depicted in a post-firing configuration. The example biopsy needle 124 includes an outer cannula 132 and an inner cannula 134. The inner cannula 134 includes an aperture 130 and a biopsy needle tip 128. During the firing process, the inner cannula 134 is advanced from the outer cannula 132. The distance that the inner cannula 134 extends from the outer cannula 132 may be referred to as a throw distance. Once the inner cannula 134 has been extended from the outer cannula 132 (eg, Figure 1E ), the tissue is captured in the hole 130. In some examples, a vacuum mechanism can be attached to the biopsy needle 124 to pull the tissue into the hole 130. As the tissue is captured in the hole 130, the outer sleeve 132 is advanced over the inner sleeve 134 (as shown in FIG. Figure 1F ), which cuts the tissue, thereby separating the tissue captured in the hole 130 from the rest of the patient's tissue. The outer sleeve 132 (alone) or both the outer sleeve 132 and the inner sleeve 134 can be made in whole or in part of a material that exhibits a high degree of echogenicity, which makes those elements appear brighter in the resulting ultrasound image. The biopsy needle 124 is then in a fully fired configuration and can be withdrawn from the patient 112. The tissue captured in the hole 130 can then be removed from the biopsy needle 124 for further analysis and examination. The above procedure can be performed multiple times to remove multiple biopsy samples. At the end of the biopsy procedure, a marker marking the location of the biopsy site can be inserted into the biopsy location.

[0041] In another case, only a portion 135 of the outer sleeve 132 is formed by a high echo material, which can be completely or partially around the circumference of the inner sleeve. When at its maximum, the portion 135 is located at a position on the outer sleeve 132 at a known distance D from the tip 128 of the inner sleeve 134. For example, this distance D can be specific to a specific needle type or manufacturer. Here, the known distance D positions the portion 135 at the distal side of the tip 128 and relative to the hole 130 of the portion 135, but other positions can be expected. By forming only the portion 135 of the outer sleeve 132 by a high echo material and forming a known distance D with the tip 128, the accuracy of the post-fire position of the inner sleeve 134 can be improved. More specifically, if a biopsy needle with an outer sleeve formed entirely of a high echo material is used, the processor analyzing the image (or the surgeon performing the procedure) may not know whether the apparent tip of the outer sleeve identified is the actual tip of that component. Given the penetration depth of ultrasound waves, it is possible that the apparent tip of the outer sleeve may be only that portion of the outer sleeve that is located at the maximum depth of penetration of that wave. Figure 1D-1E In the configuration depicted in , once portion 135 is detected, the location of the actual tip 128 can be more easily determined.

[0042] Figure 1G An example of a suitable operating environment 150 for incorporation into the biopsy needle visualization system 100 is depicted. In its most basic configuration, the operating environment 150 generally includes at least one processing unit 152 and memory 154. Depending on the exact configuration and type of computing device, the memory 154 (storing instructions to perform the active monitoring embodiments disclosed herein) may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. This most basic configuration is Figure 1E 156. In addition, the environment 150 may also include storage devices (removable devices 158 and / or non-removable devices 160), including but not limited to disks, optical disks, or tapes. Similarly, the environment 150 may also have (one or more) input devices 164 (such as a keyboard, mouse, pen, voice input, etc.), and / or (one or more) output devices 166 (such as a display, speaker, printer, etc.). The input device 164 may also include a circuit system or interface that receives or detects signals emitted from various components of the biopsy needle visualization system 100, such as the ultrasound probe 102. The environment may also include one or more communication connections 162, such as a LAN, WAN, point-to-point, etc. In embodiments, the connection may be operable to facilitate point-to-point communication, connection-oriented communication, connectionless communication, etc.

[0043] The operating environment 150 typically includes at least some form of computer-readable media. Computer-readable media can be any available media that can be accessed by the processing unit 152 or other devices that include the operating environment. As an example and not limitation, computer-readable media can include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, EEPROM, flash memory or other storage technology, CD-ROM, digital versatile disk (DVD) or other optical storage device, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or any other non-transient medium that can be used to store desired information. Computer storage media do not include communication media.

[0044] Communication media implements computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and includes any information delivery media. The term "modulated data signal" refers to a signal that has one or more of its characteristics set or changed in a manner that encodes information as a signal. By way of example and not limitation, communication media include wired media such as a wired network or a direct wired connection, and wireless media such as acoustic, RF, infrared, microwave and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media.

[0045] Operating environment 150 can be a single computer operating in a network environment using logical connections to one or more remote computers. The remote computer can be a personal computer, server, router, network PC, peer device or other public network node, and typically includes many or all of the above elements as well as other elements not mentioned. The logical connection can include any method supported by the available communication media.

[0046] Figure 2 An example of an ultrasound image 201 including a biopsy needle 224 and a plurality of biopsy needle prediction indicators is depicted. The ultrasound image is displayed on a display 200. The display 200 may be the display of the device described above with reference to FIG. Figure 1AThe display 110 discussed. The ultrasound image 201 is an example of an ultrasound image in which a biopsy needle 224 is within the field of view of the ultrasound probe. The ultrasound image 201 is generated based on image data generated from the detected reflected ultrasound sound waves. Based on the image data or ultrasound image 201, the biopsy needle 224 can be identified through the use of image analysis techniques. The shape of the biopsy needle 224 can generally be distinguished from other tissues or internal parts of the human body. For example, the biopsy needle 224 has a shape that does not naturally occur in the human body. In addition, the material of the biopsy needle 224 can also be made of a material that makes the marker easy to detect in the ultrasound image 201 or image data. For example, at least a portion of the material of the biopsy needle 224 can be a material with high echogenicity, which makes that portion of the biopsy needle 224 appear brighter in the resulting ultrasound image 201. Air or other gas within the biopsy needle can also make the biopsy needle 224 appear brighter in the ultrasound image 201.

[0047] Thus, based on the distinctive shape and material of the biopsy needle 224, the image analysis technique can more easily identify the biopsy needle within the ultrasound image 201. The image analysis technique can also be based on machine learning techniques, such as neural networks, deep learning algorithms, statistical analysis techniques, contrast enhancement techniques, or other pattern recognition or matching techniques trained based on the shape of the biopsy needle. As an example, the image analysis algorithm can first be trained on a set of ultrasound images containing a specific type of biopsy needle 224. The current ultrasound image 201 or image data is then provided as input to the trained image analysis algorithm to detect or identify the biopsy needle 224. The biopsy needle 224 can be identified based on a cross-section of the biopsy needle 224 because the ultrasound image 201 is a two-dimensional image with a cross-section of the biopsy needle 224.

[0048] In an additional example, an ultrasound technician, surgeon, or other user may provide additional input to help identify the biopsy needle 224 in the ultrasound image 201. For example, an input indicating the type of biopsy needle being used for the biopsy procedure may be provided. In an example, the input may include providing a model, brand, or other identifying information for the biopsy needle 224. Based on the input from the user, the system may obtain dimensions and other information about the biopsy needle 224, such as from a local or remote database storing such information. The local or remote database may be pre-programmed with several biopsy needle models, brands, or types, and include associated geometries associated with the biopsy needle. The image analysis technique may then use the dimensions of the biopsy needle 224 to help identify the biopsy needle 224 within the ultrasound image 201. Additional input from the ultrasound technician, surgeon, or other user may also include directly identifying the biopsy needle on the ultrasound image 201, such as receiving a pointer, touch, or other input to locate the biopsy needle 224. For example, the ultrasound technician may select the biopsy needle 224 by clicking on the biopsy needle 224 with a mouse on the display of the ultrasound image. Input identifying the biopsy needle 224, such as a click on the image of the biopsy needle 224, can also be used in the image analysis technique to limit the area of ​​the ultrasound image 201 to be analyzed. For example, upon receiving a selection of the biopsy needle 224 from the ultrasound technician, a predetermined area around the selection point can be analyzed to identify the biopsy needle 224. In other examples, the ultrasound technician can provide a two-dimensional input, such as a box, to provide boundaries for the area to be analyzed by the image analysis technique to identify the biopsy needle 224. In other examples, a combination of user input on the display of the ultrasound image and the image analysis technique can be used to determine the biopsy needle 224.

[0049] Once the biopsy needle 224 is identified in the ultrasound image 201, a biopsy needle prediction indicator can be generated based on the predicted position of the biopsy needle 224 after firing. The biopsy needle prediction indicator indicates the predicted position of the biopsy needle 224 and its elements after the biopsy needle 224 is fired. For example, when the biopsy needle 224 is fired, the biopsy needle 224 can deflect before it comes to rest in its post-fired configuration state. The deflection of the biopsy needle 224 is based in part on the characteristics of the biopsy needle 224 together with the characteristics or properties of the tissue through which the biopsy needle 224 passes during firing. As discussed further below, the predicted position of the elements of the biopsy needle 224 represented by the biopsy needle prediction indicator is determined based on the characteristics of the biopsy needle 224 and / or the characteristics of the tissue.

[0050] For example, breast tissue includes glandular, connective and adipose tissue. Patients receiving breast biopsy may have different relative amounts of these different types of breast tissue. For example, dense breasts have relatively large amounts of glandular tissue and fibrous connective tissue and relatively small amounts of adipose breast tissue. On the other hand, breasts may be made primarily of adipose breast tissue. Other features of breast tissue may include interspersed areas of dense glandular tissue and fibrous connective tissue and heterogeneous dense breast tissue with many areas of glandular tissue and fibrous connective tissue. Different features of breast tissue may result in different positions of the prediction indicator of biopsy needle 224. In one example, when biopsy needle 224 passes through breast tissue during firing, breast tissue with higher density or stiffness may result in greater deflection of biopsy needle 224. Features of breast tissue may be determined by image analysis and / or input from a user indicating features of breast tissue. Portions of breast tissue may be highlighted or otherwise emphasized in an ultrasound image. For example, if a particularly dense or stiff portion of tissue is identified through image analysis and / or user input, that portion of tissue may be highlighted or otherwise emphasized on the ultrasound image to alert the medical professional to the presence of the tissue.

[0051] The biopsy needle prediction indicator includes a trajectory indicator 202, a tip indicator 204, a deflection probability indicator 206, a hole indicator 208, and a maximum needle depth indicator 210. The trajectory indicator 202 indicates the trajectory of the biopsy needle 224. For example, if the biopsy needle 224 is fired at its current position in the ultrasound image 201, the throw portion of the biopsy needle 224 is predicted to be along the line of the trajectory indicator 202. Figure 2, the trajectory indicator 202 can be displayed as a line extending from and substantially parallel to the biopsy needle 224. The tip indicator 204 indicates the most likely position of the tip of the biopsy needle 224 in its post-firing configuration. For example, if the biopsy needle 224 is fired from its current position in the current ultrasound image 201, the most likely position of the tip of the biopsy needle 224 in the post-firing configuration is shown by the tip indicator 204. The biopsy needle 224 can be triangular in shape, or have a shape that is more similar to the tip shape of the current biopsy needle 224 used for the procedure. For example, the shape of the tip indicator 204 can be based on the geometry of the tip of the biopsy needle 224 used for the biopsy. Thus, the shape of the tip indicator 204 can change based on the specific biopsy needle 224 used to perform the biopsy. Other shapes for the tip indicator 204 are also possible, including a lancet tip needle, a trocar tip needle, a bevel tip, and a multi-point tip, etc. A deflection probability indicator 206 is also shown adjacent to the tip indicator 204. The deflection probability indicator 206 indicates a range of predicted post-fire tip positions based on the determined deflection probability for the biopsy needle 224. For example, the tip indicator 204 may indicate the most likely predicted position of the tip of the biopsy needle 224, and the deflection probability indicator 206 may cover all possible predicted positions of the tip of the biopsy needle 224. In other examples, the deflection probability indicator 206 may cover a large portion of the possible predicted tip positions, such as an 80% probability or a predicted tip position within one or two standard deviations from the most likely tip position. The deflection probability indicator 206 may be an ellipse, circle, square, rectangle, or other shape. The deflection probability indicator 206 may also be in the form of a heat map showing a probability distribution of predicted tip positions.

[0052] The bore indicator 208 indicates the predicted location of the bore of the biopsy needle 224 in its post-firing configuration. By viewing the predicted location of the bore indicated by the bore indicator 208, the surgeon can more accurately predict whether the bore will be at the target location (e.g., a lesion or mass) after firing the biopsy needle 224. The bore indicator 208 can be represented by two line segments perpendicular to the trajectory indicator 202. The distance between the bore indicators 208 represents the length of the bore of the particular biopsy needle 224 being used to perform the biopsy. Thus, the distance between the bore indicators 208 can vary for different biopsy needles.

[0053] The maximum needle depth indicator 210 indicates the maximum depth to which the biopsy needle 224 can extend when in its pre-firing configuration, where the tip position can still be predicted. For example, if the biopsy needle 224 in its pre-firing configuration were to pass through the maximum needle depth indicator 210, the tip of the biopsy needle 224 would be outside the current ultrasound image 201. The maximum needle depth indicator 210 can be a line segment perpendicular to the trajectory indicator 202. Although the biopsy needle prediction indicator has been described and depicted as having certain shapes or orientations, other shapes and orientations are also contemplated herein. For example, although some of the indicators are displayed in dashed lines and other indicators are displayed in solid lines, the technology is not limited to such examples.

[0054] Figure 3A An example method 300A for predictive visualization of a biopsy needle is depicted. The predictive visualization method 300A provides additional guidance and a biopsy needle predictive indicator to be displayed on an ultrasound image while a biopsy is being performed. As such, a surgeon performing a biopsy is able to receive substantially real-time guidance for performing a biopsy. The operations of the method 300A and other methods discussed herein may be performed by at least one processor in conjunction with a suitable operating environment such as a Figure 1G Other components of the operating environment 150) in Figures 1A-1C The system depicted in is implemented, for example, within system 100 .

[0055] At operation 302, an array of ultrasonic sound waves is emitted from an ultrasonic transducer of an ultrasonic probe. As discussed above, the ultrasonic sound waves enter the patient's body and are reflected from components in the patient's body (including natural tissue and a biopsy needle). The reflected ultrasonic sound waves are then detected at operation 304. At operation 306, ultrasonic image data is then generated from the detected reflected ultrasonic sound waves. The ultrasonic image data may be B-mode ultrasonic imaging data.

[0056] At operation 308, the image data is analyzed by a processor of the biopsy needle visualization system to identify or detect a biopsy needle within the image data. As discussed above, the image analysis technique can be based on image processing techniques and machine learning techniques (such as neural networks, deep learning algorithms, or other pattern matching techniques) trained based on the shape of a marker implanted in the patient. As an example, an image analysis algorithm can first be trained on a collection of ultrasound images at different orientations and views containing a biopsy needle. The current ultrasound image or image data is then provided as input to the trained image analysis algorithm to detect or identify the biopsy needle. The identification marker can generally be based on the shape and dimensions of the biopsy needle.

[0057] At operation 310, the characteristics of the biopsy needle are accessed or otherwise determined. The characteristics of the biopsy needle are at least one of needle length, needle gauge, needle wall thickness, needle material composition, needle tip geometry, and needle firing mechanism characteristics, hole length, throw length, and other potential biopsy needle characteristics. The characteristics of the biopsy needle can be accessed by querying a database stored locally in the biopsy needle visualization system 100 or a remote database accessible from the biopsy needle visualization system 100. In an example, a user interface can be first displayed at the beginning of the biopsy procedure to allow selection or input of the type of biopsy needle to be used in the biopsy procedure. In an example, the input to the user interface can indicate a specific brand or model of a biopsy needle. In such an example, the input to the user interface can be used to query a corresponding database to access or determine the characteristics of the biopsy needle indicated by the input to the user interface. In other examples, the characteristics of the biopsy needle (e.g., needle length, gauge, etc.) are directly provided as input to the user interface. In such an example, since the characteristics have been directly provided, no database query is performed.

[0058] At operation 312, the predicted position of the biopsy needle is determined. Determining the predicted position of the biopsy needle may include determining the position of an aspect or portion of the biopsy needle (such as the needle tip, hole, throw portion, or other features of the biopsy needle). For example, the position of the biopsy needle in the post-firing configuration may be determined. In such an example, various aspects of the biopsy needle (such as the needle tip, hole, throw portion, and / or other features, aspects, or portions of the biopsy needle) may be determined for the needle in the post-firing configuration. The determination of the predicted position of the biopsy needle may be based on the characteristics of the biopsy needle accessed or determined in operation 310. In addition, the determined predicted position of the biopsy needle may also be based on tissue characteristics. At operation 314, a biopsy needle prediction indicator is displayed on the ultrasound image. For example, the biopsy needle prediction indicator may include one or more of a trajectory indicator, a tip indicator, a deflection probability indicator, a hole indicator, and a maximum needle depth indicator. Displaying the prediction indicator may also include changing the state of the prediction indicator. For example, when the biopsy needle in its pre-firing position moves within the patient, the state of the prediction indicator may change. As an example, as the biopsy needle is repositioned, the position of the displayed predictive indicator may change. The predictive indicator may also include an audible indicator or a tactile indicator in the biopsy device. Figure 3B and 3C Additional details regarding determining the predicted location of the biopsy needle are discussed.

[0059] In addition to the prediction indicator, additional positioning indicators can also be displayed to indicate to the medical professional how to change the position of the biopsy needle to more accurately target the lesion or area of ​​interest. For example, the lesion or area of ​​interest can be identified by image analysis and / or user input. If the predicted position of the biopsy needle hole is not aligned with the lesion, then a positioning indicator can be displayed to guide the medical professional how to move the needle to the predicted position of the needle hole to more accurately target the position of the lesion. In addition to other indicators, such positioning indicators can be in the form of arrows and / or text that provide positioning guidance. In addition, visual, tactile and / or auditory positioning indicators can be displayed, which indicate the correct positioning of the biopsy needle. As an example, when the needle is positioned so that the hole of the needle will correctly target the lesion, tactile, auditory and / or visual feedback can be provided. For example, an audible sound can be provided, and when the biopsy needle moves toward or away from the correct lesion or area of ​​interest, the sound can change volume or frequency.

[0060] Figure 3B Another example method 300B for predictive visualization of a biopsy needle is depicted. At operation 320, the deflection probability of a specific biopsy needle used in a biopsy procedure is determined based on the characteristics of the specific biopsy needle. When the biopsy needle is fired, the throw portion may be deflected due to the patient's internal tissue. The direction and amount of deflection depend on the biopsy needle characteristics and the type of tissue through which the biopsy needle passes when fired. As discussed above, the characteristics of the biopsy needle may include one or more of the following: needle length, needle gauge, needle wall thickness, needle material composition, needle tip geometry, and needle firing mechanism characteristics, hole length, throw length, and other potential biopsy needle characteristics. Each of these characteristics may have an effect on the deflection of the biopsy needle when fired. For example, a biopsy needle with a long length but a large gauge (i.e., a small diameter) is more likely to deflect when fired. Similarly, a needle with a thinner wall thickness may also be more likely to have a larger degree of deflection. The geometry of the biopsy needle tip also affects the amount of deflection and the direction of deflection. The firing mechanism characteristics of the biopsy needle further affect the deflection caused by the force of firing the needle. Other characteristics of the biopsy needle may also affect the magnitude and / or direction of the biopsy needle deflection.

[0061] The probability of deflection of a biopsy needle can be determined by analyzing and / or based on a collection of experimental data. For example, based on the characteristics of the needle, a mathematical prediction can be made for the probability of the final needle position and its deflection. The mathematical prediction can be based on the mechanical behavior of a hollow cylinder advancing through a material whose density and / or stiffness are similar to the density and / or stiffness of human tissue at the biopsy site. The characteristics of the hollow cylinder or tube can be modified based on the characteristics of the biopsy needle and the deflection of the resulting hollow cylinder or tube. A computerized simulation for a biopsy needle can also be processed to determine the probability of deflection of the biopsy needle. The results of the computerized simulation provide the probability of deflection of the biopsy needle. The probability of deflection can also be determined empirically by a collection of experimental results. For example, a biopsy needle can be inserted into a replica of a breast (or other human tissue specific to the biopsy site) and fired. A biopsy needle visualization system can be used to track the deflection of the needle. The test can be repeated to form an experimental data set for different biopsy needles. For example, experimental data can be generated for a needle that passes through dense tissue and a needle that passes through adipose tissue. The deflection characteristics of a particular biopsy needle can be determined from an experimental data set.

[0062] At operation 322, elastic imaging data is optionally received. The elastic imaging data can be elastic imaging data of tissue along the firing trajectory of the biopsy needle (e.g., the path that the biopsy needle will pass through when it is fired). The elastic imaging data can be obtained directly from the biopsy needle visualization system. As an example, the imaging mode of the ultrasonic component may include an elastic imaging mode that provides elastic imaging data indicating the stiffness or other elastic properties of the tissue. Elastic imaging data can also be received from other sources and based on known tissue at the biopsy site. In one example, the firing trajectory can be determined in part based on the ultrasonic image data, and the firing trajectory can have been determined for the trajectory indicator. Elastic imaging data of at least a portion of the tissue is then received along the firing trajectory. Based on the received elastic imaging data, the tissue properties of the tissue along the firing trajectory can be determined.

[0063] At operation 324, the patient's tissue characteristics can be used to adjust the deflection probability. The tissue characteristics can be tissue characteristics along the firing trajectory of the needle or general tissue characteristics of the biopsy site. In some examples, the tissue characteristics are determined for a predetermined distance around the firing trajectory. The tissue characteristics can be determined based on the elastic imaging data received or captured in operation 322, the image analysis of the ultrasound image, and / or the user input. For example, in the case where the elastic imaging data indicates that there is a rigid portion of the tissue within the biopsy needle firing trajectory, deflection is more likely to occur. The deflection probability can then be updated based on the stiffness of the portion of the tissue and / or the position of the portion of the tissue. Other tissue characteristics (such as density and / or tissue splitting) can also be combined to adjust the deflection probability. In an example, such tissue characteristics can be identified by image analysis of the ultrasound image. For example, tissue characteristics can be determined for a portion of the tissue that appears brighter and / or has a specific shape in the ultrasound image. In addition, the user can also provide input to identify a portion of the tissue and provide tissue characteristics (such as density, stiffness, etc.) of the identified tissue. User input and / or image analysis can also identify the type of tissue in the ultrasound image. For example, user input and / or image analysis may identify a portion of tissue as either glandular tissue, connective tissue, or adipose tissue. Tissue characteristics of that type of tissue may then be accessed or received, such as from a local or remote database, which may then be used to determine the probability of deflection. Tissue characteristics may also be directly incorporated into the probability deviation determination in operation 320.

[0064] At operation 326, a tip indicator is generated based on the deflection probability and the characteristics of the biopsy needle. The tip indicator can be used for a biopsy needle in a post-fire configuration. For example, based on the length of the pitch portion of a particular needle and the deflection probability, the predicted position of the tip of the biopsy needle in the post-fire configuration can be determined, and the tip indicator can be generated based on that determination. At operation 328, a hole indicator (or multiple hole indicators) can be generated based on the deflection probability and the characteristics of the biopsy needle. The hole indicator can be used for a biopsy needle in its post-fire configuration. For example, based on the length of the pitch portion, the hole position, and the deflection probability, the predicted position of the hole of the biopsy needle in the post-fire configuration can be determined. The hole indicator can be generated based on that determination. At operation 330, a deflection probability indicator is generated. The deflection probability indicator can be for the tip of the biopsy needle in its post-fire configuration. The deflection probability indicator is based on the determined deflection probability. The deflection probability indicator indicates a range of predicted post-fire tip positions based on the determined deflection probability of the biopsy needle. For example, the tip indicator may indicate the most likely predicted position of the tip of the biopsy needle, and the deflection probability indicator may cover all possible predicted positions of the tip of the biopsy needle. In other examples, the deflection probability indicator may cover a large portion of the possible predicted tip positions, such as 90%, 80%, or 70% probability, or predicted tip positions within one or two standard deviations from the most likely tip position. In order to illustrate the probability distribution of the determined deflection probability, the deflection probability indicator may also be in the form of a heat map.

[0065] Figure 3C Another method 300C for predictive visualization of a biopsy needle is depicted. At operation 332, a maximum pre-fire biopsy needle depth is determined for prediction. The maximum pre-fire biopsy needle depth is the maximum depth to which the biopsy needle can extend in its pre-fire configuration, where the tip position can still be predicted. The determination of the maximum pre-fire biopsy needle depth can be based on the predicted tip position and the size of the display displaying the ultrasound image. Based on the determined maximum pre-fire biopsy needle depth, a maximum needle depth indicator is generated and can be displayed at the location of the determined maximum pre-fire biopsy needle depth.

[0066] At operation 336, it is determined whether the biopsy needle in its pre-fire configuration has passed the maximum pre-fire biopsy needle depth. If the biopsy needle has passed the maximum pre-fire biopsy needle depth, then method 300C proceeds to operation 336, where an alarm is generated to remind the surgeon that the tip position prediction can no longer be presented on the screen. The alarm can be visual, auditory, or tactile. In the example, an auditory or tactile indicator can also be provided, which changes frequency or amplitude as the biopsy needle approaches the maximum pre-fire biopsy needle depth. Thus, based on the changing state of the indicator, continuous guidance on the positioning of the biopsy needle can be provided to the medical professional. If the biopsy needle depth has not yet passed the maximum pre-fire biopsy needle depth, then ultrasound imaging will continue, and the maximum pre-fire biopsy needle depth indicator remains displayed for visual reference by the surgeon.

[0067] Figure 4 An example method 400 for detecting a plane shift of a biopsy needle is depicted. In an ultrasound image, the biopsy needle may be seen to move further into the patient's body when the biopsy needle is substantially aligned with the imaging plane of the ultrasound imaging system. If the needle shifts out of the imaging plane, the needle may appear to no longer be advancing in the ultrasound image even though the needle is actually moving further into the patient's body. In some cases, a decrease in the apparent depth of the needle may be seen in the ultrasound image. If the decrease in apparent depth does not correspond to the needle being withdrawn from the patient, then the surgeon has likely shifted the needle out of the imaging plane and may need to readjust the needle or the ultrasound imaging probe. The method 400 provides an alert or a change in beam form from the ultrasound imaging probe as a result of such a needle shift out of the imaging plane.

[0068] At operation 402, a first apparent depth (D1) of a biopsy needle is determined at a first time (t1). The apparent depth of a biopsy needle is the depth to which the biopsy needle enters the patient's body when it appears in an ultrasound image. In some examples, the apparent depth of the needle can be determined by measuring the length of the portion of the biopsy needle that appears in the ultrasound image. At operation 404, the apparent depth of the needle is determined again at a subsequent time (t2). This subsequent apparent depth is a second apparent depth (D2). At operation 406, it is determined whether D2 is greater than D1. If D2 is not greater than D1, then the needle may not be advanced or has been withdrawn. As such, method 400 returns to operation 402, where method 402 repeats. If D2 is greater than D1, then the needle may be advanced into the patient's body on the imaging plane, and method 400 proceeds to operation 408. At operation 408, a third apparent depth (D3) is measured at a time (t3) after time (t2). At operation 410, it is determined whether D3 is less than D2. If D3 is greater than D2, the needle is still advancing and in the imaging plane, and the method 400 returns to operation 402, where the method 400 repeats. If D3 is less than D2, then either the needle has been transferred out of the imaging plane or has been withdrawn. If D3 is less than D2, the method 400 proceeds to optional operation 412, where the difference between D3 and D2 is compared to determine whether the difference exceeds a threshold. By comparing the difference between D3 and D2 with a threshold, false alarms can be avoided when only a small change in apparent depth is observed. If the difference between D2 and D3 is less than the threshold, the method 400 proceeds back to operation 402, where the method 400 repeats. If the difference between D2 and D3 exceeds the threshold, the method 400 proceeds to operation 414, where a transfer alarm can be generated. The transfer alarm indicates that the needle may have been transferred out of the imaging plane of the ultrasound image. The transfer alarm allows the surgeon to reposition the needle or ultrasound probe to align the needle with the imaging plane again. If the needle is actually being withdrawn from the patient, the surgeon can also ignore or silence the alarm. In addition, a positioning indicator may be displayed to indicate to the medical professional how to change the position of the biopsy needle to bring the biopsy needle back into the imaging plane. For example, if the needle has been displaced out of the imaging plane, a positioning indicator may be displayed in operation 414. The positioning indicator may be in the form of an arrow and / or text that provides guidance to the medical professional on how to move the needle to bring the needle back into the imaging plane, among other possible indicators.

[0069] At operation 414, the beam form of the ultrasound sound waves emitted from the ultrasound probe may also be changed to change the imaging plane. For example, by changing the beam form of the ultrasound waves, the direction of the waves may be changed to modify the resulting imaging plane. The beam form may be changed when a potential transfer is detected (such as D3 being less than D2). The change in beam form may be predetermined based on the movement of the needle, or the beam form may be changed until it can be determined that the apparent depth of the needle is greater than D2.

[0070] The embodiments described herein may be employed using software, hardware, or a combination of software and hardware to implement and perform the systems and methods disclosed herein. Although specific devices have been described throughout the disclosure as performing specific functions, those skilled in the art will recognize that these devices are provided for illustrative purposes and that other devices may be employed to perform the functions disclosed herein without departing from the scope of the present disclosure.

[0071] The present disclosure describes some embodiments of the present technology with reference to the accompanying drawings, in which only some possible embodiments are shown. However, other aspects may be implemented in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to make the present disclosure thorough and complete and to fully convey the scope of possible embodiments to those skilled in the art.

[0072] Although specific embodiments are described herein, the scope of the present technology is not limited to those specific embodiments. Those skilled in the art will recognize other embodiments or improvements within the scope and spirit of the present technology. Therefore, specific structures, actions or media are disclosed only as illustrative embodiments. The scope of the technology is limited by the attached claims and any equivalent forms therein.

Claims

1. A method for providing guidance for the operation of a biopsy needle, the method comprising: an array of ultrasonic sound waves emitted from an ultrasonic transducer of an ultrasonic probe; detecting, by the ultrasound transducer, reflected ultrasonic sound waves, wherein the reflected ultrasonic sound waves include at least a portion of the array of ultrasonic sound waves after reflection from within the patient; generating image data based on the reflected ultrasonic sound waves; identifying, by the processor, within the generated image data, at least a portion of a biopsy needle within the patient; determining, by the processor, based at least in part on the identification of the biopsy needle, a predicted position of an aspect of the biopsy needle based at least in part on one or more biopsy needle characteristics stored in a memory operably connected to the processor, the biopsy needle characteristics including at least one of needle length, needle gauge, needle wall thickness, needle material composition, needle tip geometry, and needle firing mechanism characteristics; displaying an ultrasound image based on the generated image data on a display operatively connected to the processor; Determining a deflection probability of the post-firing needle tip position based on at least one of: (1) experimental data for the type of biopsy needle, and (2) one or more stored characteristics of the biopsy needle; and A deflection probability indicator is displayed on the ultrasound image, wherein the deflection probability indicator indicates a range of post-fire tip positions based on the determined deflection probability, wherein the deflection probability indicator depicts a probability distribution of post-fire needle tip positions.

2. The method of claim 1, wherein identifying the biopsy needle comprises identifying the biopsy needle in a pre-firing configuration, and the predicted position of the biopsy needle is a predicted position of the biopsy needle in a post-firing configuration.

3. The method of any one of claims 1 or 2, wherein the method further comprises displaying at least one of a tip indicator indicating a predicted biopsy needle tip position or a hole indicator indicating a predicted biopsy needle hole position.

4. The method of any one of claims 1 or 2, wherein identifying the biopsy needle comprises receiving user input identifying the biopsy needle in the ultrasound image.

5. The method of any one of claims 1 or 2, wherein identifying the biopsy needle comprises analyzing, by a processor, the generated image data using an image analysis technique to identify the biopsy needle.

6. The method of any one of claims 1 or 2, wherein the method further comprises obtaining experimental data for a type of biopsy needle.

7. The method of claim 1, wherein the one or more stored characteristics of the biopsy needle are based on user input regarding a type of biopsy needle. The method of claim 7 , wherein the input regarding the type of biopsy needle includes a model and a manufacturer of the biopsy needle.

9. The method of claim 6, wherein determining the deflection probability is further based on tissue characteristics within the patient along a firing trajectory of the biopsy needle.

10. The method of claim 9, wherein the tissue characteristic is based on an input that identifies a tissue characteristic.

11. The method of claim 9, further comprising determining tissue characteristics by: determining, by the processor, a firing trajectory of the biopsy needle based on the generated image data; receiving elastic imaging data of tissue along at least a portion of a firing trajectory for a biopsy needle; and Tissue properties are determined based on the received elastography data.

12. The method of claim 1, wherein the deflection probability indicator is one of an ellipse, a rectangle, a square, a triangle, or a circle.

13. The method of claim 1 wherein the deflection probability indicator is based at least in part on a standard deviation of predicted tip positions after firing. The method of claim 1 , wherein the deflection probability indicator comprises a heat map.

15. The method of claim 1, further comprising overlaying the deflection probability indicator on the ultrasound image.

16. The method of any one of claims 1 or 2, further comprising: determining that the predicted location is outside the ultrasound image; as well as In response to determining that the predicted location is outside of the ultrasound image, an alert is displayed.

17. The method of any one of claims 1 or 2, further comprising: determining a maximum pre-fire biopsy needle depth for which a predicted post-fire biopsy needle tip position remains within the ultrasound image; and A maximum needle depth indicator is displayed, wherein the maximum needle depth indicator indicates the determined maximum pre-fire biopsy needle depth.

18. The method of claim 17, wherein the maximum needle depth indicator is a line segment perpendicular to the firing trajectory of the biopsy needle.

19. The method of claim 3, wherein the tip indicator is a graphical element having a shape based on the geometry of the tip of the biopsy needle.

20. The method of claim 3, wherein the aperture indicator comprises two line segments perpendicular to the firing trajectory of the biopsy needle.

21. The method of claim 3, wherein the tip indicator and the hole indicator are displayed simultaneously.

22. A system for providing guidance for the operation of a biopsy needle, comprising: an ultrasound probe comprising an ultrasound transducer configured to transmit an array of ultrasound sound waves and detect reflected ultrasound sound waves, wherein the reflected ultrasound sound waves include at least a portion of the array of ultrasound sound waves after being reflected within a patient; monitor; at least one processor operably connected to the display and the ultrasound probe; as well as A memory, operatively connected to the at least one processor, storing instructions that, when executed by the at least one processor, perform a set of operations, the set of operations comprising: generating image data based on the reflected ultrasonic sound waves; identifying, by the at least one processor, a biopsy needle within the patient within the generated image data; determining, by the at least one processor, a predicted position of an aspect of the biopsy needle based at least in part on the identification of the biopsy needle based at least in part on one or more biopsy needle characteristics stored in the memory, the biopsy needle characteristics including at least one of needle length, needle gauge, needle wall thickness, needle material composition, needle tip geometry, and needle firing mechanism characteristics; displaying an ultrasound image based on the generated image data on a display operatively connected to the processor; determining a deflection probability of the post-firing needle tip position based on at least one of: (1) experimental data for the type of biopsy needle, and (2) one or more stored biopsy needle characteristics; and A deflection probability indicator is displayed on the ultrasound image, wherein the deflection probability indicator indicates a range of post-fire tip positions based on the determined deflection probability, wherein the deflection probability indicator depicts a probability distribution of post-fire needle tip positions.

23. The system of claim 22, wherein the set of operations further comprises: determining that the biopsy needle has moved out of the imaging plane of the ultrasound image; and In response to determining that the biopsy needle has shifted out of the imaging plane of the ultrasound image, at least one of the following operations is performed: displaying an alert indicating that the biopsy needle has moved out of the imaging plane of the ultrasound image; or The beam pattern emitted from the ultrasound probe is changed to compensate for the biopsy needle moving out of the imaging plane.

24. The system of claim 23, wherein determining that the biopsy needle has moved out of an imaging plane of the ultrasound image further comprises: determining a first apparent depth of the biopsy needle at a first time; determining a second apparent depth of the biopsy needle at a second time after the first time, the second apparent depth being greater than the first apparent depth; determining a third apparent depth of the biopsy needle at a third time after the second time, the third apparent depth being less than the second apparent depth; as well as Based on the third apparent depth being less than the second apparent depth and the second apparent depth being greater than the first apparent depth, it is determined that the biopsy needle has shifted out of an imaging plane of the ultrasound image.

25. The system of claim 22, wherein the set of operations further comprises obtaining experimental data for a type of biopsy needle.

26. The system of claim 25, wherein obtaining experimental data comprises one of: passing the needle through dense tissue and passing the needle through fatty tissue; and A biopsy needle is inserted into the copy of the breast.