Persistently displa YED instrument pass indicators

Abstract

A system for providing intraprocedural sampling location indications within a live ultrasound video is provided. The system images a target site identifies a boundary shape at the target site. The system determines a location of a resection element relative to the target site when the resection element removes a sample from the target site. The system displays an image of the target site where an indicator corresponding to the location is superimposed on the displayed image of the target site. When a second sample is removed from the target site, the indicator remains on the image of the target site presented during removal of the second sample such that indication is provided where a sample has already been removed from the target site.

Description

PERSISTENTLY DISPLA YED INSTRUMENT PASS INDICATORSPRIORITY CLAIM

[0001] The present case claims priority to U.S. Provisional Patent Application Serial No. 63 / 613,336, filed on December 21, 2023, the contents of which are incorporated by reference herein.TECHNICAL FIELD

[0002] This document pertains generally, but not by way of limitation, to a system that can be used for various medical procedures. More specifically, but not by way of limitation, this document relates to a system that can image a target site and track locations of a medical device within the target site.BACKGROUND

[0003] When a practitioner desires to gather a sample at a target site, such as a lymph node sample, the practitioner maneuvers a medical device to the target site and removes the sample. Typically, the medical device includes a biopsy needle, which is delivered to the target site and used to remove the sample. Often times, multiple samples are removed from the target site to allow for characterization of the target site. Thus, a practitioner may use the medical device to resect a sample from the target site, remove the medical device and then reinsert the medical device into the target site to remove another sample. However, the practitioner may not be able to track where samples have already been removed from the target site.SUMMARY

[0004] Examples relate to a system and method that provides intraprocedural sampling location indications within a live ultrasound video. The system can include an ultrasound image processing system that analyzes live ultrasound video feeds in order to identify anatomical characteristics of a target site. This can include using edge detection techniques to identify a boundary shape of a target nodule at the target site. The ultrasound image processing system can image the target site along with the target nodule and the boundary shape.

[0005] A resection element, such as a biopsy needle, can be used to resect a sample from the target nodule. The resection element can enter the target nodule within the boundary shape at a first instance. The ultrasound image processing system can then determine a first location of the resection element at the first instance within the target site and the target nodule while monitoring both the target nodule and the boundary shape. The ultrasound image processing system can determine the first location by identifying echogenic characteristics of the resection element. When the resection element is at the first location, tissue can be resected at the first location.

[0006] When the ultrasound image processing system determines the first location, the ultrasound image processing system can superimpose a first indicator associated with the first location on the imaged target nodule having the boundary shape. The first indicator can correspond to the first location of the resection element within the target nodule and the boundary shape. The first indicator can remain superimposed on the imaged target nodule when the resection element enters the target nodule within the boundary shape during a second instance. When the resection element enters the target nodule in the second instance, the first indicator is still superimposed such that the resection element can be positioned within the target nodule and the boundary shape at a second location different from the first location. The ultrasound image processing system can determine the second location of the resection element at the second instance within the target site and the target nodule while monitoring both the target nodule and the boundary shape by identifying echogenic characteristics of the resection element.

[0007] Since a practitioner manipulating the resection element can see the first location in real time, the practitioner can maneuver the resection element to the second location to ensure that tissue different from that resected at the first location is resected. Moreover, a second indicator can be superimposed on the imaged target nodule corresponding to the second location such that the first and second indicators remain on the imaged target nodule in order to indicate where samples have already been taken from the target nodule when subsequent sample extractions take place to ensure that tissue different from that resected at the first and second locations is resected.DESCRIPTION OF FIGURES

[0008] Figure 1 illustrates a bronchoscope system having a bronchoscope, in accordance with some examples.

[0009] Figure 2 is a schematic diagram of the bronchoscope system of Figure 1, in accordance with some examples.

[0010] Figure 3 illustrates an end effector assembly of the bronchoscope of Figure 1, in accordance with some examples.

[0011] Figure 4 shows a method for providing intraprocedural sampling location indications within a live ultrasound video, in accordance with some examples.

[0012] Figure 5 illustrates a first location of a resection element at a target nodule, in accordance with some examples.

[0013] Figure 6 illustrates a first indicator superimposed at the first location of Figure 5, in accordance with some examples.

[0014] Figure 7 illustrates a second location of the resection element of Figure 5 at the target nodule of Figure 5, in accordance with some examples.

[0015] Figure 8 illustrates a second indicator superimposed at the second location of Figure 7 along with the first indicator at the first location, in accordance with some examples.

[0016] Figure 9 shows a first indicator without a resection element lumen portion and instead only has the cutting portion, in accordance with some examples.

[0017] Figure 10 shows a target nodule of Figure 5 divided into sections that can each include portions of the target nodule, in accordance with some examples.

[0018] Figure 11 is a block diagram illustrating architecture of software used to implement social network-initiated listings, according to some examples.

[0019] Figure 12 is a block diagram illustrating a machine as an example computer system with instructions to cause the machine to implement social network-initiated listings, according to some examples.DETAILED DESCRIPTION

[0020] Examples relate to a system and method that provides intraprocedural sampling location indications within a live ultrasound video. The system can include an ultrasound image processing system that analyzes live ultrasound video feeds in order to identify anatomical characteristics of a target site. This can include using edge detection techniques to identify a boundary shape of a target nodule at the target site.The ultrasound image processing system can image the target site along with the target nodule and the boundary shape.

[0021] A resection element, such as a biopsy needle, can be used to resect a sample from the target nodule. The resection element can enter the target nodule within the boundary shape at a first instance. The ultrasound image processing system can then determine a first location of the resection element at the first instance within the target site and the target nodule while monitoring both the target nodule and the boundary shape. The ultrasound image processing system can determine the first location by identifying echogenic characteristics of the resection element. When the resection element is at the first location, tissue can be resected at the first location.

[0022] When the ultrasound image processing system determines the first location, the ultrasound image processing system can superimpose a first indicator associated with the first location on the imaged target nodule having the boundary shape. The first indicator can correspond to the first location of the resection element within the target nodule and the boundary shape. The first indicator can remain superimposed on the imaged target nodule when the resection element enters the target nodule within the boundary shape during a second instance. When the resection element enters the target nodule in the second instance, the first indicator is still superimposed such that the resection element can be positioned within the target nodule and the boundary shape at a second location different from the first location. The ultrasound image processing system can determine the second location of the resection element at the second instance within the target site and the target nodule while monitoring both the target nodule and the boundary shape by identifying echogenic characteristics of the resection element.

[0023] Figure 1 is a schematic diagram of a bronchoscope system 104 that can include an ultrasound image processing system 106 along with the bronchoscope 100. The bronchoscope system 104 is an illustrative example of a system suitable for use with the devices and methods described herein, such as a bronchoscope with an integrated stabilizer or cannulation elements.

[0024] The bronchoscope 100 can be insertable into a target site for imaging or to provide passage of or attachment to (e.g., via tethering) one or more sampling devices for biopsies, or one or more therapeutic devices for treatment of a disease state associated with the target site. The bronchoscope 100 can interface with and connect to the ultrasound image processing system 106. The bronchoscope 100 can also include aduodenoscope, though other types of endoscopes can be used with the features discussed herein. The ultrasound image processing system 106 can include an output unit 110, an input unit 112, a light source 114, a fluid source 116, a suction pump 118, and a control unit 120. The control unit 120 can be a computing device having hardware and software functionality to perform the features discussed herein.

[0025] The ultrasound image processing system 106 can also be a computing device having hardware and software functionality to perform the features discussed herein. The ultrasound image processing system 106 can include various ports for coupling with the bronchoscope system 104. For example, the control unit 120 can include a data input / output port for receiving data from and communicating data to the bronchoscope 100. The light source 114 can include an output port for transmitting light to the bronchoscope 100, such as via a fiber optic link. The fluid source 116 can include a port for transmitting fluid to the bronchoscope 100. The fluid source 116 can include, for example, a pump and a tank of fluid or can be connected to an external tank, vessel or storage unit. A suction pump can include a port used to draw a vacuum from the bronchoscope 100 to generate suction, such as for withdrawing fluid from the target site into which the bronchoscope 100 is inserted and withdrawing samples from a target resected from the target with a resection element. The output unit 110 and the input unit 112 can be used by an operator of the bronchoscope system 104 to control functions of the bronchoscope system 104 and view output of the bronchoscope 100. The control unit 120 can additionally be used to generate signals or other outputs for treating the target site into which the bronchoscope 100 is inserted. The control unit 120 can generate electrical output, acoustic output, a fluid output and the like for treating the target site with cauterizing, cutting, freezing, and the like.

[0026] The control unit 120 can include an imaging engine that can receive ultrasound signal data from sensors at the end effector 102. The imaging engine can process the received ultrasound signal data to produce real-time ultrasound images for display on the output unit 110. While the control unit 120 is described as having this functionality, the bronchoscope system 104 can include separate componentry that provides an imaging engine and the functionality described herein.

[0027] The bronchoscope 100 can include an insertion section 122, a handle 124, which can be coupled to a cable section 126, and a coupler section 200 (Figure 2). The insertion section 122 can extend distally from the handle 124 to the end effector 102 and the cable section 200 can extend proximally from the handle 124. The insertionsection 122 can be elongate and include a bending section, and a distal end to which the end effector 102 can be attached. The bending section can be controllable (e.g., by a control knob on the handle 124) to maneuver the distal end through tortuous passageways (e.g., stomach, duodenum, kidney, ureter, etc.). The insertion section 122 can also include one or more working channels (e.g., an internal lumen) that can be elongate and can support insertion of one or more therapeutic tools of the end effector 102. The working channel can extend between the handle 124 and the end effector 102. Additional functionalities, such as fluid passages, guide wires, and pull wires can also be provided by the insertion section 122 (e.g., via suction or irrigation passageways, or the like).

[0028] The coupler section 200 can be connected to the control unit 120 to connect the bronchoscope 100 to multiple features of the control unit 120, such as the input unit 112, the light source unit 114, the fluid source 118, and the suction pump.

[0029] The handle 124 can include a knob 128 as well as a port 202. The knob 128 can be connected to a pull wire, or other actuation mechanisms, extending through insertion the insertion section 122. The port 202, as well as other ports, can be configured to couple various electrical cables, guide wires, auxiliary scopes, tissue collection devices, fluid tubes, and the like to the handle 124, such as for coupling with the insertion section 122.

[0030] The ultrasound image processing system 106 can be provided on a mobile platform (e.g., a cart 130) with shelves for housing the light source 114, the suction pump, an image processing unit 204 (Figure 2), etc. Alternatively, several components of ultrasound image processing system 106 can be provided directly on the bronchoscope 100 so as to make the endoscope “self-contained.”

[0031] Figure 2 is a schematic diagram of the bronchoscope system 104 including the ultrasound image processing system 106 of Figure 1. The control unit 120 can include or can be coupled to an image processing unit 204, a treatment generator 206, and a drive motor 208, as well as the light source 114, the input unit 112, and the output unit 110. The control unit 120 can include, or can be in communication with, a surgical instrument, which can include a device configured to engage tissue and collect and store a portion of that tissue and through which imaging equipment (e.g., a camera) can view target tissue via inclusion of optically enhanced materials and components. The control unit 120 can be configured to activate a camera to view target tissue distal of the bronchoscope system 104 and the bronchoscope 100. Likewise, the control unit 120can be configured to activate the light source unit 114 to shine light on the surgical instrument, which can include select components that are configured to reflect light in a particular manner, such as tissue cutters being enhanced with reflective particles. The light source 114 can be controlled to illuminate a target site using light of a desired spectrum (e.g., broadband white light, narrow-band imaging using preferred electromagnetic wavelengths, and the like).

[0032] The coupler section 200 can be connected to the control unit 120 to connect the bronchoscope 100 to multiple features of the control unit 120, such as the image processing unit 204 and the treatment generator 206. In examples, a port can be used to insert another instrument or device, such as a daughter scope or auxiliary scope, into the bronchoscope 100. Such instruments and devices can be independently connected to the control unit 120 via the cable section 126.

[0033] The image processing unit 204 and light source 114 can each interface with the bronchoscope 100 by wired or wireless electrical connections. The ultrasound image processing system 106 can accordingly illuminate a target site, collect signals representing the target site, process signals representing the target site, and display images representing the target site on the output unit 110. The ultrasound image processing system 106 can connect (e.g., via an endoscope connector) to the bronchoscope 100 for signal transmission (e.g., light output from a light source, video signals from an imaging system in the distal end, diagnostic and sensor signals from a diagnostic device, and the like).

[0034] The fluid source 116 can be in communication with the control unit 120 and can include one or more sources of air, saline, or other fluids, as well as associated fluid pathways (e.g., air channels, irrigation channels, suction channels) and connectors (barb fittings, fluid seals, valves and the like). The fluid source 116 can be utilized as an activation energy source for a biasing device or a pressure-applying device of features discussed herein. The ultrasound image processing system 106 can also include a drive motor 208, which can include a motorized drive for advancing a distal section of bronchoscope 100.

[0035] Now making reference to Figure 3, the end effector 102 can include a first member 300. The first member 300 can include a lumen port 304 from which a resection element 306 can extend that, can be used to resect tissue from a target site. In particular, the resection element 306 can include a cutting portion 307 that can be used to resect tissue from a target. Furthermore, the resection element 306 can include aninner lumen 308, which can be coupled to a suction source (not shown ). Tissue resected from a target by the cutting portion 306 can be withdrawn from a target site via suction that is applied at the inner lumen 308 by the suction source. The end effector 102 can include a ramp 310 that can guide the resection element 306 away from the end effector 102 and towards a target.

[0036] The end effector 102 can also include a second member 312 that can function as a sensor. The second member 312 can be a piezoelectric micromachined ultrasonic transducer (PMUT), a capacitive micromachined ultrasonic transducer (CMUT), or a polymer-based CMUT. When the second member 312 is a PMUT, the second member 312 can include a flexible substrate, an ultrasound transducer array, mixed-signal integrated circuits (IC), and capacitors. The flexible substrate can be a laminated structure having a cover layer, an electrical insulating layer, electrically conductive features, and adhesives. The electrical insulating layer can be made of polyimide having a thickness of about 12 pm. The electrically conductive features can be etched from copper foils having a thickness of about 5 pm, vapor deposited copper having a thickness in a range between about 2 pm and about 4 pm thick, vapor deposited nickel having a thickness in a range between about 2 pm and about 4 pm thick, or vapor deposited gold having a thickness of about 0.5 pm. The flexible substrate can include electrical contacts such as pads for die attachment of components for the mixed-signal ICs and capacitors. The ultrasound transducer array can include an array of 64 elements where each element includes at least one PMUT. The PMUTs can have a resonant frequency between about 5 MHz and about 40 MHz. The PMUTs can also have a resonant frequency of about 9.0 MHz.

[0037] When the second member 312 is a CMUT, the second member 312 can be formed with a silicon substrate where a cavity can be formed in the silicon substrate. A thin layer can be suspended over the cavity and function as a membrane where a metalized layer can act as an electrode. When an AC signal is applied across the electrode, ultrasonic waves can be produced in a field of view of a target site. The ultrasonic waves can be used to determine a location of a target within a field of view.

[0038] Now making reference to Figure 4, a method 400 for providing intraprocedural sampling location indications within a live ultrasound video is shown. Initially, a target site having a target nodule is imaged with an ultrasound sensor during an operation 402. When the target site and the target nodule are imaged, a boundary shape of the target nodule at the target site can be identified during an operation 404.The target nodule, which can be located at the target site, can include cancerous tissue. The target site can be a lymph node where samples of the target nodule can be removed and tested. Imaging during the operation 402 can be performed to assist with removing samples, such as during an endobronchial ultrasound-guided transbronchial needle aspiration (EBUS-TBNA) procedure.

[0039] During the operation 404, the boundary of the target nodule can be identified using various techniques, such as edge detection, which can include gradient calculations, thresholding, and edge thinning. Moreover, the boundary of the target nodule can be determined using impedance mismatching, where mismatches of impedances can be indicative of different tissue characteristics at the target nodule and can therefore define the boundary of the target nodule. When the image boundary of the target nodule is determined, this can be equivalent to determining a boundary shape at a target site where the image boundary can be the boundary shape.

[0040] As an example of the method 400 and referred to herein as “the example,” during the operation 402, the second member 312 can be used to create an image 500 of a target nodule 502 at a target site 504. The second member 312 can capture ultrasonic data associated with the target site 504 and the target nodule 502 and supply this data to the ultrasound image processing system 106. During the operation 402, the ultrasound image processing system 106 can process the data to generate the image 500 as a live video feed for display at the output unit 110. The ultrasound image processing system 106 can also process the ultrasonic data captured by the second member 312 to identify a boundary shape 506 of the target nodule 502 using edge detection, which can also be provided with the live video feed during the operation 404, as shown with reference to Figure 5. Here, the boundary shape 506 can be at the target site 504.

[0041] Returning attention to Figure 4 and the method 400, after the operation 404, the method 400 performs an operation 406 where a first location of a resection element relative to the target nodule boundary shape is determined. During an EBUS-TBNA procedure, after the target site and the target nodule are identified, a resection element can be inserted into the target nodule. The resection element can be used to resect a first sample from the target nodule. In some instances, multiple samples can be resected from the target nodule for testing of different areas of the target nodule. In order to allow for removing samples from different areas of the target nodule, different locations of where the resection element has been during sample resection can be presented to a practitioner. This can prevent the possibility of overlap between differentresections. In order to allow for presentation of different locations, during an operation 408, a first indicator corresponding with the first location of the resection element can be superimposed on the imaged target nodule. The first indicator can be any type of indica, such as a red line, a shape that mimics an end of a resection element, a broken line, a series of dots, or the like. When the first indicator is superimposed on the imaged target site, the method 400 can display the imaged target site where the first indicator is superimposed on the target site during an operation 410.

[0042] Turning attention back to the example and Figure 5, during the operation 406, a first location of the resection element 306 can be determined when the resection element is advanced into the target nodule 502. The resection element 306 can be advanced by moving the resection element 306 up the ramp 310, through the lumen port 304, and into the target site 504. When the practitioner has moved the resection element 306 to an area of the target nodule 502 the practitioner deems has samples that should be removed and then removes samples, ultrasonic data can be captured via the second member 312. In the example, the captured ultrasonic data can be transmitted to the ultrasound image processing system 106. The ultrasound data can include an echogenic signature of the resection element 306.

[0043] Using the echogenic signature of the resection element 306, the ultrasound image processing system 106 can determine that the resection element 306 has the first location 508 at the target nodule 502 when samples are removed, as shown in Figure 5. Moreover, during the operations 408 and 410, the ultrasound image processing system 106 can superimpose a first indicator 600 on the target nodule 502 of the image 500 based on the echogenic signature of the resection element 306, as shown with reference to Figure 6. In the example, the ultrasound image processing system 106 can cause the image 500 having the first indicator 600 to be displayed at the output unit 110 in the live video feed. The image 500 along with the first indicator 600 can be displayed in real time in the live video feed to the practitioner at the output unit 110. The first indicator 600 can correspond to the first location 508 and can indicate that the resection element 306 has been at the location 508. Thus, when a practitioner maneuvers the resection element 306 to remove further samples from the target nodule 502, the practitioner can be aware that the resection element 306 has already been at the first location 508 and that a sample has already been resected from the first location 508.

[0044] Returning attention to Figure 4 and the method 400, after the operation 404, the method 400 performs an operation 412 where a second location of a resectionelement relative to the target nodule boundary shape is identified in a manner similar to that discussed above with reference to the operation 404. During the operation 412, the image displayed during the operation 410 is presented such that the first indicator is displayed on the image being viewed during resection of a second sample associated with the second location. During an EBUS-TBNA procedure, after a first sample is removed from the target nodule the resection element can be moved to the second location. At the second location, a second sample from the target nodule can be resected. In examples, since the practitioner can see where the first sample was resected via the first indicator, the practitioner can avoid removing a second sample from the same location. In particular, the first indicator can remain static on an image being displayed to a practitioner in real time. Thus, when the practitioner moves to a second location of the target nodule, the first indicator continues to be displayed to the practitioner. The second location can be monitored in a manner similar to that described above with refence to the first location as the practitioner resects a sample from the target nodule.

[0045] Once the second location is monitored, during an operation 414, the method can superimpose a second indicator that corresponds to the second location on the imaged target nodule. The second indicator can be any type of indicia similar to the first indicator as mentioned above. Furthermore, when the second indicator is superimposed on the imaged target site, the method 400 can display the imaged target site where the first indicator along with the second indicator are superimposed on the target site during an operation 416.

[0046] Returning to the example and Figure 7, the practitioner has moved the resection element 306 to a second location 700. The practitioner can view the image 500 at the output unit 110 while moving the resection element 306 to the second location 700. During the operation 412, the second location 700 of the resection element 306 can be identified. While the practitioner is moving the resection element 306 to the second location 700, the first indicator 600 can remain on the image 500. Thus, when different views of the target nodule 502 are obtained via ultrasonic imaging, the first indicator 600 can move with the different views of the target nodule 502 such that the first indicator 600 remains static with the target nodule 502 while viewing the target nodule 502 in real time in a live video feed.

[0047] The ultrasound image processing system 106 can determine that the resection element 306 has the second location 700 at the target nodule 502 using the echogenicsignature of the resection element 306 as discussed above when a sample is removed from the target nodule 502 at the second location 700. Moreover, during the operation 414, the ultrasound image processing system 106 can superimpose a second indicator 800 on the target nodule 502 using the echogenic signature of the resection element 306 as discussed above with reference to the operation 408 in the example and as shown in Figure 8. The ultrasound image processing system 106 can also display the imaged target site where the first indicator 600 along with the second indicator 800 are superimposed on the target site during the operation 416.

[0048] The second indicator 800 can correspond to the second location 700 and can indicate that the resection element 306 has been at the second location 700. Thus, when a practitioner removes further samples from the target nodule 502, the practitioner can be aware that the resection element 306 has already been at the first and locations 508 and 700 via the first and second indicators 600 and 800 and that samples have already been resected from the first and second locations 508 and 700. Moreover, the first and second indicators 600 and 800 can move with the target nodule 502 in the image 500 in a real time video feed. Accordingly, if the practitioner moves the resection element to a third location, the first and second indicators 600 and 800 move with the third image of the target nodule 502 in real time in a live video feed. Here, during resection of a third sample, the image can display the first indicator 600 and the second indicator 800 at the same time. By virtue of showing where the resection element 306 has moved, the practitioner is able to move the resection element 306 to different areas of the target nodule 302 in a manner that allows for appropriate resection within the target nodule 502. While indicators have only been discussed with reference to two locations at a target nodule, examples envision any number of locations and any number of indicators being monitored and superimposed on an image of a target node in real time in a live video feed.

[0049] In further examples, the control unit 120 can be provided with the boundary shape 506 of the target nodule 502 and can determine a distribution of the samples that should be resected from the target nodule 502. The control unit 120 can include data relating to an optimal spacing parameter across the target nodule 502. Using the optimal spacing parameter, the control unit 120 can output to the practitioner the number of samples that should be taken from the target nodule 302 and from where in the target nodule 302 the samples should be taken.

[0050] Biopsy distribution can also be detected based on a shape, size, density, andthe like of the target nodule 502. An ultrasound image display can be provided using B-mode ultrasound imaging. B-mode ultrasound imaging can be used to render an image of the target nodule along with the boundary shape. B-mode ultrasound imaging can render the boundary shape using edge filtering.

[0051] B-mode ultrasound imaging can be composed of dots that represent ultrasound echoes of vascular structures within a target nodule. The vascular structures can be superimposed on the target image, such as the target image 500. Doppler mode can also be used to determine a level of vascularization. The vascular images determined using B-mode ultrasound imaging and / or the determined vascularization levels determined using doppler mode can be provided to the control unit 120, which can recommend a sampling depth and / or a distance from the boundary shape 506.

[0052] Doppler mode and B-mode ultrasound imaging can be combined in various examples. To further illustrate, doppler mode can be used to create a vascularization map and then ultrasound can be switched to B-mode ultrasound imaging where the vascularization map is superimposed on the output of the B-mode ultrasound imaging. Resection element positions within a target nodule and a boundary shape can be monitored. If B-mode ultrasound imaging determines that the resection element is nearing a hot spot on the vascularization map, a warning can be provided to a practitioner manipulating the resection element. The warning can be based on a proximity of the resection element relative to an edge of the boundary shape. To further illustrate, if the resection element crosses a distance threshold, i.e., the resection element gets within a millimeter of the boundary shape, the warning can be provided.

[0053] In the examples above, the first indicator 600 of the image 500 includes the cutting portion 307 along with a resection element lumen portion 802. Furthermore, the second indicator 800 of the image 500 includes the cutting portion 307 along with a resection element lumen portion 804. In an alternative example, in Figure 9, the image 500 can include a first indicator 900 that does not have the resection element lumen portion 802 and instead only has the cutting portion 307. The first indicator 900 can correspond to a first location similar to that described above. Furthermore, the first indicator 900 and the first location defined by the first indicator 900 can be displayed as described herein.

[0054] In the alternative example, the image 500 can also include a second indicator 902 that does not have the resection element lumen portion 804 and instead only has the cutting portion 307. The second indicator 902 can correspond to a second locationsimilar to that described above. Furthermore, the second indicator 902 and the second location defined by the second indicator 902 can be displayed as described herein. In the alternative examples, the first indicator 900 and second indicator 902 can occupy less area at the target nodule 502 and the target site 504 in comparison to the first indicator 600 and the second indicator 800.

[0055] The target nodule 502 can also be divided into sections 1000-1006 that can each include portions of the target nodule 502. The target nodule sections 1000-1006 can correspond to portions of the target nodule 502 that have different densities. Tissue spectroscopy techniques can be implemented to section the target nodule 502 where portions of the target nodule 502 can be characterized based on how the portions of the target nodule 502 interact with light. In particular, light scattering, light absorption, and / or luminescence can correspond to density levels within the target nodule 502. Different density levels within the target nodule 502 can provide an indication regarding whether or not samples should be resected.

[0056] Denser tissue samples can provide an indication of potentially cancerous tissue that should be resected for further testing. Using tissue spectroscopy techniques, the target nodule 502 can be divided in order to provide indications regarding which areas should have greater amounts of samples resected. In Figure 10, the target nodule sections 1004 and 1006 can have tissue with higher densities in comparison to tissue at the target nodule sections 1000 and 1002. With this knowledge, a practitioner can resect a greater amount of tissue samples from the target nodule sections 1004 and 1006 in comparison to the target nodule sections 1000 and 1002.

[0057] In addition to using target spectroscopy techniques to create the target nodule sections 1000-1006, ultrasound techniques can be used. An amplitude and frequency of reflected signals can be examined to section the target nodule 502 into the target nodule sections 1000-1006.

[0058] Figure 11 is a block diagram 1100 illustrating a software architecture 1102, which may be installed on any one or more of the devices described above. Figure 12 is merely a non-limiting example of a software architecture, and it will be appreciated that many other architectures may be implemented to facilitate the functionality described herein. The software architecture 1202 may be implemented by hardware such as a computer system 1200 of Figure 12 that includes a processor 1202, memory 1204 and 1206, and VO components 1210 - 1214. In this example, the software architecture 1102 may be conceptualized as a stack of layers where each layer may provide aparticular functionality. For example, the software architecture 802 includes layers such as an operating system 1102, libraries 1106, frameworks 1108, and applications 1110. Operationally, the applications 1110 invoke application programming interface (API) calls 1112 through the software stack and receive messages 1114 in response to the API calls 1112, according to some implementations.

[0059] In various implementations, the operating system 1102 manages hardware resources and provides common services. The operating system 1102 includes, for example, a kernel 1120, services 1122, and drivers 1124. The kernel 1120 acts as an abstraction layer between the hardware and the other software layers in some implementations. For example, the kernel 1120 provides memory management, processor management (e.g., scheduling), component management, networking, and security settings, among other functionality. The services 1122 may provide other common services for the other software layers. The drivers 1124 may be responsible for controlling or interfacing with the underlying hardware. For instance, the drivers 1124 may include display drivers, camera drivers, Bluetooth® drivers, flash memory drivers, serial communication drivers (e.g., Universal Serial Bus (USB) drivers), WiFi® drivers, audio drivers, power management drivers, and so forth.

[0060] In some implementations, the libraries 1106 provide a low-level common infrastructure that may be utilized by the applications 1110. The libraries 1106 may include system libraries 1130 (e.g., C standard library) that may provide functions such as memory allocation functions, string manipulation functions, mathematic functions, and the like. In addition, the libraries 1106 may include API libraries 1132 such as media libraries (e.g., libraries to support presentation and manipulation of various media formats such as Moving Picture Experts Group-4 (MPEG4), Advanced Video Coding (H.264 or AVC), Moving Picture Experts Group Layer-3 (MP3), Advanced Audio Coding (AAC), Adaptive Multi-Rate (AMR) audio codec, Joint Photographic Experts Group (JPEG or JPG), or Portable Network Graphics (PNG)), graphics libraries (e.g., an OpenGL framework used to render in two dimensions (2D) and three dimensions (3D) in a graphic context on a display), database libraries (e.g., SQLite to provide various relational database functions), web libraries (e.g., WebKit to provide web browsing functionality), and the like. The libraries 1106 may also include a wide variety of other libraries 1134 to provide many other APIs to the applications 1110.

[0061] The frameworks 1108 provide a high-level common infrastructure that may be utilized by the applications 1110, according to some implementations. For example, theframeworks 1108 provide various graphic user interface (GUI) functions, high-level resource management, high-level location services, and so forth. The frameworks 1108 may provide a broad spectrum of other APIs that may be utilized by the applications 1110, some of which may be specific to a particular operating system or platform.

[0062] In an example, the applications 1110 include a home application 1150, a contacts application 1152, a browser application 1156, a book reader application 1156, a location application 1158, a media application 1160, a messaging application 1162, a game application 1164, and a broad assortment of other applications such as a third- party application 1166. According to some examples, the applications 1110 are programs that execute functions defined in the programs. Various programming languages may be employed to create one or more of the applications 1110, structured in a variety of manners, such as object-orientated programming languages (e.g., Objective-C, Java, or C++) or procedural programming languages (e.g., C or assembly language). In a specific example, the third-party application 1166 (e.g., an application developed using the Android™ or iOS™ software development kit (SDK) by an entity other than the vendor of the particular platform) may be mobile software running on a mobile operating system such as iOS™, Android™, Windows® Phone, or other mobile operating systems. In this example, the third-party application 1166 may invoke the API calls 1112 provided by the mobile operating system (e.g., the operating system 802) to facilitate functionality described herein.

[0063] Certain examples are described herein as including logic or a number of components, modules, or mechanisms. Modules may constitute either software modules (e.g., code embodied (1) on a non-transitory machine-readable medium or (2) in a transmission signal) or hardware-implemented modules. A hardware-implemented module is a tangible unit capable of performing certain operations and may be configured or arranged in a certain manner. In examples, one or more computer systems (e.g., a standalone, client or server computer system) or one or more processors may be configured by software (e.g., an application or application portion) as a hardware-implemented module that operates to perform certain operations as described herein.

[0064] In various examples, a hardware-implemented module may be implemented mechanically or electronically. For example, a hardware-implemented module may include dedicated circuitry or logic that is permanently configured (e.g., as a specialpurpose processor, such as a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC)) to perform certain operations. A hardware- implemented module may also include programmable logic or circuitry (e.g., as encompassed within a general -purpose processor or other programmable processor) that is temporarily configured by software to perform certain operations. It will be appreciated that the decision to implement a hardware-implemented module mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.

[0065] Accordingly, the term "hardware-implemented module" should be understood to encompass a tangible entity, be that an entity that is physically constructed, permanently configured (e.g., hardwired) or temporarily or transitorily configured (e.g., programmed) to operate in a certain manner and / or to perform certain operations described herein. Considering examples in which hardware-implemented modules are temporarily configured (e.g., programmed), each of the hardware-implemented modules need not be configured or instantiated at any one instance in time. For example, where the hardware-implemented modules include a general-purpose processor configured using software, the general-purpose processor may be configured as respectively different hardware-implemented modules at different times. Software may, accordingly, configure a processor, for example, to constitute a particular hardware- implemented module at one instance of time and to constitute a different hardware- implemented module at a different instance of time.

[0066] Hardware-implemented modules can provide information to, and receive information from, other hardware-implemented modules. Accordingly, the described hardware-implemented modules may be regarded as being communicatively coupled. Where multiples of such hardware-implemented modules exist contemporaneously, communications may be achieved through signal transmission (e.g., over appropriate circuits and buses) that connects the hardware-implemented modules. In examples in which multiple hardware-implemented modules are configured or instantiated at different times, communications between such hardware-implemented modules may be achieved, for example, through the storage and retrieval of information in memory structures to which the multiple hardware-implemented modules have access. For example, one hardware-implemented module may perform an operation and store the output of that operation in a memory device to which it is communicatively coupled. A further hardware-implemented module may then, at a later time, access the memorydevice to retrieve and process the stored output. Hardware-implemented modules may also initiate communications with input or output devices, and can operate on a resource (e.g., a collection of information).

[0067] The various operations of example methods described herein may be performed, at least partially, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor-implemented modules that operate to perform one or more operations or functions. The modules referred to herein may, in some examples, include processor- implemented modules.

[0068] Similarly, the methods described herein may be at least partially processor- implemented. For example, at least some of the operations of a method may be performed by one or more processors or processor-implemented modules. The performance of certain of the operations may be distributed among the one or more processors, not only residing within a single machine, but also deployed across a number of machines. In some examples, the processor or processors may be located in a single location (e.g., within a home environment, an office environment or as a server farm), while in other examples, the processors may be distributed across a number of locations.

[0069] The one or more processors may also operate to support performance of the relevant operations in a "cloud computing" environment or as a "software as a service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., application program interfaces (APIs).)

[0070] Examples may be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them. Examples may be implemented using a computer program product, e.g., a computer program tangibly embodied in an information carrier, e.g., in a machine-readable medium for execution by, or to control the operation of data processing apparatus, e.g., a programmable processor, a computer, or multiple computers.

[0071] A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, subroutine, or other unit suitable foruse in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers, at one site or distributed across multiple sites, and interconnected by a communication network.

[0072] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. In examples deploying a programmable computing system, it will be appreciated that both hardware and software architectures require consideration. Specifically, it will be appreciated that the choice of whether to implement certain functionality in permanently configured hardware (e.g., an ASIC), in temporarily configured hardware (e.g., a combination of software and a programmable processor), or a combination of permanently and temporarily configured hardware may be a design choice. Below are set out hardware (e.g., machine) and software architectures that may be deployed, in various examples.

[0073] Figure 12 is a block diagram of a machine within which instructions may be executed for causing the machine to perform any one or more of the methodologies discussed herein. In one example, the machine may be any of the devices described above. In alternative examples, the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a personal digital assistant (PDA), a cellular telephone, a web appliance, a network router, switch or bridge, or any machine capable of executing instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that, individually or jointly, execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.

[0074] The example computer system 1200 includes a processor 1202 (e.g., a central processing unit (CPU), a graphics processing unit (GPU) or both), a main memory 1204 and a static memory 1206, which communicate with each other via a bus 1208. The computer system 900 may further include a video display unit 1210 (e.g., a liquidcrystal display (LCD) or a cathode ray tube (CRT)). The computer system 900 also includes an alphanumeric input device 1212 (e.g., a keyboard), a user interface (UI) navigation device (cursor control device) 1314 (e.g., a mouse), a disk drive unit 1216, a signal generation device 1218 (e.g., a speaker) and a network interface device 1220.

[0075] The drive unit 1216 includes a machine-readable medium 1222 on which is stored one or more sets of instructions and data structures (e.g., software) 1224 embodying or utilized by any one or more of the methodologies or functions described herein. The instructions 1224 may also reside, completely or at least partially, within the main memory 1204 and / or within the processor 1202 during execution thereof by the computer system 1200, the main memory 1204 and the processor 1202 also constituting machine-readable media. Instructions 1224 may also reside within the static memory 1206.

[0076] While the machine-readable medium 1222 is shown in an example to be a single medium, the term "machine-readable medium" may include a single medium or multiple media (e.g., a centralized or distributed database, and / or associated caches and servers) that store the one or more instructions or data instructions 1224. The term "machine-readable medium" shall also be taken to include any tangible medium that is capable of storing, encoding or carrying instructions 1224 for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present invention, or that is capable of storing, encoding or carrying data structures utilized by or associated with such instructions 1224. The term "machine-readable medium" shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media. Specific examples of machine-readable media include non-volatile memory, including by way of example, semiconductor memory devices, e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), and flash memory devices; magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.

[0077] The instructions 1224 may further be transmitted or received over the network 112 using a transmission medium. The instructions 1224 may be transmitted using the network interface device 1220 and any one of a number of well-known transfer protocols (e.g., HTTP). Examples of communication networks include a local area network (“LAN”), a wide area network (“WAN”), the Internet, mobile telephone networks, plain old telephone (POTS) networks, and wireless data networks (e.g., Wi-Fiand Wi-Max networks). The term "transmission medium" shall be taken to include any intangible medium that is capable of storing, encoding or carrying instructions 1224 for execution by the machine, and includes digital or analog communications signals or other intangible media to facilitate communication of such software.

[0078] In various example examples, one or more portions of a network may be an ad hoc network, an intranet, an extranet, a VPN, a LAN, a WLAN, a WAN, a WWAN, a MAN, the Internet, a portion of the Internet, a portion of the PSTN, a plain old telephone service (POTS) network, a cellular telephone network, a wireless network, a Wi-Fi® network, another type of network, or a combination of two or more such networks. For example, the network or a portion of the network may include a wireless or cellular network, and a coupling may be a Code Division Multiple Access (CDMA) connection, a Global System for Mobile communications (GSM) connection, or another type of cellular or wireless coupling. In this example, a coupling may implement any of a variety of types of data transfer technology, such as Single Carrier Radio Transmission Technology (IxRTT), Evolution-Data Optimized (EVDO) technology, General Packet Radio Service (GPRS) technology, Enhanced Data rates for GSM Evolution (EDGE) technology, third Generation Partnership Project (3 GPP) including 3G, fourth generation wireless (4G) networks, Universal Mobile Telecommunications System (UMTS), High Speed Packet Access (HSPA), Worldwide Interoperability for Microwave Access (WiMAX), Long Term Evolution (LTE) standard, others defined by various standard-setting organizations, other long range protocols, or other data transfer technology. Although an example has been described with reference to specific examples, it will be evident that various modifications and changes may be made to these examples without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. The accompanying drawings that form a part hereof, show by way of illustration, and not of limitation, specific examples in which the subject matter may be practiced. The examples illustrated are described in sufficient detail to enable those skilled in the art to practice the teachings disclosed herein. Other examples may be utilized and derived therefrom, such that structural and logical substitutions and changes may be made without departing from the scope of this disclosure. This Detailed Description, therefore, is not to be taken in a limiting sense, and the scope of various examples is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled.

[0079] Such examples of the inventive subject matter may be referred to herein, individually and / or collectively, by the term “invention” merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed. Thus, although specific examples have been illustrated and described herein, it should be appreciated that any arrangement calculated to achieve the same purpose may be substituted for the specific examples shown. This disclosure is intended to cover any and all adaptations or variations of various examples. Combinations of the above examples, and other examples not specifically described herein, will be apparent to those of skill in the art upon reviewing the above description.

[0080] The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in a single example for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed examples require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed example. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate example.

[0081] As used herein, the terms “machine-storage medium,” “device-storage medium,” and “computer-storage medium” mean the same thing and may be used interchangeably. The terms refer to a single or multiple storage devices and / or media (e.g., a centralized or distributed database, and / or associated caches and servers) that store executable instructions 716 and / or data. The terms shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media, including memory internal or external to processors. Specific examples of machinestorage media, computer- storage media and / or device-storage media include nonvolatile memory, including by way of example semiconductor memory devices, e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), FPGA, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The terms “machine-storage media,” “computer-storage media,” and “device-storage media” specifically exclude carrier waves, modulated data signals, and other such media, at least some of which are covered under the term “signal medium” discussed below.

[0082] The instructions may be transmitted or received over the network using a transmission medium via a network interface device (e.g., a network interface component included in the communication components) and utilizing any one of a number of well-known transfer protocols (e.g., hypertext transfer protocol (HTTP)). Similarly, the instructions may be transmitted or received using a transmission medium via the coupling (e.g., a peer-to-peer coupling) to the devices 770. The terms “transmission medium” and “signal medium” mean the same thing and may be used interchangeably in this disclosure. The terms “transmission medium” and “signal medium” shall be taken to include any intangible medium that is capable of storing, encoding, or carrying the instructions for execution by the machine, and include digital or analog communications signals or other intangible media to facilitate communication of such software. Hence, the terms “transmission medium” and “signal medium” shall be taken to include any form of modulated data signal, carrier wave, and so forth. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.

[0083] The terms “machine-readable medium,” “computer-readable medium,” “device-readable medium,” and “machine storage medium,” mean the same thing and may be used interchangeably in this disclosure. The terms are defined to include both machine-storage media and transmission media. Thus, the terms include both storage devices / media and carrier waves / modulated data signals. For instance, an embodiment described herein can be implemented using a non-transitory medium (e.g., a non- transitory computer-readable medium).

[0084] Additional Examples

[0085] Example l is a system for providing intraprocedural sampling location indications within a live ultrasound video, the system comprising: a processor; and memory comprising instructions that, when executed by the processor, cause the system to perform operations comprising: imaging a target site; identifying a boundary shape at the target site; determining a first location of a resection element relative to the target site when the resection element removes a sample from the target site; displaying an image of the target site, wherein a first indicator corresponding to the first location is superimposed on the displayed image of the target site; determining a second locationof the resection element relative to the target site when the resection element removes a second sample from the target site during display of the image having the first indicator; and updating the displayed image of the target site to include, a second indicator superimposed on the image of the target site, the second indicator corresponding to the second location, wherein the second indicator is superimposed on the displayed image of the target site such that the displayed image of the target site includes the first indicator and the second indicator.

[0086] In Example 2, the subject matter of Example 1 includes, wherein the instructions further cause the system to perform operations comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; displaying an image of the segmented target site, wherein the segmented target site includes the first indicator and the second indicator.

[0087] In Example 3, the subject matter of Examples 1-2 includes, wherein the first indicator and the second indicator are one of a series of dots or a line.

[0088] In Example 4, the subject matter of Examples 1-3 includes, wherein the instructions further cause the system to perform operations comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; and displaying an image of the segmented target site, wherein a segment of the segmented target site includes the first indicator corresponding to the first location.

[0089] In Example 5, the subject matter of Examples 1-4 includes, wherein the instructions further cause the system to perform operations comprising using one of edge detection or impendence mismatching to identify the boundary shape at the target site.

[0090] In Example 6, the subject matter of Examples 1-5 includes, wherein the resection element is a needle having a tip and the first location corresponds to a tip location of the needle tip and the indicator corresponds to the tip location of the needle tip.

[0091] In Example 7, the subject matter of Examples 1-6 includes, wherein the instructions further cause the system to perform operations comprising displaying the first indicator and the second indicator during resection of a third sample.

[0092] Example 8 is a non-transitory machine storage medium having instructions embodied thereon for providing intraprocedural sampling location indications within a live ultrasound video, the instructions executable by a processor of a machine toperform operations comprising: imaging a target site; identifying a boundary shape at the target site; determining a first location of a resection element relative to the target site when the resection element removes a sample from the target site; displaying an image of the target site, wherein a first indicator corresponding to the first location is superimposed on the displayed image of the target site; determining a second location of the resection element relative to the target site when the resection element removes a second sample from the target site during display of the image having the first indicator; and updating the displayed image of the target site to include, a second indicator superimposed on the image of the target site, the second indicator corresponding to the second location, wherein the second indicator is superimposed on the displayed image of the target site such that the displayed image of the target site includes the first indicator and the second indicator.

[0093] In Example 9, the subject matter of Example 8 includes, the operations further comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; displaying an image of the segmented target site, wherein the segmented target site includes the first indicator and the second indicator.

[0094] In Example 10, the subject matter of Examples 8-9 includes, the operations further comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; and displaying an image of the segmented target site, wherein a segment of the segmented target site includes the first indicator corresponding to the first location.

[0095] In Example 11, the subject matter of Examples 8-10 includes, the operations further comprising using one of edge detection or impendence mismatching to identify the boundary shape at the target site.

[0096] In Example 12, the subject matter of Examples 8-11 includes, wherein the resection element is a needle having a tip and the first location corresponds to a tip location of the needle tip and the indicator corresponds to the tip location of the needle tip.

[0097] In Example 13, the subject matter of Examples 8-12 includes, the operations further comprising displaying the first indicator and the second indicator during resection of a third sample.

[0098] Example 14 is a method for providing intraprocedural sampling location indications within a live ultrasound video, the method comprising: imaging a target site;identifying a boundary shape at the target site; determining a first location of a resection element relative to the target site when the resection element removes a sample from the target site; displaying an image of the target site, wherein a first indicator corresponding to the first location is superimposed on the displayed image of the target site; determining a second location of the resection element relative to the target site when the resection element removes a second sample from the target site during display of the image having the first indicator; and updating the displayed image of the target site to include, a second indicator superimposed on the image of the target site, the second indicator corresponding to the second location, wherein the second indicator is superimposed on the displayed image of the target site such that the displayed image of the target site includes the first indicator and the second indicator.

[0099] In Example 15, the subject matter of Example 14 includes, the method further comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; displaying an image of the segmented target site, wherein the segmented target site includes the first indicator and the second indicator.

[0100] In Example 16, the subject matter of Examples 14-15 includes, wherein the first indicator and the second indicator are one of a series of dots or a line.

[0101] In Example 17, the subject matter of Examples 14-16 includes, the method comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; and displaying an image of the segmented target site, wherein a segment of the segmented target site includes the first indicator corresponding to the first location.

[0102] In Example 18, the subject matter of Examples 14-17 includes, the method further comprising using one of edge detection or impendence mismatching to identify the boundary shape at the target site.

[0103] In Example 19, the subject matter of Examples 14-18 includes, wherein the resection element is a needle having a tip and the first location corresponds to a tip location of the needle tip and the indicator corresponds to the tip location of the needle tip.

[0104] In Example 20, the subject matter of Examples 14-19 includes, the method further comprising displaying the first indicator and the second indicator during resection of a third sample.

[0105] Example 21 is at least one machine-readable medium including instructions that, when executed by processing circuitry, cause the processing circuitry to perform operations to implement of any of Examples 1-20.

[0106] Example 22 is an apparatus comprising means to implement of any of Examples 1-20.

[0107] Example 23 is a system to implement of any of Examples 1-20.

[0108] Example 24 is a method to implement of any of Examples 1-20.T1

Claims

CLAIMSWhat is claimed is:

1. A system for providing intraprocedural sampling location indications within a live ultrasound video, the system comprising: a processor; and memory comprising instructions that, when executed by the processor, cause the system to perform operations comprising: imaging a target site; identifying a boundary shape at the target site; determining a first location of a resection element relative to the target site when the resection element removes a sample from the target site; displaying an image of the target site, wherein a first indicator corresponding to the first location is superimposed on the displayed image of the target site; determining a second location of the resection element relative to the target site when the resection element removes a second sample from the target site during display of the image having the first indicator; and updating the displayed image of the target site to include a second indicator superimposed on the image of the target site, the second indicator corresponding to the second location, wherein the second indicator is superimposed on the displayed image of the target site such that the displayed image of the target site includes the first indicator and the second indicator.

2. The system of claim 1, wherein the instructions further cause the system to perform operations comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; displaying an image of the segmented target site, wherein the segmented target site includes the first indicator and the second indicator.

3. The system of claim 1, wherein the first indicator and the second indicator are one of a series of dots or a line.

4. The system of claim 1, wherein the instructions further cause the system toperform operations comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; and displaying an image of the segmented target site, wherein a segment of the segmented target site includes the first indicator corresponding to the first location.

5. The system of claim 1, wherein the instructions further cause the system to perform operations comprising using one of edge detection or impendence mismatching to identify the boundary shape at the target site.

6. The system of claim 1, wherein the resection element is a needle having a tip and the first location corresponds to a tip location of the needle tip and the indicator corresponds to the tip location of the needle tip.

7. The system of claim 1, wherein the instructions further cause the system to perform operations comprising displaying the first indicator and the second indicator during resection of a third sample.

8. A non-transitory machine storage medium having instructions embodied thereon for providing intraprocedural sampling location indications within a live ultrasound video, the instructions executable by a processor of a machine to perform operations comprising: imaging a target site; identifying a boundary shape at the target site; determining a first location of a resection element relative to the target site when the resection element removes a sample from the target site; displaying an image of the target site, wherein a first indicator corresponding to the first location is superimposed on the displayed image of the target site; determining a second location of the resection element relative to the target site when the resection element removes a second sample from the target site during display of the image having the first indicator; and updating the displayed image of the target site to include a second indicator superimposed on the image of the target site, the second indicator corresponding to the second location, wherein the second indicator is superimposed on the displayed imageof the target site such that the displayed image of the target site includes the first indicator and the second indicator.

9. The non-transitory machine-readable medium of claim 8, the operations further comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; displaying an image of the segmented target site, wherein the segmented target site includes the first indicator and the second indicator.

10. The non-transitory machine-readable medium of claim 8, the operations further comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; and displaying an image of the segmented target site, wherein a segment of the segmented target site includes the first indicator corresponding to the first location.

11. The non-transitory machine-readable medium of claim 8, the operations further comprising using one of edge detection or impendence mismatching to identify the boundary shape at the target site.

12. The non-transitory machine-readable medium of claim 8, wherein the resection element is a needle having a tip and the first location corresponds to a tip location of the needle tip and the indicator corresponds to the tip location of the needle tip.

13. The non-transitory machine-readable medium of claim 8, the operations further comprising displaying the first indicator and the second indicator during resection of a third sample.

14. A method for providing intraprocedural sampling location indications within a live ultrasound video, the method comprising: imaging a target site; identifying a boundary shape at the target site;determining a first location of a resection element relative to the target site when the resection element removes a sample from the target site; displaying an image of the target site, wherein a first indicator corresponding to the first location is superimposed on the displayed image of the target site; determining a second location of the resection element relative to the target site when the resection element removes a second sample from the target site during display of the image having the first indicator; and updating the displayed image of the target site to include a second indicator superimposed on the image of the target site, the second indicator corresponding to the second location, wherein the second indicator is superimposed on the displayed image of the target site such that the displayed image of the target site includes the first indicator and the second indicator.

15. The method of claim 14, the method further comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; displaying an image of the segmented target site, wherein the segmented target site includes the first indicator and the second indicator.

16. The method of claim 14, wherein the first indicator and the second indicator are one of a series of dots or a line.

17. The method of claim 14, the method comprising: determining a plurality of sample characteristics at the target site; segmenting the target site based on the plurality of sample characteristics; and displaying an image of the segmented target site, wherein a segment of the segmented target site includes the first indicator corresponding to the first location.

18. The method of claim 14, the method further comprising using one of edge detection or impendence mismatching to identify the boundary shape at the target site.

19. The method of claim 14, wherein the resection element is a needle having a tip and the first location corresponds to a tip location of the needle tip and the indicator corresponds to the tip location of the needle tip.

20. The method of claim 14, the method further comprising displaying the first indicator and the second indicator during resection of a third sample.

Images