Continuously displayed instrument path indicator

Abstract

A system is provided for providing in-process sampling position indication within real-time ultrasound video. The system images the target site and identifies the boundary shape at the target site. As a resection element removes a sample from the target site, the system determines the position of the resection element relative to the target site. The system displays an image of the target site, with an indicator corresponding to the position superimposed on the displayed image of the target site. When a second sample is removed from the target site, the indicator remains on the image of the target site presented during the removal of the second sample, thus providing indication at the position where the sample has been removed from the target site.

Description

Priority Statement

[0001] This case claims priority to U.S. Provisional Patent Application Serial No. 63 / 613,336, filed on December 21, 2023, the contents of which are incorporated herein by reference. Technical Field

[0002] This document generally relates, but not in a limited way, to systems that can be used for a variety of medical procedures. More specifically, but not in a limited way, this document relates to systems that can image a target site and track the position of a medical device within the target site. Background Technology

[0003] When an operator wishes to collect a sample from a target site (such as a lymph node sample), they manipulate a medical device to the target site and remove the sample. Typically, the medical device includes a biopsy needle, which is delivered to the target site and used to remove the sample. Multiple samples are usually removed from the target site to allow for characterization of the site. Therefore, an operator can use the medical device to remove a sample from the target site, remove the device, and then reinsert it to remove another sample. However, the operator may not be able to track where the sample has been removed from the target site. Summary of the Invention

[0004] Examples relate to systems and methods for providing in-process sampling location indication within real-time ultrasound video. The system may include an ultrasound image processing system that analyzes the real-time ultrasound video feed to identify anatomical features of a target site. This may include using edge detection techniques to identify the boundary shape of a target nodule at the target site. The ultrasound image processing system can image the target site, as well as the target nodule and its boundary shape.

[0005] A resection element, such as a biopsy needle, can be used to remove a sample from a target nodule. The resection element can enter the target nodule within its boundary shape in a first instance. An ultrasound image processing system can then determine the first location of the resection element within the target site and the target nodule in the first instance, while monitoring both the target nodule and the boundary shape. The ultrasound image processing system can determine the first location by identifying the echo characteristics of the resection element. When the resection element is in the first location, tissue can be removed at that location.

[0006] When the ultrasound image processing system determines a first location, it can overlay a first indicator associated with that location onto the imaged target nodule having a boundary shape. The first indicator may correspond to a first location of the resection element within the target nodule and the boundary shape. As the resection element enters the target nodule within the boundary shape during a second instance, the first indicator may remain overlaid on the imaged target nodule. In the second instance, when the resection element enters the target nodule, the first indicator remains overlaid, allowing the resection element to be positioned at a second location within the target nodule and the boundary shape, different from the first location. The ultrasound image processing system can determine the second location of the resection element within the target site and the target nodule in the second instance, while simultaneously monitoring both the target nodule and the boundary shape by identifying the echo characteristics of the resection element.

[0007] Since the operator manipulating the resection element can see the first position in real time, the operator can manipulate the resection element to a second position to ensure that tissue different from that removed at the first position is removed. Furthermore, a second indicator can be superimposed on the imaged target nodule corresponding to the second position, such that the first and second indicators remain on the imaged target nodule to indicate the position from which a sample has been obtained from the target nodule during subsequent sample retrieval, ensuring that tissue different from that removed at the first and second positions is removed. Attached Figure Description

[0008] Figure 1 A bronchoscopic system with a bronchoscope is shown according to some examples.

[0009] Figure 2 It is based on some examples Figure 1 A schematic diagram of a bronchoscopy system.

[0010] Figure 3 The following are examples. Figure 1 The end effector assembly of a bronchoscope.

[0011] Figure 4 Methods for providing in-process sampling location indication within real-time ultrasound video are illustrated, based on some examples.

[0012] Figure 5 The first location of the excision element at the target nodule is shown according to some examples.

[0013] Figure 6 The superposition of some examples is shown. Figure 5 The first indicator at the first position.

[0014] Figure 7 The following examples are shown. Figure 5 Target nodule Figure 5 The second position of the cut-off element.

[0015] Figure 8 The superposition of some examples is shown. Figure 7 The second indicator at the second position and the first indicator at the first position.

[0016] Figure 9 The first indicator is shown according to some examples, without the cut-off portion of the element lumen and instead only the cut portion.

[0017] Figure 10 This shows the division into sections based on some examples. Figure 5 The target nodule, and each segment may include a portion of the target nodule.

[0018] Figure 11 This is a block diagram illustrating the architecture of software for implementing a list of social network initiations, based on some examples.

[0019] Figure 12 This is a block diagram illustrating a machine as an example computer system, based on some examples, which has instructions that enable the machine to implement a list of social network initiations. Detailed Implementation

[0020] Examples relate to systems and methods for providing in-process sampling location indication within real-time ultrasound video. The system may include an ultrasound image processing system that analyzes the real-time ultrasound video feed to identify anatomical features of a target site. This may include using edge detection techniques to identify the boundary shape of a target nodule at the target site. The ultrasound image processing system can image the target site, as well as the target nodule and its boundary shape.

[0021] A resection element, such as a biopsy needle, can be used to remove a sample from a target nodule. The resection element can enter the target nodule within its boundary shape in a first instance. An ultrasound image processing system can then determine the first location of the resection element within the target site and the target nodule in the first instance, while monitoring both the target nodule and the boundary shape. The ultrasound image processing system can determine the first location by identifying the echo characteristics of the resection element. When the resection element is in the first location, tissue can be removed at that location.

[0022] When the ultrasound image processing system determines a first location, it can overlay a first indicator associated with that location onto the imaged target nodule having a boundary shape. The first indicator may correspond to a first location of the resection element within the target nodule and the boundary shape. As the resection element enters the target nodule within the boundary shape during a second instance, the first indicator may remain overlaid on the imaged target nodule. In the second instance, when the resection element enters the target nodule, the first indicator remains overlaid, allowing the resection element to be positioned at a second location within the target nodule and the boundary shape, different from the first location. The ultrasound image processing system can determine the second location of the resection element within the target site and the target nodule in the second instance, while simultaneously monitoring both the target nodule and the boundary shape by identifying the echo characteristics of the resection element.

[0023] Figure 1 This is a schematic diagram of a bronchoscopy system 104, which may include an ultrasound image processing system 106 and a bronchoscope 100. The bronchoscopy system 104 is an illustrative example of a system suitable for use with the devices and methods described herein, such as a bronchoscope with an integrated stabilizer or intubation element.

[0024] The bronchoscope 100 may be inserted into a target site for imaging, or to provide access or attachment (e.g., via tethering) to one or more sampling devices for biopsy, or to provide access or attachment (e.g., via tethering) to one or more therapeutic devices for treating a disease state associated with the target site. The bronchoscope 100 may interface with and connect to an ultrasound image processing system 106. The bronchoscope 100 may also include a duodenoscope, although other types of endoscopes may be used with the features discussed herein. The ultrasound image processing system 106 may include an output unit 110, an input unit 112, a light source 114, a fluid source 116, a suction pump 118, and a control unit 120. The control unit 120 may be a computing device having hardware and software functions to perform the features discussed herein.

[0025] The ultrasound image processing system 106 can also be a computing device with hardware and software functions that perform the features discussed herein. The ultrasound image processing system 106 may include various ports for coupling with the bronchoscope system 104. For example, the control unit 120 may include a data input port for receiving data from the bronchoscope 100 and a data output port for transmitting data to the bronchoscope 100. The light source 114 may include an output port for transmitting light, for example, via an optical fiber link to the bronchoscope 100. The fluid source 116 may include a port for transmitting fluid to the bronchoscope 100. The fluid source 116 may include, for example, a pump and a fluid tank, or may be connected to an external tank, container, or storage unit. The suction pump may include a port for creating a vacuum from the bronchoscope 100 to generate suction, for example, for withdrawing fluid from a target site inserted into the bronchoscope 100 and for withdrawing a sample from a target excised by a resection element. Output unit 110 and input unit 112 can be used by the operator of the bronchoscopy system 104 to control the functions of the bronchoscopy system 104 and view the output of the bronchoscopy 100. Control unit 120 can additionally be used to generate signals or other outputs for treating the target site into which the bronchoscopy 100 is inserted. Control unit 120 can generate electrical outputs, acoustic outputs, fluid outputs, etc., for treating the target site by cauterization, cutting, freezing, etc.

[0026] The control unit 120 may include an imaging engine that can receive ultrasound signal data from a sensor at the end effector 102. The imaging engine can process the received ultrasound signal data to generate a real-time ultrasound image for display on the output unit 110. Although the control unit 120 is described as having this function, the bronchoscopy system 104 may include separate components that provide the imaging engine and the functions described herein.

[0027] The bronchoscope 100 may include an insertion section 122, a handle 124 that can be coupled to a cable section 126, and a coupler section 200. Figure 2Insertion segment 122 extends distally from handle 124 to end effector 102, and cable segment 200 extends proximally from handle 124. Insertion segment 122 may be elongated and includes a curved section to which end effector 102 may be attached distally. The curved section may be controllable (e.g., via a control knob on handle 124) to manipulate the distal end through a curved passage (e.g., stomach, duodenum, kidney, ureter, etc.). Insertion segment 122 may also include one or more working channels (e.g., internal lumens), which may be elongated and may support the insertion of one or more therapeutic instruments of end effector 102. Working channels may extend between handle 124 and end effector 102. Additional functions, such as fluid channels, guidewires, and drawwires, may also be provided by insertion segment 122 (e.g., via aspiration or flushing channels, etc.).

[0028] Coupler segment 200 can be connected to control unit 120 to connect bronchoscope 100 to multiple features of control unit 120, such as input unit 112, light source unit 114, fluid source 118 and suction pump.

[0029] Handle 124 may include knob 128 and port 202. Knob 128 may be connected to a wire-pulling or other actuating mechanism extending through insertion section 122. Port 202 and other ports may be configured to couple various cables, guidewires, auxiliary endoscopes, tissue sampling devices, fluid tubing, etc., to handle 124, for example, for coupling with insertion section 122.

[0030] The ultrasound image processing system 106 can be mounted on a mobile platform (e.g., a trolley 130) having features for accommodating a light source 114, a suction pump, and an image processing unit 204. Figure 2 Shelves, etc. Alternatively, some components of the ultrasound image processing system 106 can be directly mounted on the bronchoscope 100 to make the endoscope "self-contained".

[0031] Figure 2 It includes Figure 1A schematic diagram of the bronchoscopic system 104 of the ultrasound image processing system 106. The control unit 120 may include or be coupled to the image processing unit 204, the treatment generator 206, and the drive motor 208, as well as the light source 114, the input unit 112, and the output unit 110. The control unit 120 may include, or be in communication with, surgical instruments, which may include devices configured to engage tissue and acquire and store portions of that tissue, and imaging devices (e.g., camera devices) may be used to observe target tissue via these devices including optically enhanced materials and components. The control unit 120 may be configured to activate the camera device to view target tissue distal to the bronchoscopic system 104 and the bronchoscope 100. Similarly, the control unit 120 may be configured to activate the light source unit 114 to illuminate surgical instruments, which may include selected components configured to reflect light in a specific manner, such as a tissue cutter enhanced with reflective microparticles. The light source 114 can be controlled to illuminate the target area using light of the desired spectrum (e.g., broadband white light, narrowband imaging using preferred electromagnetic wavelengths, etc.).

[0032] Coupler segment 200 can be connected to control unit 120 to connect bronchoscope 100 to various features of control unit 120, such as image processing unit 204 and treatment generator 206. In this example, the port can be used to insert another instrument or device (such as a sub-scope or auxiliary scope) into bronchoscope 100. Such instruments and devices can be independently connected to control unit 120 via cable segment 126.

[0033] Image processing unit 204 and light source 114 can each interface with bronchoscope 100 via wired or wireless connection. Ultrasonic image processing system 106 can accordingly illuminate the target area, acquire signals representing the target area, process the signals representing the target area, and display an image representing the target area on output unit 110. Ultrasonic image processing system 106 can be connected to bronchoscope 100 (e.g., via endoscope connector) for signal transmission (e.g., light output from the light source, video signals from the imaging system in the distal end, diagnostic and sensor signals from diagnostic equipment, etc.).

[0034] Fluid source 116 may be in communication with control unit 120 and may include one or more sources of air, saline, or other fluids, as well as associated fluid paths (e.g., air passages, flushing passages, suction passages) and connectors (barbed fittings, fluid seals, valves, etc.). Fluid source 116 may serve as an activation energy source for the biasing or pressure application devices of the features discussed herein. Ultrasonic image processing system 106 may also include drive motor 208, which may include a motorized drive for advancing the distal segment of bronchoscope 100.

[0035] Now refer to Figure 3 The end effector 102 may include a first member 300. The first member 300 may include a lumen port 304 from which a cutting element 306 extends, and the cutting element may be used to remove tissue from a target site. Specifically, the cutting element 306 may include a cutting portion 307 that can be used to remove tissue from the target site. Furthermore, the cutting element 306 may include an internal lumen 308 that may be coupled to a suction source (not shown). Tissue removed from the target site by the cutting portion 306 can be withdrawn from the target site via suction applied by the suction source at the internal lumen 308. The end effector 102 may include an inclined portion 310 that can guide the cutting element 306 away from the end effector 102 and toward the target.

[0036] The end effector 102 may also include a second component 312 that can be used as a sensor. The second component 312 may be a piezoelectric micromechanical ultrasonic transducer (PMUT), a capacitive micromechanical ultrasonic transducer (CMUT), or a polymer-based CMUT. When the second component 312 is a PMUT, it may include a flexible substrate, an ultrasonic transducer array, a mixed-signal integrated circuit (IC), and a capacitor. The flexible substrate may be a laminated structure having a capping layer, an electrically insulating layer, conductive features, and an adhesive. The electrically insulating layer may be made of polyimide having a thickness of about 12 µm. The conductive features may be etched from copper foil having a thickness of about 5 µm, vapor-deposited copper having a thickness in the range of about 2 µm to about 4 µm, vapor-deposited nickel having a thickness in the range of about 2 µm to about 4 µm, or vapor-deposited gold having a thickness of about 0.5 µm. The flexible substrate may include electrical contacts, such as pads for die attachment of components for the mixed-signal IC and capacitor. The ultrasonic transducer array may comprise an array of 64 elements, each element comprising at least one PMUT. The PMUT may have a resonant frequency between approximately 5 MHz and approximately 40 MHz. The PMUT may also have a resonant frequency of approximately 9.0 MHz.

[0037] When the second component 312 is a CMUT, the second component 312 can be formed using a silicon substrate, in which a cavity can be formed. A thin layer can be suspended above the cavity and used as a film, wherein a metallization layer can be used as an electrode. When an AC signal is applied across the electrode, ultrasonic waves can be generated in the field of view of the target location. The ultrasonic waves can be used to determine the position of the target within the field of view.

[0038] Now refer to Figure 4This paper illustrates a method 400 for providing in-process sampling location indication within real-time ultrasound video. First, during operation 402, a target site with a target nodule is imaged using an ultrasound sensor. While the target site and target nodule are imaged, the boundary shape of the target nodule at the target site can be identified during operation 404. The target nodule, which may be located at the target site, may include cancerous tissue. The target site may be a lymph node, where a sample of the target nodule can be removed and examined. Imaging can be performed during operation 402 to assist in sample removal, such as during ultrasound-guided transbronchial needle aspiration biopsy (EBUS-TBNA) procedures.

[0039] During operation 404, various techniques such as edge detection can be used to identify the boundaries of the target nodule. Edge detection can include gradient calculation, thresholding, and edge thinning. Furthermore, impedance mismatch can be used to determine the boundaries of the target nodule, where impedance mismatch can indicate different tissue characteristics at the target nodule and thus define the boundaries of the target nodule. When determining the image boundaries of the target nodule, this can be equivalent to determining the boundary shape at the target site, where the image boundary can be a boundary shape.

[0040] As an example of method 400 and referred to herein as "example", during operation 402, the second component 312 can be used to create an image 500 of the target nodule 502 at the target site 504. The second component 312 can capture ultrasound data associated with the target site 504 and the target nodule 502 and provide this data to the ultrasound image processing system 106. During operation 402, the ultrasound image processing system 106 can process the data to generate image 500 as a real-time video feed for display at output unit 110. The ultrasound image processing system 106 can also process the ultrasound data captured by the second component 312 to identify the boundary shape 506 of the target nodule 502 using edge detection; the boundary shape can also be provided along with the real-time video feed during operation 404, as shown in reference. Figure 5 As shown. Here, the boundary shape 506 can be at the target location 504.

[0041] Returning attention to Figure 4Following operation 404, method 400 performs operation 406, in which a first position of the resection element relative to the boundary shape of the target nodule is determined. During the EBUS-TBNA operation, after identifying the target site and the target nodule, the resection element can be inserted into the target nodule. The resection element can be used to remove a first sample from the target nodule. In some cases, multiple samples can be removed from the target nodule to detect different regions of the target nodule. To enable the removal of samples from different regions of the target nodule, the different positions where the resection element was located during sample removal can be presented to the operator. This prevents the possibility of overlap between different resections. To enable the presentation of different positions, during operation 408, a first indicator corresponding to the first position of the resection element can be superimposed on the imaged target nodule. The first indicator can be any type of indicator, such as a red line, a shape simulating the end of the resection element, a dashed line, a dot sequence, etc. When the first indicator is superimposed on the imaged target site, method 400 can display the imaged target site with the first indicator superimposed on the target site during operation 410.

[0042] Let's return our attention to the examples and Figure 5 During operation 406, a first position of the resection element 306 can be determined as it is advanced into the target nodule 502. The resection element 306 can be advanced by moving it upward along the inclined portion 310, through the lumen port 304, and into the target site 504. Once the operator has moved the resection element 306 to the area of ​​the target nodule 502 that the operator deems to have a sample that should be removed and subsequently removes the sample, ultrasound data can be captured via the second member 312. In this example, the captured ultrasound data can be transmitted to the ultrasound image processing system 106. The ultrasound data may include the echo characteristics of the resection element 306.

[0043] Using the echo characteristics of the resection element 306, the ultrasound image processing system 106 can determine that the resection element 306 has a first position 508 at the target nodule 502 during sample removal, such as... Figure 5 As shown. Furthermore, during operations 408 and 410, the ultrasound image processing system 106 can superimpose a first indicator 600 onto the target nodule 502 of image 500 based on the echo characteristics of the resection element 306, as shown in reference. Figure 6As shown. In this example, the ultrasound image processing system 106 can display an image 500 with a first indicator 600 at the output unit 110 in a real-time video feed. The image 500, together with the first indicator 600, can be displayed in real-time at the output unit 110 in a real-time video feed to the operator. The first indicator 600 may correspond to a first position 508 and may indicate that the resection element 306 is already at position 508. Therefore, when the operator manipulates the resection element 306 to remove additional samples from the target nodule 502, the operator can know that the resection element 306 was previously at the first position 508 and that the sample has been resected from the first position 508.

[0044] Returning attention to Figure 4 Following operation 404, method 400 performs operation 412, wherein a second position of the resection element relative to the boundary shape of the target nodule is identified in a manner similar to that discussed above with reference to operation 404. During operation 412, the image displayed during operation 410 is presented such that a first indicator is displayed on the image being viewed during the resection of a second sample associated with the second position. During the EBUS-TBNA operation, after the first sample is removed from the target nodule, the resection element can be moved to the second position. At the second position, the second sample can be resected from the target nodule. In the example, because the operator can see the position where the first sample is resected via the first indicator, the operator can avoid removing the second sample from the same position. In particular, the first indicator can remain stationary on the image displayed to the operator in real time. Therefore, the first indicator continues to be displayed to the operator as the operator moves to the second position of the target nodule. The second position can be monitored in a manner similar to that described above with reference to the first position as the operator resectes the sample from the target nodule.

[0045] Once the second location is detected, during operation 414, the method can overlay a second indicator corresponding to the second location onto the imaged target nodule. The second indicator can be any type of marker similar to the first indicator described above. Furthermore, when the second indicator is overlaid on the imaged target site, method 400 can display the imaged target site during operation 416, showing the first indicator together with the second indicator overlaid on the target site.

[0046] Return to the example and Figure 7The operator has moved the resection element 306 to the second position 700. The operator can view the image 500 at the output unit 110 while moving the resection element 306 to the second position 700. The second position 700 of the resection element 306 can be identified during operation 412. When the operator moves the resection element 306 to the second position 700, the first indicator 600 can remain on the image 500. Therefore, when different views of the target nodule 502 are obtained via ultrasound imaging, the first indicator 600 can be used in conjunction with the different views of the target nodule 502. Figure 1 The movement is such that when the target nodule 502 is viewed in real time during real-time video feed, the first indicator 600 remains stationary relative to the target nodule 502.

[0047] When the sample is removed from the target nodule 502 at the second position 700, the ultrasound image processing system 106 can use the echo characteristics of the resection element 306 as described above to determine that the resection element 306 has a second position 700 at the target nodule 502. Furthermore, during operation 414, the ultrasound image processing system 106 can use the echo characteristics of the resection element 306 to overlay a second indicator 800 onto the target nodule 502, as discussed in operation 408 of the reference example above and as... Figure 8 As shown. The ultrasound image processing system 106 can also display the target area being imaged, wherein during operation 416, the first indicator 600 together with the second indicator 800 are superimposed on the target area.

[0048] The second indicator 800 may correspond to the second position 700 and may indicate that the excision element 306 was previously located at the second position 700. Therefore, when the operator removes another sample from the target nodule 502, the operator can know via the first indicator 600 and the second indicator 800 that the excision element 306 was previously located at the first position 508 and the second position 700, and that a sample has been excised from the first position 508 and the second position 700. Furthermore, the first indicator 600 and the second indicator 800 may move along with the target nodule 502 in the real-time video feed. Therefore, if the operator moves the excision element to the third position, the first indicator 600 and the second indicator 800 move in real-time with the third image of the target nodule 502 in the real-time video feed. Here, during the excision of the third sample, the image may simultaneously display the first indicator 600 and the second indicator 800. By showing the positions where the resection element 306 has been moved, the operator is able to move the resection element 306 to different regions of the target nodule 502 in a manner that allows for proper resection within the target nodule 502. Although the indicators are discussed with reference to only two positions at the target nodule, the example envisions real-time monitoring of any number of positions and any number of indicators, and overlaying them onto an image of the target nodule in a real-time video feed.

[0049] In another example, control unit 120 may be provided with the boundary shape 506 of target nodule 502 and may determine the distribution of samples that should be removed from target nodule 502. Control unit 120 may include data relating to optimal spacing parameters over the entire target nodule 502. Using the optimal spacing parameters, control unit 120 may output to the operator the number of samples that should be obtained from target nodule 502 and where in target nodule 502 the samples should be obtained.

[0050] Biopsy distribution can also be detected based on the shape, size, and density of the target nodule 502. B-mode ultrasound imaging can be used to provide ultrasound image display. B-mode ultrasound imaging can be used to render images of the target nodule and its boundary shape. Edge filtering can be used in B-mode ultrasound imaging to render the boundary shape.

[0051] B-mode ultrasound imaging can consist of points representing ultrasound echoes of vascular structures within the target nodule. The vascular structures can be superimposed on the target image (such as target image 500). Doppler modes can also be used to determine the level of vascularization. The vascular image determined using B-mode ultrasound imaging and / or the determined level of vascularization determined using Doppler modes can be provided to the control unit 120, which can recommend sampling depth and / or distance from the boundary shape 506.

[0052] In various examples, Doppler and B-mode ultrasound imaging can be combined. To further illustrate, Doppler mode can be used to create a vascularization map, after which the ultrasound can be switched to B-mode ultrasound imaging, where the vascularization map is superimposed on the output of the B-mode ultrasound imaging. The location and boundary shape of the resection element within the target nodule can be monitored. If B-mode ultrasound imaging determines that the resection element is approaching a hotspot on the vascularization map, a warning can be issued to the operator manipulating the resection element. The warning can be based on the proximity of the resection element to the edge of the boundary shape. To further illustrate, a warning can be issued if the resection element crosses a distance threshold, i.e., the resection element enters within one millimeter of the boundary shape.

[0053] In the above example, the first indicator 600 of image 500 includes a cut portion 307 and a cut-off element lumen portion 802. Furthermore, the second indicator 800 of image 500 includes a cut portion 307 and a cut-off element lumen portion 804. In an alternative example, in... Figure 9 In the image 500, the first indicator 900 may include a first indicator 900 that does not have the cut element lumen portion 802, but only has a cut portion 307. The first indicator 900 may correspond to a first position similar to that described above. Furthermore, the first indicator 900 and the first position defined by the first indicator 900 may be displayed as described herein.

[0054] In an alternative example, image 500 may further include a second indicator 902, which does not have the ablation element lumen portion 804, but only has the cutting portion 307. The second indicator 902 may correspond to a second position similar to that described above. Furthermore, the second indicator 902 and the second position defined by the second indicator 902 may be displayed as described herein. In an alternative example, the first indicator 900 and the second indicator 902 may occupy less area at the target nodule 502 and the target site 504 compared to the first indicator 600 and the second indicator 800.

[0055] The target nodule 502 can also be divided into segments 1000 to 1006, each segment potentially comprising a portion of the target nodule 502. Segments 1000 to 1006 can correspond to portions of the target nodule 502 with varying densities. Histospectral techniques can be employed to segment the target nodule 502, where portions of the target nodule 502 can be characterized based on how they interact with light. Specifically, light scattering, light absorption, and / or luminescence can correspond to density levels within the target nodule 502. Different density levels within the target nodule 502 can provide an indication of whether a sample should be excised.

[0056] A denser tissue sample can provide an indication of potentially cancerous tissue that should be removed for further testing. Using tissue spectroscopy, the target nodule 502 can be segmented to provide an indication of which areas should have a larger sample removed. Figure 10 In this study, target nodule segments 1004 and 1006 may have higher tissue density compared to the tissue at target nodule segments 1000 and 1002. Using this knowledge, the operator can remove a larger tissue sample from target nodule segments 1004 and 1006 compared to target nodule segments 1000 and 1002.

[0057] In addition to using targeted spectral techniques to create target nodule segments 1000 to 1006, ultrasound techniques can also be used. The amplitude and frequency of the reflected signal can be examined to segment the target nodule 502 into target nodule segments 1000 to 1006.

[0058] Figure 11 This is a block diagram 1100 illustrating a software architecture 1102 that can be installed on any one or more of the devices described above. Figure 12 This is merely a non-limiting example of a software architecture, and it will be understood that many other architectures can be implemented to facilitate the functionality described herein. Software architecture 1202 can be derived from, for example... Figure 12The hardware implementation of computer system 1200 includes processor 1202, memory 1204 and memory 1206, and I / O units 1210 to I / O units 1214. In this example, software architecture 1102 can be conceptualized as a stack of layers, where each layer provides a specific function. For example, software architecture 1102 includes layers such as operating system 1102, libraries 1106, framework 1108, and application 1110. Operationally, according to some implementations, application 1110 activates application programming interface (API) call 1112 through the software stack and receives message 1114 in response to API call 1112.

[0059] In various implementations, the operating system 1102 manages hardware resources and provides public services. The operating system 1102 includes, for example, a kernel 1120, services 1122, and drivers 1124. In some implementations, the kernel 1120 acts as an abstraction layer between the hardware and other software layers. For example, the kernel 1120 provides functions such as memory management, processor management (e.g., scheduling), component management, networking, and security settings. Services 1122 can provide other public services to other software layers. Drivers 1124 can be responsible for controlling or interfacing with the underlying hardware. For example, drivers 1124 may include display drivers, camera drivers, Bluetooth® drivers, flash memory drivers, serial communication drivers (e.g., Universal Serial Bus (USB) drivers), Wi-Fi® drivers, audio drivers, power management drivers, etc.

[0060] In some implementations, library 1106 provides low-level public infrastructure that can be utilized by application 1110. Library 1106 may include system library 1130 (e.g., the C standard library), which provides functions such as memory allocation, string manipulation, and mathematical functions. Additionally, library 1106 may include API library 1132, such as: media library (e.g., a library supporting the rendering and manipulation of various media formats, such as Moving Picture Experts Group-4 (MPEG4), Advanced Video Coding (H.264 or AVC), Moving Picture Experts Group Layer-3 (MP3), Advanced Audio Coding (AAC), Adaptive Multi-Rate (AMR) audio codec, Joint Picture Experts Group (JPEG or JPG), or Portable Web Graphics (PNG)), graphics library (e.g., an OpenGL framework for rendering in two-dimensional (2D) and three-dimensional (3D) environments on a display), database library (e.g., SQLite providing various relational database functions), web library (e.g., WebKit providing web browsing functionality), etc. Library 1106 may also include various other libraries 1134 to provide many other APIs to application 1110.

[0061] Depending on the implementation, framework 1108 provides advanced public infrastructure that can be utilized by application 1110. For example, framework 1108 provides various graphical user interface (GUI) functions, advanced resource management, advanced location services, etc. Framework 1108 can provide a wide range of other APIs that can be utilized by application 1110, some of which may be specific to a particular operating system or platform.

[0062] In the example, application 1110 includes a home application 1150, a contacts application 1152, a browser application 1156, a book reader application 1156, a location application 1158, a media application 1160, a messaging application 1162, a game application 1164, and a variety of other applications such as a third-party application 1166. According to some examples, application 1110 is a program that performs functions defined in a program. One or more applications 1110 can be created using various programming languages, such as object-oriented programming languages ​​(e.g., Objective-C, Java, or C++) or procedural programming languages ​​(e.g., C or assembly language). In a particular example, third-party application 1166 (e.g., an entity other than a platform-specific vendor using Android) TM Or iOS TM Applications developed using a Software Development Kit (SDK) can run on mobile operating systems such as iOS. TM Android TM Mobile software running on Windows® Phone or other mobile operating systems. In this example, a third-party application 1166 may invoke API calls 1112 provided by the mobile operating system (e.g., operating system 802) to facilitate the functionality described herein.

[0063] Some examples are described herein as comprising logic or multiple components, modules, or mechanisms. Modules can constitute software modules (e.g., (1) code implemented on a non-transitory machine-readable medium or (2) for transmitting signals) or hardware-implemented modules. Hardware-implemented modules are tangible units capable of performing certain operations and can be configured or arranged in a certain way. In the examples, one or more computer systems (e.g., standalone, client, or server computer systems) or one or more processors can be hardware-implemented modules configured by software (e.g., an application or application portion) to operate to perform certain operations as described herein.

[0064] In various examples, hardware-implemented modules can be implemented mechanically or electronically. For example, a hardware-implemented module may include a dedicated circuit system or logic permanently configured (e.g., as a dedicated processor, such as a field-programmable gate array (FPGA) or application-specific integrated circuit (ASIC)) to perform certain operations. A hardware-implemented module may also include programmable logic or circuit systems temporarily configured by software to perform certain operations (e.g., as included within a general-purpose processor or other programmable processor). It will be understood that cost and time considerations can drive decisions regarding whether to mechanically implement a hardware-implemented module as a dedicated and permanently configured circuit system or as a temporarily configured circuit system (e.g., configured by software).

[0065] Therefore, the term "hardware-implemented module" should be understood to encompass tangible entities, i.e., entities that are physically constructed, permanently configured (e.g., hardwired), or temporarily or provisionally configured (e.g., programmed) to operate in a particular manner and / or perform the specific operations described herein. Consider examples of hardware-implemented modules being provisionally configured (e.g., programmed), where each of the hardware-implemented modules does not need to be configured or instantiated at any given time. For example, in the case where the hardware-implemented modules include a general-purpose processor configured using software, the general-purpose processor can be configured as different hardware-implemented modules at different times. Thus, software can configure the processor to constitute a specific hardware-implemented module at one time and different hardware-implemented modules at different times.

[0066] Hardware-implemented modules can provide information to and receive information from other hardware-implemented modules. Therefore, the described hardware-implemented modules can be considered communicatively coupled. In the presence of multiple such hardware-implemented modules, communication can be achieved through signal transmission (e.g., via suitable circuitry and buses) connecting the modules. In an example where multiple hardware-implemented modules are configured or instantiated at different times, communication between such modules can be achieved, for example, by storing information in a memory structure accessible to the multiple modules and retrieving information from that memory structure. For example, one module can perform an operation and store the output of that operation in a memory device communicatively coupled to it. Another module can then access the memory device at a subsequent time to retrieve and process the stored output. Hardware-implemented modules can also initiate communication with input or output devices and operate on resources (e.g., collections of information).

[0067] The various operations of the example methods described herein can be performed, at least in part, by one or more processors configured, either temporarily (e.g., by software) or permanently, to perform the relevant operations. Whether temporarily or permanently configured, such processors can constitute modules of processor implementations that perform operations to execute one or more operations or functions. In some examples, modules mentioned herein may include processor implementation modules.

[0068] Similarly, the methods described herein can be implemented at least partially by processors. For example, at least some of the operations of the method can be executed by one or more processors or modules implemented by processors. The execution of some operations can be distributed across one or more processors, not only residing on a single machine but also deployed across multiple machines. In some examples, one or more processors may reside in a single location (e.g., a home environment, an office environment, or as a server cluster), while in other examples, processors may be distributed across multiple locations.

[0069] One or more processors may also operate to support the execution of related operations in a “cloud computing” environment or as “Software as a Service” (SaaS). For example, at least some of the operations may be performed by a set of computers (as an example of a machine including processors) that are accessible via a network (e.g., the Internet) and via one or more suitable interfaces (e.g., application programming interfaces (APIs)).

[0070] Examples can be implemented as digital electronic circuit systems or as computer hardware, firmware, software, or a combination thereof. Examples can be implemented using computer program products, such as computer programs tangibly embodied in an information carrier, such as computer programs in machine-readable media, for performing or controlling the operation of a data processing apparatus (e.g., a programmable processor, a computer, or a plurality of computers).

[0071] Computer programs can be written in any programming language, including compiled or interpreted languages, and can be deployed in any form, including as standalone programs or as modules, subroutines, or other units suitable for use in a computing environment. Computer programs can be deployed to execute on a single computer or on multiple computers located at a single point or distributed across multiple points and interconnected via a communication network.

[0072] Computing systems can include clients and servers. Clients and servers are typically geographically separated and usually interact via communication networks. The client-server relationship arises from computer programs running on their respective computers and having a client-server relationship with each other. In the example of deploying a programmable computing system, it will be understood that both hardware architecture and software architecture need to be considered. Specifically, it will be understood that the choice of implementing a particular function in permanently configured hardware (e.g., ASIC), temporarily configured hardware (e.g., a combination of software and a programmable processor), or a combination of permanently and temporarily configured hardware can be a design choice. The hardware architectures (e.g., machines) and software architectures that can be deployed in various examples are illustrated below.

[0073] Figure 12 This is a block diagram of a machine within which instructions can be executed to cause the machine to perform any or more of the methods discussed herein. In one example, the machine can be any of the devices described above. In alternative examples, the machine operates as a standalone device or can be connected (e.g., networked) to other machines. In a networked deployment, the machine can operate as a server machine or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine can be a personal computer (PC), tablet PC, set-top box (STB), personal digital assistant (PDA), cellular phone, network device, network router, switch, or bridge, or any machine capable of executing (sequentially or otherwise) instructions specifying actions to be taken by the machine. Furthermore, although only a single machine is shown, the term "machine" should also be considered to include any collection of machines that individually or jointly execute a set (or more) of instructions to perform any or more of the methods discussed herein.

[0074] Example computer system 1200 includes processors 1202 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both), main memory 1204, and static memory 1206 that communicate with each other via bus 1208. Computer system 900 may also include a video display unit 1210 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). Computer system 900 also includes an alphanumeric input device 1212 (e.g., a keyboard), a user interface (UI) navigation device (cursor control device) 1314 (e.g., a mouse), a hard disk drive unit 1216, a signal generation device 1218 (e.g., a speaker), and a network interface device 1220.

[0075] The drive unit 1216 includes a machine-readable medium 1222 on which one or more sets of instructions and data structures (e.g., software) 1224 are stored, which embody or be utilized by any or more of the methods or functions described herein. The instructions 1224 may also reside wholly or at least partially in main memory 1204 and / or in processor 1202 during execution by computer system 1200, which also constitute the machine-readable medium. The instructions 1224 may also reside in static memory 1206.

[0076] Although machine-readable medium 1222 is shown as a single medium in the example, the term "machine-readable medium" can include a single medium or multiple media (e.g., a centralized or distributed database, and / or associated caches and servers) storing one or more instructions or data instructions 1224. The term "machine-readable medium" should also be considered to include: any tangible medium capable of storing, encoding, or carrying instructions 1224, or any tangible medium capable of storing, encoding, or carrying data structures utilized by or associated with such instructions 1224, instructions 1224 executed by a machine and causing the machine to perform any one or more methods of the present invention. Therefore, the term "machine-readable medium" should be considered to include, but is not limited to, solid-state memory, as well as optical and magnetic media. Specific examples of machine-readable media include non-volatile memory, which by way of example includes: semiconductor memory devices, such as erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), and flash memory devices; disks, such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.

[0077] Instructions 1224 can also be sent or received via network 112 using a transmission medium. Instructions 1224 can be sent using network interface device 1220 and any of many well-known transmission protocols (e.g., HTTP). Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet, mobile phone networks, simple old-fashioned telephone (POTS) networks, and wireless data networks (e.g., Wi-Fi and Wi-Max networks). The term “transmission medium” should be considered to include any intangible medium capable of storing, encoding, or carrying instructions 1224 executed by a machine and comprising digital or analog communication signals, or other intangible media facilitating communication by such software.

[0078] In various exemplary examples, one or more portions of a network may be an ad hoc network, intranet, extranet, VPN, LAN, WLAN, WAN, WWAN, MAN, the Internet, a portion of the Internet, a portion of the PSTN, a Simple Old-Style Telephone Service (POTS) network, a cellular telephone network, a wireless network, a Wi-Fi® network, another type of network, or a combination of two or more such networks. For example, a network or a portion of a network may include a wireless or cellular network, and the coupling may be a Code Division Multiple Access (CDMA) connection, a Global System for Mobile Communications (GSM) connection, or another type of cellular or wireless coupling. In this example, coupling can implement any of various types of data transmission technologies, such as Single Carrier Radio Transmission (1xRTT), Evolved Data Optimized (EVDO), General Packet Radio Service (GPRS), GSM Evolution Enhanced Data Rate (EDGE), the 3rd Generation Partnership Project (3GPP) including 3G, fourth-generation wireless (4G) networks, Universal Mobile Telecommunications System (UMTS), High-Speed ​​Packet Access (HSPA), Global Microwave Access Interoperability (WiMAX), Long Term Evolution (LTE) standards, other standards defined by various standards setting organizations, other telemetry protocols, or other data transmission technologies. Although examples have been described with reference to specific examples, it will be apparent that various modifications and changes can be made to these examples without departing from the broader spirit and scope of the invention. Therefore, the specification and drawings should be considered illustrative rather than restrictive. The accompanying drawings, which form part of this document, illustrate specific examples of how the subject matter can be practiced in an illustrative and non-limiting manner. The examples shown have been described in sufficient detail to enable those skilled in the art to practice the teachings disclosed herein. Other examples can be utilized and derived therefrom, allowing for structural and logical substitutions and changes without departing from the scope of this disclosure. Therefore, this specific embodiment is not to be construed as limiting, and the scope of the various examples is defined only by the appended claims together with the full scope of their equivalents.

[0079] For convenience only, such examples of the subject matter of this invention may be referred to individually and / or generally by the term "invention" herein, and if more than one invention or inventive concept is disclosed in fact, it is not intended to voluntarily limit the scope of this application to any single invention or inventive concept. Therefore, while specific examples have been shown and described herein, it should be understood that any arrangement intended to achieve the same purpose may be substituted for the specific examples shown. This disclosure is intended to cover any and all adaptations or variations of the various examples. Combinations of the above examples and other examples not specifically described herein will be apparent to those skilled in the art upon review of the foregoing description.

[0080] Providing an abstract of this disclosure enables the reader to quickly determine the nature of the technical disclosure. The abstract is submitted based on the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Furthermore, as can be seen in the foregoing detailed description, various features are combined in a single example for the purpose of simplification. This approach of the disclosure should not be construed as reflecting an intention that the claimed example requires more features than are expressly listed in each claim. Rather, as reflected in the appended claims, the subject matter of the invention lies in fewer than all features in a single disclosed example. Therefore, the appended claims are thus incorporated into the detailed description, wherein each claim is presented independently as a separate example.

[0081] As used herein, the terms “machine storage medium,” “device storage medium,” and “computer storage medium” refer to the same thing and can be used interchangeably. These terms refer to one or more storage devices and / or media (e.g., centralized or distributed databases, and / or associated caches and servers) that store executable instructions 716 and / or data. Therefore, the terms should be considered to include, but are not limited to, solid-state memory, as well as optical and magnetic media, including memory internal or external to the processor. Specific examples of machine storage media, computer storage media, and / or device storage media include: non-volatile memory, including, for example, semiconductor memory devices such as erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), FPGAs, and flash memory devices; disks, such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The terms “machine storage medium,” “computer storage medium,” and “device storage medium” specifically exclude carrier waves, modulated data signals, and other such media, at least some of which are covered by the term “signal medium” discussed below.

[0082] Instructions can be transmitted or received over a network using a transmission medium via a network interface device (e.g., a network interface component included in a communication component) and utilizing any of the many known transmission protocols (e.g., Hypertext Transfer Protocol (HTTP)). Similarly, instructions can be sent or received using a transmission medium via coupling with device 770 (e.g., peer-to-peer coupling). The terms "transmission medium" and "signal medium" refer to the same thing and may be used interchangeably in this disclosure. The terms "transmission medium" and "signal medium" should be considered to include any intangible medium capable of storing, encoding, or carrying instructions for machine execution, and include digital or analog communication signals or other intangible media used to facilitate communication of such software. Therefore, the terms "transmission medium" and "signal medium" should be considered to include any form of modulated data signal, carrier wave, etc. The term "modulated data signal" means a signal whose characteristics are set or altered in a manner that encodes information in the signal.

[0083] The terms “machine-readable medium,” “computer-readable medium,” “device-readable medium,” and “machine storage medium” refer to the same thing and are used interchangeably in this disclosure. These terms are limited to include both machine storage media and transmission media. Therefore, these terms include both storage devices / media and carrier / modulated data signals. For example, the embodiments described herein may be implemented using non-transitory media (e.g., non-transitory computer-readable media).

[0084] Additional examples

[0085] Example 1 is a system for providing in-process sampling position indication within real-time ultrasound video. The system includes: a processor; and a memory including instructions that, when executed by the processor, cause the system to perform operations including: imaging a target region; identifying a boundary shape at the target region; determining a first position of a resection element relative to the target region when a sample is removed from the target region by a resection element; displaying an image of the target region, wherein a first indicator corresponding to the first position is superimposed on the displayed image of the target region; determining a second position of a resection element relative to the target region during the display of the image having the first indicator, when a second sample is removed from the target region by a resection element; and updating the displayed image of the target region to include a second indicator superimposed on the image of the target region, the second indicator corresponding to the second position, wherein the second indicator is superimposed on the displayed image of the target region such that the displayed image of the target region includes both the first and second indicators.

[0086] In Example 2, the subject matter according to Example 1 includes, wherein the instructions further cause the system to perform operations including: determining multiple sample characteristics at a target location; segmenting the target location based on the multiple sample characteristics; and displaying an image of the segmented target location, wherein the segmented target location includes a first indicator and a second indicator.

[0087] In Example 3, the subject matter described in Examples 1 to 2 includes, wherein the first indicator and the second indicator are one of a sequence of points or a line.

[0088] In Example 4, the subject matter according to Examples 1 to 3 includes, wherein the instructions further cause the system to perform operations including: determining multiple sample characteristics at a target location; segmenting the target location based on the multiple sample characteristics; and displaying an image of the segmented target location, wherein the segmented target location fragments include a first indicator corresponding to a first position.

[0089] In Example 5, the subject matter according to Examples 1 to 4 includes, wherein the instructions further cause the system to perform an operation including: using one of edge detection or impedance mismatch to identify the boundary shape at the target location.

[0090] In Example 6, the subject matter according to Examples 1 to 5 includes, wherein the cutting element is a needle with a tip, and a first position corresponds to the tip position of the needle tip, and an indicator corresponds to the tip position of the needle tip.

[0091] In Example 7, the subject matter according to Examples 1 to 6 includes, wherein the instructions further cause the system to perform operations including: displaying a first indicator and a second indicator during the excision of a third sample.

[0092] Example 8 is a non-transitory machine storage medium embodying instructions for providing in-process sampling position indication within real-time ultrasound video. These instructions are executable by a machine processor to perform operations including: imaging a target region; identifying a boundary shape at the target region; determining a first position of a resection element relative to the target region when a sample is removed from the target region by a resection element; displaying an image of the target region, wherein a first indicator corresponding to the first position is superimposed on the displayed image of the target region; determining a second position of a resection element relative to the target region during the display of the image with the first indicator, when a second sample is removed from the target region by a resection element; and updating the displayed image of the target region to include a second indicator superimposed on the image of the target region, the second indicator corresponding to the second position, wherein the second indicator is superimposed on the displayed image of the target region such that the displayed image of the target region includes both the first and second indicators.

[0093] In Example 9, the subject matter according to Example 8 includes the operation further comprising: determining multiple sample characteristics at the target location; segmenting the target location based on the multiple sample characteristics; and displaying an image of the segmented target location, wherein the segmented target location includes a first indicator and a second indicator.

[0094] In Example 10, the subject matter according to Examples 8 to 9 includes the operation further comprising: determining multiple sample characteristics at the target location; segmenting the target location based on the multiple sample characteristics; and displaying an image of the segmented target location, wherein the segment of the target location includes a first indicator corresponding to a first position.

[0095] In Example 11, the subject matter according to Examples 8 to 10 includes the operation further comprising: using either edge detection or impedance mismatch to identify the boundary shape at the target location.

[0096] In Example 12, the subject matter according to Examples 8 to 11 includes a cutting element that is a needle with a tip, and a first position that corresponds to the tip position of the needle tip, and an indicator that corresponds to the tip position of the needle tip.

[0097] In Example 13, the subject matter according to Examples 8 to 12 includes the operation further comprising: displaying a first indicator and a second indicator during the excision of a third sample.

[0098] Example 14 is a method for providing in-process sampling position indication within a real-time ultrasound video, the method comprising: imaging a target region; identifying a boundary shape at the target region; determining a first position of a resection element relative to the target region as a sample is removed from the target region by a resection element; displaying an image of the target region, wherein a first indicator corresponding to the first position is superimposed on the displayed image of the target region; determining a second position of a resection element relative to the target region as a second sample is removed from the target region during the display of the image having the first indicator; and updating the displayed image of the target region to include a second indicator superimposed on the image of the target region, the second indicator corresponding to the second position, wherein the second indicator is superimposed on the displayed image of the target region such that the displayed image of the target region includes both the first and second indicators.

[0099] In Example 15, the subject matter according to Example 14 includes the method further comprising: determining multiple sample characteristics at a target location; segmenting the target location based on the multiple sample characteristics; and displaying an image of the segmented target location, wherein the segmented target location includes a first indicator and a second indicator.

[0100] In Example 16, the subject matter described according to Examples 14 and 15 includes, wherein the first indicator and the second indicator are one of a sequence of points or a line.

[0101] In Example 17, the subject matter according to Examples 14 to 16 includes the method comprising: determining a plurality of sample characteristics at a target location; segmenting the target location based on the plurality of sample characteristics; and displaying an image of the segmented target location, wherein the segment of the target location includes a first indicator corresponding to a first location.

[0102] In Example 18, the subject matter according to Examples 14 to 17 includes the method further comprising: using either edge detection or impedance mismatch to identify the boundary shape at the target location.

[0103] In Example 19, the subject matter according to Examples 14 to 18 includes, wherein the cutting element is a needle with a tip, and a first position corresponds to the tip position of the needle tip, and an indicator corresponds to the tip position of the needle tip.

[0104] In Example 20, the subject matter according to Examples 14 to 19 includes the method further comprising: displaying a first indicator and a second indicator during the excision of a third sample.

[0105] Example 21 is at least one machine-readable medium comprising instructions that, when executed by processing circuitry, cause the processing circuitry to perform operations for implementing any of the examples 1 to 20.

[0106] Example 22 is an apparatus that includes means for implementing any of Examples 1 to 20.

[0107] Example 23 is a system for implementing any of Examples 1 through 20.

[0108] Example 24 is a method for implementing any of Examples 1 through 20.

Claims

1. A system for providing in-process sampling position indication within real-time ultrasound video, the system comprising: processor; as well as The memory includes instructions that, when executed by the processor, cause the system to perform operations, the operations including: Image the target area; Identify the boundary shape at the target location; When the excision element removes the sample from the target site, a first position of the excision element relative to the target site is determined; An image of the target region is displayed, wherein a first indicator corresponding to the first position is superimposed on the displayed image of the target region; During the display of an image having the first indicator, when the excision element removes a second sample from the target region, a second position of the excision element relative to the target region is determined; and The displayed image of the target region is updated to include a second indicator superimposed on the image of the target region, the second indicator corresponding to the second position, wherein the second indicator is superimposed on the displayed image of the target region such that the displayed image of the target region includes the first indicator and the second indicator.

2. The system of claim 1, wherein, The instruction also causes the system to perform operations, including: Determine the characteristics of multiple samples at the target site; The target region is segmented based on the characteristics of the multiple samples; The image displays a segmented target region, wherein the segmented target region includes the first indicator and the second indicator.

3. The system according to claim 1, wherein, The first indicator and the second indicator are one of a dot sequence or a line.

4. The system according to claim 1, wherein, The instruction also causes the system to perform operations, including: Determine the characteristics of multiple samples at the target site; The target region is segmented based on the characteristics of the multiple samples; and The image displays a segmented target region, wherein the segmented target region includes a segment of the first indicator corresponding to the first position.

5. The system according to claim 1, wherein, The instructions also cause the system to perform operations including: using either edge detection or impedance mismatch to identify the boundary shape at the target location.

6. The system according to claim 1, wherein, The cutting element is a needle with a tip, and the first position corresponds to the tip position of the needle tip, and the indicator corresponds to the tip position of the needle tip.

7. The system according to claim 1, wherein, The instructions also cause the system to perform operations including displaying the first indicator and the second indicator during the excision of the third sample.

8. A non-transitory machine storage medium having instructions embodied thereon for providing in-process sampling position indication within real-time ultrasound video, the instructions being executable by a machine processor to perform operations including: Image the target area; Identify the boundary shape at the target location; When the excision element removes the sample from the target site, a first position of the excision element relative to the target site is determined; An image of the target region is displayed, wherein a first indicator corresponding to the first position is superimposed on the displayed image of the target region; During the display of an image having the first indicator, when the excision element removes a second sample from the target region, a second position of the excision element relative to the target region is determined; and The displayed image of the target region is updated to include a second indicator superimposed on the image of the target region, the second indicator corresponding to the second position, wherein the second indicator is superimposed on the displayed image of the target region such that the displayed image of the target region includes the first indicator and the second indicator.

9. The non-transitory machine-readable medium according to claim 8, wherein the operation further comprises: Determine the characteristics of multiple samples at the target site; The target region is segmented based on the characteristics of the multiple samples; The image displays a segmented target region, wherein the segmented target region includes the first indicator and the second indicator.

10. The non-transitory machine-readable medium according to claim 8, wherein the operation further comprises: Determine the characteristics of multiple samples at the target site; The target region is segmented based on the characteristics of the multiple samples; as well as The image displays a segmented target region, wherein the segmented target region includes a segment of the first indicator corresponding to the first position.

11. The non-transitory machine-readable medium according to claim 8, wherein the operation further comprises: The boundary shape at the target location is identified using either edge detection or impedance mismatch.

12. The non-transitory machine-readable medium according to claim 8, wherein, The cutting element is a needle with a tip, and the first position corresponds to the tip position of the needle tip, and the indicator corresponds to the tip position of the needle tip.

13. The non-transitory machine-readable medium according to claim 8, wherein the operation further comprises: The first indicator and the second indicator are displayed during the excision of the third sample.

14. A method for providing a sampling position indication during real-time ultrasound video, the method comprising: Image the target area; Identify the boundary shape at the target location; When the excision element removes the sample from the target site, a first position of the excision element relative to the target site is determined; An image of the target region is displayed, wherein a first indicator corresponding to the first position is superimposed on the displayed image of the target region; During the display of an image having the first indicator, when the excision element removes a second sample from the target region, a second position of the excision element relative to the target region is determined; and The displayed image of the target region is updated to include a second indicator superimposed on the image of the target region, the second indicator corresponding to the second position, wherein the second indicator is superimposed on the displayed image of the target region such that the displayed image of the target region includes the first indicator and the second indicator.

15. The method according to claim 14, further comprising: Determine the characteristics of multiple samples at the target site; The target region is segmented based on the characteristics of the multiple samples; The image displays a segmented target region, wherein the segmented target region includes the first indicator and the second indicator.

16. The method of claim 14, wherein, The first indicator and the second indicator are one of a dot sequence or a line.

17. The method of claim 14, wherein the method comprises: Determine the characteristics of multiple samples at the target site; The target region is segmented based on the characteristics of the multiple samples; as well as The image displays a segmented target region, wherein the segmented target region includes a segment of the first indicator corresponding to the first position.

18. The method according to claim 14, further comprising: The boundary shape at the target location is identified using either edge detection or impedance mismatch.

19. The method of claim 14, wherein, The cutting element is a needle with a tip, and the first position corresponds to the tip position of the needle tip, and the indicator corresponds to the tip position of the needle tip.

20. The method of claim 14, further comprising: The first indicator and the second indicator are displayed during the excision of the third sample.

Images