Ultrasound imaging system and method for obtaining ultrasound images therewith

Abstract

An ultrasound imaging system and a method for obtaining an ultrasound image therefrom are disclosed. The ultrasound imaging system can include an ultrasound probe including a transducer array configured to acquire an ultrasound image; and a console including a processor and a non-transitory computer-readable medium having stored thereon a plurality of logic modules configured to perform operations when executed by the processor, including: receiving the ultrasound image; detecting one or more targets within the ultrasound image; and generating a visualization from the ultrasound image to center the one or more detected targets within a display portion of the ultrasound image. Generating the visualization can include cropping the ultrasound image to center the one or more detected targets within the display portion of the ultrasound image. Generating the visualization can include increasing a magnification of a cropped portion of the ultrasound image to center the one or more detected targets within the display portion of the ultrasound image.

Description

[0001] priority

[0002] This application claims priority to U.S. Provisional Application No. 63 / 119,829, filed December 1, 2020, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of medical devices, and more specifically to ultrasound imaging systems and methods for obtaining ultrasound images therethrough. Background Technology

[0004] Various existing ultrasound systems are available, including wired or wireless ultrasound detectors connected to a visual monitor. Clinicians can use these systems to hold and manipulate the ultrasound detector to place a vascular access device (VAD) (e.g., a catheter) inside the patient. Ultrasound imaging is commonly used to guide a needle to a target, such as a vein in the patient. The needle can be monitored in real time before and after percutaneous insertion. In this way, clinicians are able to determine the distance and orientation of the needle to the target vein and ensure accurate insertion with minimal patient discomfort. However, unintentional and accidental movement of the ultrasound detector can occur during ultrasound imaging. This movement may prevent the clinician from seeing the target vein and the needle. Locating and locating the needle and target vein to be viewed on the visual monitor screen can be difficult and may waste valuable time. Because the plane of the needle, including the needle, is perpendicular (or nearly perpendicular) to the image plane of the ultrasound detector, the distance and orientation of the needle may be difficult to determine just before percutaneous insertion.

[0005] When the needle plane is parallel to the image plane, it is easier to monitor the needle's distance and orientation immediately after percutaneous insertion. When the ultrasound detector is inadvertently moved or displaced, clinicians may lose the vein and / or needle while adjusting the image plane before and after percutaneous insertion, potentially resulting in a loss of valuable time. Existing ultrasound systems do not offer convenient needle guidance capabilities that take into account inadvertent movement or displacement of the ultrasound detector. Therefore, a method and system for ultrasound image target tracking is needed to address inadvertent movement or displacement of the ultrasound detector to facilitate effective needle guidance.

[0006] Therefore, this paper discloses a method and system for analyzing ultrasound images to detect targets, including anatomical targets and medical devices, appearing within the ultrasound imaging area, and generating cropped images to maintain the position of the detected targets in the cropped images even when the ultrasound probe is displaced. Summary of the Invention

[0007] In short, this document discloses an ultrasound detector that includes image target tracking capabilities in some embodiments. The ultrasound detector system can provide a consistent ultrasound view throughout the ultrasound-guided process while compensating for unintentional movement of the ultrasound detector. Exemplary tracking features advantageously allow for accidental movement of the ultrasound detector during the process, without drastic shifts in the most important imaging data on the screen.

[0008] In some embodiments, an ultrasound imaging system is disclosed, comprising an ultrasound detector including a transducer array configured to acquire ultrasound images; and a console including a processor and a non-transitory computer-readable medium thereon storing a plurality of logic modules configured, when executed by the processor, to perform operations including: receiving ultrasound images; detecting one or more targets within the ultrasound images; and generating visualizations from the ultrasound images to center the one or more detected targets within a display portion of the ultrasound images. In some embodiments, generating visualizations includes cropping the ultrasound image to center the one or more detected targets within a display portion of the ultrasound image. In some embodiments, generating visualizations includes increasing the magnification of the cropped portion of the ultrasound image to center the one or more detected targets within a display portion of the ultrasound image.

[0009] In some embodiments, the ultrasound detector is operatively connected to a console via a wired or wireless connection. In some embodiments, the console includes a display, and wherein multiple logic modules, when executed by a processor, are configured to perform further operations including visualizing a cropped ultrasound image on the display. In some embodiments, detecting one or more targets includes distinguishing components within an ultrasound image based on variations in color saturation within the ultrasound image. In a particular embodiment, detecting one or more targets includes identifying each of the one or more targets as a blood vessel, bone, organ, or medical device. In other embodiments, identifying each of the one or more targets includes comparing features of each of the one or more targets to thresholds set for defining an organ, blood vessel, bone, or medical device.

[0010] In some embodiments, the features include one or more of the following: pulsations detected during analysis of ultrasound images and previous ultrasound images; the size of each of the one or more targets; and the color saturation of each of the one or more targets. In some embodiments, the result of comparing the features with one or more thresholds is a confidence level for each of the one or more targets, which indicates the likelihood of identifying a particular target. In a particular embodiment, when executed by a processor, multiple logic modules are configured to perform further operations, including: detecting that at least a first target of the one or more targets is within a threshold distance from the edge of the ultrasound image.

[0011] In some embodiments, when executed by the processor, multiple logic modules are configured to perform further operations, including generating an alert indicating to the clinician that a first target is within a threshold of the edge of the ultrasound image. In some embodiments, the alert includes a text notification or an arrow indicating the direction of movement of the ultrasound probe. In other embodiments, one or more targets include blood vessels and needles. In yet another embodiment, one or more targets include the distal tip of a needle.

[0012] In some embodiments, a method for acquiring ultrasound images via an ultrasound imaging system is disclosed, wherein the ultrasound imaging system includes an ultrasound detector including a transducer array configured to acquire ultrasound images; and a console including a processor and a non-transitory computer-readable medium thereon storing a plurality of logic modules configured, when executed by the processor, to perform operations including: receiving ultrasound images; detecting one or more targets within the ultrasound images; and generating a visualization from the ultrasound images by cropping the ultrasound images around the one or more detected targets. In some embodiments, the method includes receiving ultrasound images, detecting one or more targets within the ultrasound images, and generating a visualization from the ultrasound images to center the one or more detected targets within a display portion of the ultrasound images. In some embodiments, generating the visualization includes cropping the ultrasound images to center the one or more detected targets within a display portion of the ultrasound images. In some embodiments, generating the visualization includes increasing the magnification of the cropped portion of the ultrasound images to center the one or more detected targets within a display portion of the ultrasound images.

[0013] In some embodiments, the ultrasound detector is operatively connected to a console via a wired or wireless connection. In some embodiments, the console includes a display, and wherein multiple logic modules, when executed by a processor, are configured to perform further operations, including presenting a visualization of a cropped ultrasound image on the display. In some embodiments, detecting one or more targets includes distinguishing components within an ultrasound image based on variations in color saturation within the ultrasound image. In a particular embodiment, detecting one or more targets includes identifying each of the one or more targets as a blood vessel, bone, organ, or medical device. In other embodiments, identifying each of the one or more targets includes comparing features of each of the one or more targets to thresholds set for defining an organ, blood vessel, bone, or medical device.

[0014] In some embodiments, the features include one or more of the following: pulsations detected during analysis of ultrasound images and previous ultrasound images; the size of each of the one or more targets; and the color saturation of each of the one or more targets. In some embodiments, the result of comparing the features with one or more thresholds is a confidence level for each of the one or more targets, which indicates the likelihood of identifying a particular target. In a particular embodiment, when executed by a processor, multiple logic modules are configured to perform further operations, including: detecting that at least a first target of the one or more targets is within a threshold distance from the edge of the ultrasound image.

[0015] In some embodiments, when executed by the processor, multiple logic modules are configured to perform further operations, including generating an alert indicating to the clinician that a first target is within a threshold of the edge of the ultrasound image. In some embodiments, the alert includes a text notification or an arrow indicating the direction of movement of the ultrasound probe. In other embodiments, one or more targets include blood vessels and needles. In yet another embodiment, one or more targets include the distal tip of a needle.

[0016] These and other features of the concepts provided herein will become more apparent to those skilled in the art in light of the accompanying drawings and the following description, which describe specific embodiments of these concepts in more detail. Attached Figure Description

[0017] A more specific description of the disclosure will be presented with reference to specific embodiments shown in the accompanying drawings. It should be understood that these drawings depict only typical embodiments of the invention and are therefore not intended to be limiting of its scope. Exemplary embodiments of the invention will be described and explained with additional specificity and detail using the drawings, wherein:

[0018] Figure 1 A block diagram of an ultrasound imaging system according to some embodiments is shown.

[0019] Figure 2A A detector connected to a console is shown according to some implementation schemes.

[0020] Figure 2B A detector connected to a console that displays a target vein in a cropped image is shown, according to some embodiments.

[0021] Figure 3A A visualization view of a cropped image of a target vein in a cropped image according to some embodiments is shown.

[0022] Figure 3B A visualization view of a cropped image of a target vein as the detector is displaced, according to some embodiments, is shown.

[0023] Figure 3C A visualization view of a cropped image of a target vein, including a movement warning when the detector is moved, is shown according to some embodiments.

[0024] Figure 3D This diagram shows a view of a warning message displayed on a console monitor when the detector shifts and no longer captures the target vein, according to some implementations.

[0025] Figure 4A A detector connected to a console displaying a target vein and a needle, according to some implementation schemes, is shown.

[0026] Figure 4B A detector connected to a console that displays a target vein and needle in a cropped image is shown according to some embodiments.

[0027] Figure 5A A visualization of a cropped image of a target vein and a view of the tracking of needle projection are shown according to some implementation schemes.

[0028] Figure 5B This illustrates a visualization of a cropped image of a target vein and a view of the tracking of needle projection as the detector shifts, according to some embodiments.

[0029] Figure 5C Visualizations of cropped images of target veins according to some embodiments are shown, as well as views illustrating the tracking of the tip projection, including a movement warning, when the detector shifts. Detailed Implementation

[0030] Before disclosing some specific embodiments in more detail, it should be understood that the specific embodiments disclosed herein do not limit the scope of the concepts provided herein. It should also be understood that the specific embodiments disclosed herein may have features that can be easily separated from the specific embodiments, and may optionally be combined with or substituted for features of any of the many other embodiments disclosed herein.

[0031] Regarding the terminology used herein, it should also be understood that these terms are for describing certain specific embodiments and do not limit the scope of the concepts presented herein. Ordinal numbers (e.g., first, second, third, etc.) are generally used to distinguish or identify different features or steps within a set of features or steps and do not provide for a sequence or numerical limitation. For example, the features or steps “first,” “second,” and “third” do not necessarily appear in that order, and a particular embodiment including such features or steps is not necessarily limited to these three features or steps. Labels such as “left,” “right,” “top,” “bottom,” “front,” and “back” are used for convenience and do not imply, for example, any particular fixed position, orientation, or direction. Rather, such labels are used to reflect, for example, relative position, orientation, or direction. The singular forms “a,” “an,” and “the” include the plural forms unless the context clearly specifies otherwise.

[0032] For clarity, it should be understood that the term "distal" refers to the direction relatively closer to the patient on whom the medical device will be used, while the term "proximal" refers to the direction relatively farther from the patient. Furthermore, the terms "comprising," "having," and "with," as used herein, including in the claims, should have the same meaning as the term "including."

[0033] Finally, in the following description, the terms “or” and “and / or” as used herein are to be interpreted as including or meaning any one or any combination thereof. For example, “A, B or C” or “A, B and / or C” means “any one of the following: A; B; C; A and B; A and C; B and C; A, B and C”. Exceptions to this definition occur only when the combination of elements, components, functions, steps, or actions is inherently mutually exclusive in some respects.

[0034] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art.

[0035] The embodiments disclosed herein relate to an ultrasound imaging system for performing ultrasound imaging while placing a needle into a target vein in a patient. In some embodiments, an ultrasound imaging system including image target tracking capability is provided. The ultrasound imaging system can provide a consistent ultrasound view throughout the ultrasound-guided procedure while compensating for unintentional movement of the ultrasound probe. Exemplary tracking features advantageously allow for accidental movement of the ultrasound probe during the procedure, without drastic shifts in the most important imaging data on the screen. According to exemplary embodiments, the ultrasound imaging system can be primarily used for the insertion of an access device (e.g., a needle). Image tracking provides precise placement of the needle into a target vein or another anatomical target, regardless of unintentional movement of the ultrasound probe.

[0036] refer to Figure 1A block diagram of an ultrasound imaging system 100 according to some embodiments is shown. A console 102 may house various components of the ultrasound imaging system 100. The console 102 may include a processor 116 and a memory 118, such as random access memory (RAM) or non-volatile memory (e.g., electrically erasable programmable read-only memory, EEPROM), for controlling the functions of the ultrasound imaging system 100 and for performing various logical operations or algorithms during operation of the ultrasound imaging system 100 according to executable instructions 120 stored in the memory 118 for execution by the processor 116. For example, the console 102 is configured to instantiate one or more processes via instructions 120 for adjusting the distance of an activated ultrasound transducer 148 to a predetermined target (e.g., a target vein) or region, activating the orientation of the activated ultrasound transducer 148 to the predetermined target or region, or activating both the distance and orientation of the ultrasound transducer 148 relative to the predetermined target or region, and processing electrical signals from an ultrasound detector 106 into an ultrasound image. The ultrasonic transducer 148 can be activated using ultrasonic imaging data, magnetic field data, fiber optic shape sensing data, or a combination thereof received by the console 102. The console 102 can activate certain ultrasonic transducers in the 2D array of ultrasonic transducers 148, or move transducers that are already activated in the linear array of ultrasonic transducers 148.

[0037] The digital controller / analog interface 122 may also be included in the console 102 and communicate with the processor 116 and other system components to manage the interface between the ultrasound detector 106 and other system components described herein. The ultrasound imaging system 100 further includes a port 124 for connection to additional components, such as optional components 126 including a printer, storage medium, keyboard, etc. Port 124 may be implemented as a Universal Serial Bus (USB) port, although other types of ports may be used for this connection or any other connection shown or described herein. The console 102 includes a power connection 128 to enable an operable connection to an external power supply 130. An internal power supply 132 (e.g., a battery) may also be used with or without the external power supply 130. Power management circuitry 134 is included in the digital controller / analog interface 122 of the console 102 to regulate power use and distribution. Optionally, a standalone optical interrogator 154 may be communicatively coupled to the console 102 via one of the ports 124. Alternatively, the console 102 may include an optical interrogator integrated into the console 502. This optical interrogator is configured to transmit an input optical signal to an accompanying fiber optic mandrel 156 for shape sensing in conjunction with the ultrasound imaging system 100. The fiber optic mandrel 156 can then be configured to be inserted into the cavity of a medical device such as a needle, and the input optical signal from the optical interrogator 154 can be transmitted along the length of the fiber optic mandrel 156 to multiple fiber Bragg grating (FBG) sensors. The optical interrogator 154 can also be configured to receive reflected light signals transmitted by the fiber optic mandrel 156 from the multiple FBG sensors, which can indicate the shape of the fiber optic mandrel 156.

[0038] The optical interrogator 154 can also be configured to convert reflected light signals into corresponding electrical signals for processing by the console 102 into distance and orientation information relative to a target, and for dynamically adjusting the distance, orientation, or both of the activated ultrasound transducer 148 relative to the target (e.g., a target vein) or medical device (e.g., a needle) as the target approaches. For example, the distance and orientation of the activated ultrasound transducer 148 can be adjusted relative to a vein that is the target. An image plane can be established by arranging the activated ultrasound transducer 148 at a specific angle to the target vein based on the orientation of the target vein (e.g., perpendicular or parallel to other configurations). In another embodiment, when a medical device (e.g., a needle) is near the ultrasound detector 106, an image plane can be established by activating the ultrasound transducer 148 perpendicular to the plane of the medical device including the needle 204. The distance and orientation information can also be used to display an image representation of the medical device on a display.

[0039] Display screen 104 can be integrated into (or connected to) console 102 to provide clinicians with a GUI and display information in the form of an ultrasound image of the target acquired by ultrasound detector 106. Furthermore, ultrasound imaging system 100 allows the distance and orientation of magnetized medical devices, such as needles, to be superimposed on the ultrasound image of the target in real time, enabling clinicians to accurately guide the magnetized medical device to a predetermined target (e.g., a vein). Alternatively, display screen 104 can be decoupled from and communicatively (e.g., wirelessly) coupled to console 102. Console button interface 136 allows clinicians to immediately recall desired modes to display screen 104 to assist in ultrasound-based medical procedures. In some embodiments, display screen 104 can be implemented as an LCD device. Ultrasound detector 106 may optionally include an internal measurement unit (IMU) 158, which may house an accelerometer 160, a gyroscope 162, and a magnetometer 164.

[0040] When preparing to insert a needle or other medical device into a target, the ultrasound detector 106 can be used in conjunction with ultrasound-based visualization of the target, such as a vein. This visualization provides real-time ultrasound guidance and helps reduce complications commonly associated with such insertion, including unintentional arterial puncture, hematoma, pneumothorax, etc. The ultrasound detector 106 can be configured to provide the console 102 with electrical signals corresponding to ultrasound imaging data, magnetic field data, shape sensing data, or a combination thereof for real-time ultrasound needle guidance.

[0041] In one implementation, target detection logic 166 may be executed by processor 116 to detect blood vessels and other anatomical targets in ultrasound images. Target detection logic 166 may include pulsation detection logic 168 and component recognition logic 170. Target detection logic 166 may use pulsation detection logic 168 and component recognition logic 170. Pulsation detection logic 168 may compare image sequences of blood vessels to detect pulses indicated by periodic changes in blood vessel size (e.g., expansion of blood vessel diameter). Target detection logic 166 may also detect bone by identifying tissues with high density based on color saturation in ultrasound images. Component recognition logic 170 may analyze the reflection of echoes in each ultrasound image. This may be implemented, for example, using threshold settings to identify organs, blood vessels, and bones. The various logics 166, 168, and 170 may be stored on a non-transitory computer-readable medium of console 102. Image cropping logic 172 can be executed on processor 116 to crop an image with a detected anatomical target (e.g., a target vein) such that the anatomical target is located at the center of the cropped image, which is also the center of the entire ultrasound imaging area, as will be discussed in more detail herein. Here, "cropping" can refer to reducing the amount of ultrasound image displayed. Furthermore, cropping can include increasing the magnification of the cropped portion of the ultrasound image. Target detection logic 166 and image cropping logic 172 can be collectively referred to as "console logic" or "logic of console 102"; however, the term console logic can also include... Figure 1 References to any other logical modules shown.

[0042] refer to Figure 2A According to some embodiments, a detector connected to a console is shown. In one embodiment, the ultrasound detector 200 is connected to the console 102 via a wired connection. In another embodiment, a wireless connection may be used. The ultrasound detector 200 includes a body that houses a console operatively connected to an ultrasound imaging device 220. The ultrasound detector 200 may be configured to assist a user (e.g., a clinician) in inserting an access device (e.g., a needle) into a target vein 210 of a patient. An ultrasound transducer located in the head 202 of the ultrasound detector is configured to capture 2-D ultrasound images 222 to be displayed on a screen 104 of the console 102. The head 202 may house a linear array (not shown) or a 2-D array of ultrasound transducers. The ultrasound transducer may be implemented as a piezoelectric transducer or a capacitive micromechanical ultrasound transducer (CMUT). When the ultrasound detector 200 is configured with a 2-D array of ultrasound transducers, a subset of the ultrasound transducers may be linearly activated as needed for ultrasound imaging based on the captured ultrasound imaging data.

[0043] The transducers can be configured to hold the target in the image plane or switch to a different image plane that includes the target (e.g., from a plane perpendicular to the medical device plane to a plane parallel to the medical device plane). If the ultrasound detector 200 is configured with a movable linear array of ultrasound transducers, the ultrasound transducers may have been activated for ultrasound imaging. For example, based on ultrasound imaging data, a subset or all of the available ultrasound transducers can be moved together on the movable linear array as needed for ultrasound imaging to hold the target in the image plane established by the activated ultrasound transducers or switch to a different image plane that includes the target.

[0044] The probe 202 can be placed close to the patient's skin near the needle insertion site, allowing the activated ultrasound transducer in the probe 202 to generate ultrasound signals and transmit them as a pulse sequence into the patient's body. The transmitter (not shown) can then receive the reflected ultrasound signals (i.e., reflections of ultrasound pulses generated from the patient's body). The reflected ultrasound signals can be converted into corresponding electrical signals for processing into an ultrasound image via the control panel of the detector 200. Therefore, clinicians can use... Figure 2A The ultrasound imaging system 100 depicted in the image determines a suitable insertion site and establishes a vascular access to the target vein 210 using a needle or other medical device.

[0045] Figure 2A The ultrasound imaging system 100 depicted is capable of visualizing a target vein 210 in a total of available ultrasound images 222 displayed on a monitor 104 of a console 102. In one embodiment, image data is received from a detector 200. Figure 1 In the console 102 depicted above, the target detection logic 166 can process image data to present ultrasound images in the total available ultrasound images 222. (See above reference...) Figure 1 As discussed, the target detection logic 166 can utilize pulsation detection logic 168 and component recognition logic 170. Pulsation detection logic 168 can compare image sequences of blood vessels to detect pulses indicated by periodic changes in vessel size (e.g., expansion of vessel diameter). Component recognition logic 170 can also detect bone by identifying tissues with high density based on color saturation in the ultrasound images. Component recognition logic 170 can analyze the reflection of echoes in each image. This can be implemented using thresholds set to define organs, blood vessels, and bones. The individual logics can be stored on a non-transitory computer-readable medium on console 102. As discussed above, target detection logic 166 can process image data including target vein 210 to present an ultrasound image 222.

[0046] Figure 2A The ultrasound imaging system 100 depicted can be used for site assessment during insertion. Note that, although... Figure 2A The ultrasound detector assembly depicted has a general shape, but the ultrasound detector 200 can have different shapes as long as the detector captures the insertion site and the target vein 210.

[0047] Now for reference Figure 2B The detector 200 is shown connected to the console 102, which displays the target vein 210 in a cropped image 224 of the total available ultrasound images. (See above reference...) Figure 2A The ultrasound detector 200 discussed is connected to the console 102 via a wired connection. In one embodiment, a wireless connection may be used. The ultrasound detector 200 includes a body that houses a console operatively connected to an ultrasound imaging device 220. The ultrasound detector 200 can be configured to assist a user (e.g., a clinician) in inserting an access device (e.g., a needle) into a target vein 210 of a patient. The probe 202 can be placed close to the patient's skin near the needle insertion site, so that an activated ultrasound transducer in the probe 202 can generate an ultrasound signal and transmit the ultrasound signal as a pulse sequence into the patient's body. A transmitter (not shown) can then receive the reflected ultrasound signal (i.e., reflections of ultrasound pulses generated from the patient's body). The reflected ultrasound signal can be converted into a corresponding electrical signal for processing into an ultrasound image via the console of the detector 200. Thus, a clinician can use... Figure 2B The ultrasound imaging system 100 depicted in the image determines a suitable insertion site and establishes a vascular access to the target vein 210 using a needle or other medical device.

[0048] Figure 2B The ultrasound imaging system 100 depicted is capable of imaging and detecting a target vein 210 and provides visualization of a cropped image 320 shown on a display 104, which serves as a console 102. The cropped image 224 is a subset of the total ultrasound image. In one embodiment, as... Figure 1 As depicted, image data is received from detector 200 by console 102. Target detection logic 166 running on console 102 can process the image data to detect anatomical targets (target vein 210) within the ultrasound image.

[0049] Object detection logic 166 can be used Figure 1The diagram depicts pulse detection logic 168 and component identification logic 170. Pulsation detection logic 168 can compare image sequences of blood vessels to detect pulses indicated by periodic changes in vessel size (e.g., expansion of vessel diameter). Component identification logic 170 can also detect bone by identifying high-density tissue based on color saturation in ultrasound images. Component identification logic 170 can analyze the reflection of echoes in each ultrasound image. This can be implemented using thresholds set to define anatomical targets such as organs, blood vessels, bones, etc. In one embodiment, Figure 1 The image cropping logic 172 depicted herein can crop the ultrasound image capturing the imaging region 300 such that the detected anatomical target (e.g., target vein 210) is centered in the cropped image 224. The cropped image 224 then includes the vein 210 at its center and is displayed on the display 104 of the console 102. In addition to cropping the ultrasound image capturing the imaging region 300, the cropped image 224 can be enlarged to fill or substantially fill the display 104. As shown in Figures 2A to 2B What we see in the comparison, Figure 2B The image of the target vein 210 looks better than Figure 2A The large size of the target vein 210 in the image indicates that the cropped image 224 has been magnified.

[0050] Now for reference Figure 3A The following is a display view of a cropped image of the target vein, according to some implementation schemes. See reference... Figures 2A to 2B The ultrasound detector 200 discussed includes a body and a head 202, the head 202 housing a transducer capable of generating and transmitting ultrasound signals into the patient's body. Figure 3A The ultrasound imaging system 100 depicted is configured to acquire ultrasound images, detect a target vein 210, and present a cropped visualization of the target vein 210 on a display showing the target vein 210. In this embodiment, an ultrasound detector 200 emits ultrasound pulses such that it receives reflection data including an imaging region 300, which includes the target vein 210.

[0051] An ultrasound image of imaging region 300 is provided to console 102, where console logic processes the ultrasound image. Specifically, target detection logic 166 analyzes the ultrasound image to detect target vein 210. For example, target detection logic 166 may place a bounding box around target vein 210, or it may detect the coordinates of the box around target vein 210. It should be understood that the term "box" is not limited to a square or rectangle, but may refer to any other shape, such as a circle, ellipse, etc. Then, image cropping logic 172 crops the ultrasound image of imaging region 300 showing the image of target vein 210 in such a way that target vein 210 is located at the center of cropped image 320. For example, when executed by processor 116, image cropping logic 172 may crop the ultrasound image of imaging region 300 showing the bounding box or coordinates determined by target detection logic 166. The cropped image 320 containing target vein 210 can then be displayed on the screen of console 102.

[0052] refer to Figure 3B According to some embodiments, a visualization of a cropped image of a target vein is shown when the detector is displaced. In this embodiment, the detector 200 is unintentionally displaced along a first direction, for example, to the left. The displacement of the detector 200 results in a corresponding displacement of the position of the target vein 210 within the imaging region 300, wherein the corresponding displacement of the target vein 210 can be considered as being in a second direction opposite to the first direction.

[0053] However, according to an exemplary embodiment, the logic of the ultrasound imaging system 100 is configured to detect the target vein 210 and display an image on the console 102, wherein the target vein 210 is displayed in the center of the image (i.e., compensating for displacement of the detector 200). Therefore, even if the detector 200 may be unintentionally displaced, the image displayed by the console 102 will keep the target vein 210 in the center of the displayed image; thus, it allows the clinician to continue focusing on the target vein 210 itself, rather than on the unintentional displacement of the detector 200.

[0054] In other words, advantageously, the cropped image 320 does not change in response to the displacement of the detector 200. The ultrasound imaging system 100 can identify and differentiate anatomical targets, such as the target vein 210. The ultrasound imaging system 100 can then identify the anatomical target and perform image tracking of that target. The console 102 of the ultrasound imaging system 100 can employ console logic (e.g., target detection logic 166 and image cropping logic 172, as described above) to receive a sequence (or continuous signal) of ultrasound images from the detector 200. Furthermore, the console logic can repeatedly detect the target vein 210 within each image and can crop the current image for visualization (e.g., as the cropped image 320). In this way, the display of the cropped image 320 of the target vein 210 remains unaffected by the displacement of the detector 200, allowing clinicians to advantageously maintain a line of sight for visualization of the target vein 210.

[0055] Now for reference Figure 3C The following embodiments illustrate a cropped image of a target vein with a movement warning when the detector is displaced. In one embodiment, the ultrasound imaging system 100 can maintain and transmit information about the position of the identified target vein 210. For example, console logic can determine that displacement of the detector 200 has caused the target vein 210 to be within a threshold distance from the edge of the imaging area 300, and in response, generate a warning or indication (e.g., warning 322) configured to notify the user (e.g., a clinician) that the target vein 210 may soon leave the detector 200's line of sight due to the displacement or movement of the detector 200. In some embodiments, the warning or indication can be a visual warning displayed by the console 102, such as... Figure 3C Warning 322 is shown in the image. Warning 322 may include text such as "Motion Warning" and / or an indication of the direction of the detector 200 relative to the target vein 210 (e.g., arrow 324) to position the ultrasound imaging area 300 more centrally on the target vein 210.

[0056] For example, the console logic can detect the target vein 210 in each ultrasound image received from the detector 200. When the ultrasound detector 200 moves unintentionally in a manner that the probe 202 is about to stop capturing the target vein 210, the console logic provides a "movement warning" alert displayed on the display 104, for example as an overlay on the cropped image 320. The console logic can detect the position of the target vein 210 relative to the boundary of the total ultrasound image area 300. A visual alert may be accompanied by an arrow indicating how the detector should be moved away from the edge of the screen. In this way, the clinician is alerted in time before the visualization of the target vein 210 is lost. In one embodiment, the "movement warning" alert may be generated by an alarm generation logic component of the console logic. In some embodiments, the warning or alarm may be an audio alarm such as a beep. In some embodiments, the warning or alarm may be a vibration of the detector 200, in which case the detector 200 will include a vibration motor communicatively coupled to the console logic. In some embodiments, the warning or alarm may be any combination of visual alarms, audio alarms, and / or vibrations.

[0057] Now for reference Figure 3D The diagram illustrates, according to some embodiments, a view of a warning message displayed on a console display when the detector shifts and no longer captures the target vein. As described above, the ultrasound imaging system 100 can maintain and transmit information about the location of the identified target vein 210. For example, console logic can notify the clinician that the target vein 210 has moved off the screen in a specific direction, for instance, by analyzing the ultrasound image, failing to detect the target vein 210, and generating a visualization to be presented on display 104. When the ultrasound detector 200 moves in a manner that it no longer captures the target vein 210 (i.e., the target vein is no longer within the imaging area 300) (indicated by double arrows), the console logic can generate an alert configured to be presented on display 104 for the clinician to view.

[0058] exist Figure 3DIn the implementations depicted, the console logic can analyze each ultrasound image received from detector 200 to detect the target vein 210. When the ultrasound detector 200 moves unintentionally in a manner that the probe 202 no longer captures the target vein 210 (e.g., the target vein 210 is outside the imaging area 300), the console logic provides a "movement warning" alert displayed on display 104, for example as an overlay on the cropped image 320. For example, the console logic can provide a "moving detector" message alert 326, which is displayed as an overlay on the presentation of the total imaging area 300. In some implementations, the console logic can also provide an arrow 324 indicating the direction in which the detector needs to be moved to restore capture of the target vein 210. This alerts the clinician to move the detector and restore visualization of the target vein 210.

[0059] refer to Figure 4A The diagram illustrates a connection according to some implementation schemes. Figure 2A The detector in the control console includes an imager for the target vein and needle. As described above, the ultrasound detector 200 can be connected to the control console 102 via a wired or wireless connection. As shown, the probe 202 can be placed close to the patient's skin near the needle insertion site, so that the activated ultrasound transducer in the probe 202 can generate an ultrasound signal and transmit the generated ultrasound signal as a pulse sequence into the patient's body. The transmitter (not shown) can then receive the reflected ultrasound signal (i.e., the reflection of the ultrasound pulses generated from the patient's body). The reflected ultrasound signal can be converted into a corresponding electrical signal for processing into an ultrasound image by the control console of the detector 200. Therefore, clinicians can use... Figure 2A The ultrasound imaging system 100 depicted in the diagram determines a suitable insertion site and establishes a vascular access to the target vein 210 using a needle 210 or other medical device. Furthermore, reflected ultrasound signals may include reflections from the needle 404, enabling the ultrasound imaging system 100 to display an ultrasound image showing the imaging region 400.

[0060] Now for reference Figure 4BThe detector 200 is shown connected to a console 102, which displays a portion of the target vein 210 and needle 404 in a cropped image 420 of the total available ultrasound images. As discussed, the ultrasound imaging system 100 can be configured to acquire an ultrasound image showing an ultrasound imaging region 400 and present a cropped image 420 showing a portion of the ultrasound imaging region 400 on a display 104 of the console 102. In some such embodiments, target detection logic 166 of the console 102 can process image data (ultrasound reflection data) to crop the ultrasound image and render the cropped image 420. Specifically, target detection logic 166 can use pulse detection logic 168 and component recognition logic 170. Pulse detection logic 168 can compare image sequences of blood vessels to detect pulses indicated by periodic changes in blood vessel size (e.g., expansion of blood vessel diameter). Component recognition logic 170 can also detect bone by identifying tissue with high density based on color saturation in the ultrasound image.

[0061] The component identification logic 170 can analyze the reflection of echoes in each image. Component identification can be performed by comparing features of detected components (e.g., pulsatility across multiple images, size of the detected component, color saturation, etc.) with thresholds set to define organs, blood vessels, and bones. Based on the results of comparing the features of the detected components with one or more thresholds, a confidence level (or score) indicating the probability of identifying a particular component can be determined (e.g., a confidence score for a specific detected component being bone or blood vessel).

[0062] Furthermore, in a similar manner, target detection logic 166 can also be configured to detect needles using ultrasound images. The needle, such as needle 404, may include specific known reflective features (e.g., size, color saturation, etc.) such that component identification logic 170 of target detection logic 166 can detect and identify the needle in the same manner as discussed regarding vascular and bone detection. Therefore, ultrasound detector 200 can be configured to assist a user (e.g., a clinician) in inserting an access device (e.g., needle 404) into a target vein 210 of a patient. Probe 202 can be placed close to the patient's skin near the needle insertion site, so that an activated ultrasound transducer in probe 202 can generate ultrasound signals and transmit these signals as a sequence of pulses into the patient's body. A transmitter (not shown) can then receive the reflected ultrasound signals (i.e., reflections of ultrasound pulses generated from the patient's body). The reflected ultrasound signals can be converted into corresponding electrical signals for processing into an ultrasound image via the console of detector 200. Thus, a clinician can use... Figure 2B The ultrasound imaging system 100 depicted in the image determines a suitable insertion site and establishes a vascular access to the target vein 210 using a needle 210 or other medical device.

[0063] After detecting and identifying the components included within the imaging region 400, the ultrasound imaging system 100 can be configured to generate a cropped image, such as cropped image 420, which includes a portion of the target vein 210 and needle 404. In one embodiment, Figure 1 The image cropping logic 172 depicted in the diagram can crop the ultrasound image showing the imaging region 400 such that the detected anatomical target (e.g., target vein 210) is centered in the cropped image 420. The cropped image 420 then includes the vein 210 at its center and is displayed on the monitor 104 of the console 102. In addition to cropping the ultrasound image 300, the cropped image 420 can be enlarged to fill or substantially fill the monitor 104. As in... Figures 4A to 4B What we see in the comparison, Figure 4B The image of the target vein 210 looks better than Figure 2A The large size of the target vein 210 in the image indicates that the cropped image 420 has been magnified.

[0064] In some embodiments, determining the boundaries of the cropped ultrasound image showing the imaging region 400 includes determining the location of the needle 404 and its distance from the target vein 210. For example, when the needle 404 is very close to the target vein 210, the cropped image 420 may consist of a smaller bounding box surrounding the target vein 210, while when the needle 404 is further away from the target vein 210, the cropped image 420 may consist of a larger bounding box. Thus, in both cases, the cropped image 420 shows the target vein 210 and the needle 404. However, in other embodiments, the bounding box on which the cropped image 420 is created is of a predetermined size, and the cropping will not take into account the position of the needle 404. As mentioned above, it should be understood that the term "box" is not limited to a square or rectangle, but can refer to any other shape, such as a circle, an ellipse, etc.

[0065] Now for reference Figure 5A The image shows a cutout view of a portion of the target vein and needle, according to some embodiments. (See reference...) Figures 4A to 4B The discussed ultrasound imaging system 100 is configured to acquire ultrasound images, detect a target vein 210 and a needle 404, including the distal tip 501 of the needle 404. Furthermore, the ultrasound imaging system 100 can be configured to present a cropped visualization, such as a cropped image 520, on a display showing the target vein 210 and the needle 404. In some embodiments, needle tip tracking can be implemented using the teachings of one or more of the following U.S. patents: 5,775,322; 5,879,297; 6,129,668; 6,216,028; and 6,263,230, each of which is incorporated herein by reference in its entirety.

[0066] refer to Figure 5B A visualization view of a cropped image of a target vein and a portion of a needle is shown according to some embodiments. In this embodiment, detector 200 is unintentionally displaced along a first direction, for example, to the left. The displacement of detector 200 can produce a corresponding displacement of the position of the target vein 210 within the imaging region 500, wherein the corresponding displacement of the target vein 210 can be considered in a second direction opposite to the first direction. However, according to an exemplary embodiment, after the unintentional displacement of detector 200, there is no change in the cropped image 520 of the vein 210 and the distal tip 501 displayed to the clinician. In other words, advantageously, the cropped image 520 does not change in response to the displacement of detector 200. The ultrasound imaging system 100 can identify and differentiate anatomical targets, such as the target vein 210 and the distal tip 501 of the needle 404, in order to perform image tracking of the distal tip 501. The ultrasound imaging system 100 can employ console logic to receive a sequence (or continuous signal) of ultrasound images from detector 200. The console logic can then repeatedly detect the target vein 210 within each image and can crop the current image to visualize it in the cropped image 520. In this way, the target vein 210 displayed in the cropped image 520 remains unaffected by the displacement of the detector 200. In other words, the focus remains on the target vein 210 and on the tracking of the needle tip 501. Therefore, advantageously, the clinician does not lose visualization of the target vein 210 and tracking of the distal tip 501.

[0067] In other words, advantageously, the cropped image 520 does not change in response to the displacement of the detector 200. The ultrasound imaging system 100 can identify and differentiate anatomical targets, such as the target vein 210. The ultrasound imaging system 100 can then identify the anatomical target and perform image tracking of that target. The console 102 of the ultrasound imaging system 100 can employ console logic (e.g., target detection logic 166 and image cropping logic 172, as described above) to receive a sequence (or continuous signal) of ultrasound images from the detector 200. Furthermore, the console logic can repeatedly detect the target vein 210 and the needle 404 within each image and can crop the current image for visualization (e.g., as the cropped image 520). In this way, the display of the cropped image 520 of the target vein 210 remains unaffected by the displacement of the detector 200, allowing clinicians to advantageously maintain a line of sight for visualization of the target vein 210 and the needle 404 as the needle 404 approaches the target vein 210.

[0068] Now for reference Figure 5CAccording to some embodiments, a cropped image of a target vein and a portion of the needle, including a movement warning, is shown. In one embodiment, the ultrasound imaging system 100 can maintain and transmit information about the location of the identified target vein 210. For example, console logic can determine that displacement of the detector 200 has caused the distal tip 501 of the target vein 210 and / or the needle 404 to be within a threshold distance from the edge of the imaging area 300, and in response, generate a warning or indication (e.g., warning 322) configured to notify the user (e.g., a clinician) that the target vein 210 or the distal tip 501 of the needle 404 may soon leave the detector 200's line of sight due to displacement or movement of the detector 200. In some embodiments, the warning or indication can be a visual warning displayed by the console 102, such as... Figure 5C Warning 522 as seen in the image. Warning 522 may include text such as “Motion Warning” and / or an indication of the direction of the detector 200 relative to the target vein 210 (e.g., arrow 324) to position the ultrasound imaging area 500 more centrally on the target vein 210.

[0069] For example, the console logic can detect the target vein 210 and needle 404, including the distal tip 501 of needle 404, in each ultrasound image received from detector 200. When the ultrasound detector 200 moves unintentionally in a manner that the probe 202 is about to stop capturing the target vein 210 or the distal tip 501 of needle 404, the console logic provides a "movement warning" alert displayed on display 104, for example as an overlay on cropped image 520. The console logic can detect the position of the target vein 210 relative to the boundary of the total ultrasound image area 500. The visual alert may be accompanied by an arrow indicating how the detector should be moved away from the edge of the screen. In this way, the clinician is alerted in time before the visualization of the target vein 210 or the distal tip 501 of needle 404 is lost. In one embodiment, the "movement warning" alert may be generated by an alarm generation logic component of the console logic. In some embodiments, the warning or alarm may be an audio alarm such as a beep. In some embodiments, the warning or alarm may be a vibration of detector 200, in which case detector 200 will include a vibration motor communicatively coupled to the console logic. In some implementations, the warning or alarm can be any combination of visual alarm, audio alarm, and / or vibration.

[0070] A system that not only provides ultrasound imaging but also ensures precise insertion of the needle into the target based on ultrasound image tracking without taking into account accidental displacement of the ultrasound detector advantageously reduces the risk of puncturing the patient's skin in the wrong place or even in multiple places.

[0071] Embodiments of the invention may be implemented in other specific forms without departing from the spirit of the disclosed text. The described embodiments are to be considered illustrative in all respects only, and not restrictive. Therefore, the scope of the embodiments is indicated by the appended claims rather than by the foregoing description. All modifications within the equivalent meaning and scope of the claims should be included within their scope.

Claims

1. An ultrasound imaging system, characterized in that, include: An ultrasonic detector configured to acquire a series of ultrasonic images during needle insertion; and A control console, communicatively coupled to the ultrasound detector, includes a processor and a non-transitory computer-readable medium storing logic thereon, which, when executed by the processor, is configured to perform operations including: Receive ultrasound images, the ultrasound images including a series of ultrasound images acquired by the ultrasound detector during the needle insertion process. The first target blood vessel within the ultrasound image is detected repeatedly as follows: Detect pulses within the ultrasound image that indicate periodic changes in the size of the first target blood vessel. Detecting the first target blood vessel in one or more targets within a threshold distance of the edge of the first ultrasound image in a series of ultrasound images, and Analyze the color saturation within the ultrasound image relative to one or more thresholds indicating blood vessels, and Generating a visualization from the ultrasound image includes (i) determining a bounding box around the first target blood vessel, wherein the first target blood vessel is centered within the bounding box; (ii) cropping the ultrasound image at the bounding box; and (iii) displaying the cropped ultrasound image on a display screen during the needle insertion process, wherein the display screen is integrated into or connected to the console; and wherein the visualization is regenerated based on the reception of the ultrasound image during the needle insertion process.

2. The ultrasound imaging system according to claim 1, characterized in that, Generating the visualization involves increasing the magnification of the cropped ultrasound image to center the one or more targets detected within the cropped ultrasound image.

3. The ultrasound imaging system according to claim 1, characterized in that, The ultrasonic detector is communicatively coupled to the control console via a wired or wireless connection.

4. The ultrasound imaging system according to claim 1, characterized in that, The console includes the display screen, and the logic therein, when executed by the processor, is configured to perform the further operation of presenting the visualization of the cropped ultrasound image on the display screen.

5. The ultrasound imaging system according to claim 1, characterized in that, Detecting the one or more targets includes distinguishing components within the ultrasound image based on variations in color saturation within the ultrasound image.

6. The ultrasound imaging system according to claim 1, characterized in that, Detecting the one or more targets includes identifying each of the one or more targets as the first target: a blood vessel, bone, organ, or medical device.

7. The ultrasound imaging system according to claim 6, characterized in that, Identifying each of the one or more targets includes comparing features of each of the one or more targets with a threshold set to define an organ, blood vessel, bone, or medical device.

8. The ultrasound imaging system according to claim 7, characterized in that, The features include one or more of the following when analyzing the first ultrasound image in the series of ultrasound images and the previous ultrasound image in the series of ultrasound images: pulsation, the size of each of the one or more targets, and the color saturation of each of the one or more targets.

9. The ultrasound imaging system according to claim 8, characterized in that, The result of comparing the feature with the one or more thresholds is the confidence level of each indicator among the one or more targets in identifying the selected target.

10. The ultrasound imaging system according to claim 1, characterized in that, When executed by the processor, the logic is configured to perform further operations including: An alert is generated to indicate to the clinician that the first target blood vessel is within the threshold distance of the edge of the first ultrasound image.

11. The ultrasound imaging system according to claim 10, characterized in that, The alert may include a text notification or an arrow indicating the direction to move the ultrasound detector.

12. The ultrasound imaging system according to claim 1, characterized in that, The one or more targets include the first target blood vessel and the needle.

13. The ultrasound imaging system according to claim 12, characterized in that, The one or more targets include the distal tip of the needle.

Images