Method and system for imaging a needle from ultrasound imaging data
By receiving the target path or area of the needle, the ultrasonic beam steering angle of the ultrasonic probe is automatically adjusted, which solves the problem of unintuitive user interface, improves the imaging accuracy and clarity of the needle, and achieves better needle positioning and tracking.
Patent Information
- Application Number
- CN202080048755.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-07-15
- Filing Date
- 2020-06-25
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-06-25
AI Technical Summary
In medical ultrasound imaging, it is difficult for users to intuitively adjust the steering angle of the ultrasound beam emitted by the ultrasound probe, resulting in the imaging of the needle being not clear enough and the user interface is not intuitive, affecting the accurate visualization of the needle.
By receiving the target path or target area of the needle, the steering angle of the ultrasonic beam emitted by the ultrasonic probe is automatically adjusted to match the angle between the needle path and the ultrasonic probe surface to optimize imaging.
Provides a more intuitive user interface, improves the imaging accuracy and clarity of the needle, allowing users to position and track the position of the needle more easily.
Smart Images

Figure CN114080186B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the subject matter disclosed herein relate to medical imaging, such as ultrasound imaging, and more particularly to displaying an image including a needle from ultrasound imaging data. Background Art
[0002] Medical imaging systems are often used to monitor and image a subject. In some examples, the medical imaging system may be an ultrasound system for detecting the presence of a needle, such as a biopsy needle, inserted into a subject. In this way, the ultrasound system may be used to locate and track the needle in a subject during a medical procedure.
[0003] One or more images obtained using the ultrasound system may be presented to the user at a user interface. The user may be a medical professional familiar with medical procedures, and thus the user may have an overall impression of where the needle is located in the subject, the type of tissue into which the needle is inserted, the depth of the needle in the subject, the total length of the needle, etc. However, the user may not be familiar with the mechanical details of the ultrasound probe of the ultrasound system, such as the steering angle of the ultrasound beam emitted by the ultrasound probe. Summary of the invention
[0004] In one embodiment, a method may include receiving a target path or target area of a needle, and adjusting a steering angle of an ultrasound beam emitted from an ultrasound probe based on the target path or target area.
[0005] It should be understood that the above brief description is provided to introduce in a simplified form selected concepts that are further described in the detailed description. It is not meant to identify key or essential features of the claimed subject matter, the scope of which is solely defined by the claims that follow the detailed description. Furthermore, the claimed subject matter is not limited to implementations that solve any disadvantages noted above or in any part of this disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] The present invention will be better understood by reading the following description of non-limiting embodiments with reference to the accompanying drawings, in which:
[0007] Figure 1 An exemplary ultrasound imaging system is shown in accordance with an exemplary embodiment.
[0008] Figure 2 A flow chart of a method for adjusting a steering angle of an ultrasound beam emitted by an ultrasound probe and imaging a needle therefrom according to an embodiment is shown.
[0009] Figure 3 A flow chart of a method for adjusting a steering angle of an ultrasonic beam emitted by an ultrasound probe in response to a position of the ultrasound probe being changed and imaging a needle thereby according to an embodiment is shown.
[0010] Figure 4 A schematic diagram illustrating geometric considerations for adjusting the steering angle based on the angle between the path of the needle and the surface of the ultrasound probe, according to an embodiment, is shown.
[0011] Figure 5 A schematic diagram illustrating a first example of image transformation according to an embodiment is shown.
[0012] Figure 6 A schematic diagram illustrating a second example of image transformation according to an embodiment is shown.
[0013] Figure 7 A schematic diagram of an exemplary process for generating a portion of a needle in an image is shown, according to an embodiment.
[0014] Figure 8 A first exemplary user interface display of a display device of an ultrasound imaging system according to an embodiment is shown.
[0015] Fig. 9 A second exemplary user interface display of a display device of an ultrasound imaging system according to an embodiment is shown. DETAILED DESCRIPTION
[0016] The following description relates to various embodiments for adjusting the steering angle of an ultrasound beam emitted by an ultrasound probe and imaging a needle therefrom. Figure 1 An exemplary ultrasound imaging system for generating imaging data thereof is depicted in FIG. Figure 2 and Figure 3 A method for adjusting the steering angle of an ultrasound beam and thereby imaging a needle is described. Geometric considerations for adjusting the steering angle are given in Figure 4 It is schematically shown in FIG. Figures 5 to 7 An exemplary process for generating an image depicting a needle, such as via an image transform, is shown. Figure 8 and Fig. 9 An exemplary user interface display of a display device of an ultrasound imaging system is depicted in which an image depicting a needle may be displayed.
[0017] Figure 1A block diagram of a system 100 according to one embodiment is depicted. In the illustrated embodiment, the system 100 is an imaging system, and more specifically an ultrasound imaging system. However, it should be understood that the embodiments described herein can be implemented using other types of medical imaging modalities (e.g., MR, CT, PET / CT, SPECT). In addition, it should be understood that other embodiments do not actively collect medical images. Instead, the embodiments can retrieve images or ultrasound data previously acquired by the imaging system, and analyze the image data as described herein. As shown, the system 100 includes multiple components. These components can be coupled to each other to form a single structure, can be separate but located in a common room, or can be far away from each other. For example, one or more of the modules described herein can be operated in a data server, which has a different and remote location relative to other components of the system 100, such as a probe and a user interface. Optionally, in the case of an ultrasound system, the system 100 can be a single system that can be moved from one room (e.g., portable) to another room. For example, the system 100 can include wheels or be transported on a car.
[0018] In the illustrated embodiment, the system 100 includes a transmit beamformer 101 and a transmitter 102 that drives an array of elements 104 (e.g., piezoelectric crystals) within a diagnostic ultrasound probe 106 (or transducer) to transmit ultrasound signals (e.g., continuous signals or pulsed signals) into a body or volume (not shown) of a subject. The elements 104 and the probe 106 may have a variety of geometric shapes. The ultrasound signal is backscattered from a body structure (e.g., an inserted needle) to produce an echo that returns to the element 104. The echo is received by a receiver 108. The received echo is provided to a receive beamformer 110 that performs beamforming and outputs a radio frequency (RF) signal. The RF signal is then provided to an RF processor 112 that processes the RF signal. Alternatively, the RF processor 112 may include a complex demodulator (not shown) that demodulates the RF signal to form an I / Q data pair representing the echo signal. The RF or I / Q signal data may then be provided directly to the memory 114 for storage (e.g., temporary storage). The system 100 also includes a system controller 116, which may be part of a single processing unit (e.g., a processor) or distributed among multiple processing units. The system controller 116 is configured to control the operation of the system 100.
[0019] For example, the system controller 116 may include an image processing module that receives image data (e.g., an ultrasound signal in the form of RF signal data or an I / Q data pair) and processes the image data. For example, the image processing module may process the ultrasound signal to generate two-dimensional (2D) slices or frames of ultrasound information (e.g., ultrasound images) or ultrasound waveforms (e.g., continuous or pulsed wave Doppler spectra or waveforms) for display to an operator. When the system 100 is an ultrasound system, the image processing module may be configured to perform one or more processing operations based on a plurality of optional ultrasound modalities of the acquired ultrasound information. By way of example only, ultrasound modalities may include color flow, acoustic radiation force imaging (ARFI), B mode, A mode, M mode, spectral Doppler, acoustic flow, tissue Doppler module, C scan, and elastic imaging. In addition, in some examples, one or more processing operations may include one or more image transformations, such as a Radon transform for identifying linear features in an ultrasound image.
[0020] When echo signals are received, the acquired ultrasound information may be processed in real time during an imaging session (or scanning session). In addition or alternatively, the ultrasound information may be temporarily stored in the memory 114 during the imaging session and processed in a less than real-time manner in real-time or offline operation. An image memory 120 is included for storing processed slices or waveforms of acquired ultrasound information that are not scheduled for immediate display. The image memory 120 may include any known data storage medium, such as a permanent storage medium, a removable storage medium, etc. In addition, the image memory 120 may be a non-transitory storage medium.
[0021] In operation, the ultrasound system may acquire data, such as 2D data sets, spectral Doppler data sets, and / or volume data sets, by various techniques (e.g., three-dimensional (3D) scanning, real-time 3D imaging, volume scanning, 2D scanning using a probe with a positioning sensor, freehand scanning using voxel correlation techniques, scanning using a 2D or matrix array probe, etc.). An ultrasound spectrum (e.g., waveform) and / or image may be generated (at the controller 116) from the acquired data and displayed to an operator or user on the display device 118.
[0022] The system controller 116 is operably connected to a user interface 122 that enables an operator to control at least some operations of the system 100. The user interface 122 may include hardware, firmware, software, or a combination thereof that enables an individual (e.g., an operator) to directly or indirectly control the operation of the system 100 and its various components. As shown, the user interface 122 includes a display device 118 having a display area 117. In some embodiments, the user interface 122 may also include one or more user interface input devices 115, such as a physical keyboard, a mouse, and / or a touchpad. In one embodiment, a touchpad may be configured to the system controller 116 and the display area 117 so that when a user moves a finger / glove / stylus on the surface of the touchpad, a cursor on the ultrasound image or Doppler spectrum on the display device 118 moves in a corresponding manner.
[0023] In an exemplary embodiment, the display device 118 is a touch-sensitive display (e.g., a touch screen) that can detect the presence of an operator's touch on the display area 117 and can also identify the location of the touch in the display area 117. The touch can be applied by, for example, at least one of an individual's hand, a glove, a stylus, etc. In this way, the touch-sensitive display can also be characterized as an input device configured to receive input from an operator (such as a request to adjust or update the orientation of the displayed image). The display device 118 also transmits information from the controller 116 to the operator by displaying the information to the operator. The display device 118 and / or the user interface 122 can also perform audio communication. The display device 118 is configured to present information to the operator during or after an imaging or data acquisition session. The information presented can include ultrasound images (e.g., one or more 2D frames), graphic elements, measurement graphics of the displayed image, user-selectable elements, user settings, and other information (e.g., administrative information, patient's personal information, etc.).
[0024] In addition to the image processing module, the system controller 116 may also include one or more of a graphics module, an initialization module, a tracking module, and an analysis module. The image processing module, the graphics module, the initialization module, the tracking module, and / or the analysis module may coordinate with each other to present information to an operator during and / or after an imaging session. For example, the image processing module may be configured to display the acquired image on the display device 118, and the graphics module may be configured to display specified graphics with the displayed image, such as optional icons related to the image (e.g., an image rotation icon) and measurement parameters (e.g., data). The controller may include an algorithm stored within a memory of the controller for automatically adjusting a steering angle of an ultrasonic signal or beam emitted by an element 104 of the probe 106, and then generating an ultrasonic image depicting at least a portion of a needle inserted into the body of a subject, as described below with reference to FIG. Figures 2 to 4The algorithm may further include image transformations and other routines for post-processing the generated ultrasound images, as described below with reference to Figures 5 to 7 Further described.
[0025] The screen of the display area 117 of the display device 118 is composed of a series of pixels that display data acquired using the probe 106. The acquired data includes one or more imaging parameters calculated for each pixel of the display or a group of pixels (e.g., a group of pixels assigned the same parameter value), wherein the one or more calculated image parameters include one or more of intensity, velocity (e.g., blood flow velocity), color blood flow velocity, texture, granularity, contractility, deformation, and deformation rate values. This series of pixels then constitutes a display image and / or Doppler spectrum generated from the acquired ultrasound data.
[0026] The system 100 may be a medical ultrasound system for acquiring imaging data of a scanned object (e.g., biological tissue including an inserted needle). The acquired image data may be used to generate one or more ultrasound images, which may then be displayed via a display device 118 of a user interface 122. For example, the one or more generated ultrasound images may include one or more 2D frames. Specifically, the image processing module discussed above may be programmed to generate and display one or more 2D frames.
[0027] Typically, the ultrasound probe can be adjusted at the user interface by controlling the steering angle of the transmitted ultrasound beam. In some examples, the ultrasound probe can be used to image an object that is linear in at least one dimension, such as a needle. In such examples, for optimal imaging, it may be desirable for the ultrasound beam to contact the object at a 90° angle relative to the linear dimension. However, it may be difficult to achieve this angle through user control of non-intuitive parameters (such as the steering angle of the ultrasound beam). In some examples, such inherent difficulties may lead to poor object visualization.
[0028] According to the embodiments disclosed herein, the above-mentioned problems can be at least partially solved by automatically adjusting the steering angle of the ultrasonic beam and imaging the object (e.g., a needle) by it. At the user interface, the user can provide a target area where the expected object is located. Thereafter, an angle can be determined between lines that are respectively parallel to the linear dimensions of the object and the surface of the ultrasound probe. In some examples, the target area can be the target path of the needle, so that the angle can be the angle between the determined path of the needle and the surface of the ultrasound probe. The steering angle can then be adjusted toward the determined angle. In this way, a more intuitive interface can be provided to the user, allowing the needle to be more accurately visualized.
[0029] Reference now Figure 2, depicting a method 200 for adjusting a steering angle of an ultrasound beam emitted by an ultrasound probe. Thereafter, imaging data may be received from the ultrasound probe, from which an image may be generated and displayed to a user at a display device.
[0030] The following reference Figure 1 The depicted systems and components describe the method 200, but it should be understood that the method 200 may be implemented with other systems and components without departing from the scope of the present disclosure. In some embodiments, the method 200 may be implemented as executable instructions in any suitable combination of the imaging system 100, an edge device (e.g., an external computing device) connected to the imaging system 100, a cloud in communication with the imaging system, etc. As an example, the method 200 may be implemented in a non-transitory memory of a computing device, such as Figure 1 A controller (eg, a processor) of the imaging system 100.
[0031] Method 200 may begin at 205, where an ultrasound scan may be initiated. The ultrasound scan may include emitting an ultrasound beam from a transducer element (e.g., 104) of an ultrasound probe (e.g., 106). The ultrasound beam may be directed toward a body of a subject (such as a patient). Therein, a needle, such as a biopsy needle, may be inserted so that the ultrasound probe may image the object by collecting echoes reflected by the interaction of the ultrasound beam with the object. Those skilled in the art will appreciate that any object inserted into the body can be imaged accordingly in this manner, and that the method 200 should not be understood as being limited to a needle.
[0032] At 210, method 200 may include receiving a target area of the needle. The target area may be set at a user interface (e.g., 122) of an ultrasound imaging system (e.g., 100). In some examples, the target area may be initialized by default at the center of a display area (e.g., 117) of a display device (e.g., 118). The display area may include an image depicting the subject's body, as imaged from a previous ultrasound scan. In additional or alternative examples, the user may move or initialize the target area via user selection. The user selection may include one or more of a touch selection, a navigation request, or a voice command. In some examples, and as described below with reference to Figure 8 and Fig. 9Further described, touch selection can include a "draggable" selection area on the display device, so that the user can place a finger on a selection area in the selection area and move the selection area via touch control. In such examples, the sterile cover can be set above the surface of the display device. In additional or alternative examples, the navigation request can include a user-actuated icon for moving the target area upward, downward, left or right. In additional or alternative examples, the voice command can include a recognition navigation command, such as "up", "down", "left" or "right". In addition, the voice command can include a brief location request recognized by the algorithm implemented in the memory of the controller, such as "skin surface", "puncture point" etc. The target area can be a structure superimposed on the display area of the display device and represented by 2D coordinates, such as a linear target path (e.g., a line segment), an area around the target path (e.g., an ellipse) or a target area around a center point (e.g., a circle).
[0033] At 215, method 200 may include determining or estimating the path of the needle based on the target area of the needle. In examples where the target area includes the target path, the path of the needle can be projected along the target path so that the path of the needle can be a line including the target path. In examples where the target area includes the target area, one or more of the puncture point, the origin direction, and the penetration depth of the needle can be determined. In one example, a position sensor of the outer end of the needle (e.g., the end of the needle not inserted into the subject) can be communicatively coupled to the ultrasound imaging system so that the puncture point or the origin direction can be provided or inferred. The puncture point may include the location where the needle punctures the subject's skin. In addition, the origin direction may include the orientation of the needle relative to the reference plane of the position sensor. The penetration depth may be the depth of the inner end of the needle inserted into the subject (e.g., the end of the needle inserted into the subject). The penetration depth can be determined based on one or more of the center of the target area, the puncture point, and the origin direction. In other examples, one or more of the puncture point, the origin direction, and / or the penetration depth can be provided by the user at a user interface (e.g., 122). The path of the needle can then be projected based on one or more of the target area, the puncture point, the penetration depth, and the origin direction. As an example, the path of the needle can be projected along a line segment between the center of the target area and the puncture point. As another example, the path of the needle can be projected along the hypotenuse of a right triangle defined by the needle's origin direction and the penetration depth (where the length of one side adjacent to the right angle of the right triangle can be the penetration depth, and where the origin direction can be used to determine the angle between the needle and the subject's skin surface).
[0034] At 220, method 200 may include determining a needle angle based on the path of the needle and the position of an ultrasound probe (e.g., 106). The position of the ultrasound probe may be used to determine a line parallel to the surface of the ultrasound probe including the transducer element (e.g., 104). For example, the position and orientation of the ultrasound probe may be received from one or more position sensors therein. The surface of the ultrasound probe may then be inferred and positioned based on the received position and orientation of the ultrasound probe. That is, since the ultrasound probe may be manufactured according to a set standard, the surface of the ultrasound probe may be determined relative to a reference position and a reference orientation of one or more position sensors included in the ultrasound probe. The needle angle may then be defined using a line parallel to the surface of the ultrasound probe and the path of the needle (e.g., a line parallel to the axis of the needle). In some examples, the needle angle may be a predetermined amount wider than the angle between the surface of the ultrasound probe and the path of the needle so that user error may be taken into account. For example, a user may have an overall impression of where the needle is located in the body of the subject, but may not know exactly where the needle is located, resulting in small inaccuracies due to such user error.
[0035] As referenced below Figure 4 As shown and described, when the steering angle of the ultrasound beam emitted by the ultrasound probe (e.g., 106) is equal to the needle angle, the ultrasound beam can be perpendicular to the path of the needle, thereby providing optimal imaging of the needle. Therefore, at 225, method 200 may include determining whether the steering angle of the ultrasound beam emitted by the ultrasound probe (e.g., 106) is within a threshold angle of the needle angle (e.g., less than 20°, 15°, 10°, or 5°). The steering angle can be defined by a line perpendicular to the surface of the ultrasound probe and a line parallel to the ultrasound beam.
[0036] If the steering angle is outside the threshold angle of the needle angle, method 200 may proceed to 230 to adjust the steering angle toward the needle angle. In some examples, adjusting the steering angle toward the needle angle may include adjusting the steering angle to be within the threshold angle of the needle angle. In additional or alternative examples, adjusting the steering angle toward the needle angle may include matching the steering angle to the needle angle.
[0037] Once the steering angle has been adjusted toward the needle angle, or if it is determined at 225 that the steering angle is within a threshold angle of the needle angle, the method 200 may proceed to 235 to receive first imaging data from an ultrasound probe (e.g., 106). The first imaging data may include ultrasound echoes of ultrasound beams emitted by transducer elements (e.g., 104) of the ultrasound probe. In some examples, the first imaging data may further include physiological and / or temporal parameters, a set of 2D or 3D spatial coordinates, and other information that may be used to process the first imaging data at an image processing module.
[0038] At 240, method 200 may include generating a first image depicting at least a portion of a needle inserted into a body of a subject from the imaging data. For example, the first image may include a 2D frame corresponding to a target slice of the received volumetric ultrasound data. In some examples, second imaging data may be received from an ultrasound probe (e.g., 106) before the needle is inserted into the body of the subject. In such examples, a second image may be generated based on the second imaging data, wherein the second image may include a second 2D frame depicting the subject's body without the needle. In this way, the difference between the first image and the second image may correspond to the resulting physiological changes in the needle and the subject's body. Therefore, in some examples, the first image may be generated from both the first imaging data and the second image.
[0039] As an example, a so-called "blind area" may exist in the first imaging data corresponding to an area that is not imaged by the ultrasound probe. However, the same area may exist in the second imaging data, allowing the area to be imaged in the second image and thereby imaged in the first image (e.g., by stitching together the first image from the first imaging data and the second image). In addition, and as described below with reference to Figure 7 As described, since another portion of the needle may exist in the "blind zone", the other portion may be projected based on the known length of the needle and thereby generated in the first image in the "blind zone".
[0040] As another example, an image transformation may be performed on a target region in the first image. Figure 5 As described, the image transform may be a Radon transform, which is used to detect linear structures representing the needle and remove one or more artifacts (e.g., from collisions with the ultrasound probe or movement of the needle during imaging) from the target region. Figure 6 As described, the color or brightness of the detected linear structure may be changed so as to depict the needle with higher contrast relative to the subject's body.
[0041] At 245, method 200 may include displaying the first image at a display device (e.g., 118). One or more functions for further manipulating the first image (e.g., zooming in, moving to a different area of the first image, defining a new target area for imaging, etc.) may be presented to a user of the display device. Figure 8 and Fig. 9 Two examples of such displays are provided. In this way, the needle can be clearly imaged based on the target area provided by the user. Thus, more intuitive user control can be employed in needle imaging relative to control of another parameter such as the steering angle itself.
[0042] At 250, method 200 may determine whether a nerve or other physiological feature has been identified within a threshold distance (e.g., 2 mm, 1 mm, 0.5 mm, 0.1 mm) of the target area. In some examples, a nerve identification algorithm may be implemented in a memory of the controller to prevent the needle from reaching the identified nerve or to alert the user of the presence of the identified nerve. Thus, if a nerve is identified within a threshold distance of the target area, method 200 may proceed to 255 to generate and display a notification or alarm. The notification may indicate to a user of an ultrasound imaging system (e.g., 100) that the path of the needle (e.g., as determined based on the target area) is within a threshold distance of the identified nerve. In some examples, the notification may include a prompt indicating that the needle should be retracted or reinserted into an area away from the identified nerve. In additional or alternative examples, the notification may request the user to confirm the identified nerve. Method 200 may then end.
[0043] If no nerves are identified within the threshold distance of the target area, the method 200 can proceed to 260 to maintain the current display. For example, the current display can include an image generated and displayed as described above. The method 200 can then end.
[0044] Reference now Figure 3 , depicts a method 300 for adjusting a steering angle of an ultrasound beam emitted by an ultrasound probe in response to the position of the ultrasound probe being changed and then imaging at least a portion of a needle therefrom. In some examples, method 300 may follow method 200. Thus, in some examples, an image depicting at least a portion of the needle may initially be generated and displayed to a user.
[0045] The following reference Figure 1 The depicted systems and components describe the method 300, but it should be understood that the method 300 can be implemented with other systems and components without departing from the scope of the present disclosure. In some embodiments, the method 300 can be implemented as executable instructions in any suitable combination of the imaging system 100, an edge device (e.g., an external computing device) connected to the imaging system 100, a cloud in communication with the imaging system, etc. As an example, the method 300 can be implemented in a non-transitory memory of a computing device, such as Figure 1 A controller (eg, a processor) of the imaging system 100.
[0046] The method 300 may begin at 305, where the method 300 may include receiving a position of an ultrasound probe (e.g., 106). The position of the ultrasound probe may be received from one or more position sensors therein. In some examples, receiving the position of the ultrasound probe may be after receiving one or more previous positions of the ultrasound probe. Thus, at 310, the method 300 may include determining whether the position of the ultrasound probe has changed (e.g., relative to one or more previous positions). If the position of the ultrasound probe has not changed, the method 300 may proceed to 315 to maintain the current display. For example, as described above with reference to Figure 2 As described, the current display may include an image generated and displayed according to method 200. Method 300 may then end.
[0047] If the position of the ultrasound probe (e.g., 106) has changed, the method 300 may proceed to 320 to determine whether the changed position of the ultrasound probe is outside the detection range of the needle. For example, the position of the ultrasound probe may have been manually adjusted away from the target area (e.g., the position where the needle is assumed to be) or away from the position where the needle was previously imaged and detected via image transformation. In this way, it can be subsequently determined that the needle is no longer present in the imaging data received from the ultrasound probe at the changed position. Therefore, if the changed position of the ultrasound probe is outside the detection range, the method 300 may proceed to 325 to generate and display a notification or alarm. The notification may indicate to the user of the ultrasound imaging system (e.g., 100) that the ultrasound probe is outside the detection range of the needle. In some examples, the notification may include a prompt indicating that the changed position of the ultrasound probe should be manually adjusted back to within the detection range of the needle. In addition, in some examples, the image may continue to be displayed and may change appearance in response to newly received imaging data (e.g., in response to the ultrasound probe being moved). The method 300 may then end.
[0048] If the changed position of the ultrasound probe is within the detection range, the method 300 may proceed to 330 to adjust the steering angle of the ultrasound beam emitted by the transducer element (e.g., 104) of the ultrasound probe (e.g., 106) based on the target area of the needle and the changed position of the ultrasound probe. Figure 2 The steering angle may be adjusted toward the needle angle by a process similar to the process described at 220 to 230 of the method 200 described in . For example, at 335, an updated needle angle may be determined based on the target area of the needle and the changed position of the ultrasound probe. Then, at 340, the steering angle may be adjusted toward the updated needle angle.
[0049] At 345, method 300 may include receiving updated imaging data from an ultrasound probe (e.g., 106). The updated imaging data may include ultrasound echoes of ultrasound beams emitted by transducer elements (e.g., 104) of the ultrasound probe. In some examples, the updated imaging data may further include physiological and / or temporal parameters, 2D or 3D spatial coordinate sets, and other information that may be used to process the updated imaging data at an image processing module.
[0050] At 350, the method 300 may include generating an updated image depicting at least a portion of the needle inserted into the body of the subject from the updated imaging data. For example, the updated image may include a 2D frame corresponding to the target slice of the received volumetric ultrasound data. Post-processing the updated imaging data, such as via an image transformation, may include, for example, referring to Figure 2 One or more of the examples described at 240 of the described method 200 .
[0051] In some examples, the image transformation can be used to identify the needle depicted in the image and store its position. Thus, when the position of the ultrasound probe has changed and the needle is subsequently re-imaged, the position of the needle in the image can be updated so that the needle can be tracked by the ultrasound imaging system (e.g., 100) provided herein. In one example, the above reference Figure 2 The described nerve identification algorithm can further detect whether the position of the needle itself is within a threshold distance of the identified nerve. If so, a notification can be generated, similar to that described above with reference to Figure 2 The notification generated at 255 of method 200. If not, the current display may be maintained.
[0052] At 355, method 300 may include displaying the updated image at a display device (e.g., 118). One or more functions for further manipulating the updated image (e.g., zooming in, moving to a different area of the updated image, defining a new target area for imaging, etc.) may be presented to a user of the display device. Figure 8 and Fig. 9 Two examples of such displays are provided. In this way, when the position of the ultrasound probe is changed, the image displayed to the user at the display device can be automatically updated. The method 300 can then end.
[0053] Reference now Figure 4 , schematic diagram 400 depicts geometric considerations for adjusting a steering angle 420 of one or more ultrasound beams 406 emitted by a transducer element 104 of an ultrasound probe 106. Such geometric considerations may be described by reference to Figure 1 Ultrasound imaging system described and referenced Figure 2 and Figure 3The described method adopts. Specifically, an ultrasound beam 406 can be directed to a needle 402 inserted into a subject's body 404. The ultrasound beam 406 can be reflected from a portion of the needle 402 so that the portion of the needle 402 can be imaged by processing the echo of the ultrasound beam 406 received at the surface 104a of the transducer element 104.
[0054] The needle path 408 can be defined as being parallel to the axis of the needle 402, and the first line 410 can be defined as being parallel to the surface 104a of the transducer element 104 of the ultrasound probe 106. At the intersection of the needle path 408 and the first line 410, a needle angle 412 can be defined. Additionally, a second line 414 can be defined as being parallel to the ultrasound beam 406, and a third line 416 can be defined as being perpendicular to the first line 410 (e.g., such that an angle 418 defined between the first line 410 and the third line 416 is 90°). At the intersection of the second line 414 and the third line 416, a steering angle 420 can be defined. Additionally, at the intersection of the needle path 408 and the second line 414, an angle 422 can be defined.
[0055] In order to optimally image the needle 402, the angle 422 should be as close to 90° as possible. Geometrically, to obtain a value of 90°, the needle angle 412 and the steering angle 420 must be equal. The needle angle 412 can be determined by
[0056]
[0057] Wherein the first point P1 and the second point P2 are located along the needle path 408, and the X and Y coordinates are defined relative to axes parallel to the first line 410 and the third line 416, respectively, such that P 1,X and P 2,X refers to the X component of P1 and P2 respectively, and P 1,Y and P 2,Y Refer to the Y components of P1 and P2 respectively. The steering angle 420 can then be adjusted to match the needle angle 412. In this way, the ultrasound beam can be set perpendicular to the needle by adjusting the steering angle to be equal to the angle between the surface of the ultrasound probe and the path of the needle.
[0058] Reference now Figure 5 , schematic diagram 500 depicts a first example of an image transformation 550 for an image 502 depicting a portion of a needle 504 in a target region 506. In some examples, image 502 may be imaged by an ultrasound imaging system, such as reference Figure 1 The described ultrasound imaging system implements a method for generating an image, such as according to reference Figure 2 and Figure 3The method described. As shown, one or more artifacts 508 may be present in a target area 506 around the needle 504. In some examples, the one or more artifacts 508 may be caused by colliding with the ultrasound probe (e.g., 106) or moving the needle 504 during imaging. The image transform 550 can be a transform such as a Radon transform, which is operable to detect linear structures in a 2D image. In some examples, each of the needle 504 and the one or more artifacts 508 can be identified by the image transform 550. In addition, the image transform 550 can distinguish the needle 504 as being clearer and / or brighter than the one or more artifacts 508. Therefore, the image transform 550 can generate an image 552 with the one or more artifacts 508 removed.
[0059] Reference now Figure 6 , schematic diagram 600 depicts a second example of an image transformation 650 for an image 602 depicting a portion of a needle 604 in a target region 606. In some examples, image 602 may be imaged by an ultrasound imaging system, such as reference Figure 1 The described ultrasound imaging system implements a method for generating an image, such as according to reference Figure 2 and Figure 3 As shown, needle 604 may appear dark, such that needle 604 may be difficult to distinguish from other structures depicted in image 602. Image transform 650 may be a transform such as a Radon transform, which is operable to detect linear structures in a 2D image. In some examples, needle 604 may be identified by image transform 650. Image transform 650 may further operate to change the color or brightness of needle 604. Thus, image transform 650 may generate image 652 in which needle 654 is depicted in a brighter color or with increased brightness compared to needle 604 depicted by image 602.
[0060] Reference now Figure 7 , schematic diagram 700 depicts an exemplary process 750 for generating a portion 754 of a needle 704. In some examples, image 702 may be imaged by an ultrasound imaging system, such as reference Figure 1 The described ultrasound imaging system implements a method for generating an image, such as according to reference Figure 2 and Figure 3 As shown, there may be a blind area 706 in the image 702 corresponding to an area not imaged by the ultrasound probe (e.g., 106). In the depicted example, the portion 754 of the needle 704 is not present in the image 702. However, the exemplary process 750 can project the portion 754 based on the known length of the needle 704 and thereby generate the portion 754 in the image 752.
[0061] Reference now Figure 8 , depicting a first exemplary user interface display 800 of a display device 802. In one example, the display device 802 may be Figure 1 The display device 118 shown. The first exemplary user interface display 800 may include an image 804 generated by ultrasound imaging data received by an ultrasound probe (e.g., 106). There may be a blind area 806 corresponding to an area not imaged by the ultrasound probe in the image 804. At the display device 802, the user can define a target area 810 in which the user expects the needle to be imaged. As shown, the target area 810 may include a plurality of selection areas (e.g., a first selection area 812 and a second selection area 814), which can be moved (e.g., "drag and drop") by the user via touch, mouse, keyboard, etc. Alternatively, the user can actuate an icon 820 operable to move the target area 810 upward, downward, left, and right. As shown, the target area 810 may at least partially include an area outside the image 804. In this way, the user can manipulate the target area at the display device to provide a prediction of where the needle will be imaged.
[0062] Reference now Fig. 9 , depicting a second exemplary user interface display 900 of a display device 902. In one example, the display device 902 may be Figure 1 The second exemplary user interface display 900 may include an image 904 generated by ultrasound imaging data received by an ultrasound probe (e.g., 106). There may be a blind area 906 in the image 904 corresponding to an area not imaged by the ultrasound probe. As shown, a needle 908 may be imaged in a target area 910. The target area 910 may have been defined by a user prior to imaging the needle 908, as described above with reference to FIG. Figure 8 As shown, the target area 910 may include multiple selection areas (e.g., a first selection area 912 and a second selection area 914) that can be moved (e.g., "drag and drop") by a user via touch, a mouse, a keyboard, etc. for further imaging. Alternatively, the user-actuable icon 920 is operable to move the target area 910 up, down, left, and right. As shown, the target area 910 may at least partially include an area outside of the image 904. In this way, the user can manipulate the target area at the display device to further image the needle even after the needle has been imaged.
[0063] In this way, the user can provide a target area for the needle, and the steering angle of the ultrasound beam can be automatically adjusted by the target area. In one example, an image depicting the needle can then be generated via the ultrasound imaging system and displayed to the user on a display device. The technical effect of adjusting the steering angle based on the target area provided by the user is to provide a more intuitive user interface for the user when the controller of the ultrasound imaging system performs geometric calculations. In some examples, one or more image transformations can be implemented in the memory of the controller to further refine the generated image of the needle. The technical effect of using such image transformations is that artifacts can be removed from the vicinity of the depicted needle, and / or the color of the depicted needle can be changed or brightened.
[0064] In one embodiment, a method includes receiving a target path or target area of a needle, and adjusting a steering angle of an ultrasonic beam emitted from an ultrasound probe based on the target path or target area. In a first example of the method, adjusting the steering angle of the ultrasonic beam based on the target path or target area includes: positioning the surface of the ultrasound probe, inferring the path of the needle based on the target path or target area, determining the needle angle between the path of the needle and the surface of the ultrasound probe, and in response to determining that the steering angle does not match the needle angle within a threshold, adjusting the steering angle toward the needle angle. In a second example of the method that optionally includes the first example, in response to receiving the target area of the needle, inferring the path of the needle based on the target area includes determining a puncture point of the needle, and projecting the path of the needle between the center of the target area and the puncture point. In a third example of the method that optionally includes one or more of the first and second examples, in response to receiving the target path of the needle, inferring the path of the needle based on the target path includes projecting the path of the needle along the target path. In a fourth example of the method that optionally includes one or more of the first to third examples, positioning the surface of the ultrasound probe includes receiving the position and orientation of the ultrasound probe, and positioning the surface of the ultrasound probe based on the position and orientation of the ultrasound probe. In a fifth example of the method, which optionally includes one or more of the first to fourth examples, determining that the steering angle does not match the needle angle includes the steering angle being outside a threshold angle of the needle angle.
[0065] In another embodiment, a system includes an ultrasound probe, a user interface configured to receive input from a user of the system, a display device, and a processor configured with instructions in a non-transitory memory that, when executed, cause the processor to: receive a user selection at the user interface; estimate a needle path based on the user selection; adjust a steering angle of an ultrasound beam of the ultrasound probe based on a position of the ultrasound probe and the needle path; receive first imaging data from the ultrasound probe; generate a first image based on the first imaging data, the first image depicting at least a portion of a needle inserted into a body; and display the first image at the display device. In a first example of the system, a user selects a target area including a path for the needle. In a second example of the system that optionally includes the first example, estimating the needle path based on the user selection includes determining an origin direction of the needle, determining a penetration depth of the needle based on the target area, and projecting the needle path based on the penetration depth and the origin direction. In a third example of the system that optionally includes one or more of the first and second examples, generating a first image based on the first imaging data includes receiving second imaging data from the ultrasound probe before inserting the needle into the body, generating a second image based on the second imaging data, and generating the first image based on the first imaging data and the second image. In a fourth example of the system optionally including one or more of the first to third examples, generating the first image based on the first imaging data and the second image includes generating another portion of the needle in the first image in an area where the needle is not shown in the first imaging data. In a fifth example of the system optionally including one or more of the first to fourth examples, generating the first image based on the first imaging data and the second image includes performing an image transformation on a target area in the first image. In a sixth example of the system optionally including one or more of the first to fifth examples, performing the image transformation includes removing one or more artifacts from the target area. In a seventh example of the system optionally including one or more of the first to sixth examples, performing the image transformation includes changing the color or brightness of the needle in the target area. In an eighth example of the system optionally including one or more of the first to seventh examples, the user selection includes one or more of a touch screen selection, a navigation request, or a voice command.
[0066] In yet another embodiment, a method includes: determining a path of a needle; performing a first adjustment of a steering angle of an ultrasound beam of an ultrasound probe based on a position of the ultrasound probe and the path of the needle; receiving imaging data from the ultrasound probe; generating an image based on the imaging data, the image including at least a portion of the needle inserted into the body; displaying the image at a display device; and in response to the position of the ultrasound probe being changed, performing a second adjustment of the steering angle based on the changed position of the ultrasound probe and the path of the needle; receiving updated imaging data from the ultrasound probe; updating the image based on the updated imaging data; and displaying the updated image at the display device. In a first example of the method, the method also includes generating a notification and displaying it at a display device in response to identifying that a nerve is within a threshold distance of the path of the needle. In a second example of the method that optionally includes the first example, the notification indicates that the path of the needle is within a threshold distance of the identified nerve. In a third example of the method that optionally includes one or more of the first and second examples, the notification requests a user to confirm the identified nerve. In a fourth example of the method, which optionally includes one or more of the first to third examples, the method further includes generating and displaying a notification at a display device in response to the changed position of the ultrasound probe being outside a detection range of the needle's path.
[0067] As used herein, the elements or steps listed in the singular and beginning with the word "one" or "a kind of" should be understood as not excluding a plurality of the elements or steps, unless such exclusion is explicitly stated. In addition, the reference to "an embodiment" of the present invention is not intended to be interpreted as excluding the existence of additional embodiments that also include the cited features. In addition, unless explicitly stated to the contrary, the embodiment of "including", "comprising" or "having" an element or multiple elements with a specific characteristic may include additional such elements without the characteristic. The terms "including" and "in..." are used as the concise language equivalents of the corresponding terms "including" and "wherein". In addition, the terms "first", "second" and "third" etc. are only used as marks, and are not intended to impose numerical requirements or specific positional order on their objects.
[0068] This written description uses examples to disclose the invention, including the best mode, and also to enable a person of ordinary skill in the relevant art to practice the invention, including making and using any devices or systems and performing any included methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to a person of ordinary skill in the art. Such other examples are intended to fall within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insignificant differences from the literal language of the claims.
Claims
1. A method, comprising: a target path or target area for receiving the needle; as well as adjusting a steering angle of an ultrasonic beam emitted from an ultrasonic probe based on the target path or the target area, wherein adjusting the steering angle comprises determining a needle angle between a path of the needle and a line parallel to a surface of the ultrasound probe, Wherein the target area of the needle is movable based on a user selection, and wherein the moving comprises moving at least a portion of the target area.
2. The method according to claim 1, wherein adjusting the steering angle of the ultrasonic beam based on the target path or the target area comprises: positioning a surface of the ultrasound probe; inferring the path of the needle based on the target path or the target area; as well as In response to determining that the steering angle does not match the needle angle within a threshold, the steering angle is adjusted toward the needle angle.
3. The method according to claim 2, wherein: In response to receiving the target area of the needle, inferring the path of the needle based on the target area includes: determining a puncture point of the needle; and The path of the needle is projected between the center of the target area and the puncture point.
4. The method according to claim 2, wherein: In response to receiving the target path of the needle, inferring the path of the needle based on the target path includes: The path of the needle is projected along the target path.
5. The method of claim 2, wherein positioning the surface of the ultrasound probe comprises: receiving a position and orientation of the ultrasound probe; and The surface of the ultrasound probe is positioned based on the position and the orientation of the ultrasound probe. 6 . The method of claim 2 , wherein determining that the steering angle does not match the needle angle comprises the steering angle being outside a threshold angle of the needle angle.
7. A system, comprising: Ultrasound probe; a user interface configured to receive input from a user of the system; Display devices; and A processor configured with instructions in a non-transitory memory, the instructions, when executed, causing the processor to: displaying a target area for the needle, the target area indicating an area where a user desires the needle to be imaged; receiving, at the user interface, a user selection to move the target area, the moving comprising moving at least a portion of the target area; estimating a needle path based on the user selection; adjusting a steering angle of an ultrasound beam of the ultrasound probe based on the position of the ultrasound probe and the path of the needle; receiving first imaging data from the ultrasound probe; generating a first image based on the first imaging data, the first image depicting at least a portion of the needle inserted into a body; and The first image is displayed at the display device.
8. The system of claim 7, wherein estimating the path of the needle based on the user selection comprises: determining the origin direction of the needle; determining a penetration depth of the needle based on the target area; as well as The path of the needle is projected based on the penetration depth and the origin direction.
9. The system of claim 7, wherein generating the first image based on the first imaging data comprises: receiving second imaging data from the ultrasound probe prior to inserting the needle into the body; generating a second image based on the second imaging data; as well as The first image is generated based on the first imaging data and the second image.
10. The system of claim 9, wherein generating the first image based on the first imaging data and the second image comprises: Another portion of the needle in the first image is generated in an area where the needle is not shown in the first imaging data.
11. The system of claim 9, wherein generating the first image based on the first imaging data and the second image comprises: An image transformation is performed on the target area in the first image.
12. The system of claim 11, wherein performing the image transformation comprises: One or more artifacts are removed from the target region.
13. The system of claim 11, wherein performing the image transformation comprises: The color or brightness of the needle is changed in the target area.
14. The system of claim 7, wherein the user selection comprises one or more of a touch screen selection, a navigation request, or a voice command.
15. A method comprising: displaying a target area for the needle, the target area indicating an area where a user desires the needle to be imaged; receiving a user selection to move the target area, the moving comprising moving at least a portion of the target area; Determine the needle path; performing a first adjustment of a steering angle of an ultrasound beam of the ultrasound probe based on the position of the ultrasound probe and the path of the needle; receiving imaging data from the ultrasound probe; generating an image based on the imaging data, the image including at least a portion of the needle inserted into a body; displaying the image at a display device; as well as In response to the position of the ultrasound probe being changed: performing a second adjustment of the steering angle based on the changed position of the ultrasound probe and the path of the needle; receiving updated imaging data from the ultrasound probe; updating the image based on the updated imaging data; as well as The updated image is displayed at the display device.
16. The method according to claim 15, further comprising: In response to identifying that a nerve is within a threshold distance of the path of the needle, a notification is generated and displayed at the display device.
17. The method of claim 16, wherein the notification indicates that the path of the needle is within the threshold distance of the identified nerve.
18. The method of claim 16, wherein the notification requests user confirmation of the identified nerve.
19. The method according to claim 15, further comprising: In response to the changed position of the ultrasound probe being outside of a detection range of the path of the needle, a notification is generated and displayed at the display device.
Citation Information
Patent Citations
Device and method for carrying out ultrasound scanning
CN101700187A
Ultrasonic imaging method and device
CN102920476A
Needle Enhancement in Diagnostic Ultrasound Imaging
US20140187942A1
Ultrasonic diagnostic device
US20160081666A1
Identifying Anatomical Structures
US20160183913A1
