Configuring protocol-based ultrasound imaging data systems and methods

Abstract

Techniques for acquiring and configuring ultrasound sweep imaging data are disclosed. An ultrasound imaging protocol is identified for acquisition of ultrasound imaging data, the ultrasound imaging protocol including at least one sweep. A sweep direction of an ultrasound probe for the at least one sweep is configured based on a user characteristic, such as a user input or preference. The ultrasound imaging data is acquired via the ultrasound probe according to the identified ultrasound imaging protocol and the configured sweep direction. The acquired ultrasound imaging data is configured for further processing based at least in part on the identified ultrasound imaging protocol and the configured sweep direction, such as further processing using an artificial intelligence model.

Description

[0001] CONFIGURING PROTOCOL-BASED ULTRASOUND IMAGING DATA SYSTEMS AND METHODS

[0002] TECHNICAL FIELD

[0003]

[0001] The present disclosure relates to acquiring and configuring medical imaging data. For example, embodiments relate to acquiring and configuring ultrasound imaging data based on one or more protocols, such as configuring sweep acquisition data based on user characteristics.

[0004] BACKGROUND

[0005]

[0002] Various medical imaging modalities can be used for clinical analysis and medical intervention, as well as visual representation of the function of organs and tissues, such as magnetic resonance imaging (MRI), ultrasound (US), or computed tomography (CT). Implementations of medical imaging modalities may use one or more protocols, such as imaging protocols for acquiring ultrasound images using sweeps. A sweep can refer to acquiring multiple image frames at different physical locations during continuous or substantially continuous movement of the location of the imaging plane (e.g., by physically moving the transducer and / or electronic beamforming). Sweeps may be acquired according to a pattern or grid. Imaging protocols can be used, for example, to evaluate a fetus using an ultrasound imaging system.

[0006] SUMMARY

[0007]

[0003] Apparatuses, systems, and methods for acquiring and configuring protocol-based ultrasound imaging data are disclosed. In some implementations, the disclosed technology can be used to configure ultrasound imaging protocols or ultrasound imaging data acquired using one or more protocols based on a user characteristic. The user characteristic can be a user input or a user preference specifying a direction of a sweep. For example, instead of following a rigid protocol for a sweep acquisition, which may specify certain directions (e.g., left-right, up-down) of sweeps, the disclosed technology can determine the direction of the sweeps based on the user characteristic and / or using sensor data. Using the disclosed technology, the user can provide an input specifying the direction of one or more sweeps, and the resulting ultrasound imaging data can be configured based on the user input. In some implementations, configuring the ultrasound imaging data can include flipping one or more images or reversing a sequence of ultrasound images.

[0008]

[0004] In accordance with at least one example disclosed herein, an ultrasound imaging system is disclosed. The ultrasound imaging system comprises an ultrasound probe configured to acquire ultrasound imaging data and at least one processor in communication with the ultrasound probe. The at least one processor is configured to identify an ultrasound imaging protocol for acquisition of the ultrasound imaging data, the ultrasound imaging protocol comprising at least one sweep. A sweep direction of the ultrasound probe for the at least one sweep is configured based on a user characteristic. The user characteristic can be a user input or a user preference. The ultrasound imaging data is acquired using the ultrasound probe according to the identified ultrasound imaging protocol and the configured sweep direction. The acquired ultrasound imaging data is configured for further processing based at least in part on the identified ultrasound imaging protocol and the configured sweep direction. The further processing can include, for example, determining a fetal measurement or a fetal health characteristic of a fetus represented in the configured ultrasound imaging data.

[0009]

[0005] In some embodiments, a user input is received after acquisition of the ultrasound imaging data, the user input indicating an actual sweep direction of the at least one sweep.

[0010]

[0006] In some implementations, the further processing of the configured ultrasound imaging data is performed, the further processing comprising applying at least one artificial intelligence model to analyze the configured ultrasound imaging data.

[0011]

[0007] In some implementations, inertial measurement unit (IMU) data is received for the acquired ultrasound imaging data, and the acquired ultrasound imaging data is evaluated based on the IMU data and the configured sweep direction.

[0012]

[0008] In some implementations, a probe orientation or probe placement is determined, which can comprise an angle of the probe. In these and other implementations, an actual sweep direction can be determined using at least accelerometer data.

[0009] In accordance with at least one example disclosed herein, a non-transitory computer- readable medium is disclosed carrying instructions that, when executed, cause a processor to execute operations to perform at least one method disclosed herein.

[0013]

[0010] In accordance with at least one example disclosed herein, methods are disclosed herein using at least a portion of an ultrasound imaging system disclosed herein.

[0014] BRIEF DESCRIPTION OF THE DRAWINGS

[0015] [Oil] FIG. 1 is a block diagram of an ultrasound imaging system arranged in accordance with principles of the present disclosure.

[0016]

[0012] FIG. 2 is a diagram illustrating an ultrasound imaging protocol in accordance with principles of the present disclosure.

[0017]

[0013] FIG. 3 is a block diagram illustrating a workflow in accordance with principles of the present disclosure.

[0018]

[0014] FIG. 4 is a flow diagram illustrating a process for acquiring and configuring ultrasound imaging data in accordance with principles of the present disclosure.

[0019] DESCRIPTION

[0020]

[0015] The following description of certain examples is illustrative in nature and is in no way intended to limit the disclosed technology or its applications or uses. In the following detailed description of examples of the present apparatuses, systems, and methods, reference is made to the accompanying drawings, which form a part hereof, and in which are shown by way of illustration specific examples in which the described apparatuses, systems, and methods may be practiced. These examples are described in sufficient detail to enable those skilled in the art to practice the presently disclosed apparatuses, systems, and methods, and it is to be understood that other examples may be utilized and that structural and logical changes can be made without departing from the spirit and scope of the present disclosure. Moreover, for the purpose of clarity, detailed descriptions of certain features will not be discussed when they would be apparent to those with skill in the art, so as not to obscure the description of the present technology. The following detailed description is therefore not to be taken in a limiting sense, and the scope of the present technology is defined only by the appended claims.

[0021]

[0016] Users of medical imaging systems, such as ultrasound imaging systems, face technical challenges related to acquiring images using protocols. For example, ultrasound imaging data can be acquired (e.g., by a novice user) by moving an ultrasound probe according to a predetermined grid (termed “blind sweeps”) or according to another protocol. In other examples, a user can perform guided sweeps, in which the user follows guidance provided via a device or system to reach a position or orientation for capturing a specific view. These examples are in contrast to freehand sweeps that can be performed by a trained user, during which the user can move the transducer as needed to localize anatomical structures of interest. Protocol-based image acquisition is useful, for example, in resource- constrained settings or in environments where experienced or trained users of ultrasound imaging systems may not be available. Additionally, protocol-based image acquisition can be useful for acquiring ultrasound imaging data for further processing by one or more artificial intelligence (Al) models or other analysis algorithms. For example, a novice user can acquire ultrasound imaging data using blind sweeps, and the acquired data can be processed using an Al model or an analysis algorithm to determine health characteristics of a subject.

[0022]

[0017] But existing systems may rely on rigid protocols, such as sweep-based protocols that require the ultrasound probe to be carefully maneuvered along one or more predetermined paths in a specific direction, using a predetermined orientation of the probe, or the like. Moreover, differences in protocols can result in confusion and user error. For example, while some protocols may require sweeps that are performed from left to right (e.g., relative to the direction that the user or subject is facing), other protocols may require sweeps that are performed from right to left. Failure to follow these rigid protocols may result in unusable data or erroneous analysis of resulting data. For example, using existing systems a fetal head on the left side of a subject can erroneously be interpreted as being on the right side of the subject when blind sweeps are performed in the wrong direction (e.g., from left to right when the blind sweep protocol specifies right to left), or a breech presentation of a fetus can be interpreted as a cephalic presentation when sweeps are performed from top (superior) to bottom (inferior) when the blind sweep protocol specifies bottom (inferior) to top (superior). Similar errors may occur when the probe is oriented in an unexpected way (e. g. , rotated -180 degrees).

[0023]

[0018] The present disclosure describes systems and related methods for acquiring and configuring medical imaging data, such as for configuring ultrasound imaging data acquired using sweeps according to user characteristics. As used herein, a “sweep” or “sweep acquisition” can refer to one or more operations for using an ultrasound transducer or probe to acquire imaging data, which may be according to a protocol, such as an operation for acquiring imaging data by moving the transducer or probe along one or more paths relative to an anatomy of a subject. In some examples, a sweep acquisition can follow a grid or other pattern. The disclosed technology can configure a sweep direction or other sweep characteristic based on one or more user characteristics, such as a user input or user preference. For example, for an identified ultrasound imaging protocol, the disclosed technology can determine a sweep direction based on a user input specifying a preferred or actual direction of probe movement. Ultrasound imaging data can then be acquired according to the identified ultrasound imaging protocol and the determined sweep direction, and the acquired ultrasound imaging data can be configured for further processing based on the identified ultrasound imaging protocol and the determined sweep direction. For example, whereas an existing sweep protocol may specify a left-to-right sweep direction, the disclosed technology allows a user to instead choose a right-to-left sweep direction or switch between different sweep directions, and the resulting data can be configured based on the user’s chosen sweep direction. Configuring the resulting data can include flipping one or more images, reversing an image sequence, or combinations thereof. The configured data can then be provided to an artificial intelligence model or other analysis algorithm for further processing (e.g., determination of fetal health characteristics, identifying of anatomy of interest, performance of measurements).

[0024]

[0019] In some implementations, inertial measurement unit (IMU) data can be captured or received and used to analyze acquired or configured ultrasound imaging data. In some instances, the IMU may be attached to or included in the ultrasound probe. An IMU can comprise, for example, an accelerometer, a magnetometer, a gyroscope, and / or an electromagnetic localization sensor used to capture the IMU data. The IMU data can be evaluated to determine an actual direction of one or more sweeps and / or a probe orientation, and the evaluation can be used to configure the ultrasound imaging data or receive confirmation of sweep direction. For example, before image acquisition the user can specify a preferred direction for sweeps, and IMU data (e.g., accelerometer data) captured during image acquisition can be compared to evaluate whether the actual direction of the sweeps matches the preferred direction. Additionally or alternatively, IMU data can be used to determine a probe position and / or orientation, which can include a probe angle. In some implementations, the evaluation can be provided to the user, so that the user can confirm that the correct sweep direction was used. Additionally or alternatively, the evaluation can be provided to the user so that one or more sweeps can be repeated (e.g., if the evaluation shows that the user performed a sweep in the wrong direction or with an incorrect probe orientation).

[0020] Advantages of the disclosed technology can include improving analyses of medical imaging data using blind sweep protocols or other protocols or sweeps. For example, the disclosed technology can reduce errors in the analysis of ultrasound imaging data because the ultrasound imaging data can be properly configured for further processing based on the actual direction of sweeps. Additionally, the disclosed technology can provide greater flexibility by allowing ultrasound imaging data to be configured based on user preferences or other user characteristics instead of relying on rigid protocols. For example, sweep directions can vary based on whether a user is right handed or left handed. While examples are described herein related to obstetric ultrasound screening, it will be appreciated that the disclosed technology can be applied to other medical imaging implementations (e.g., general imaging, vascular imaging, etc.). For example, the disclosed technology can provide an improved process for imaging of other anatomical structures, such as structures in a gastrointestinal (GI) tract of a subject. Additionally, while examples herein relate to evaluating imaging data acquired using blind sweep protocols, it will be appreciated that the disclosed technology can be applied to other imaging protocols and / or other uses of medical imaging systems. Other examples of using protocols may include performing protocolized 3D and / or 4D acquisitions.

[0025]

[0021] FIG. 1 is a block diagram of an ultrasound imaging system 100 arranged in accordance with principles of the present disclosure. In the ultrasound imaging system 100 of FIG. 1, an ultrasound probe 112 includes a transducer array 114 for transmitting ultrasonic waves and receiving echo information. The transducer array 114 can be implemented as a linear array, convex array, a phased array, and / or a combination thereof. The transducer array 114, for example, can include a two-dimensional array (as shown) of transducer elements capable of scanning in both elevation and azimuth dimensions for 2D and / or 3D imaging. The transducer array 114 can be coupled to a microbeamformer 116 in the probe 112, which controls transmission and reception of signals by the transducer elements in the array. In this example, the microbeamformer 116 is coupled by the probe cable to a transmit / receive (T / R) switch 118, which switches between transmission and reception and protects the main beamformer 122 from high-energy transmit signals. In some embodiments, the T / R switch 118 and other elements in the system can be included in the ultrasound probe 112 rather than in a separate ultrasound system base. In some embodiments, the ultrasound probe 112 may be coupled to the ultrasound imaging system via a wireless connection (e.g., WiFi, Bluetooth).

[0026]

[0022] The transmission of ultrasonic beams from the transducer array 114 under control of the microbeamformer 116 is directed by the transmit controller 120 coupled to the T / R switch 118 and the beamformer 122, which receives input from the user’s operation of the user interface (e.g., control panel, touch screen, console) 125. The user interface 125 may include soft and / or hard controls. One of the functions controlled by the transmit controller 120 is the direction in which beams are steered. Beams may be steered straight ahead from (orthogonal to) the transducer array 114, or at different angles for a wider field of view. The partially beamformed signals produced by the microbeamformer 116 are coupled via channels 115 to a main beamformer 122 where partially beamformed signals from individual patches of transducer elements are combined into a fully beamformed signal. In some embodiments, microbeamformer 116 is omitted and the transducer array 114 is coupled via channels 115 to the beamformer 122. In some embodiments, the system 100 can be configured (e.g., include a sufficient number of channels 115 and have a transmit / receive controller programmed to drive the transducer array 114) to acquire ultrasound data responsive to a plane wave or diverging beams of ultrasound transmitted toward the subject. In some embodiments, the number of channels 115 from the ultrasound probe may be less than the number of transducer elements of the transducer array 114 and the system can be operable to acquire ultrasound data packaged into a smaller number of channels than the number of transducer elements.

[0027]

[0023] The beamformed signals are coupled to a signal processor 126. The signal processor 126 can process the received echo signals in various ways, such as bandpass filtering, decimation, I and Q component separation, and / or harmonic signal separation. The signal processor 126 can also perform additional signal enhancement such as speckle reduction, signal compounding, and noise elimination. The processed signals are coupled to a B-mode processor 128, which can employ amplitude detection for the imaging of structures in the body. The signals produced by the B-mode processor 128 are coupled to a scan converter 130 and a multiplanar reformatter 132. The scan converter 130 arranges the echo signals in the spatial relationship from which they were received in a desired image format. For instance, the scan converter 130 can arrange the echo signal into a two-dimensional (2D) sector-shaped format, or a pyramidal three-dimensional (3D) image. The multiplanar reformatter 132 can convert echoes, which are received from points in a common plane in a volumetric region of the body into an ultrasonic image of that plane, as described in U.S. Pat. No. 6,443,896 (Detmer).

[0028]

[0024] A volume Tenderer 134 converts the echo signals of a 3D data set into a projected 3D image as viewed from a given reference point, e.g., as described in U.S. Pat. No. 6,530,885 (Entrekin et al.). In some implementations, the system 100 can additionally or alternatively be configured to perform 3D and / or 4D acquisitions, such as protocolized 3D / 4D acquisitions. The 2D or 3D images can be coupled from the scan converter 130, multiplanar reformatter 132, and volume Tenderer 134 to at least one processor 137 for further image processing operations. For example, the at least one processor 137 can include an image processor 136 configured to perform further enhancement and / or buffering and temporary storage of imaging data for display on an image display 138. The display 138 can include a display device implemented using a variety of display technologies, such as LCD, LED, OLED, or plasma display technology. The at least one processor 137 can include a graphics processor 140, which can generate graphic overlays for display with the ultrasound images. These graphic overlays can contain, e.g., standard identifying information such as patient name, date and time of the image, imaging parameters, and the like. For these purposes the graphics processor 140 receives input from the user interface 125, such as a typed patient name. The user interface 125 can also be coupled to the multip lanar reformatter 132 for selection and control of a display of multiple multiplanar reformatted (MPR) images.

[0025] The user interface 125 can include one or more mechanical controls, such as buttons, dials, a trackball, a physical keyboard, and others, which may also be referred to herein as hard controls. Alternatively or additionally, the user interface 125 can include one or more soft controls, such as buttons, menus, soft keyboard, and other user interface control elements implemented for example using touch-sensitive technology (e.g., resistive, capacitive, or optical touch screens). One or more of the user controls can be co-located on a control panel 124. For example one or more of the mechanical controls can be provided on a console and / or one or more soft controls can be co-located on a touch screen, which can be attached to or integral with the console. The display 138 and the user interface 125 can be included in an I / O component, via which outputs are provided by the system 100 and / or inputs are received by the system 100.

[0029]

[0026] In some implementations, the user interface 125 can receive inputs and provide outputs of the disclosed system. For example, the user interface 125 can receive a user input specifying a preferred or actual direction of a sweep, and the user interface 125 can provide an output indicating results of evaluation of IMU data (e.g., whether sweeps were performed in the correct / expected direction or determined probe orientation). In some implementations the one or more outputs of the system can be provided via one or more graphical user interfaces (e.g., via the display 138).

[0027] The at least one processor 137 (e.g., the image processor 136, the graphics processor 140, or a different processor) can perform functions associated with acquiring and configuring medical imaging data, as described herein. For example, the at least one processor 137 can identify imaging protocols, configure sweep direction based on user characteristics, receive acquired imaging data, configure the acquired imaging data based on an imaging protocol and the configured sweep direction, evaluate IMU data, and so forth.

[0030]

[0028] Although described as separate processors, it will be understood that the functionality of any of the processors described herein can be implemented in a single processor (e.g., a CPU or GPU implementing the functionality of processor 137) or fewer number of processors than described in this example. In some embodiments, the at least one processor 137 can be hardware-based (e.g., include multiple layers of interconnected nodes implemented in hardware). In some embodiments, the at least one processor 137 can be implemented at other processing stages, e.g., prior to the processing performed by the image processor 136, volume Tenderer 134, multiplanar reformatter 132, and / or scan converter 130. In some embodiments, the at least one processor 137 can be implemented to process ultrasound data in the channel domain, beamspace domain (e.g., before or after beamformer 122), the IQ domain (e.g., before, after, or in conjunction with signal processor 126), and / or the k-space domain. As described, in some embodiments, functionality of two or more of the processing components (e.g., beamformer 122, signal processor 126, B-mode processor 128, scan converter 130, multiplanar reformatter 132, volume Tenderer 134, at least one processor 137, image processor 136, graphics processor 140, etc.) can be combined into a single processing unit and / or divided between multiple processing units. The processing units can be implemented in software, hardware, or a combination thereof. For example, the at least one processor 137 can include one or more graphical processing units (GPU). In another example, beamformer 122 can include an application specific integrated circuit (ASIC).

[0031]

[0029] The at least one processor 137 can be coupled to one or more computer-readable media (e.g., memory 142) included in the system 100, which can be non-transitory. The one or more computer-readable media can carry instructions and / or a computer program that, when executed, cause the at least one processor 137 to perform operations described herein. A computer program can be stored / distributed on any suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, and can also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Furthermore, embodiments can take the form of a computer program product accessible from a computer-readable medium providing program code for use by or in connection with a computer or any device or system that executes instructions. For the purposes of this disclosure, a computer-readable medium can generally be any tangible apparatus that can contain, store, communicate, propagate, and / or transport the program for use by or in connection with the instruction execution device. The computer- readable medium can be, for example, without limitation, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, and / or a propagation medium. Nonlimiting examples of a computer readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk, and / or an optical disk. Optical disks can include compact disk read only memory (CD-ROM), compact disk-read / write (CD-R / W), and / or DVD.

[0032]

[0030] The ultrasound probe 112 can include or be coupled to an inertial measurement unit (IMU) 113. The IMU 113 can comprise one or more sensors to capture IMU data associated with acquisitions performed using the ultrasound probe 112. Sensors included in the IMU 113 can include one or more of an accelerometer, a magnetometer, a gyroscope, and / or an electromagnetic localization sensor. Data captured via the IMU 113 can be stored in the memory 142 and / or evaluated (e.g., using the at least one processor 137) to perform one or more calibration operations and / or to determine a probe direction, a probe orientation, and / or other characteristics. IMU data and / or analyses performed using the IMU data can be outputted by the ultrasound imaging system (e.g., via user interface 125), and ultrasound imaging data captured using the ultrasound imaging system 100 can be configured using IMU data and / or evaluations of IMU data captured using the IMU 113.

[0031] FIG. 2 is a diagram illustrating an ultrasound imaging protocol 200 in accordance with principles of the present disclosure. The ultrasound imaging protocol 200 can be performed using the system 100 of FIG. 1 to acquire ultrasound imaging data. The ultrasound imaging protocol 200 can be performed using an ultrasound probe 210 (e.g., 112 of FIG. 1) in contact with an anatomy 225 of a subject, which can be an abdomen of a person. The protocol 200 comprises a first set of sweeps 215 having a substantially vertical orientation relative to the anatomy 225, which are illustrated as being performed from inferior (bottom) to superior (top). The protocol 200 further comprises a second set of sweeps 220 having a substantially horizontal orientation relative to the anatomy 225, which are illustrated as being performed from left to right. The first set of sweeps 215 and the second set of sweeps 220 can further specify or be associated with an orientation of the ultrasound probe 210 (e.g., an angle or direction of the ultrasound probe 210 relative to the anatomy 225 and / or the sweeps).

[0033]

[0032] As discussed herein, existing protocol-based technologies may be rigid in that the ultrasound imaging protocol 200 must be performed strictly in accordance with a predetermined direction and orientation of the ultrasound probe 210 relative to the first set of sweeps 215 and the second set of sweeps 220, and any deviation from this strict performance may result in erroneous or unusable ultrasound imaging data. By contrast, the disclosed technology allows a sweep direction of one or more of the first set of sweeps 215 or the second set of sweeps 220 to be configured based on a user characteristic. For example, in the illustrated embodiment a user can specify via a user input that the first set of sweeps 215 will be performed from inferior (bottom) to superior (top), rather than having a predetermined sweep direction. Based on the user-specified sweep direction, resulting ultrasound imaging data can be properly configured for further processing.

[0034]

[0033] The disclosed technology can be used to modify existing imaging protocols or modify data based on existing protocols. For example, an existing imaging protocol may specify that the first set of sweeps 215 must be performed from superior (top) to inferior (bottom), but the disclosed technology allows the sweep direction to be reversed based on the user characteristic, and the resulting data is reconfigured to be useable in view of the reversal of the sweep direction (e.g., by flipping an image or reversing an image sequence). In some implementations, the disclosed technology can determine that the sweep direction specified by the existing imaging protocol is the same as the user-specified sweep direction, in which case no reconfiguration of the resulting data is needed. In some implementations, the ultrasound imaging protocol 200 does not have predetermined or preset sweep directions, and the disclosed technology is applied to define or determine the sweep directions and configure the resulting ultrasound imaging data accordingly.

[0035]

[0034] FIG. 3 is a block diagram illustrating a workflow 300 in accordance with principles of the present disclosure. The workflow 300 can be performed using the ultrasound imaging system 100 of FIG. 1 and for performing the protocol 200 of FIG. 2.

[0036]

[0035] The workflow 300 begins at operation 310, where ultrasound imaging data is acquired or received via an ultrasound probe. The ultrasound imaging data received at operation 310 includes a set of sweeps (e.g., 215 and 220 of FIG. 2) having one or more characteristics, which includes a sweep direction. Other characteristics can include a probe orientation, position, or direction (e.g., angle, position relative to subject anatomy or user). In some implementations, the ultrasound imaging data received at operation 310 includes IMU data (e.g., received via 113 of FIG. 1).

[0037]

[0036] The workflow 300 proceeds to operation 320, where pre-processing logic is applied using the ultrasound imaging data received at operation 310, one or more user characteristics, and / or one or more analysis algorithm requirements. For example, operation 320 can include receiving a user input or determining a user preference (e.g., based on user history or a user profile), which can specify a preferred or actual direction of one or more sweeps represented in the ultrasound imaging data received at operation 310. In other words, applying the preprocessing logic can include determining a sweep direction (e.g., an actual or a preferred sweep direction) based on a user characteristic and / or based on IMU data. Additionally, operation 320 can include determining one or more analysis algorithm requirements for an analysis algorithm (e.g., based on an existing imaging protocol) that will be applied to the ultrasound imaging data received at operation 310. For example, the analysis algorithm requirements can specify expected sweep directions for an existing protocol and / or the analysis algorithm.

[0038]

[0037] The workflow 300 proceeds to operation 330, where one or more user confirmations can be received. For example, a confirmation received at operation 330 can indicate that an actual sweep direction in the ultrasound imaging data received at operation 310 matches a preferred or determined sweep direction identified at operation 320. In some implementations, the user confirmation at operation 330 can use or be based on IMU data received at operation 310. For example, an actual sweep direction can be determined based on the IMU data, and the actual sweep direction can be compared to a user-specified sweep direction to determine whether the actual sweep direction matches the user-specified sweep direction. In some implementations, operation 330 can include receiving an indication whether or not an actual sweep direction and a user-specified sweep direction do not match. In some implementations, the operation 330 can be optional.

[0039]

[0038] The workflow 300 proceeds to operation 340, where the ultrasound imaging data received at operation 310 is configured (e.g., pre-processed) for further processing. Configuring the ultrasound imaging data can include flipping an image or reversing an image sequence. For example, at operation 320 it can be determined that a user-specified sweep direction does not match a sweep direction specified by an existing protocol and / or an analysis algorithm requirement. Accordingly, it can be determined at operation 340 that the resulting data for the respective sweep should be reconfigured (e.g., flipped or reversed) before the data is provided to an analysis algorithm. For example, the order of a series of images may be reversed such that the last image acquired will become the first image in the sequence and the first image acquired will become the last image in the sequence. In some examples, individual image frames can be flipped (e.g., mirrored horizontally) when it is determined that probe marker orientation does not match an analysis algorithm requirement - that is, when the ultrasound probe is rotated by -180 degrees, as compared to its expected position or orientation. In some examples, image frames in a sequence of images can be reversed when an actual and / or preferred (e.g., user-specified) sweep direction is reversed, as compared to an expected sweep direction of an analysis algorithm or an existing protocol.

[0039] In embodiments where IMU signals are used, in the event the IMU signals indicate an actual sweep direction and / or probe orientation and a user-specified sweep direction and / or probe orientation do not match, the system may alert the user the sweep should be repeated. Additionally or alternatively, when the IMU signals indicate a mismatch at operation 330, the system may seek confirmation from the user as to the user’s chosen characteristic. Alternatively, the system may automatically perform the pre-processing based on the IMU data and ignore the user’s input characteristic.

[0040]

[0040] The workflow 300 proceeds to operation 350, where the data configured at operation 340 is provided to an analysis algorithm (e.g., an artificial intelligence model) for further processing. The further processing can include, for example, performing a measurement, determining a fetal health characteristic, identifying an anatomy of interest, or the like. Advantageously, the disclosed technology can configure the data for analysis by the analysis algorithm, even if the data has been acquired in a way that deviates from an expected protocol and / or an expected acquisition technique for the analysis algorithm.

[0041]

[0041] It will be appreciated that the workflow 300 can be performed in a different order and / or one or more operations of the workflow 300 can be repeated while maintaining a similar functionality. For example, user preferences and / or user characteristics identified at operation 320 can be determined before ultrasound imaging data is acquired or received at operation 310. Additionally or alternatively, identifying user preferences or characteristics can be optional, and the ultrasound imaging data can instead be configured based on IMU data, the evaluation of which can optionally be confirmed at operation 330 - that is, the data can be configured based on actual sweep characteristics determined after the fact instead of based on user characteristics determined before acquisition.

[0042]

[0042] FIG. 4 is a flow diagram illustrating a process 400 for acquiring and configuring ultrasound imaging data in accordance with principles of the present disclosure. The process 400 can be performed using the system 100 of FIG. 1, according to the protocol 200 of FIG. 2, and / or according to the workflow 300 of FIG. 3.

[0043]

[0043] The process 400 begins at block 410, where an ultrasound imaging protocol is identified for acquisition of ultrasound imaging data. For example, the ultrasound imaging protocol can comprise a predetermined set of sweeps to be performed using an ultrasound probe to acquire the ultrasound imaging data. The predetermined set of sweeps can have various characteristics, such as an orientation and direction of the ultrasound probe relative to an anatomy of a subject. The ultrasound imaging protocol can correspond to a set of requirements for an analysis algorithm and / or artificial intelligence model for analysis of the ultrasound imaging data. For example, the identified ultrasound imaging protocol can specify a grid or pattern of sweeps to be performed, which corresponds to a configuration of data for analysis by the analysis algorithm and / or artificial intelligence model. In some implementations, the ultrasound imaging protocol does not have a preset or predetermined direction for one or more sweeps, and the process 400 is used to define the sweep direction and configure the resulting data.

[0044]

[0044] The process 400 proceeds to block 420, where a sweep direction of a sweep in the identified ultrasound imaging protocol is configured based on a user characteristic. The user characteristic can comprise a user input or a user preference. For example, a user can provide an input specifying a preferred direction of the sweep. Additionally or alternatively, the user characteristic can be determined automatically or retrieved from a user profile. In some implementations, a preferred sweep direction can be determined based on prior interactions of a user, such as a user history indicating that a user performs sweeps in a given direction beyond a threshold frequency (e.g., more than 50%, more than 90%). Configuring the sweep direction allows for configuration, modification, or reconfiguration of the ultrasound imaging protocol identified at block 410. For example, the identified ultrasound imaging protocol may specify left-to-right sweeps, but the sweep direction can be reversed based on the user characteristic. In some implementations, the operations at block 420 can be repeated to configure multiple sweep directions (e.g., a first sweep direction for vertical sweeps and a second sweep direction for horizontal sweeps).

[0045]

[0045] The process 400 proceeds to block 430, where the ultrasound imaging data is acquired using the ultrasound probe according to the identified imaging protocol and the configured sweep direction. In other words, a set of sweeps can be acquired, including a sweep according to the configured sweep direction, whether or not the configured sweep direction is specified in the identified ultrasound imaging protocol and / or corresponding analysis algorithm requirements or expectations.

[0046]

[0046] The process 400 proceeds to block 440, where the acquired ultrasound imaging data is configured for further processing based at least in part on the identified ultrasound imaging protocol and the configured sweep direction. For example, if the configured sweep direction varies from a sweep direction specified in the identified ultrasound imaging protocol or corresponding analysis algorithm requirements or expectations, at least a portion of the acquired ultrasound imaging data can be modified by flipping one or more images or reversing an order of a set of images. The configuring of the acquired ultrasound imaging data ensures that the data is suitable for further processing, based on expected or required characteristics of data to be processed according to an analysis algorithm and / or artificial intelligence model. In other words, the analysis algorithm or artificial intelligence model may typically require that ultrasound imaging data be acquired according to a rigid protocol. Accordingly, to account for the sweep direction configured at block 420, the acquired ultrasound imaging data may need to be modified before further processing is performed.

[0047]

[0047] Operations performed at block 440 can include comparing actual or preferred sweep directions to expected sweep directions and / or comparing actual probe orientation to expected probe orientation. These and other operations can be based on the sweep direction configured at block 420, an actual sweep direction (e.g., based on IMU data), and / or a determined probe position or orientation (e.g., based on IMU data and a position of a probe marker). Based on the comparison(s) performed at block 440, the ultrasound imaging data acquired at block 430 can be configured in various ways, such as flipping one or more image frames horizontally or vertically and / or changing an order of a sequence of image frames.

[0048]

[0048] In some implementations, the process 400 includes performing the further processing of the configured ultrasound imaging data, which can include applying an artificial intelligence model to analyze the configured ultrasound imaging data. That is, after the data has been properly configured for the further processing at block 440, the further processing can then be performed. Examples of further processing include determining a fetal health characteristic of a fetus represented in the configured ultrasound imaging data, taking a measurement, identifying an anatomy of interest, or the like.

[0049]

[0049] In some implementations, the process 400 includes receiving a user input after acquisition of the ultrasound imaging data to indicate an actual sweep direction of the sweep and / or an actual probe orientation or position. This operation can be performed in addition to or as an alternative to operations performed at block 420. For example, rather than specifying a sweep direction before acquisition, a user can instead acquire the ultrasound imaging data and indicate or confirm after the fact the actual sweep direction. Alternatively, the user can specify the sweep direction before acquisition and subsequently indicate after the acquisition the actual sweep direction (e.g., to confirm that the correct sweep direction was applied).

[0050]

[0050] In some implementations, the process 400 includes receiving inertial measurement unit (IMU) data for the acquired ultrasound imaging data and evaluating the acquired ultrasound imaging data based on the IMU data and the configured sweep direction. For example, accelerometer data and / or other IMU data can be evaluated to determine an actual sweep direction, and the actual sweep direction can be compared to the configured sweep direction to confirm that the configured sweep direction was used. In some implementations, the results of the evaluation of the IMU data can be provided to the user (e.g., via a graphical user interface) to confirm that the configured sweep direction was used and / or that the results of the evaluation of the IMU data are correct.

[0051]

[0051] Evaluation of IMU data can be based on calibration of an ultrasound imaging system. For example, a one-time or periodic calibration can be performed using an accelerometer or other sensor to determine a baseline direction (e.g., for axial / sagittal or vertical / horizontal direction) of a maternal body of a subject (or bed / couch) following a defined protocol, and the IMU data can be compared to the baseline direction to determine position or direction of an ultrasound probe. For example, for any vertical or horizontal sweep, the disclosed technology can capture current accelerometer data, and the current accelerometer data (e.g., in the elevation direction) can be used to identify any erroneous movement against the baseline. In some implementations, the IMU data is used to determine orientation and linear acceleration of the ultrasound probe (e.g., based on a probe marker of the ultrasound probe).

[0052]

[0052] Operations can be added to and / or removed from the process 400 while maintaining a similar functionality, and one or more operations of the process 400 can be repeated and / or performed in parallel. Operations of the process 400 can be performed automatically and / or responsive to one or more user interactions. One or more operations of the process 400 can be performed in real time (e.g., in seconds or less), such as for configuring acquired ultrasound imaging data during an examination of a subject.

[0053]

[0053] Advantageously, systems and related methods disclosed herein can provide flexibility in the acquisition of ultrasound imaging data while still producing data that is useable by analysis algorithms and / or artificial intelligence models. For example, ultrasound imaging data can be configured based on user preferences and / or actual user behaviors, even where the acquisition of the ultrasound imaging data does not strictly follow an existing ultrasound imaging protocol.

[0054]

[0054] In various examples where components, systems and / or methods are implemented using a programmable device, such as a computer-based system or programmable logic, it should be appreciated that the above-described systems and methods can be implemented using any of various known or later developed programming languages, such as “Python”, “C”, “C++”, “FORTRAN”, “Pascal”, “VHDL” and the like. Accordingly, various storage media, such as magnetic computer disks, optical disks, electronic memories and the like, can be prepared that can contain information that can direct a device, such as a computer, to implement the above-described systems and / or methods. Once an appropriate device has access to the information and programs contained on the storage media, the storage media can provide the information and programs to the device, thus enabling the device to perform functions of the systems and / or methods described herein. For example, if a computer disk containing appropriate materials, such as a source file, an object file, an executable file or the like, were provided to a computer, the computer could receive the information, appropriately configure itself and perform the functions of the various systems and methods outlined in the diagrams and flowcharts above to implement the various functions. That is, the computer could receive various portions of information from the disk relating to different elements of the above-described systems and / or methods, implement the individual systems and / or methods and coordinate the functions of the individual systems and / or methods described above.

[0055]

[0055] In view of this disclosure it is noted that the various methods and devices described herein can be implemented in hardware, software, and / or firmware. Further, the various methods and parameters are included by way of example only and not in any limiting sense. In view of this disclosure, those of ordinary skill in the art can implement the present teachings in determining their own techniques and needed equipment to affect these techniques, while remaining within the scope of the invention. The functionality of one or more of the processors described herein may be incorporated into a fewer number or a single processing unit (e.g., a CPU) and may be implemented using application specific integrated circuits (ASICs) or general-purpose processing circuits which are programmed responsive to executable instructions to perform the functions described herein.

[0056]

[0056] Although the present system may have been described with particular reference to an ultrasound imaging system, it is also envisioned that the present system can be extended to other medical imaging systems where one or more images are obtained in a systematic manner. Accordingly, the present system may be used to obtain and / or record image information related to, but not limited to renal, testicular, breast, ovarian, uterine, thyroid, hepatic, lung, musculoskeletal, splenic, cardiac, arterial and vascular systems, as well as other imaging applications related to ultrasound-guided interventions. Further, the present system may also include one or more programs which may be used with conventional imaging systems so that they may provide features and advantages of the present system. Certain additional advantages and features of this disclosure may be apparent to those skilled in the art upon studying the disclosure, or may be experienced by persons employing the novel system and method of the present disclosure. Another advantage of the present systems and method may be that conventional medical image systems can be easily upgraded to incorporate the features and advantages of the present systems, devices, and methods.

[0057] Of course, it is to be appreciated that any one of the examples, examples or processes described herein may be combined with one or more other examples, examples and / or processes or be separated and / or performed amongst separate devices or device portions in accordance with the present systems, devices and methods.

[0057]

[0058] Finally, the above-discussion is intended to be merely illustrative of the present systems and methods and should not be construed as limiting the appended claims to any particular example or group of examples. Thus, while the present system has been described in particular detail with reference to exemplary examples, it should also be appreciated that numerous modifications and alternative examples may be devised by those having ordinary skill in the art without departing from the broader and intended spirit and scope of the present systems and methods as set forth in the claims that follow. Accordingly, the specification and drawings are to be regarded in an illustrative manner and are not intended to limit the scope of the appended claims.

Claims

CLAIMSWhat is claimed is:

1. An ultrasound imaging system comprising: an ultrasound probe configured to acquire ultrasound imaging data; and at least one processor in communication with the ultrasound probe, the at least one processor configured to: identify an ultrasound imaging protocol for acquisition of the ultrasound imaging data, wherein the ultrasound imaging protocol comprises at least one sweep; configure, for the at least one sweep in the ultrasound imaging protocol, a sweep direction of the ultrasound probe based on a user characteristic; acquire, using the ultrasound probe, the ultrasound imaging data according to the identified ultrasound imaging protocol and the configured sweep direction; and configure the acquired ultrasound imaging data for further processing based at least in part on the identified ultrasound imaging protocol and the configured sweep direction.

2. The ultrasound imaging system of claim 1, wherein the at least one processor is further configured to: receive, after acquisition of the ultrasound imaging data, a user input indicating an actual sweep direction of the at least one sweep.

3. The ultrasound imaging system of claim 1, wherein the at least one processor is further configured to:perform the further processing of the configured ultrasound imaging data, wherein the further processing comprises applying at least one analysis algorithm or artificial intelligence model to analyze the configured ultrasound imaging data.

4. The ultrasound imaging system of claim 1 , wherein the further processing comprises determining a fetal measurement or a fetal health characteristic of a fetus represented in the configured ultrasound imaging data or evaluating an anatomical structure.

5. The ultrasound imaging system of claim 1, wherein the processor is further configured to: receive inertial measurement unit (IMU) data for the acquired ultrasound imaging data; and evaluate the acquired ultrasound imaging data based on the IMU data and the configured sweep direction.

6. The ultrasound imaging system of claim 1, wherein configuring the acquired ultrasound imaging data comprises at least one of flipping an image or reversing an image sequence.

7. The ultrasound imaging system of claim 1, wherein the user characteristic comprises a user input or a user preference.

8. A computer-implemented method of acquiring ultrasound sweep imaging data, the method comprising: identifying an ultrasound imaging protocol for acquisition of ultrasound imaging data, wherein the ultrasound imaging protocol comprises at least one sweep;configuring, for the at least one sweep in the ultrasound imaging protocol, a sweep direction of an ultrasound probe based on a user characteristic; acquiring, via the ultrasound probe, the ultrasound imaging data according to the identified ultrasound imaging protocol and the configured sweep direction; and configuring the acquired ultrasound imaging data for further processing based at least in part on the identified ultrasound imaging protocol and the configured sweep direction.

9. The computer-implemented method of claim 8 further comprising: receiving, after acquisition of the ultrasound imaging data, a user input indicating an actual sweep direction of the at least one sweep.

10. The computer-implemented method of claim 8 further comprising: performing the further processing of the configured ultrasound imaging data, wherein the further processing comprises applying at least one analysis algorithm or artificial intelligence model to analyze the configured ultrasound imaging data.

11. The computer-implemented method of claim 8, wherein the further processing comprises determining a fetal measurement or a fetal health characteristic of a fetus represented in the configured ultrasound imaging data or evaluating an anatomical structure.

12. The computer-implemented method of claim 8 further comprising: receiving inertial measurement unit (IMU) data for the acquired ultrasound imaging data; andevaluating the acquired ultrasound imaging data based on the IMU data and the configured sweep direction.

13. The computer-implemented method of claim 8, wherein configuring the acquired ultrasound imaging data comprises at least one of flipping an image or reversing an image sequence.

14. The computer-implemented method of claim 8, wherein the user characteristic comprises a user input or a user preference.

15. At least one non-transitory computer-readable medium carrying instructions that, when executed by a computing system, cause the computing system to: identify an ultrasound imaging protocol for acquisition of ultrasound imaging data, wherein the ultrasound imaging protocol comprises at least one sweep; configure, for the at least one sweep in the ultrasound imaging protocol, a sweep direction of an ultrasound probe based on a user characteristic; acquire, via the ultrasound probe, the ultrasound imaging data according to the identified ultrasound imaging protocol and the configured sweep direction; and configure the acquired ultrasound imaging data for further processing based at least in part on the identified ultrasound imaging protocol and the configured sweep direction.

16. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the computing system to: receive, after acquisition of the ultrasound imaging data, a user input indicating an actual sweep direction of the at least one sweep.

17. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the computing system to: perform the further processing of the configured ultrasound imaging data, wherein the further processing comprises applying at least one analysis algorithm or artificial intelligence model to analyze the configured ultrasound imaging data.

18. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the computing system to: receive inertial measurement unit (IMU) data for the acquired ultrasound imaging data; and evaluate the acquired ultrasound imaging data based on the IMU data and the configured sweep direction.

19. The non-transitory computer-readable medium of claim 15, wherein configuring the acquired ultrasound imaging data comprises at least one of flipping an image or reversing an image sequence.

20. The non-transitory computer-readable medium of claim 15, wherein the user characteristic comprises a user input or a user preference.

21. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the computing system to: determine a probe orientation or probe placement, wherein the probe orientation or probe placement comprises an angle; and determine an actual sweep direction based at least in part on accelerometer data.

Images