Systems and methods for displaying ultrasound probe position using post-diastole 3D imaging

Abstract

A system and method for obtaining ultrasound images of an interior of a subject is provided, the system and method comprising: an image processing unit that receives and processes acquired ultrasound scan data to create ultrasound images derived from the ultrasound image data; a motion detection system configured to detect a pattern of inactive time frames within a movement cycle of the subject; and an ultrasound imaging probe operably connected to the image processing unit to acquire the ultrasound scan data for use by the image processing unit to form the ultrasound images. The motion detection system detects a pattern of one or more inactive time frames within a first movement cycle of the subject, acquires ultrasound volume scan data of the subject during the inactive time frames within a second movement cycle of the subject, and calibrates a position of a scan plane of the ultrasound images within the volume ultrasound images.

Description

Background Technology

[0001] This disclosure relates to ultrasound imaging, and more specifically to methods and systems for obtaining and providing a 3D navigation volume to identify the current 2D scan plane during a 2D scanning procedure.

[0002] Ultrasound imaging is a medical imaging technique used to image organs and soft tissues in the human body. Ultrasound imaging uses real-time, non-invasive high-frequency sound waves to produce a series of two-dimensional (2D) and / or three-dimensional (3D) images.

[0003] In various applications, the acquisition of one or more standard scanning planes and / or views can be performed to provide medical diagnosis. For example, transthoracic echocardiography may involve acquiring ultrasound images that include multiple standard views, such as a four-chamber (4CH) view, a two-chamber (2CH) view, an apicolateral long axis (APLAX) view, a parasternal long axis (PLAX) view, a parasternal short axis (PSAX) view, etc. To acquire the desired standard view, the ultrasound operator can manipulate the probe to an image acquisition position, such as in one of the suprasternal, apicolateral, parasternal, or subcostal windows relative to the heart. The ultrasound operator can manually rotate the probe to different rotational positions, such as between PLAX and PSAX views, and / or move the probe to different positions to acquire different standard views.

[0004] However, manual rotation of the ultrasound probe during probe positioning to obtain these views can cause it to unintentionally slip out of a specific window, making it difficult to obtain the desired ultrasound image / view. Reasons for this may include: the probe being rotated and / or moved to a position partially covering the patient's ribs, the similarity between adjacent views within a specific window (e.g., the similarity between different PSAX views), and / or due to the operator's lack of experience in determining the appropriate probe position for the necessary scanning plane to obtain the desired view. Therefore, in many cases, the actual 2D scanning plane may differ from the desired 2D scanning plane, resulting in images that do not show the structures needed for accurate diagnosis; for example, apical fluoroscopy narrowing when the probe is not aligned with the true apex of the left ventricle of the heart.

[0005] As an alternative to manually rotating and / or moving the ultrasound probe to individually acquire the ultrasound scan plane of the desired standard view, the ultrasound operator can acquire one or more full 3D ultrasound volumes of a region of interest (such as the heart). A standard observation plane can then be detected within the 3D volume and presented on a display system for analysis. Because the desired 2D scan plane can be selected relative to the 3D volume to obtain the desired image, proper probe positioning is not required within the 3D volume. Alternatively, the 3D volume can be used as a guide to instruct the operator on probe positioning to obtain the desired 2D image.

[0006] However, 3D ultrasound setup is more complex and time-consuming. Furthermore, the frame rate is typically much lower than in 2D or thin-plate ultrasound, resulting in a significantly lower physical resolution of the image plane. 3D ultrasound also records substantially more ultrasound data, much of which is not used to perform the necessary analyses.

[0007] Due to these drawbacks of both 2D and 3D ultrasound imaging, it is desirable to develop an ultrasound system and method that provides the operator with a navigation tool for proper positioning of the ultrasound probe, without requiring a full 3D ultrasound scan of the object of interest, such as the heart.

[0008] By comparing such systems with some aspects of this disclosure as set forth with reference to the accompanying drawings in the remainder of this application, further limitations and disadvantages of conventional and traditional methods will become apparent to those skilled in the art. Summary of the Invention

[0009] In one exemplary embodiment of the present invention, an ultrasound imaging system for obtaining ultrasound images of the interior of an object includes: an image processing unit configured to receive and process acquired ultrasound scan data to create an ultrasound image derived from the ultrasound image data, the image processing unit including a motion detection system configured to detect patterns of inactive time frames during a movement cycle of the object; a memory unit operatively connected to the image processing unit; a display operatively connected to the image processing unit to present the ultrasound image to a user; and an ultrasound imaging probe operatively connected to the image processing unit to acquire ultrasound scan data for use by the image processing unit to form an ultrasound image, wherein the motion detection system is configured to: detect patterns of one or more inactive time frames during a first movement cycle of the object; acquire ultrasound volumetric scan data of the object during inactive time frames during a second movement cycle of the object; and calibrate the position of the scanning plane of the ultrasound image within the volumetric ultrasound image.

[0010] In another exemplary embodiment of the present invention, a method for determining the position of a scanning plane of an ultrasound image of an object includes the following steps: providing an ultrasound imaging system comprising: an image processing unit configured to receive and process acquired ultrasound scan data to create an ultrasound image derived from the ultrasound image data, the image processing unit including a motion detection system configured to detect patterns of inactive time frames within a movement cycle of the object; a memory unit operatively connected to the image processing unit; a display operatively connected to the image processing unit to present the ultrasound image to a user; and an ultrasound imaging probe operatively connected to the image processing unit to acquire ultrasound scan data for image processing. The processing unit uses this to form an ultrasound image, wherein the motion detection system is configured to: detect patterns of one or more inactive time frames within a first movement cycle of the object; acquire ultrasound volumetric scan data of the object during inactive time frames within a second movement cycle of the object to form a volumetric ultrasound image of the object; and calibrate the position of the scanning plane of the ultrasound image within the volumetric ultrasound image; use a probe to acquire ultrasound scan data; determine the movement pattern of the object for the first movement cycle of the object; determine inactive time frames within the movement pattern of the object; acquire volumetric ultrasound scan data during inactive time frames within the second movement cycle of the object; generate a volumetric ultrasound image of the object based on the volumetric ultrasound scan data; and calibrate the position of the scanning plane of the ultrasound image within the volumetric ultrasound image.

[0011] In yet another exemplary embodiment of the method of the present invention, a method for determining the position of a scanning plane of a 2D ultrasound image of the heart includes the following steps: providing an ultrasound imaging system having: an image processing unit configured to receive and process acquired ultrasound scan data to create a 2D ultrasound image derived from the ultrasound image data, the image processing unit including a motion detection system configured to detect patterns of late diastolic time frames within the cardiac cycle of the heart; a memory unit operatively connected to the image processing unit; a display operatively connected to the image processing unit to present the 2D ultrasound image to a user; and an ultrasound imaging probe operatively connected to the image processing unit to acquire ultrasound scan data for use in... The image processing unit uses this to form a 2D ultrasound image, wherein the motion detection system is configured to: detect the pattern of the late diastolic timeframe within the first cardiac cycle of the heart; acquire ultrasound volumetric scan data of the heart during the late diastolic timeframe within the second cardiac cycle of the heart to form a 3D ultrasound image of the heart; and calibrate the position of the scanning plane of the 2D ultrasound image within the 3D ultrasound image; use a probe to acquire ultrasound scan data; determine the movement pattern of the heart for the first cardiac cycle of the heart; determine the late diastolic timeframe within the cardiac cycle of the heart; acquire volumetric ultrasound scan data during the late diastolic timeframe in the second cardiac cycle of the heart; generate a 3D ultrasound image of the heart based on the volumetric ultrasound scan data; and calibrate the position of the scanning plane of the 2D ultrasound image within the 3D ultrasound image.

[0012] It should be understood that the above brief description is provided to introduce selected concepts further described in the detailed embodiments in a simplified form. This is not intended to identify key or essential features of the claimed subject matter, the scope of which is uniquely defined by the claims following the detailed embodiments. Furthermore, the claimed subject matter is not limited to embodiments that address any shortcomings mentioned above or in any part of this disclosure. Attached Figure Description

[0013] Figure 1 This is a schematic diagram of an ultrasound imaging system according to an embodiment of the present disclosure.

[0014] Figure 2 This is a flowchart illustrating a method according to an exemplary embodiment of the present disclosure.

[0015] Figure 3 This is a schematic representation of a display showing a 3D ultrasound volumetric image, illustrating the detection location of the ultrasound probe in relation to the 2D ultrasound image obtained from the probe.

[0016] Figure 4This is a schematic diagram of the vector space of the left ventricular myocardium of the heart, formed by the registration of the A-4CH image and the PLAX image of the heart. Detailed Implementation

[0017] Certain implementations may exist in methods and systems for acquiring standard ultrasound scan planar views. These implementations offer the technical advantage of acquiring 3D images of the object scanned by the probe during periods of inactivity of the detected object, providing a 3D volumetric map representing the position of the ultrasound probe relative to the object for presentation on a display.

[0018] The foregoing summary of the invention and the following detailed description of certain embodiments will be better understood when read in conjunction with the accompanying drawings. For the purposes of the figures illustrating the functional blocks of various embodiments, these functional blocks do not necessarily represent a division between hardware circuits. Thus, for example, one or more functional blocks (e.g., a processor or memory) may be implemented in a single piece of hardware (e.g., a general-purpose signal processor or a block of random access memory, a hard disk, etc.) or in multiple pieces of hardware. Similarly, a program may be a standalone program, may be included as a subroutine in an operating system, may be a function in an installed software package, etc. It should be understood that the various embodiments are not limited to the arrangements and tools shown in the drawings. It should also be understood that embodiments may be combined, or other embodiments may be utilized, and structural, logical, and electrical changes may be made without departing from the scope of the various embodiments. Therefore, the following detailed description should not be considered limiting, and the scope of this disclosure is defined by the appended claims and their equivalents.

[0019] As used herein, elements or steps described in the singular and beginning with the word "a" or "an" should be understood to not exclude multiple said elements or steps, unless such exclusion is explicitly stated. Furthermore, references to "exemplary embodiments," "various embodiments," "certain embodiments," "representative embodiments," etc., are not intended to be construed as excluding the existence of additional embodiments that also incorporate the described features. Additionally, unless explicitly stated to the contrary, embodiments that "comprise," "include," or "have" one or more elements having a particular attribute may include additional elements that do not have that attribute.

[0020] Additionally, as used herein, the term "image" broadly refers to both a visual image and the data representing that image. However, many implementations generate (or are configured to generate) at least one visual image. Furthermore, as used herein, the phrase "image" is used to refer to ultrasound modes such as B-mode (2D mode), M-mode, three-dimensional (3D) mode, CF mode, PW Doppler, CW Doppler, MGD, and / or submodes of B-mode and / or CF such as shear wave elastography (SWEI), TVI, Angio, B-flow, BMI, BMI_Angio, and in some cases also MM, CM, TVD, where "image" and / or "plane" includes a single beam or multiple beams.

[0021] Furthermore, as used herein, the term processor or processing unit refers to any type of processing unit capable of performing the required computations required for various implementation schemes, such as single-core or multi-core: CPU, Accelerated Processing Unit (APU), graphics board, DSP, FPGA, ASIC, or combinations thereof.

[0022] It should be noted that the various embodiments of generating or forming images described herein may include processing for forming the image, which in some embodiments includes beamforming, while in others does not. For example, an image may be formed without beamforming, such as by multiplying a matrix of demodulated data by a coefficient matrix such that the product is an image, and wherein this process does not form any “beams.” Alternatively, image formation may be performed using a combination of channels that may originate from more than one transmission event (e.g., synthetic aperture technology).

[0023] In various implementations, for example, ultrasonic processing to form an image is performed in software, firmware, hardware, or a combination thereof, including ultrasonic beamforming, such as receive beamforming. Figure 1 This document illustrates a specific embodiment of an ultrasound system having a software beamformer architecture formed according to various embodiments, such as those examples disclosed in U.S. Patent Application Publication No. US2020 / 0289096 entitled “Method And System For Providing Standard Ultrasound Scan Plane Views Using Automatic Scan Acquisition Rotation And View Detection,” the entire contents of which are expressly incorporated herein by reference for all purposes.

[0024] Figure 1 This is a block diagram of an exemplary ultrasound system operable to acquire standard ultrasound scan planar views according to various implementation schemes. Reference Figure 1 The image shows an ultrasound system 100. The ultrasound system 100 includes a transmitter 102, an ultrasound probe 104, a transmit beamformer 110, a receiver 118, a receive beamformer 120, an A / D converter 122, an RF processor 124, an RF / IQ buffer 126, a user input module 130, a signal processor 132, an image buffer 136, a display system 134, a memory unit / file 138, and a training engine 160.

[0025] Transmitter 102 may include suitable logic components, circuitry, interfaces, and / or code operable to drive ultrasound probe 104. Ultrasound probe 104 may include a two-dimensional (2D) array of piezoelectric elements. Ultrasound probe 104 may include a set of transmitting transducer elements 106 and a set of receiving transducer elements 108 that generally constitute the same elements. In some embodiments, ultrasound probe 104 is operable to acquire ultrasound image data covering at least a majority of anatomical structures, such as the heart, blood vessels, or any suitable anatomical structure. Ultrasound probe 104 is operable to acquire ultrasound scan planes at different rotation and / or tilt angles without physically moving the ultrasound probe. In an exemplary embodiment, ultrasound probe 104 may include a one-dimensional transducer array that can be mechanically oriented in multiple orientations by a motor in response to instructions from signal processor 132. In a preferred embodiment, probe 104 includes a 2D array of ultrasound elements operable to electronically transmit ultrasound signals and acquire ultrasound data in any orientation in three-dimensional space, referred to as a four-dimensional (e4D) matrix probe. For example, the e4D ultrasound probe 104 may be a GE4Vc-D four-dimensional (4D) matrix cardiac probe. Processing of images acquired in any directional orientation can be performed partially or entirely via internal probe sub-aperture processing, via system-side software beamforming, or via beamforming in hardware. In exemplary embodiments, the acquired scanning plane is a 2D image and / or a plate image. For example, multi-line acquisition (MLA) can be used to acquire plate images, wherein multiple transmit beams are spatially arranged along the plane and multiple receive beams of each transmit beam are received orthogonally to the planar width of the transmit beams. In various embodiments, the thickness of the plate image may be 7 mm or less. Furthermore, the system 100 may use a process similar to that used for acquiring plate images to acquire 3D / volume ultrasound images of anatomical structures or objects.

[0026] The transmitting beamformer 110 may include suitable logic components, circuitry, interfaces, and / or code operable to control the transmitter 102, which drives the set of transmitting transducer elements 106 via the transmitting sub-aperture beamformer 114 to transmit ultrasonic signals to a region of interest (e.g., a person, animal, underground cavity, physical structure, etc.). The transmitted ultrasonic signals may be backscattered from structures (such as blood cells or tissue) within the object of interest to generate echoes. The echoes are received by the receiving transducer element 108.

[0027] The set of receiving transducer elements 108 in the ultrasonic probe 104 is operable to convert the received echo into an analog signal, perform sub-aperture beamforming via the receiving sub-aperture beamformer 116, and then transmit it to the receiver 118. The receiver 118 may include suitable logic components, circuitry, interfaces, and / or code operable to receive the signal from the receiving sub-aperture beamformer 116. The analog signal can be transmitted to one or more of a plurality of A / D converters 122.

[0028] Multiple A / D converters 122 may include suitable logic components, circuitry, interfaces, and / or code operable to convert analog signals from receiver 118 into corresponding digital signals. The multiple A / D converters 122 are disposed between receiver 118 and RF processor 124. However, this disclosure is not limited in this respect. Therefore, in some embodiments, multiple A / D converters 122 may be integrated within receiver 118.

[0029] RF processor 124 may include suitable logic components, circuitry, interfaces, and / or code operable to demodulate digital signals output from a plurality of A / D converters 122. According to one embodiment, RF processor 124 may include a multiplexer (not shown) operable to demodulate digital signals to form I / Q data pairs representing corresponding echo signals. The RF or I / Q signal data can then be transmitted to an RF / IQ buffer 126. RF / IQ buffer 126 may include suitable logic components, circuitry, interfaces, and / or code operable to provide temporary storage of the RF or I / Q signal data generated by RF processor 124.

[0030] The receiver beamformer 120 may include suitable logic components, circuitry, interfaces, and / or code operable to perform digital beamforming processing, such as summing a delayed channel signal received from the RF processor 124 via the RF / IQ buffer 126 and outputting a beam sum signal. The resulting processed information may be the beam sum signal output from the receiver beamformer 120 and transmitted to the signal processor 132 to generate an image and present it on the display system 134. According to some embodiments, the receiver 118, multiple A / D converters 122, the RF processor 124, and the beamformer 120 may be integrated into a single beamformer, which may be digital. In various embodiments, the ultrasound system 100 includes multiple receiver beamformers 120.

[0031] User input module 130 can be used to input patient data, scan parameters, settings, select protocols and / or templates, select one or more desired standard views, provide commands for storing the displayed scan planes, and so on. In an exemplary embodiment, user input module 130 is operable to configure, manage, and / or control the operation of one or more components and / or modules in ultrasound system 100. In this regard, user input module 130 is operable to configure, manage, and / or control the operation of transmitter 102, ultrasound probe 104, transmit beamformer 110, receiver 118, receive beamformer 120, RF processor 124, RF / IQ buffer 126, user input module 130, signal processor 132, image buffer 136, display system 134, and / or archive 138. User input module 130 may include buttons, rotary encoders, touchscreens, motion tracking, voice recognition, mouse devices, keyboards, cameras, and / or any other devices capable of receiving user commands. In some implementations, for example, one or more user input modules in user input module 130 may be integrated into other components (such as display system 134). As an example, user input module 130 may include a touchscreen display.

[0032] In various embodiments, a protocol and / or one or more desired standard views can be selected during or at the start of the imaging procedure in response to instructions received via user input module 130. For example, the ultrasound operator can identify a transthoracic echocardiogram acquired at the start of the imaging procedure using a top window protocol via user input module 130. Protocols may include multiple predefined standard views, such as a four-chamber (4CH) view, a two-chamber (2CH) view, a top long axis (APLAX) view, a parasternal long axis (PLAX) view, a parasternal short axis (PSAX) view, etc. The selected protocol can be provided to signal processor 132 via user input module 130, allowing signal processor 132 to apply view detection processing and acquire rotation and / or tilt parameters. The view detection processing applied by signal processor 132 automatically detects each standard view. Once the ultrasound probe 104 is properly positioned at the top window, acquisition rotation and / or tilt parameters can be applied by signal processor 132 to automatically rotate and / or tilt the scan plane to acquire each standard view.

[0033] Signal processor 132 may include suitable logic components, circuitry, interfaces, and / or code operable to process ultrasound scan data (i.e., summed IQ signals) to generate an ultrasound image for presentation on display system 134. Signal processor 132 is operable to perform one or more processing operations based on multiple selectable ultrasound modalities on the acquired ultrasound scan data. In exemplary embodiments, signal processor 132 may be used to perform display processing and / or control processing, etc. Acquired ultrasound scan data can be processed in real time during a scanning session as echo signals are received. Additionally or alternatively, ultrasound scan data may be temporarily stored in RF / IQ buffer 126 during a scanning session and processed in a less real-time manner during online or offline operation. In various embodiments, processed image data may be presented at display system 134 and / or stored at memory unit / file 138. The archive / storage unit 138 may be a local archive, picture archiving and communication system (PACS), or any suitable device for storing images, executable commands and functions of the image processing unit 132, and / or related information.

[0034] Now for reference Figure 1 and Figure 2 System 100 further includes a motion detection system 180, which may be formed as part of signal processor 132 or as a separate component of system 100 capable of accessing ultrasound scan data from probe 104. Figure 2In the illustrated exemplary embodiment of the operation method 200 of the motion detection system 180, the motion detection system 180 is capable of analyzing information about the imaged object, which is obtained directly from the imaging system 100 and / or from a separate medical sensing and / or diagnostic system, such as an electrocardiogram system 400 operatively connected to the processor 132 / motion detection system 180, or included as part of the motion detection system 180 for automatically detecting QRS complexes used to calculate the patient's heart rate, and then using known empirical formulas to estimate the timing of the late diastolic interval, so as to determine and / or estimate the inactive periods of the object based on the determined movement pattern of the object. To make such determination and / or estimation of the most inactive time frames within the movement cycle of the object imaged by the ultrasound imaging system 100, the motion detection system 180 may utilize various types of data about the object, including but not limited to electrocardiogram data and / or ultrasound scan data. In one exemplary embodiment, electrocardiogram data and / or ultrasound scan data are acquired in real time to determine the movement pattern of the object and whether the movement within the object being scanned has been paused in repeatable inactive time frames. The motion detection system 180 can perform this task in any of a variety of suitable methods, techniques, and / or processes, and in an exemplary embodiment, it is performed using one or more of pattern recognition algorithms, neural networks, machine learning, and / or artificial intelligence (AI) 190, which forms part of the motion detection system 180 and has executable functions / information stored on the image processor 132, in the memory unit 138, or in any other suitable location or in any other suitable manner for operating the AI ​​application 190.

[0035] In block 202 of an exemplary embodiment of method 200, system 180 / AI 190 first examines electrocardiogram (ECG) and / or ultrasound scan data and determines, based on the representation of various parts of the object in the ECG data (e.g., detected PR and / or ST segments of the ECG of the cardiac object, detected intervals between U and P waves) and / or ultrasound scan data (e.g., little or no movement of the object between consecutive / multiple 2D images generated by image processor 132), whether all or any relevant parts of the object being scanned have temporarily ceased moving. More specifically, system 180 / AI 190 analyzes the object movement data (e.g., ECG and / or ultrasound scan data) to determine any recurring patterns of time frames within a movement cycle in which the object moves minimally or not at all, e.g., remains stationary.

[0036] For example, when the object being scanned is a patient's heart, the image processor 132 provides 2D images based on ultrasound scan data of the moving heart, the motion corresponding to the cardiac cycle, i.e., the movement of the heart through the systolic and diastolic phases of the cardiac cycle. With ultrasound scan data of the cardiac cycle provided, the system 180 / AI 190 can examine the ultrasound scan data / 2D images to locate those 2D images in which the heart is not moving / only has minimal movement. These 2D images correspond to the resting phase of the cardiac cycle when the heart is inactive or only moving minimally, i.e., the portion of the cardiac cycle during the late diastolic phase of the imaging heart. This ultrasound scan data can be used by the system 180 / AI 190 alone, in combination with electrocardiogram data from an external or internal electrocardiogram system 400, or the determination can be made using only the electrocardiogram data.

[0037] Proceeding to box 204, system 180 / AI 190 can then use information provided by the electrocardiogram and / or image data to determine the approximate length of the window / time frame of inactivity of the detected object (e.g., when the heart is in late diastole). During this inactive time frame, the ultrasound scan data obtained by probe 104 is largely similar to the ultrasound scan data obtained immediately before and after the detected time frame. Therefore, the ultrasound scan data obtained via probe 104 during the detected inactive time frame can be readily omitted from any real-time 2D images provided by signal processor 132, as it closely repeats the ultrasound scan data / 2D images immediately before and after the inactive time frame.

[0038] Furthermore, in block 206, ultrasound scan data / 2D images immediately before and immediately after the inactive timeframe can be stitched together and / or interpolated by system 180 / AI 190 to provide a seamless appearance to the 2D image generated by signal processor 132 from the ultrasound scan data and presented on display system 134 without any significant loss of temporal resolution in the displayed 2D image. In an exemplary embodiment, system 180 / AI 190 may stitch together or interpolate scan data of ultrasound images immediately before and immediately after the inactive timeframe to create an inactive timeframe ultrasound image for presentation on display system 134 during the inactive timeframe.

[0039] After determining the inactive timeframe, and after or simultaneously with stitching ultrasound scan data / images immediately before and immediately after the inactive timeframe, in box 208, system 180 / AI 190 continues to operate probe 104 during the inactive timeframe to obtain 3D volume / image 300 of the object being scanned. Figure 3 In an exemplary implementation of its operation, system 180 / AI 190 may determine inactive time frames in a first number of movement cycles (e.g., a first cardiac cycle) of an object, and may operate probe 104 to obtain 3D volume 300 during inactive time frames in a second or any subsequent movement cycle of the object.

[0040] After acquisition, system 180 / AI 190 continues to use the 3D / volume ultrasound scan data acquired during the inactive time frame in box 210 to generate the 3D volume 300 of the object. Figure 3 (This is indicated by the symbol ). In an alternative implementation, the 3D volume 300 is presented on the display system 134, but can also remain within the system 180 / AI 190.

[0041] Since the 3D volume 300 corresponds to the object being scanned, in block 212, system 180 / AI 190 can calibrate and / or determine the position of the scanning plane 302 of the ultrasound image 304 within the 3D volume. Using this calibration, system 180 / AI 190 can present the 3D volume 300 on display system 134, where the representation of the actual scanning plane 302 is currently obtained by the position of probe 104 relative to the 3D volume 300, and any modifications resulting from the current operating scanning parameters, settings, protocols, and / or templates used with probe 104.

[0042] like Figure 3 As shown, in an optional step of box 214, a representation 302 of the scanning plane on the 3D volume 300, such as a line or plane running through the 3D volume 300, may be presented on the display 134 to provide the operator with a visual indication / representation of the scanning plane 302 in association with the real-time 2D image 304 presented on the display system 134. The 3D volume 300 and the scanning plane representation 302 thus enable the operator to position the displayed 2D image 304 in real time relative to the object / 3D volume being scanned, giving the operator a visual indication of the desired scanning plane of the current scanning plane representation 302 relative to a standard view (which may optionally be represented on the 3D volume 300 using a separate scanning plane indicator 306), or a visual indication of necessary adjustments to the position of the probe 104 relative to the object / 3D volume 300 to reduce or eliminate perspective distortion in the displayed 2D image 304.

[0043] The operation of system 180 / AI application 190 in boxes 208-214 can be repeated during continuous cycles / during inactive time frames within continuous cycles to update the representation of the current scan plane representation 302 on display system 134 relative to the 3D volume 300 and any desired scan plane indicator 306, so as to provide the operator with guidance on the movement of probe 104 toward the position used to obtain the desired standard view of the object.

[0044] Additionally, as a 3D volume 300 is generated during inactive time frames, ultrasound scan data and scan planes from multiple 2D acquisitions / images 304 of an object (e.g., a heart) obtained at the top, beside the sternum, and in any other view window can be precisely calibrated about their relative positions with respect to each other using the known positions of the scan plane representation 302 of each 2D image 304 relative to one or more of the acquired 3D volumes 300. Thus, the correlation between the scan plane representation 302 / 2D image 304 and the 3D volume 300 enables the transformation of ultrasound scan data from multiple views / 2D images 304 (and optionally combined with the 3D volume 300) into a single shared vector space (not shown), which includes combined scan data from the calibrated 2D images 304 to describe the size and motion of the scanned object, which in an exemplary embodiment is a heart. This vector space is a representation of the object (i.e., the heart) as a series of vectors describing the object's edges and other important features in a common 3D coordinate system. Edges and features are extracted and combined from multiple 2D images corresponding to multiple views of the object, thus the vector space summarizes all known information about the object. In an alternative implementation of system 180 / AI application 190 and its operation, where the 3D volume 300 is not presented on display 134, the 3D volume in all implementations is stored in conjunction with the 2D image 304, and for subsequent measurements of the object, the stored 3D volume 300 can be used to align the current 2D image / ultrasound sector 304 with other / subsequent 2D images 304 / ultrasound sectors of the object obtained using probe 104 positioned at different locations, orientations, and / or angles relative to the object.

[0045] For example, refer to Figure 4The diagram illustrates a vector space 401 representing the left ventricular myocardium, created using an acquired 3D volume 300 of the left ventricular myocardium based on the alignment of an apical long axis (APLAX) ultrasound image / sector 402 and a parasternal long axis (PLAX) ultrasound image / sector 403. The 3D volume 300 is acquired during an inactive period determined for the subject (i.e., the late diastolic phase of the heart) during the imaging procedure used to acquire images 402 and 403. By aligning / registering the 3D volumes 300 acquired at different image angles / positions during the respective late diastolic phases, APLAX images 402 and PLAX images 403 can be aligned with each other in 3D space using the aligned 3D volumes 300. Figure 4 In this context, the alignment of views 402 and 403 results in the creation of a vector space representation 401 of the left ventricular myocardium. From this vector space 401, various measurements of the object represented by the vector space representation 401 can be obtained, such as thickness measurements 404, rather than from one of the individual ultrasound images / sectors 402 or 403, which can lead to more accurate measurement results.

[0046] This written description uses examples to disclose the invention, including the best mode, and also enables those skilled in the art to practice the invention, including making and using any device or system and performing any included methods. The scope of the invention is defined by the claims and may include other examples that would occur to those skilled in the art. Such other examples are intended to fall within the scope of the claims if they have structural elements that are not indistinguishable from the literal language of the claims, or if they include equivalent structural elements that have minor differences from the literal language of the claims.

Claims

1. An ultrasound imaging system for obtaining ultrasound images of the interior of an object, the ultrasound imaging system comprising: - An image processing unit configured to receive and process acquired ultrasound scan data to create a 2D ultrasound image, the image processing unit including a motion detection system configured to detect patterns of inactivity time frames within a movement cycle of the object by locating the 2D ultrasound image generated from ultrasound scan data in which the object is not moving. - A memory unit, operatively connected to the image processing unit; - A display operatively connected to the image processing unit to present the ultrasound image to a user; - An ultrasound imaging probe, operatively connected to the image processing unit to acquire ultrasound scan data for use by the image processing unit to form the 2D ultrasound image and obtain volumetric ultrasound scan data. The motion detection system is configured as follows: Detect the pattern of one or more inactive time frames within the first movement cycle of the object; The probe is operated to acquire volumetric ultrasound scan data of the object during one or more inactive time frames within a second movement cycle of the object, the second movement cycle corresponding to a pattern of one or more inactive time frames detected within a first movement cycle of the object; A volumetric ultrasound image is generated based on the volumetric ultrasound scan data obtained during one or more inactive time frames in the second movement cycle; as well as The position of the scanning plane of the 2D ultrasound image within the calibration volume ultrasound image.

2. The ultrasound imaging system according to claim 1, wherein the motion detection system includes pattern recognition artificial intelligence.

3. The ultrasound imaging system of claim 1, wherein the motion detection system is configured to stitch together a 2D ultrasound image immediately preceding the one or more inactive time frames with a 2D ultrasound image immediately following the one or more inactive time frames, or to interpolate scan data of the 2D ultrasound image immediately preceding the one or more inactive time frames with scan data of the 2D ultrasound image immediately following the one or more inactive time frames to create an inactive time frame 2D ultrasound image.

4. The ultrasound imaging system of claim 1, wherein the volumetric ultrasound image is presented on the display in association with a representation of the 2D ultrasound image within the volumetric ultrasound image.

5. The ultrasound imaging system of claim 4, wherein the representation of the 2D ultrasound image is a representation of the scanning plane of the 2D ultrasound image.

6. The ultrasound imaging system of claim 5, further comprising a representation of the desired scan view within the volumetric ultrasound image.

7. The ultrasound imaging system of claim 1, wherein the motion detection system is configured to update the position of the scanning plane of the 2D ultrasound image within the volumetric ultrasound image during subsequent inactivity time frames within a subsequent movement cycle of the object.

8. The ultrasound imaging system of claim 1, wherein the motion detection system is configured to combine ultrasound scan data from a plurality of 2D ultrasound images calibrated with the volumetric ultrasound image into a shared vector space representation of the object.

9. The ultrasound imaging system of claim 1, wherein the volumetric ultrasound image is presented on the display in association with a representation of the scanning plane of the 2D ultrasound image and a representation of the desired scanning plane to prevent perspective shrinkage in the 2D ultrasound image.

10. A method for determining the position of a scanning plane in an ultrasound image of an object, the method comprising the steps of: - Provide an ultrasound imaging system, the ultrasound imaging system comprising: - An image processing unit configured to receive and process acquired ultrasound scan data to create a 2D ultrasound image, the image processing unit including a motion detection system configured to detect patterns of inactive time frames within a movement cycle of the object; - A memory unit, operatively connected to the image processing unit; - A display operatively connected to the image processing unit to present the 2D ultrasound image to a user; - An ultrasound imaging probe operatively connected to the image processing unit to acquire ultrasound scan data for use by the image processing unit to form the 2D ultrasound image, wherein the motion detection system is configured to: detect a pattern of one or more inactive time frames within a first movement cycle of the object by locating a 2D ultrasound image generated from ultrasound scan data of the object when it is not moving; operate the probe to acquire volumetric ultrasound scan data of the object during the one or more inactive time frames within a second movement cycle of the object to form a volumetric ultrasound image of the object, the second movement cycle corresponding to the pattern of one or more inactive time frames detected within the first movement cycle of the object; - Use the probe to obtain 2D ultrasound scan data; - Determine the movement pattern of the object based on the first movement cycle of the object; - Determine one or more inactive time frames within the movement pattern of the object; - Volumetric ultrasound scan data are obtained using the probe during the one or more inactive time frames in the second movement cycle of the object; - Generate a volumetric ultrasound image of the object based on the volumetric ultrasound scan data; and - The position of the scanning plane of the 2D ultrasound image within the volumetric ultrasound image is calibrated.

11. The method according to claim 10, further comprising the step of: - After calibrating the position of the scanning plane of the 2D ultrasound image within the volumetric ultrasound image, the volumetric ultrasound image is displayed on the monitor; and - A representation of the location of the scanning plane of the 2D ultrasound image within the volumetric ultrasound image.

12. The method of claim 11, further comprising the step of: The representation shows the location of the desired scanning plane within the volumetric ultrasound image.

13. The method according to claim 11, further comprising the following step: - Stitch together the 2D ultrasound image immediately preceding the one or more inactive time frames with the 2D ultrasound image immediately following the one or more inactive time frames; or - Interpolate the scan data of the 2D ultrasound image immediately preceding the one or more inactive time frames with the scan data of the 2D ultrasound image immediately following the one or more inactive time frames to create an inactive time frame ultrasound image.

14. The method of claim 11, further comprising the step of: The position of the scanning plane of the 2D ultrasound image within the volumetric ultrasound image is updated during subsequent inactive time frames within a subsequent movement cycle of the object.

15. The method according to claim 11, further comprising the step of: Ultrasound scan data from multiple 2D ultrasound images, calibrated using the volumetric ultrasound image, are combined into a shared vector space representation of the object.

16. A method for determining the position of a scanning plane in a 2D ultrasound image of the heart, the method comprising the steps of: - Provide an ultrasound imaging system, the ultrasound imaging system comprising: - An image processing unit configured to receive and process acquired ultrasound scan data to create 2D ultrasound images, the image processing unit including a motion detection system configured to detect patterns of late diastolic time frames within the cardiac cycle of the heart; - A memory unit, operatively connected to the image processing unit; - A display operatively connected to the image processing unit to present the 2D ultrasound image to a user; - An ultrasound imaging probe operatively connected to the image processing unit to acquire ultrasound scan data for use by the image processing unit to form the 2D ultrasound image and acquire volumetric ultrasound scan data to form a 3D ultrasound image, wherein the motion detection system is configured to: detect a pattern of late diastolic timeframes within a first cardiac cycle of the heart by locating a 2D ultrasound image generated from ultrasound scan data of the heart when it is not moving; operate the probe to acquire volumetric ultrasound scan data of the heart during the late diastolic timeframe within a second cardiac cycle of the heart to form a 3D ultrasound image of the heart, the second cardiac cycle corresponding to the pattern of the late diastolic timeframe detected within the first cardiac cycle of the heart; - Use the probe to obtain 2D ultrasound scan data; - Determine the heart's movement pattern for the first cardiac cycle of the heart; - Determine the late diastolic time frame within the movement pattern of the first cardiac cycle of the heart; - During the second cardiac cycle of the heart, volumetric ultrasound scan data are obtained using the probe during a defined late diastolic time frame; - Generate a 3D ultrasound image of the heart based on the volumetric ultrasound scan data; and - The position of the scanning plane of the 2D ultrasound image within the 3D ultrasound image is calibrated.

17. The method of claim 16, further comprising the step of: - After calibrating the position of the scanning plane of the 2D ultrasound image within the 3D ultrasound image, the 3D ultrasound image is displayed on the monitor; as well as - A representation of the position of the scanning plane of the 2D ultrasound image within the 3D ultrasound image.

18. The method of claim 16, further comprising the step of: The desired scanning plane is represented to eliminate perspective distortion within the 3D ultrasound image.

19. The method of claim 16, further comprising the step of: The position of the scanning plane of the 2D ultrasound image within the 3D ultrasound image is updated during subsequent late diastolic time frames within subsequent cardiac cycles of the heart.

Images