Systems and methods for real-time automatic tracking of a minimum hiatal size plane of an ultrasound volume during a pelvic floor muscle exam

Abstract

Systems and methods for real-time automatic tracking of a minimum hiatal size plane of an ultrasound volume during a pelvic floor exam are provided. The method includes acquiring an ultrasound volume of an anatomical region over a period of time. The method includes extracting an A-plane from the ultrasound volume and displaying the A-plane. The method includes receiving an OmniView (OV) line overlaid on the A-plane. The method includes rendering an OV plane based on a position and trajectory of the OV line and displaying the OV plane. The method includes automatically identifying key points in a region of interest in the A-plane. The method includes automatically tracking the key points in the region of interest in the A-plane over the period of time to automatically adjust the position and trajectory of the OV line, the OV plane is automatically updated over the period of time based on the adjustments made to the position and trajectory of the OV line.

Description

Technical Field

[0001] Some implementations involve ultrasound imaging. More specifically, some implementations involve methods and systems for automatically tracking the minimum aperture size plane of an ultrasound volume in real time during pelvic floor muscle examination. Background Technology

[0002] Ultrasound imaging is a medical imaging technique used to image organs and soft tissues in the human body. Ultrasound imaging uses real-time, non-invasive high-frequency sound waves to produce a range of two-dimensional (2D), three-dimensional (3D), and / or four-dimensional (4D) images.

[0003] Ultrasonic volume acquisition is typically described in three planes: the A-plane, the B-plane, and the C-plane. The A-plane is parallel to the acquisition plane. The B-plane is also parallel to the acquisition plane but perpendicular to the A-plane. The C-plane, also known as the coronal plane, comprises layers of two-dimensional slices parallel to the transducer surface and at various depths from the transducer surface (i.e., perpendicular to the ultrasound beam).

[0004] Pelvic floor muscle ultrasound can be used to evaluate the structural integrity of the levator ani muscle, assess the possibility of pelvic organ prolapse, and / or evaluate the appropriateness of pelvic floor muscle function and strength. Pelvic floor muscle examination is essential for assessing the integrity of the pelvic muscles and determining any preventative and / or corrective measures, including surgical intervention. During a pelvic floor muscle examination, the ultrasound operator may perform 4D ultrasound acquisition (i.e., 3D image acquisition over time) while the patient performs various muscle movements. The ultrasound system can present the A-plane, and the ultrasound operator can locate the OmniView line (OV line) or drawing frame overlaid on the A-plane. The OV line or drawing frame defines the location to be drawn within the 3D ultrasound volume as the OV plane (i.e., a minimum hiatus size view corresponding to the levator hiatus). The OV plane can roughly correspond to the C-plane. For example, the ultrasound system can draw the OV plane from a layer 1 to 2 cm below the OV line, or it can draw the OV plane based on image data defined by the drawing frame. During a pelvic floor muscle ultrasound examination, the ultrasound system can display the A plane and OV plane corresponding to the OV line or drawing frame in the split screen.

[0005] During pelvic floor muscle examination, the ultrasound operator continuously monitors dynamic images to assess the correctness of movement and the integrity and function of muscle structures. However, even when the probe remains stationary, the OV plane corresponding to the static position of the OV line or drawing frame does not consistently present the correct visual plane due to muscle relaxation (valsalva phase) and contraction (contraction phase). Therefore, after acquisition, the operator or other medical professional performs offline analysis to select frames acquired at maximum volume (e.g., corresponding to maximum valsalva or maximum contraction) and reposition the OV line or drawing frame to obtain a drawing of the OV plane with the smallest opening size in the view, enabling measurements and diagnoses.

[0006] Current pelvic floor muscle ultrasound examination workflows suffer from several problems and are inefficient. For example, ultrasound operators are typically only able to view the correct OV plane within the selected 3D volume frame (i.e., after selecting the 3D volume frame and repositioning the OV lines or drawing frame). Furthermore, the selection of the 3D volume frame is subjective, requiring operator expertise and potentially leading to fatigue, errors, inconsistencies, and / or unstable clinical presentations. Additionally, the correct OV plane image view is only retrospective (i.e., not available in real-time during the examination) and is only available after adjusting the OV lines or drawing frame. This is because, although the muscles move during the examination, the volume drawn on the OV plane presented during the pelvic floor muscle examination corresponds entirely to the initially positioned OV lines or drawing frame.

[0007] By comparing such systems with some aspects of this disclosure as set forth with reference to the accompanying drawings in the remainder of this application, further limitations and disadvantages of conventional and traditional methods will become apparent to those skilled in the art. Summary of the Invention

[0008] A system and / or method are provided for automatically tracking a minimum pore size plane of an ultrasound volume in real time during pelvic floor muscle examination, the system and / or method being substantially as shown and / or described in conjunction with at least one of the accompanying drawings, as set forth more fully in the claims.

[0009] These and other advantages, aspects and novel features of this disclosure, as well as details of its illustrative embodiments, will be more fully understood from the following description and accompanying drawings. Attached Figure Description

[0010] Figure 1 This is a block diagram of an exemplary ultrasound system operable, according to various implementation schemes, to automatically track the minimum pore size plane of the ultrasound volume in real time during pelvic floor muscle examination.

[0011] Figure 2This is an illustration of an exemplary three-dimensional (3D) ultrasound volume acquisition with an A-plane, a B-plane, and an OV-plane according to various embodiments, and an exemplary display of a two-dimensional (2D) image including a plot of the A-plane and the OV-plane with OV lines.

[0012] Figure 3 Examples of imaging techniques include two-dimensional (2D) A-plane images and OV-plane plots taken at first and second subsequent times during pelvic floor muscle examination, according to various implementation schemes.

[0013] Figure 4 This is an exemplary display of a two-dimensional (2D) A-plane image with a region of interest and key points according to various implementation schemes.

[0014] Figure 5 These are exemplary images of strain images according to various implementation schemes.

[0015] Figure 6 Examples of images include two-dimensional (2D) A-plane images with OV lines and OV plane plots overlaid with strain information, according to various implementation schemes.

[0016] Figure 7 These are exemplary images of strain curves and strain images according to various implementation schemes.

[0017] Figure 8 This is an exemplary image of a two-dimensional (2D) OV planar plot of the maximum contraction phase and the maximum varsalva phase according to various implementation schemes.

[0018] Figure 9 This is a flowchart illustrating exemplary steps of a plane with a minimum pore size that can be used to automatically track ultrasound volumes in real time during pelvic floor muscle examination, according to various embodiments. Detailed Implementation

[0019] Certain embodiments of the method and system for automatically tracking the minimum pore size plane of the ultrasound volume in real time during pelvic floor muscle examination may exist. Various aspects of this disclosure have the technical effect of automatically tracking and dynamically adjusting the position and trajectory of the OmniView (OV) line in real time during on-site ultrasound volume acquisition, enabling the plotting, presentation, and updating of corresponding OV images throughout the on-site acquisition. Various embodiments also have the technical effect of automatically calculating strain and providing strain information through OV images.

[0020] The foregoing summary of the invention and the following detailed description of certain embodiments will be better understood when read in conjunction with the accompanying drawings. For the purposes of the diagrams illustrating the functional blocks of the various embodiments, these functional blocks do not necessarily represent a division between hardware circuits. Thus, for example, one or more functional blocks (e.g., a processor or memory) may be implemented in a single piece of hardware (e.g., a general-purpose signal processor or a block of random access memory, a hard disk, etc.) or in multiple pieces of hardware. Similarly, a program may be a standalone program, may be included as a subroutine in an operating system, may be a function in an installed software package, etc. It should be understood that the various embodiments are not limited to the arrangements and tools shown in the drawings. It should also be understood that embodiments may be combined, or other embodiments may be utilized, and structural, logical, and electrical changes may be made without departing from the scope of the various embodiments. Therefore, the following detailed description should not be considered limiting, and the scope of this disclosure is defined by the appended claims and their equivalents.

[0021] As used herein, elements or steps listed in the singular and beginning with the word "a" or "an" should be understood to not exclude multiple such elements or steps, unless such exclusion is explicitly stated. Furthermore, references to "exemplary embodiments," "various embodiments," "certain embodiments," "representative embodiments," etc., are not intended to be construed as excluding additional embodiments that also include the described features. Moreover, unless explicitly stated to the contrary, embodiments that "comprise," "include," or "have" one or more elements having a particular attribute may include additional elements that do not have that attribute.

[0022] Additionally, as used herein, the term "image" broadly refers to both a visual image and the data representing that image. However, many implementations generate (or are configured to generate) at least one visual image. Furthermore, as used herein, the phrase "image" is used to refer to ultrasound modes such as B-mode (2D mode), M-mode, three-dimensional (3D) mode, CF mode, PW Doppler, CW Doppler, contrast-enhanced ultrasound (CEUS), and / or submodes of B-mode and / or CF such as harmonic imaging, shear wave elastography (SWEI), strain elastography, TVI, PDI, B-flow, MVI, UGAP, and in some cases also MM, CM, TVD, where "image" and / or "plane" includes a single beam or multiple beams.

[0023] Furthermore, as used herein, the term processor or processing unit refers to any type of processing unit capable of performing the required computations required for various implementation schemes, such as single-core or multi-core: CPU, accelerated processing unit (APU), graphics processing unit (GPU), DSP, FPGA, ASIC, or combinations thereof.

[0024] Although some embodiments may describe ultrasound examination, for example, in the context of pelvic floor muscle examination, the scope of various aspects of this disclosure should not be limited to pelvic floor muscle ultrasound examination unless so claimed, and may additionally and / or alternatively be applied to any suitable ultrasound examination of anatomical regions with movable anatomical structures (e.g., heart, fetus, etc.).

[0025] It should be noted that the various embodiments of generating or forming images described herein may include processing for forming the image, which in some embodiments includes beamforming, while in others does not. For example, an image may be formed without beamforming, such that the product is an image, by multiplying a matrix of demodulated data by a coefficient matrix, and wherein the process does not form any “beams.” Alternatively, image formation may be performed using a combination of channels that may originate from more than one transmission event (e.g., synthetic aperture technology).

[0026] In various implementations, for example, ultrasonic processing to form an image is performed in software, firmware, hardware, or a combination thereof, including ultrasonic beamforming, such as receive beamforming. One specific implementation of an ultrasonic system having a software beamformer architecture formed according to the various implementations is... Figure 1 As shown in the image.

[0027] Figure 1 This is a block diagram of an exemplary ultrasound system 100 operable, according to various embodiments, for real-time automatic tracking of the minimum aperture size plane of the ultrasound volume during pelvic floor muscle examination. Reference Figure 1 The image shows an ultrasound system 100 and a training system 200. The ultrasound system 100 includes a transmitter 102, an ultrasound probe 104, a transmit beamformer 110, a receiver 118, a receive beamformer 120, an A / D converter 122, an RF processor 124, an RF / IQ buffer 126, a user input device 130, a signal processor 132, an image buffer 136, a display system 134, and a file 138.

[0028] Transmitter 102 may include suitable logic components, circuitry, interfaces, and / or code operable to drive ultrasound probe 104. Ultrasound probe 104 may include a two-dimensional (2D) array of piezoelectric elements. Additionally and / or alternatively, ultrasound probe 104 may be a mechanically oscillating ultrasound probe 104, which may include a one-dimensional (1D) array of piezoelectric elements mounted on a transducer assembly capable of movement in a single plane. For example, the transducer assembly may be capable of movement of approximately 120 to 150 degrees by a motor driving gears, belts, and / or ropes to pivot the shaft or hub of the transducer assembly. Ultrasound probe 104 may include a set of transmitting transducer elements 106 and a set of receiving transducer elements 108 that generally constitute the same elements. The set of transmitting transducer elements 106 may emit ultrasound signals that pass through oil and probe caps and into the target. In a representative embodiment, ultrasound probe 104 is operable to acquire ultrasound image data covering at least a majority of anatomical structures, such as the pelvic region or any suitable anatomical area. In an exemplary embodiment, the ultrasound probe 104 can operate in a volume acquisition mode, wherein the transducer assembly of the ultrasound probe 104 moves to acquire a plurality of parallel 2D ultrasound slices forming an ultrasound volume.

[0029] The transmitting beamformer 110 may include suitable logic components, circuitry, interfaces, and / or code operable to control the transmitter 102, which drives the set of transmitting transducer elements 106 via the transmitting sub-aperture beamformer 114 to transmit ultrasonic signals to a region of interest (e.g., a person, animal, underground cavity, physical structure, etc.). The transmitted ultrasonic signals may be backscattered from structures (such as blood cells or tissue) within the object of interest to generate echoes. The echoes are received by the receiving transducer element 108.

[0030] The set of receiving transducer elements 108 in the ultrasonic probe 104 is operable to convert the received echo into an analog signal, perform sub-aperture beamforming via the receiving sub-aperture beamformer 116, and then transmit it to the receiver 118. The receiver 118 may include suitable logic components, circuitry, interfaces, and / or code operable to receive the signal from the receiving sub-aperture beamformer 116. The analog signal can be transmitted to one or more of a plurality of A / D converters 122.

[0031] Multiple A / D converters 122 may include suitable logic components, circuitry, interfaces, and / or code operable to convert analog signals from receiver 118 into corresponding digital signals. The multiple A / D converters 122 are disposed between receiver 118 and RF processor 124. However, this disclosure is not limited in this respect. Therefore, in some embodiments, multiple A / D converters 122 may be integrated within receiver 118.

[0032] RF processor 124 may include suitable logic components, circuitry, interfaces, and / or code operable to demodulate digital signals output from a plurality of A / D converters 122. According to one embodiment, RF processor 124 may include a multiplexer (not shown) operable to demodulate digital signals to form I / Q data pairs representing corresponding echo signals. The RF or I / Q signal data can then be transmitted to an RF / IQ buffer 126. RF / IQ buffer 126 may include suitable logic components, circuitry, interfaces, and / or code operable to provide temporary storage of the RF or I / Q signal data generated by RF processor 124.

[0033] The receiver beamformer 120 may include suitable logic components, circuitry, interfaces, and / or code operable to perform digital beamforming processing, such as summing a delayed channel signal received from the RF processor 124 via the RF / IQ buffer 126 and outputting a beam sum signal. The resulting processed information may be a beam sum signal output from the receiver beamformer 120 and transmitted to the signal processor 132. According to some embodiments, the receiver 118, multiple A / D converters 122, the RF processor 124, and the beamformer 120 may be integrated into a single beamformer, which may be digital. In various embodiments, the ultrasound system 100 includes multiple receiver beamformers 120.

[0034] User input device 130 can be used to input patient data, scan parameters, settings, select protocols and / or templates, select the position and trajectory of OmniView (OV) lines, select measurement results, etc. In an exemplary embodiment, user input device 130 is operable to configure, manage, and / or control the operation of one or more components and / or modules in ultrasound system 100. In this regard, user input device 130 is operable to configure, manage, and / or control the operation of transmitter 102, ultrasound probe 104, transmit beamformer 110, receiver 118, receive beamformer 120, RF processor 124, RF / IQ buffer 126, user input device 130, signal processor 132, image buffer 136, display system 134, and / or file 138. User input device 130 may include one or more buttons, one or more rotary encoders, a touch screen, motion tracking, voice recognition, a mouse device, a keyboard, a camera, and / or any other device capable of receiving user commands. In certain embodiments, for example, one or more user input devices in user input device 130 may be integrated into other components, such as display system 134 or ultrasound probe 104. For example, user input device 130 may include a touchscreen display.

[0035] Signal processor 132 may include suitable logic components, circuitry, interfaces, and / or code operable to process ultrasound scan data (i.e., summed IQ signals) to generate an ultrasound image for presentation on display system 134. Signal processor 132 is operable to perform one or more processing operations based on multiple selectable ultrasound modalities on the acquired ultrasound scan data. In exemplary embodiments, signal processor 132 may be used to perform display processing and / or control processing, etc. Acquired ultrasound scan data can be processed in real time during a scanning session as echo signals are received. Additionally or alternatively, ultrasound scan data may be temporarily stored in RF / IQ buffer 126 during a scanning session and processed in a less real-time manner during online or offline operation. In various embodiments, processed image data may be presented at display system 134 and / or stored in archive 138. Archive 138 may be a local archive, a Picture Archiving and Communication System (PACS), or any suitable device for storing images and related information.

[0036] Signal processor 132 may be one or more central processing units, microprocessors, microcontrollers, etc. For example, signal processor 132 may be an integrated component or may be distributed in various locations. In an exemplary embodiment, signal processor 132 may include an A-plane extraction processor 140, an OV line processor 150, an OV plane drawing processor 160, and a measurement processor 170. Signal processor 132 may be able to receive input information from user input device 130 and / or file 138, generate output that can be displayed by display system 134, and manipulate the output in response to input information from user input device 130, etc. For example, signal processor 132, A-plane extraction processor 140, OV line processor 150, OV plane drawing processor 160, and measurement processor 170 may perform any of the methods and / or instruction sets discussed herein according to various embodiments.

[0037] The ultrasound system 100 is operable to continuously acquire ultrasound scan data at a frame rate suitable for the imaging situation under consideration. Typically, the frame rate is in the range of 20 to 120, but may be lower or higher. The acquired ultrasound scan data may be displayed on the display system 134 at the same frame rate, or at a slower or faster display rate. An image buffer 136 is included for storing frames of acquired ultrasound scan data that are not scheduled for immediate display. Preferably, the image buffer 136 has sufficient capacity to store frames of ultrasound scan data for at least several minutes. The frames of ultrasound scan data are stored in a manner that facilitates retrieval based on their acquisition order or time. The image buffer 136 may be embodied in any known data storage medium.

[0038] Signal processor 132 may include A-plane extraction processor 140, which includes suitable logic components, circuitry, interfaces, and / or code operable to extract and sequentially present A-plane two-dimensional (2D) ultrasound image slices (i.e., planes parallel to the acquisition plane) from a four-dimensional (4D) ultrasound volume (i.e., a three-dimensional (3D) ultrasound volume over time) of the pelvic region or any suitable anatomical region, one slice at a time. For example, A-plane extraction processor 140 may be configured to automatically extract A-planes from ultrasound volumes acquired over time and present the extracted A-planes at display system 134. For example, A-plane extraction processor 140 may be configured to generate an image loop of the extracted A-planes for playback at display system 134. An ultrasound operator may provide pause, play, rewind, and / or fast-forward commands to A-plane extraction processor 140 via a user input device to control the playback of the image loop. The ultrasound operator can control the playback of the image loop to examine the pelvic muscles at maximum valsalva and maximal contraction for measurement. The A-plane extraction processor 140 can be configured to store the extracted A-plane images and / or image loops in archive 138 and / or any suitable data storage medium.

[0039] Signal processor 132 may include OV line processor 150, which includes suitable logic components, circuitry, interfaces, and / or code operable to receive the initial position and trajectory of the OV line in an initial A-plane image. OV line processor 150 may be configured to receive user positioning of the OV line overlaid on the initial A-plane image via user input device 130. For example, in a pelvic floor muscle examination, the OV line may be positioned to extend through the pubic symphysis (SP) and levator ani muscle (LA). The OV line defines the image data of the ultrasound volume to be plotted to generate an OV plane, which may typically correspond to the C-plane (i.e., a layer of two-dimensional slices parallel to the transducer surface and at various depths from the transducer surface). In a pelvic floor muscle examination, the OV line defines an OV plane corresponding to the plane of minimum hiatus size. In various embodiments, the plotted image data may have a layer 1 to 2 cm below the OV line. OV line processor 150 is configured to provide the initial position and trajectory of the OV lines to OV plane rendering processor 160, such that OV plane rendering processor 160 can render and display an OV plane image with a corresponding A-plane image based on the OV lines. Additionally or alternatively, OV line processor 150 may be configured to store the position and trajectory of the OV lines and / or the A-plane image with the OV lines in file 138 and / or any suitable data storage medium.

[0040] OV line processor 150 may include suitable logic components, circuitry, interfaces, and / or code operable to track OV lines to automatically adjust the position and trajectory of the OV lines in subsequent A-plane images during the acquisition period. In this regard, OV line processor 150 may include, for example, artificial intelligence image analysis algorithms, computer vision algorithms, one or more deep neural networks (e.g., convolutional neural networks, such as u-net), and / or may utilize any suitable form of image analysis technique or machine learning processing capability configured to track the position and trajectory of OV lines in A-plane images during the acquisition period. Additionally and / or alternatively, the artificial intelligence image analysis technique or machine learning processing capability configured to track the position and trajectory of OV lines in A-plane images may be provided by different processors or distributed across multiple processors at ultrasound system 100 and / or communicatively coupled to remote processors of ultrasound system 100.

[0041] For example, an OV line tracking function can be provided as a deep neural network, which may consist of, for example, an input layer, an output layer, and one or more hidden layers between the input and output layers. Each layer may consist of multiple processing nodes, which may be called neurons. For example, the OV line tracking function may include an input layer with neurons for each pixel of the A-plane image. The output layer may have neurons corresponding to the updated position and trajectory of the OV line. Each neuron in each layer can perform a processing function and pass the processed ultrasound image information to one of a plurality of neurons in a downstream layer for further processing. For example, neurons in the first layer can learn to identify edges of structures in the extracted A-plane image. Neurons in the second layer can learn to identify shapes based on the detected edges from the first layer. Neurons in the third layer can learn the position of the identified shapes relative to landmarks in the extracted A-plane image. Neurons in the fourth layer can learn to identify regions of interest in the A-plane image, such as the pubic symphysis (SP) and levator ani (LA) muscles in an A-plane image of pelvic floor muscle examination. Neurons in the fifth layer can learn to identify key points in the identified regions of interest. Key points may be landmarks or other traceable features in the A-plane image. Processing performed by a deep neural network can track the updated position and trajectory of the OV line with high probability based on the tracked key points in the identified region of interest in the A-plane image.

[0042] In an exemplary embodiment, the OV line processor 150 may be configured to store the position and trajectory information of the OV lines and / or an A-plane image with adjusted OV lines in a file 138 and / or any suitable storage medium. The OV line processor 150 may be configured to provide the position and trajectory information of the OV lines to the OV plane rendering processor 160, enabling the OV plane rendering processor 160 to render an OV plane image based on the position and trajectory information of the OV lines and to render the rendered OV plane at the display system 134, as described below.

[0043] Signal processor 132 may include an OV plane rendering processor 160, which includes suitable logic components, circuitry, interfaces, and / or code operable to render an OV plane based on OV lines received from OV line processor 150 and to display the rendered OV plane at display system 134. For example, OV plane rendering processor 160 may be configured to receive position and trajectory information of OV lines from OV line processor 150. OV plane rendering processor 160 may be configured to render a 2D projection of a 3D ultrasound volume based on the position and trajectory information of the OV lines. For example, OV plane rendering processor 160 may render a 2D projection (i.e., an OV plane image) from a layer of ultrasound volume 1 cm to 2 cm below the OV lines. The rendered OV plane image typically corresponds to the C-plane. In pelvic floor muscle examination, the rendered OV plane image corresponds to the minimum hiatus distance (MHD) plane of the levator hiatus. OV plane rendering processor 160 continuously renders and renders OV plane images based on any adjustments made to the position and trajectory of the OV lines during the acquisition period. OV plane rendering processor 160 can be configured to render the rendered OV plane image and a corresponding A-plane image with the OV lines. For example, the A-plane image with the OV lines and the OV plane image can be rendered in a split-screen view at display system 134. OV plane rendering processor 160 can be configured to store the rendered OV plane in file 138 and / or any suitable data storage medium.

[0044] Figure 2 This is an illustration of an exemplary three-dimensional (3D) ultrasound volume acquisition 300 with an A-plane 310, a B-plane 330, and an OV-plane 320 according to various embodiments, and an exemplary display of a two-dimensional (2D) image including an A-plane 310 with an OV line 312 and an OV-plane plotting diagram 320. Reference Figure 2The 3D ultrasound volume 300 may include an A-plane 310, a B-plane 330, and an OV-plane 320. The OV-plane 320 typically corresponds to the C-plane (i.e., a layer parallel to the transducer surface and at various depths from the transducer surface, representing a 2D slice). The OV-plane 320 is plotted and presented based on the position and trajectory of the OV lines 312. The OV lines 312 can initially be positioned in the A-plane image 310 via a user input device 130. The position and trajectory of the OV lines 312 can be automatically tracked and adjusted in subsequent A-plane images 310 extracted from the ultrasound volume 300 acquired over time (i.e., 4D acquisition). The OV-plane image 320 is automatically updated by adjusting the OV lines 312 during the acquisition period.

[0045] Figure 3 Exemplary images 400A, 400B are two-dimensional (2D) A-plane images 410A, 410B and OV-plane plots 420A, 420B taken at a first time 400A and a second subsequent time 400B during pelvic floor muscle examination, according to various implementation schemes. Reference Figure 3 An A-plane image 410A extracted from the ultrasound volume acquired at the first time point 400A can be displayed on the display system 134. An ultrasound operator can overlay OV lines 412A onto the A-plane image 410A, and an OV plane rendering processor 160 can render and render an OV plane image 420A corresponding to the position and trajectory of the OV lines 412A in the A-plane 410A. In various embodiments, 10 to 30 ultrasound volumes can be acquired over time during pelvic floor muscle examination (i.e., 4D acquisition). An A-plane image 410 is extracted from each ultrasound volume, and the position and trajectory of the OV lines 412 are automatically tracked and adjusted based on movement occurring in the anatomical region (e.g., when the patient performs contractions and valsalva muscle movements during the pelvic floor muscle examination). An OV plane image 420B is rendered and rendered based on the adjusted OV lines 412B in the A-plane image 410B extracted from the ultrasound volume acquired at a second subsequent time point. Because the OV lines 412A and 412B were dynamically tracked and adjusted throughout the pelvic floor muscle examination, OV plane images 420A and 420B that correctly showed the minimum hiatus distance (MHD) plane of the levator hiatus were drawn and presented throughout the pelvic floor muscle examination.

[0046] Figure 4 This is an exemplary display 500 of a two-dimensional (2D) A-plane image 510 having a region of interest 514 and key points 516 according to various embodiments. (See also...) Figure 4The OV line processor 150 can be configured to automatically identify regions of interest 514 in the extracted A-plane image 510. For example, in a pelvic floor muscle examination, the OV line is positioned as extending through the pubic symphysis (SP) and levator ani (LA) regions of the pelvic region. The OV line processor 150 can be configured to automatically identify the pubic symphysis (SP) and levator ani (LA) as regions of interest 514 in the A-plane image 510. The OV line processor 150 can be configured to automatically select key points 516 in the identified regions of interest 514. Key points 516 may correspond to landmarks and / or other traceable features in the A-plane image 510. The OV line processor 150 can be configured to automatically track the regions of interest 514 and key points 516 in subsequently acquired A-plane images 510 to adjust the position and trajectory of the OV line.

[0047] Refer again Figure 1Signal processor 132 may include measurement processor 170, which includes suitable logic components, circuitry, interfaces, and / or code operable to perform measurements on one or more OV planar images 320, 420A, 420B drawn and presented during the examination period. For example, measurement processor 170 may be configured to calculate strain on the pelvic floor muscles in the OV planar images 320, 420A, 420B of the levator hiatus. For example, the valsalva maneuver and contraction movements during pelvic floor muscle examination cause tissue distortion. For example, ultrasound signals in OV planes 320, 420A, 420B may be tracked to calculate strain based on speckle tracking or direct strain calculation (e.g., where the displacement of a smaller signal segment between two frames is first estimated, and then strain is obtained by taking the derivative of the displacement). Measurement processor 170 can be configured to generate strain images, graphs of strain values, and / or overlay strain information (e.g., color-coded) onto OV planar images 320, 420A, 420B. In various embodiments, measurement processor 170 can be configured to deploy an artificial intelligence model for pelvic floor muscle disease risk to predict the risk of having pelvic floor muscle disease. For example, the model can be trained based on strain images, B-mode images, patient demographic information (e.g., age, body mass index (BMI), medical history (e.g., number of vaginal deliveries, diabetes, etc.), etc.). Measurement processor 170 can be configured to infer the model to generate predicted risks, which can be displayed as icons (e.g., risk meters), levels (e.g., low, medium, high), and / or numbers (e.g., 1 to 5). Predicted risks can be color-coded (e.g., red for high risk, yellow for medium risk, and green for low risk). Risk prediction can be displayed together with one or more of the following: A-plane images 310, 410A, 410B with OV lines 312, 412A, 412B; OV-plane images 320, 420A, 420B; strain images; strain curves; OV-plane images 320, 420A, 420B with covered strain information; etc.

[0048] For example, the measurement processor 170 can be configured to calculate the area, length, and height based on the contour of the levator hiatus (e.g., the contour of the levator hiatus at maximal contraction and maximal valsalva). The area, length, and height measurements for each stage in the maximal contraction and maximal valsalva phases, as well as the ratio of the area, length, and height measurements between the maximal contraction and maximal valsalva phases, can be presented at the display system 134.

[0049] In various implementations, the measurement processor 170 may be configured to present measurements from previous examinations and measurements from the current examination to assess treatment and disease progression over time. The measurement processor 170 may be configured to store measurement results (e.g., strain information, strain images, strain graphs, OV plane images with overlaid strain information, area measurements, length measurements, height measurements, ratio measurements, etc.) in archive 138 and / or any suitable data storage medium.

[0050] Figure 5 This is an exemplary image of strain image 600 according to various embodiments. Reference Figure 5 A strain image 600 of the levator muscle hiatus is shown. The strain image 600 can be color-coded to show strain values ​​corresponding to different locations of the levator muscle hiatus. The strain image 600 can be generated by the measurement processor 170 based on analysis (e.g., speckle tracking or direct strain calculation) of the ultrasonic signals from OV plane images 320, 420A, 420B during inspection. The strain image 600 can be presented alone at the display system 134, or it can be presented at the display system 134 together with one or more of the following: A plane images 310, 410A, 410B with OV lines 312, 412A, 412B; OV plane images 320, 420A, 420B; strain curves; OV plane images 320, 420A, 420B with overlaid strain information; area measurements; length measurements; height measurements; ratio measurements; etc. The strain image 600 can be stored in archive 138 and / or any suitable data storage medium.

[0051] Figure 6 This is an exemplary image 700 of a two-dimensional (2D) A-plane image 710 with OV lines 712 and an OV plane plot 720 overlaid with strain information 722, according to various embodiments. Reference Figure 6The A-plane image 710 includes an OV line 712 extending between the pubic symphysis (SP) region and the levator ani (LA) region in the pelvic region. The OV plane image 720 is a plot of 1 cm to 2 cm of image data acquired below the OV line 712 within an ultrasound volume. For example, the measurement processor 170 calculates strain information 722 by analyzing the OV plane image 720 acquired during the examination period based on speckle tracking or direct strain calculation. The calculated strain information 722 is superimposed on the OV plane image 720. In various embodiments, the strain information 722 may be color-coded based on strain values ​​at different locations in the OV plane image 720. The A-plane image 710 with the OV line 712 and the OV plane image 720 with strain information 722 may be displayed at a display system 134. In some embodiments, additional measurement results may be presented along with the A-plane image 710 and the OV-plane image 720, such as strain curves, strain images 600, area measurements, length measurements, height measurements, ratio measurements, etc. The A-plane image 710 with OV lines 712 and the OV-plane image 720 with strain information 722 may be stored in archive 138 and / or any suitable data storage medium.

[0052] Figure 7 This is an exemplary display 800 of strain curves 810 and strain images 820 according to various embodiments. Reference Figure 7 Strain curve 810 and strain image 820 can be displayed 800 at display system 134. Strain curve 810 can show strain information over time for various muscle locations. Strain image 820 can be color-coded to show strain values ​​corresponding to different muscle locations. Strain curve 810 and strain image 820 can be presented together at display system 134. In an exemplary embodiment, additional measurement results can be presented together with strain curve 810 and strain image 820, such as A-plane image 710 with OV line 712, OV plane image 720 with strain information 722, area measurement results, length measurement results, height measurement results, ratio measurement results, etc. Strain curve 810 and strain image 820 can be stored in archive 138 and / or any suitable data storage medium.

[0053] Figure 8 This is an exemplary image 900 of two-dimensional (2D) OV planar plots 910A, 910B, drawn according to various embodiments, during the maximum contraction phase 910A and the maximum valsalva phase 910B. Reference Figure 8The measurement processor 170 or the ultrasound operator can select an OV planar image with the maximum contraction phase 910A and an OV planar image with the maximum valsalva phase 910B. The measurement processor 170 can be configured to automatically measure the height 912A, 912B, length 914A, 914B, and area 916A, 916B of the levator hiatus contour at the maximum contraction phase 910A and the maximum valsalva phase 910B. The measurement processor 170 can be configured to provide a ratio measurement result between the height 912A, 912B, length 914A, 914B, and / or area 916A, 916B of the maximum contraction phase 910A and the maximum valsalva phase 910B. The measurement processor 170 can be configured to present the measurement results 912A, 912B, 914A, 914B, 916A, 916B, and the corresponding measurement values ​​at the display system 134. In an exemplary embodiment, additional measurement results may be presented together with area measurement results 916A, 916B, length measurement results 914A, 914B, height measurement results 912A, 912B, and / or ratio measurement results, such as an A-plane image 710 with OV line 712, an OV plane image 720 with strain information 722, strain images 600, 820, strain curve 810, etc. The area measurement results 916A, 916B, length measurement results 914A, 914B, height measurement results 912A, 912B, and / or ratio measurement results may be stored in file 138 and / or any suitable data storage medium.

[0054] Refer again Figure 1 The display system 134 can be any device capable of conveying visual information to a user. For example, the display system 134 may include a liquid crystal display, a light-emitting diode display, and / or any suitable one or more displays. Display system 134 is operable to present A-plane images 310, 410A, 410B, 710 with OV lines 312, 412A, 412B, 712, OV plane images 320, 420A, 420B, 720, 910A, 910B, OV plane images 320, 420A, 420B, 720, 910A, 910B covered with strain information 722, strain images 600, 820, strain curve 810, OV plane images 320, 420A, 420B, 720, 910A, 910B together with area measurement results 916A, 916B, length measurement results 914A, 914B, height measurement results 912A, 912B and / or ratio measurement results and / or any suitable information.

[0055] File 138 may be one or more computer-readable storage devices integrated with and / or communicatively coupled (e.g., via a network) to ultrasound system 100, such as Image Archiving and Communication System (PACS), server, hard disk, floppy disk, CD, CD-ROM, DVD, compact memory, flash memory, random access memory, read-only memory, electrically erasable and programmable read-only memory, and / or any suitable memory. File 138 may include, for example, a database, library, information set, or other storage accessed by and / or combined with signal processor 132. For example, file 138 may be able to temporarily or permanently store data. File 138 may be able to store medical image data, data generated by signal processor 132, and / or instructions readable by signal processor 132, etc. For example, in various implementations, file 138 stores the ultrasonic volume 300, A-plane images 310, 410A, 410B, 710, the position and trajectory information of OV lines 312, 412A, 412B, 712, OV plane images 320, 420A, 420B, 720, 910A, 910B, strain information 722, strain images 600, 820, strain curve 810, area measurement results 916A, 916B, length measurement results 914A, 914B, height measurement results 912A, 912B, and ratio measurement results, used to extract the indexes of A-plane images 310, 410A, 410B, 710 from the ultrasonic volume 300. Commands for automatically tracking and adjusting OV lines 312, 412A, 412B, and 712 in A-plane images 310, 410A, 410B, and 710; commands for drawing and displaying OV plane images 320, 420A, 420B, 720, 910A, and 910B based on the position and trajectory of OV lines 312, 412A, 412B, and 712; commands for performing strain measurements 600, 722, 810, and 820 and presenting their measurement results; and commands for performing area measurements 916A and 916B, length measurements 914A and 914B, height measurements 912A and 912B, and / or ratio measurements and presenting their measurement results.

[0056] The components of the ultrasound system 100 can be implemented in software, hardware, firmware, etc. The various components of the ultrasound system 100 can be communicatively connected. The components of the ultrasound system 100 can be implemented individually and / or integrated in various forms. For example, the display system 134 and the user input device 130 can be integrated into a touchscreen display.

[0057] Still referencing Figure 1The training system 200 may include a training engine 210 and a training database 220. The training engine 210 may include suitable logic components, circuits, interfaces, and / or code operable to train neurons of a deep neural network (e.g., an artificial intelligence model) inferred (i.e., deployed) by the OV line processor 150. For example, the artificial intelligence model inferred by the OV line processor 150 may be trained to automatically track the position and trajectory of OV lines 312, 412A, 412B, and 712 in the A-plane images 310, 410A, 410B, and 710 during the acquisition period using a database 220 of classified A-plane images 310, 410A, 410B, and 710 of the pelvic region or any suitable anatomical region (e.g., heart, fetus, etc.).

[0058] In various implementations, the training image database 220 can be a Picture Archiving and Communication System (PACS) or any suitable data storage medium. In a particular implementation, the training engine 210 and / or the training image database 220 can be a remote system communicatively coupled to the ultrasound system 100 via a wired or wireless connection, such as... Figure 1 As shown. Additionally and / or alternatively, components or all of the training system 200 may be integrated with the ultrasound system 100 in various forms.

[0059] Figure 9 This is a flowchart 1000 illustrating exemplary steps 1002 to 1018 of various embodiments for use in real-time automatic tracking of the minimum slit size planes 312, 320, 412A, 420A, 412B, 420B, 712, 720, 910A, 910B of an ultrasound volume 300 during pelvic floor muscle examination. (See also:) Figure 9 The diagram illustrates a flowchart 1000 including exemplary steps 1002 to 1018. Some embodiments may omit one or more steps, and / or perform the steps in a different order than listed, and / or combine certain steps discussed below. For example, some steps may not be performed in a particular embodiment. Also, some steps may be performed in a different chronological order than listed below, including simultaneous execution.

[0060] At step 1002, the ultrasound probe 104 of the ultrasound system 100 acquires an ultrasound volume 300 of an anatomical region over a period of time. For example, the ultrasound probe 104 may be a mechanically oscillating ultrasound probe, which may include a one-dimensional (1D) array of piezoelectric elements mounted on a transducer assembly capable of movement in a single plane. The ultrasound probe 104 may operate in a volume acquisition mode, wherein the transducer assembly of the mechanically oscillating ultrasound probe 104 automatically moves to acquire multiple parallel 2D image slices that form an ultrasound volume 300, such as an ultrasound volume 300 of the pelvic region. The ultrasound probe 104 may sequentially acquire several (e.g., 10 to 30) ultrasound volumes 300 within that time period (i.e., 4D acquisition). The ultrasound volumes 300 may be provided to the A-plane extraction processor 140 of the signal processor 132 and / or stored in a file 138 and / or any suitable data storage medium.

[0061] At step 1004, the signal processor 132 of the ultrasound system 100 can extract A-planes 310, 410A, 410B, 510, and 710 from the ultrasound volume 300 and display these planes on the display system 134. For example, the A-plane extraction processor 140 of the signal processor 132 can be configured to extract A-planes 310, 410A, 410B, 510, and 710 from the ultrasound volume 300 and display these planes on the display system 134.

[0062] At step 1006, the signal processor 132 of the ultrasound system 100 may receive OmniView (OV) lines 312, 412A, 412B, and 712 overlaid on the A-planes 310, 410A, 410B, 510, and 710. For example, the OV line processor 150 of the signal processor 132 may be configured to receive user positioning of the OV lines 312, 412A, 412B, and 712 superimposed on the A-plane images 310, 410A, 410B, 510, and 710 via the user input device 130. For example, in a pelvic floor muscle examination, the OV lines 312, 412A, 412B, and 712 may be positioned to extend through the pubic symphysis (SP) and the levator ani muscle (LA). OV lines 312, 412A, 412B, and 712 define the image data of the ultrasound volume to be plotted to generate OV planes 320, 420A, 420B, 720, 910A, and 910B. In pelvic floor muscle examination, OV lines 312, 412A, 412B, and 712 define OV planes 320, 420A, 420B, 720, 910A, and 910B corresponding to the plane of minimum opening size. OV line processor 150 may be configured to provide the positions and tracks of OV lines 312, 412A, 412B, 712 to the OV plane drawing processor 160 of signal processor 132 and / or store the positions and tracks of OV lines 312, 412A, 412B, 712 and / or A-plane images 310, 410A, 410B, 510, 710 with OV lines 312, 412A, 412B, 712 in archive 138 and / or any suitable data storage medium.

[0063] At step 1008, the signal processor 132 of the ultrasound system 100 can draw and display OV planes 320, 420A, 420B, 720, 910A, and 910B based on the positions and trajectories of OV lines 312, 412A, 412B, and 712. For example, the OV plane drawing processor 160 of the signal processor 132 can be configured to draw OV planes 320, 420A, 420B, 720, 910A, and 910B based on the OV lines 312, 412A, 412B, and 712 received from the OV line processor 150, and to display the drawn OV planes 320, 420A, 420B, 720, 910A, and 910B at the display system 134. The OV planar rendering processor 160 can render 2D projections (i.e., OV planar images 320, 420A, 420B, 720, 910A, 910B) from layers of ultrasound volume 300 1 cm to 2 cm below OV lines 312, 412A, 412B, 712, 712. During pelvic floor muscle examination, the rendered OV planar images 320, 420A, 420B, 720, 910A, 910B correspond to the minimum hiatus distance (MHD) plane of the levator hiatus. The OV planar rendering processor 160 can be configured to present the rendered OV planar images 320, 420A, 420B, 720, 910A, 910B and corresponding A-plane images 310, 410A, 410B, 510, 710 with OV lines 312, 412A, 412B, 712. For example, A-plane images 310, 410A, 410B, 510, 710 with OV lines 312, 412A, 412B, 712, and OV plane images 320, 420A, 420B, 720, 910A, 910B can be presented in a split-screen view at display system 134. OV plane drawing processor 160 can be configured to store the drawn OV planes 320, 420A, 420B, 720, 910A, 910B in file 138 and / or any suitable data storage medium.

[0064] At step 1010, the signal processor 132 of the ultrasound system 100 can automatically identify regions of interest 514 in A-planes 310, 410A, 410B, 510, and 710. For example, the OV line processor 150 can be configured to automatically identify regions of interest 514 in the extracted A-plane image 510. For example, in a pelvic floor muscle examination, OV lines 312, 412A, 412B, and 712 are located as extending through the pubic symphysis (SP) region and the levator ani (LA) region of the pelvic region. The OV line processor 150 can be configured to automatically identify the pubic symphysis (SP) and the levator ani (LA) as regions of interest 514 in the A-plane image 510.

[0065] At step 1012, the signal processor 132 of the ultrasound system 100 can automatically select key points 516 in each region of interest 514 in the A-plane images 310, 410A, 410B, 510, and 710. For example, the OV line processor 150 can be configured to automatically select key points 516 in the identified regions of interest 514. Key points 516 may correspond to landmarks and / or other traceable features in the A-plane images 310, 410A, 410B, 510, and 710.

[0066] At step 1014, the signal processor 132 of the ultrasound system 100 can automatically track key points 516 during this time period to automatically adjust the position and trajectory of OV lines 312, 412A, 412B, and 712. Based on the adjustments made to the position and trajectory of OV lines 312, 412A, 412B, and 712, the drawing and display of OV planes 320, 420A, 420B, 720, 910A, and 910B are automatically updated during this time period. For example, the OV line processor 150 can be configured to automatically track regions of interest 514 and key points 516 in subsequently acquired A-plane images 310, 410A, 410B, 510, and 710 to adjust the position and trajectory of OV lines 312, 412A, 412B, and 712. In this regard, the OV line processor 150 may include, for example, artificial intelligence image analysis algorithms, computer vision algorithms, one or more deep neural networks (e.g., convolutional neural networks, such as u-net), and / or may utilize any suitable form of image analysis technique or machine learning processing capabilities configured to track the position and trajectory of OV lines 312, 412A, 412B, 712 in A-plane images 310, 410A, 410B, 510, 710 during the acquisition period. The OV plane rendering processor 160 continuously renders and renders OV plane images 320, 420A, 420B, 720, 910A, 910B based on any automatic adjustments made to the position and trajectory of OV lines 312, 412A, 412B, 712 during the acquisition period.

[0067] At step 1016, the signal processor 132 of the ultrasound system 100 may perform at least one measurement of 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, 916B. For example, the measurement processor 170 of the signal processor 132 may be configured to perform measurements on one or more OV planar images 320, 420A, 420B, 720, 910A, 910B that are drawn and presented during the examination period. For example, the measurement processor 170 may be configured to calculate the strain of the pelvic floor muscles in the OV planar images 320, 420A, 420B, 720, 910A, 910B of the levator hiatus. For example, ultrasound signals in OV planes 320, 420A, 420B, 720, 910A, 910B can be tracked to calculate strain based on speckle tracking or direct strain calculation (e.g., where the displacement of a smaller signal segment between two frames is first estimated, and then strain is obtained by taking the derivative of the displacement). Measurement processor 170 can be configured to generate strain images 600, 820, curves of strain values ​​810, and / or to overlay strain information 722 (e.g., color-coded) onto OV plane images 320, 420A, 420B, 720, 910A, 910B. In various embodiments, measurement processor 170 can be configured to infer an artificial intelligence model of pelvic floor muscle disease risk to generate predicted risk. For example, the measurement processor 170 can be configured to calculate the area 916A, 916B, length 914A, 914B, height 912A, 912B, and ratio based on the contour of the levator hiatus (e.g., the contour of the levator hiatus at maximum contraction and maximum valsalva).

[0068] At step 1018, the signal processor 132 of the ultrasonic system 100 can cause the display system 132 to display at least one measurement result 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, 916B. For example, the measurement processor 170 can be configured to cause the display system 134 to present strain images 600, 820, OV planar images 320, 420A, 420B, 720, 910A, 910B overlaid with strain information 722, strain curve 810, predicted risk, area measurement results 916A, 916B, length measurement results 914A, 914B, height measurement results 912A, 912B, ratio measurement results, and / or any suitable measurement results.

[0069] Various aspects of this disclosure provide a method 1000 and a system 100 for automatically tracking, in real time, the minimum aperture size planes 312, 320, 412A, 420A, 412B, 420B, 712, 720, 910A, 910B of an ultrasound volume 300 during an examination of the pelvic floor muscles. According to various embodiments, method 1000 may include acquiring an ultrasound volume 300 of an anatomical region over a period of time by a probe 104 of the ultrasound system 100. Method 1000 may include extracting planar images 310, 410A, 410B, 510, 710 from the ultrasound volume 100 by at least one processor 132, 140 of the ultrasound system 100. The planar images 310, 410A, 410B, 510, 710 are presented at a display system 134 of the ultrasound system 100. Method 1000 may include receiving 1006 OmniView (OV) lines 312, 412A, 412B, 712 overlaid on A-plane images 310, 410A, 410B, 510, 710 by at least one processor 132, 150. Method 1000 may include drawing 1008 OV plane images 320, 420A, 420B, 720, 910A, 910B by at least one processor 132, 160 based on the position and trajectory of the OV lines 312, 412A, 412B, 712. The OV plane images 320, 420A, 420B, 720, 910A, 910B are presented at a display system 134. Method 1000 may include automatically identifying key points 516 of 1010, 1012 within regions of interest 514 of A-plane images 310, 410A, 410B, 510, and 710 by at least one processor 132, 150. Method 1000 may include automatically tracking the key points 516 of 1014 within regions of interest 514 of A-plane images 310, 410A, 410B, 510, and 710 during the time period to automatically adjust the positions and trajectories of OV lines 312, 412A, 412B, and 712. Based on the adjustments made to the positions and trajectories of OV lines 312, 412A, 412B, and 712, OV plane images 320, 420A, 420B, 720, 910A, and 910B are automatically updated during the time period.

[0070] In a representative embodiment, the anatomical region is the pelvic region. OV lines 312, 412A, 412B, and 712, overlaid on A-plane images 310, 410A, 410B, 510, and 710, may pass through the pubic symphysis and levator ani muscle of the pelvic region. In an exemplary embodiment, the region of interest 514 in the A-plane images 310, 410A, 410B, 510, and 710 includes the pubic symphysis and levator ani muscle. OV plane images 320, 420A, 420B, 720, 910A, and 910B may correspond to the minimum hiatus distance planes 312, 320, 412A, 420A, 412B, 420B, 712, 720, 910A, and 910B. In various embodiments, at least one processor 132, 150 performing artificial intelligence performs automatic identification 1010, 1012 of key points 516 in regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 and / or automatic tracking 1014 of key points 516 in regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 within that time period. In some embodiments, at least one processor performing computer vision performs automatic tracking 1014 of key points 516 in regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 within that time period. In a representative embodiment, method 1000 includes calculating strain 1016 by at least one processor 132, 170 based on speckle tracking or direct strain calculation. Method 1000 may include at least one processor 132, 170 causing a display system 134 to present strain images 600, 820, strain 722 overlaid on OV planar images 320, 420A, 420B, 720, 910A, 910B, and / or strain curves 810 over time. In an exemplary embodiment, method 1000 includes at least one processor 132, 170 calculating at least one measurement result 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, 916B, including area measurements 916A, 916B, length measurements 914A, 914B, height measurements 912A, 912B, and / or ratio measurements during the maximum contraction phase 910A and the maximum valsalva phase 910B. Method 1000 may include display system 134 displaying measurement results 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, 916B by at least one processor 132, 170.

[0071] Various embodiments provide a system 100 for automatically tracking, in real time, the minimum aperture size planes 312, 320, 412A, 420A, 412B, 420B, 712, 720, 910A, and 910B of an ultrasound volume 300 during pelvic floor muscle examination. The ultrasound system 100 may include a probe 104, at least one processor 132, 140, 150, 160, and 170, and a display system 134. The ultrasound probe 104 is operable to acquire ultrasound volumes 300 of anatomical regions over a period of time. At least one processor 132, 140 may be configured to extract A-plane images 310, 410A, 410B, 510, and 710 from the ultrasound volume 300. At least one processor 132, 150 may be configured to receive OmniView (OV) lines 312, 412A, 412B, 712 overlaid on A-plane images 310, 410A, 410B, 510, 710. At least one processor 132, 160 may be configured to draw OV plane images 320, 420A, 420B, 720, 910A, 910B based on the position and trajectory of OV lines 312, 412A, 412B, 712. At least one processor 132, 150 may be configured to automatically identify key points 516 in regions of interest 514 in A-plane images 310, 410A, 410B, 510, 710. At least one processor 132, 150 may be configured to automatically track key points 516 in regions of interest 514 within A-plane images 310, 410A, 410B, 510, 710 during the time period to automatically adjust the position and trajectory of OV lines 312, 412A, 412B, 712. At least one processor 132, 160 is configured to automatically update OV plane images 320, 420A, 420B, 720, 910A, 910B during the time period based on adjustments to the position and trajectory of OV lines 312, 412A, 412B, 712. The display system 134 can be configured to present A-plane images 310, 410A, 410B, 510, 710, OV lines 312, 412A, 412B, 712 covering the A-plane images 310, 410A, 410B, 510, 710, and OV plane images 320, 420A, 420B, 720, 910A, 910B.

[0072] In an exemplary embodiment, the anatomical region is the pelvic region. OV lines 312, 412A, 412B, and 712, overlaid on A-plane images 310, 410A, 410B, 510, and 710, may pass through the pubic symphysis and levator ani muscle of the pelvic region. In various embodiments, the region of interest in A-plane images 310, 410A, 410B, 510, and 710 includes the pubic symphysis and levator ani muscle. OV plane images 320, 420A, 420B, 720, 910A, and 910B may correspond to the minimum hiatus distance planes 312, 320, 412A, 420A, 412B, 420B, 712, 720, 910A, and 910B. In some embodiments, at least one processor 132, 150 is configured to perform artificial intelligence to automatically identify key points 516 in regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 and / or automatically track key points 516 in regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 within that time period. In a representative embodiment, at least one processor 132, 150 is configured to apply computer vision to automatically track key points 516 in regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 within that time period. In an exemplary embodiment, at least one processor 132, 170 is configured to calculate strain based on speckle tracking or direct strain calculation. At least one processor 132, 170 is configured to cause the display system 134 to present strain images 600, 820, strain 722 overlaid on OV planar images 320, 420A, 420B, 720, 910A, 910B, and / or strain curves 810 over time. In various embodiments, at least one processor 132, 170 is configured to calculate at least one measurement result 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, 916B, including area measurements 916A, 916B, length measurements 914A, 914B, height measurements 912A, 912B, and / or ratio measurements during the maximum contraction phase 910A and the maximum valsalva phase 910B. At least one processor 132, 170 is configured to cause the display system 134 to present measurement results 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, 916B.

[0073] Some embodiments provide a non-transitory computer-readable medium on which a computer program is stored, the computer program having at least one code segment. The at least one code segment is machine-executable to cause the ultrasound system 100 to perform step 1000. Step 1000 may include receiving 1002 an ultrasound volume 300 of an anatomical region over a period of time. Step 1000 may include extracting 1004 A-plane images 310, 410A, 410B, 510, 710 from the ultrasound volume 300. The A-plane images 310, 410A, 410B, 510, 710 are presented at a display system 134 of the ultrasound system 100. Step 1000 may include receiving 1006 OmniView (OV) lines 312, 412A, 412B, 712 overlaid on the A-plane images 310, 410A, 410B, 510, 710. Step 1000 may include drawing OV planar images 320, 420A, 420B, 720, 910A, and 910B based on the positions and trajectories of OV lines 312, 412A, 412B, and 712. The OV planar images 320, 420A, 420B, 720, 910A, and 910B are displayed on display system 134. Step 1000 may include automatically identifying key points 516 of 1010 and 1012 within regions of interest 514 in the A-plane images 310, 410A, 410B, 510, and 710. Step 1000 may include automatically tracking key points 516 of 1014 within regions of interest 514 in A-plane images 310, 410A, 410B, 510, and 710 during the time period to automatically adjust the positions and trajectories of OV lines 312, 412A, 412B, and 712. Based on the adjustments made to the positions and trajectories of OV lines 312, 412A, 412B, and 712, 1008 OV plane images 320, 420A, 420B, 720, 910A, and 910B are drawn and automatically updated during the time period.

[0074] In various implementations, the anatomical region is the pelvic region. OV lines 312, 412A, 412B, and 712, overlaid on A-plane images 310, 410A, 410B, 510, and 710, pass through the pubic symphysis and levator ani muscle of the pelvic region. Regions of interest in A-plane images 310, 410A, 410B, 510, and 710 include the pubic symphysis and levator ani muscle. OV plane images 320, 420A, 420B, 720, 910A, and 910B correspond to the minimum hiatus distance planes 312, 320, 412A, 420A, 412B, 420B, 712, 720, 910A, and 910B. In some embodiments, artificial intelligence is used to automatically identify key points 516 of 1010, 1012 within regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 and / or automatically track key points 516 of 1014 within regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 during that time period. In a representative embodiment, computer vision is used to automatically track key points 516 of 1014 within regions of interest 514 of A-plane images 310, 410A, 410B, 510, 710 during that time period. In an exemplary embodiment, step 1000 may include calculating strain 1016 based on speckle tracking or direct strain calculation. Step 1000 may include displaying display system 134 displaying strain images 600, 820, strain 722 overlaid on OV planar images 320, 420A, 420B, 720, 910A, 910B, and / or strain curves 810 over time. In various embodiments, step 1000 may include calculating 1016 at least one measurement result 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, 916B, including area measurements 916A, 916B at the maximum contraction phase 910A and the maximum valsalva phase 910B, length measurements 914A, 914B, height measurements 912A, 912B, and / or ratio measurements. Step 1000 may include displaying measurement results 600, 722, 810, 820, 912A, 912B, 914A, 914B, 916A, and 916B in the display system 134.

[0075] As used herein, the term "circuit" refers to physical electronic components (i.e., hardware) and any software and / or firmware ("code") that is configurable hardware, executed by the hardware, and / or otherwise associated with the hardware. For example, as used herein, a particular processor and memory may include a first "circuit" when executing one or more lines of first code, and a particular processor and memory may include a second "circuit" when executing one or more lines of second code. As used herein, "and / or" refers to any one or more items in a list linked by "and / or". For example, "x and / or y" refers to any element in the three-element set {(x),(y),(x,y)}. Similarly, "x, y and / or z" refers to any element in the seven-element set {(x),(y),(z),(x,y),(x,z),(y,z),(x,y,z)}. As used herein, the term "exemplary" means used as a non-limiting example, instance, or illustration. As used herein, the terms "for example" and "such" introduce a list of one or more non-limiting examples, instances, or illustrations. As used herein, a circuit is "operable" and / or "configured" to perform a function whenever the circuit includes the necessary hardware and code to perform the function (if required), regardless of whether the execution of the function is disabled or not enabled by some user-configurable settings.

[0076] Other embodiments may provide a computer-readable device and / or a non-transitory computer-readable medium and / or a machine-readable device and / or a non-transitory machine-readable medium, wherein the device and / or medium stores machine code executable by a machine and / or a computer program having at least one code segment, thereby enabling the machine and / or computer to perform the steps described herein for automatically tracking the minimum hole size plane of the ultrasound volume in real time during pelvic floor muscle examination.

[0077] Therefore, this disclosure can be implemented in hardware, software, or a combination of hardware and software. This disclosure may be implemented centrally in at least one computer system or distributed, wherein different elements are distributed across several interconnected computer systems. Any kind of computer system or other apparatus suitable for performing the methods described herein is appropriate.

[0078] Various implementations may also be embedded in a computer program product that includes all the features of the methods described herein and is capable of executing those methods when loaded into a computer system. As used herein, a computer program means any expression of a set of instructions represented in any language, code, or notation, which is intended to cause a system with information processing capabilities to directly perform a particular function or to perform a particular function after being: a) translated into another language, code, or notation; or b) reproduced in a different material form.

[0079] While this disclosure has been described with reference to certain embodiments, those skilled in the art will understand that various changes and substitutions can be made without departing from the scope of this disclosure. Furthermore, many modifications can be made to adapt particular situations or materials to the teachings of this disclosure without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the specific embodiments disclosed, but rather to include all embodiments falling within the scope of the appended claims.

Claims

1. An ultrasound imaging method, the method comprising: The ultrasound volume of an anatomical region is acquired over a period of time by the probe of an ultrasound system. An A-plane image is extracted from the ultrasound volume by at least one processor of the ultrasound system, wherein the A-plane image is displayed on the display system of the ultrasound system; The at least one processor receives the OmniView line overlaid on the A-plane image; The at least one processor draws an OmniView planar image based on the position and trajectory of the OmniView lines, wherein the OmniView planar image is presented on the display system; The at least one processor automatically identifies key points in the region of interest in the A-plane image; and The at least one processor automatically tracks the key points in the region of interest in the A-plane image during the time period to automatically adjust the position and trajectory of the OmniView line, and draws the OmniView plane image automatically updated during the time period based on the adjustments made to the position and trajectory of the OmniView line.

2. The method according to claim 1, wherein: The anatomical region is the pelvic region, and The OmniView line, which is overlaid on the A-plane image, passes through the pubic symphysis and levator ani muscle of the pelvic region.

3. The method according to claim 2, wherein: The region of interest in the A-plane image includes the pubic symphysis and the levator ani muscle, and The OmniView planar image corresponds to the plane of minimum crack distance.

4. The method according to claim 1, wherein, The at least one processor performing artificial intelligence performs automatic identification of key points in the region of interest in the A-plane image and / or automatic tracking of the key points in the region of interest in the A-plane image within the time period.

5. The method according to claim 1, wherein, The key points in the region of interest in the A-plane image are automatically tracked during the time period by the at least one processor that performs computer vision.

6. The method according to claim 1, wherein the method comprises: The strain is calculated by the at least one processor based on speckle tracking or direct strain calculation; as well as The display system is rendered by the at least one processor: Strain images The strain and / or strain overlaid on the OmniView planar image The strain curve is shown as the strain over time.

7. The method according to claim 1, wherein the method comprises: The at least one processor calculates at least one measurement result, including area measurements, length measurements, height measurements, and / or ratio measurements during the maximum contraction and maximum valsalva phases; and The at least one processor causes the display system to present the measurement results.

8. An ultrasound system, the ultrasound system comprising: An ultrasound probe, which is operable to acquire ultrasound volume of an anatomical region over a period of time; At least one processor, said at least one processor being configured to: Extract the A-plane image from the ultrasound volume; Receive the OmniView line overlaid on the image of plane A; Draw an OmniView planar image based on the position and trajectory of the OmniView lines; Automatically identify key points in the region of interest in the A-plane image; and Automatically tracking key points in the region of interest within the A-plane image during the time period to automatically adjust the position and trajectory of the OmniView line, wherein the at least one processor is configured to automatically update the OmniView plane image during the time period based on adjustments made to the position and trajectory of the OmniView line; and A display system configured to present: The A-plane image; The OmniView line overlaid on the image in plane A; and The OmniView planar image.

9. The ultrasound system according to claim 8, wherein: The anatomical region is the pelvic region, and The OmniView line, which is overlaid on the A-plane image, passes through the pubic symphysis and levator ani muscle of the pelvic region.

10. The ultrasound system according to claim 9, wherein: The region of interest in the A-plane image includes the pubic symphysis and the levator ani muscle, and The OmniView planar image corresponds to the plane of minimum crack distance.

11. The ultrasound system according to claim 8, wherein, The at least one processor is configured to perform artificial intelligence to automatically identify key points in the region of interest in the A-plane image and / or automatically track the key points in the region of interest in the A-plane image within the time period.

12. The ultrasound system according to claim 8, wherein, The at least one processor is configured to apply computer vision to automatically track the key points in the region of interest in the A-plane image during the time period.

13. The ultrasound system according to claim 8, wherein, The at least one processor is configured to: Strain is calculated based on speckle tracking or direct strain calculation; and The display system shall present: Strain images The strain and / or strain overlaid on the OmniView planar image The strain curve is shown as the strain over time.

14. The ultrasound system according to claim 8, wherein, The at least one processor is configured to: Calculate at least one measurement result, said at least one measurement result including area measurement results, length measurement results, height measurement results, and / or ratio measurement results at the maximum contraction stage and the maximum Valsalva stage; and The display system then presents the measurement results.

15. A non-transitory computer-readable medium storing a computer program, the computer program having at least one code segment executable by a machine to cause an ultrasound system to perform steps including: Receive ultrasound volume of the anatomical region over a period of time; An A-plane image is extracted from the ultrasound volume, wherein... The A-plane image is displayed on the display system of the ultrasound system; Receive the OmniView line overlaid on the image of plane A; An OmniView planar image is drawn based on the position and trajectory of the OmniView lines, wherein the OmniView planar image is presented on the display system; Automatically identify key points in the region of interest in the A-plane image; and During the time period, the key points in the region of interest in the A-plane image are automatically tracked to automatically adjust the position and trajectory of the OmniView line. Based on the adjustments made to the position and trajectory of the OmniView line, the OmniView plane image is drawn and automatically updated during the time period.

16. The non-transitory computer-readable medium according to claim 15, wherein: The anatomical region referred to is the pelvic region. The OmniView line, overlaid on the A-plane image, passes through the pubic symphysis and levator ani muscle of the pelvic region. The region of interest in the A-plane image includes the pubic symphysis and the levator ani muscle, and The OmniView planar image corresponds to the plane of minimum crack distance.

17. The non-transitory computer-readable medium according to claim 15, wherein, By performing artificial intelligence, the system automatically identifies key points in the region of interest within the A-plane image and / or automatically tracks the key points in the region of interest within the A-plane image during the time period.

18. The non-transitory computer-readable medium according to claim 15, wherein, The key points in the region of interest in the A-plane image are automatically tracked within the time period by performing computer vision.

19. The non-transitory computer-readable medium of claim 15, comprising: Strain is calculated based on speckle tracking or direct strain calculation. as well as The display system shall present: Strain images The strain and / or strain overlaid on the OmniView planar image The strain curve is shown as the strain over time.

20. The non-transitory computer-readable medium of claim 15, comprising: Calculate at least one measurement result, said at least one measurement result including area measurement results, length measurement results, height measurement results, and / or ratio measurement results at the maximum contraction stage and the maximum valsalva stage; and The display system then presents the measurement results.

Images