Method and system for adjusting user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views

Abstract

The present disclosure provides a system and method for adjusting user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views. The method includes acquiring an ultrasound image view by an ultrasound system. The method includes automatically detecting a target view from a set of target views by at least one processor of the ultrasound system. The target view corresponds to the ultrasound image view. The method includes automatically determining, by at least one processor, one or both of the presence or absence of multiple anatomical features associated with the target view in the ultrasound image view. The method includes presenting, by at least one processor, at a display system at least one user interface element indicating one or both of the presence or absence of each anatomical feature in the multiple anatomical features.

Description

Technical Field

[0001] Certain embodiments relate to ultrasound imaging. More specifically, certain embodiments relate to methods and systems for adjusting user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views. The adjusted user interface elements can be configured to indicate protocol compliance or non-compliance by identifying anatomical features and / or image features that are present and / or absent in the acquired ultrasound image views associated with a detected target view. Background Art

[0002] Ultrasound imaging is a medical imaging technique used to image organs and soft tissues in the human body. Ultrasound imaging uses real-time, non-invasive, high-frequency sound waves to produce two-dimensional (2D), three-dimensional (3D) and / or four-dimensional (4D) (i.e., real-time / continuous 3D images) images.

[0003] Ultrasound imaging is a valuable non-invasive tool for diagnosing a variety of medical conditions. Several types of ultrasound examinations are performed based on specific examination protocols corresponding to specific examination types. For example, there are examination protocols for multiple types of ultrasound examinations, including obstetric fetal examinations, gynecological examinations, cardiac examinations, etc. The examination protocol may define multiple specific target views and criteria for compliance with the target views based on the presence of certain anatomical features. For example, a protocol for a second-trimester obstetric fetal examination may include multiple predefined views, such as a head transcerebellar plane view, a cross-sectional sagittal plane view, a facial coronal plane view, a sagittal spinal view, a four-chamber heart view, etc. Each predefined view may include criteria for compliance with the protocol, such as the presence of certain anatomical features, image features, etc. For example, a protocol compliance head transcerebellar plane view for a second-trimester obstetric fetal examination may include anatomical features such as the cerebellum, the cavity of the septum pellucidum, the cisterna magna, the midline falx, and the symmetry of the brain, as well as image features such as a specific magnification of the acquired ultrasound image view. However, it may be difficult for an ultrasound operator to ensure that all protocol views have been acquired and that the acquired ultrasound image views are compliant with the protocol.

[0004] Further limitations and disadvantages of conventional and traditional approaches will become apparent to those skilled in the art by comparing such systems with certain aspects of the present disclosure as set forth in the remainder of this application with reference to the accompanying figures. Summary of the invention

[0005] There is provided a system and method for adjusting user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views, substantially as shown and / or described in connection with at least one of the accompanying drawings, as more fully set forth in the claims.

[0006] These and other advantages, aspects and novel features of the present disclosure, as well as details of illustrated embodiments thereof, will be more fully understood from the following description and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a block diagram of an exemplary ultrasound system operable to adjust user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views in accordance with various embodiments.

[0008] Figure 2 An exemplary display according to various embodiments is provided that presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element being presented at a side panel of the display.

[0009] Figure 3 An exemplary display according to various embodiments is shown that presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element being presented at a side panel of a main display and at a touch screen display.

[0010] Figure 4 An exemplary display according to various embodiments presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element being presented at a floating panel of the display.

[0011] Figure 5 An exemplary display according to various embodiments is shown that presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element being presented at a floating panel of a main display and at a touch screen display.

[0012] Figure 6 An exemplary display according to various embodiments presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element comprising a pictogram superimposed on the acquired ultrasound image view.

[0013] Figure 7 An exemplary display according to various embodiments is shown that presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element including a pictogram superimposed on the acquired ultrasound image view presented at a primary display and a user interface element presented at a touch screen display.

[0014] Figure 8 An exemplary display according to various embodiments is shown that presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element being presented at a primary display and including a pictogram superimposed on the acquired ultrasound image view presented at a touch screen display.

[0015] Fig. 9 An exemplary display according to various embodiments presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element comprising structure markers superimposed on the acquired ultrasound image view.

[0016] Fig.10 An exemplary display according to various embodiments is shown that presents an acquired ultrasound image view and user interface elements that identify anatomical features present and absent in the acquired ultrasound image view, the user interface elements including structure markers superimposed on the acquired ultrasound image view presented at a main display and user interface elements presented at a touch screen display.

[0017] Fig.11 An exemplary display according to various embodiments presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element including a three-dimensional (3D) model having a representation of the location of the acquired ultrasound image view and instructions for manipulating an ultrasound probe to acquire a protocol compliance view.

[0018] Fig.12 An exemplary display according to various embodiments is shown that presents an acquired ultrasound image view and a user interface element that identifies anatomical features present and absent in the acquired ultrasound image view, the user interface element including a three-dimensional (3D) model having a representation of the location of the acquired ultrasound image view, instructions for manipulating an ultrasound probe to acquire a protocol compliance view presented at a main display, and a user interface element presented at a touch screen display.

[0019] Fig.13 is a flow chart illustrating exemplary steps that may be used to adjust user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views according to an exemplary embodiment. DETAILED DESCRIPTION

[0020] Certain embodiments may reside in methods and systems for adjusting user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views. Various embodiments have the technical effect of indicating protocol compliance or non-compliance by identifying anatomical features and / or image features that are present and / or absent in acquired ultrasound image views associated with a detected target view. Various aspects of the present disclosure have the technical effect of providing user feedback for manipulating an ultrasound probe to acquire protocol-compliant ultrasound image views.

[0021] When reading in conjunction with the accompanying drawings, the following specific embodiments of the aforementioned invention content and certain embodiments will be better understood. In terms of the scope of the figures of the functional blocks of various embodiments shown in the accompanying drawings, these functional blocks do not necessarily represent the division between hardware circuits. Therefore, for example, one or more functional blocks (e.g., processors or memories) can be implemented in a single piece of hardware (e.g., a general signal processor or random access memory block, a hard disk, etc.) or multiple pieces of hardware. Similarly, a program can be an independent program, can be included in an operating system as a subroutine, can be a function in an installed software package, etc. It should be understood that various embodiments are not limited to the arrangements and tools shown in the accompanying drawings. It should also be understood that embodiments can be combined, or other embodiments can be utilized, and structural, logical and electrical changes can be made without departing from the scope of various embodiments. Therefore, the following detailed description should not be considered as a restrictive meaning, and the scope of the present disclosure is limited by the attached claims and their equivalents.

[0022] As used herein, elements or steps listed in the singular and beginning with the word "one" or "an" should be understood not to exclude a plurality of said elements or steps, unless such exclusion is explicitly stated. In addition, references to "exemplary embodiments," "various embodiments," "certain embodiments," "representative embodiments," etc. are not intended to be interpreted as excluding the presence of additional embodiments that also incorporate the features of the narration. In addition, unless explicitly stated to the contrary, embodiments that "comprise," "include," or "have" an element or multiple elements having a particular property may include additional elements that do not have that property.

[0023] In addition, as used herein, the term "image" refers broadly to both a visible image and the data representing the visible image. However, many embodiments generate (or are configured to generate) at least one visible image. In addition, as used herein, the phrase "image" is used to refer to ultrasound modes, such as B-mode (2D mode), M-mode, three-dimensional (3D) mode, CF mode, PW Doppler, CW Doppler, MGD, and / or a sub-mode of B-mode and / or CF, such as shear wave elastography (SWEI), TVI, Angio, B-flow, BMI, BMI_Angio, and in some cases also includes MM, CM, TVD, wherein "image" and / or "plane" include a single beam or multiple beams.

[0024] Furthermore, as used herein, the term processor or processing unit refers to any type of processing unit, whether single-core or multi-core: CPU, accelerated processing unit (APU), graphics board, DSP, FPGA, ASIC, or a combination thereof, that can perform the required computations required by various implementations.

[0025] It should be noted that various embodiments of generating or forming images described herein may include processing for forming an image that includes beamforming in some embodiments and does not include beamforming in other embodiments. For example, an image may be formed without beamforming, such as by multiplying a matrix of demodulated data by a matrix of coefficients such that the product is an image, and wherein the process does not form any "beams." Additionally, the formation of an image may be performed using a combination of channels that may originate from more than one transmit event (e.g., synthetic aperture techniques).

[0026] In various embodiments, ultrasound processing to form an image, including ultrasound beamforming, such as receive beamforming, is performed, for example, in software, firmware, hardware, or a combination thereof. One specific implementation of an ultrasound system having a software beamformer architecture formed according to various embodiments is described in Figure 1 Shown in.

[0027] Figure 1 is a block diagram of an exemplary ultrasound system 100 operable to adjust user interface elements 220 to 270 based on real-time anatomical structure recognition in an acquired ultrasound image view 210 in accordance with various embodiments. Figure 1 , an ultrasound system 100 is shown. The ultrasound system 100 includes a transmitter 102, an ultrasound probe 104, a transmit beamformer 110, a receiver 118, a receive beamformer 120, an A / D converter 122, an RF processor 124, an RF / IQ buffer 126, a user input device 130, a signal processor 132, an image buffer 136, a display system 134, and an archive 138.

[0028] The transmitter 102 may include suitable logic, circuitry, interfaces and / or code operable to drive the ultrasound probe 104. The ultrasound probe 104 may include a two-dimensional (2D) array of piezoelectric elements. The ultrasound probe 104 may include a set of transmit transducer elements 106 and a set of receive transducer elements 108 that are generally constructed as identical elements. In certain embodiments, the ultrasound probe 104 may be operable to acquire ultrasound image data covering at least a majority of an anatomical structure, such as a heart, a blood vessel, or any suitable anatomical structure.

[0029] The transmit beamformer 110 may include suitable logic, circuitry, interfaces and / or code that may be operable to control the transmitter 102 to drive the set of transmit transducer elements 106 via the transmit sub-aperture beamformer 114 to transmit ultrasound transmit signals into a region of interest (e.g., a person, an animal, an underground cavity, a physical structure, etc.). The transmitted ultrasound signals may be backscattered from structures (e.g., blood cells or tissue) in the object of interest to generate echoes. The echoes are received by the receive transducer elements 108.

[0030] The set of receive transducer elements 108 in the ultrasound probe 104 may be operable to convert received echoes into analog signals, which are sub-aperture beamformed by the receive sub-aperture beamformer 116 and then transmitted to the receiver 118. The receiver 118 may comprise suitable logic, circuitry, interfaces, and / or code that may be operable to receive the signals from the receive sub-aperture beamformer 116. The analog signals may be transmitted to one or more of the plurality of A / D converters 122.

[0031] The plurality of A / D converters 122 may comprise suitable logic, circuitry, interfaces, and / or code that may be operable to convert analog signals from the receiver 118 into corresponding digital signals. The plurality of A / D converters 122 are disposed between the receiver 118 and the RF processor 124. Nevertheless, the present disclosure is not limited in this regard. Therefore, in some embodiments, the plurality of A / D converters 122 may be integrated within the receiver 118.

[0032] The RF processor 124 may include suitable logic, circuitry, interfaces, and / or code that may be operable to demodulate the digital signals output by the plurality of A / D converters 122. According to one embodiment, the RF processor 124 may include a complex demodulator (not shown) that may be operable to demodulate the digital signals to form I / Q data pairs representing corresponding echo signals. The RF or I / Q signal data may then be transferred to the RF / IQ buffer 126. The RF / IQ buffer 126 may include suitable logic, circuitry, interfaces, and / or code that may be operable to provide temporary storage of the RF or I / Q signal data generated by the RF processor 124.

[0033] The receive beamformer 120 may comprise suitable logic, circuitry, interfaces, and / or code operable to perform digital beamforming processing to, for example, sum delayed channel signals received from the RF processor 124 via the RF / IQ buffer 126 and output a beam summed signal. The resulting processed information may be a beam summed signal output from the receive beamformer 120 and communicated to the signal processor 132. According to some embodiments, the receiver 118, the plurality of A / D converters 122, the RF processor 124, and the beamformer 120 may be integrated into a single beamformer, which may be digital. In various embodiments, the ultrasound system 100 comprises a plurality of receive beamformers 120.

[0034] The user input device 130 may be used to enter patient data, scan parameters, settings, select an exam type, protocol and / or template, etc. In an exemplary embodiment, the user input device 130 may be operable to configure, manage and / or control the operation of one or more components and / or modules in the ultrasound system 100. In this regard, the user input device 130 may be used to configure, manage and / or control the operation of the transmitter 102, ultrasound probe 104, transmit beamformer 110, receiver 118, receive beamformer 120, RF processor 124, RF / IQ buffer 126, user input device 130, signal processor 132, image buffer 136, display system 134 and / or archive 138. The user input device 130 may include buttons, rotary encoders, touch screens, touch pads, trackballs, motion tracking, voice recognition, mouse devices, keyboards, cameras and / or any other device capable of receiving user instructions. In certain embodiments, for example, one or more of the user input devices 130 may be integrated into other components such as the display system 134. For example, user input device 130 may include a touch screen display.

[0035] The signal processor 132 may include suitable logic, circuitry, interfaces, and / or code that is operable to process ultrasound scan data (i.e., the summed IQ signal) to generate an ultrasound image for presentation on a display system 134. The signal processor 132 is operable to perform one or more processing operations based on a plurality of selectable ultrasound modalities on the acquired ultrasound scan data. In an exemplary embodiment, the signal processor 132 may be used to perform display processing and / or control processing, etc. The acquired ultrasound scan data may be processed in real time during a scanning session as echo signals are received. Additionally or alternatively, the ultrasound scan data may be temporarily stored in the RF / IQ buffer 126 during a scanning session and processed in a less real-time manner in an online operation or an offline operation. In various embodiments, the processed image data may be presented at the display system 134 and / or may be stored at an archive 138. The archive 138 may be a local archive, a picture archiving and communication system (PACS), an enterprise archive (EA), a vendor-independent archive (VNA), or any suitable device for storing images and related information.

[0036] The signal processor 132 may be one or more central processing units, microprocessors, microcontrollers, etc. For example, the signal processor 132 may be an integrated component, or may be distributed in various locations. In an exemplary embodiment, the signal processor 132 may include a view detection processor 140, an anatomical structure detection processor 150, and a user interface element processor 160. The signal processor 132 may be capable of receiving input information from the user input device 130 and / or the archive 138, receiving image data, generating output that may be displayed by the display system 134, and manipulating the output in response to the input information from the user input device 130, etc. The signal processor 132 (which includes the view detection processor 140, the anatomical structure detection processor 150, and the user interface element processor 160) may be capable of, for example, executing any of the methods and / or instruction sets discussed herein according to various embodiments.

[0037] The ultrasound system 100 is operable to continuously acquire ultrasound scan data at a frame rate suitable for the imaging situation under consideration. Typical frame rates are in the range of 20 to 120 frames per second, but may be lower or higher. The acquired ultrasound scan data may be displayed on the display system 134 at a display rate that is the same as the frame rate, or slower or faster. An image buffer 136 is included for storing processed frames of acquired ultrasound scan data that are not scheduled for immediate display. Preferably, the image buffer 136 has sufficient capacity to store frames of ultrasound scan data for at least several minutes. The frames of ultrasound scan data are stored in a manner that is easy to retrieve from them according to their acquisition order or time. The image buffer 136 may be embodied as any known data storage medium.

[0038] The signal processor 132 may include a view detection processor 140 that includes suitable logic, circuitry, interfaces, and / or code that is operable to detect a target view provided by a captured ultrasound image view. For example, during a second trimester obstetric fetal examination, an associated protocol may define multiple views to be acquired, such as a head transcerebellar plane view, a cross-sectional sagittal plane view, a facial coronal plane view, a sagittal spinal view, a four-chamber heart view, etc. The view detection processor 140 may include suitable logic components, circuitry, interfaces, and / or code that are operable to provide image analysis techniques to determine which target views are provided in the captured ultrasound image view. In various embodiments, the view detection processor 140 may include, for example, an artificial intelligence image analysis algorithm, one or more deep neural networks (e.g., convolutional neural networks, such as u-net) and / or may utilize any suitable form of artificial intelligence image analysis technology or machine learning processing functionality configured to detect views of the captured ultrasound image view. Additionally and / or alternatively, an artificial intelligence image analysis technique or machine learning processing function configured to provide a view detection function may be provided by a different processor or distributed on multiple processors at the ultrasound system 100 and / or distributed on a remote processor communicatively coupled to the ultrasound system 100. For example, the view detection function may be provided as a deep neural network, which may be composed of, for example, an input layer, an output layer, and one or more hidden layers between the input layer and the output layer. Each layer may be composed of a plurality of processing nodes, which may be referred to as neurons. For example, the view detection function may include an input layer having a neuron for each pixel or a group of pixels from an acquired ultrasound image view. Depending on the type of examination, the output layer may have neurons corresponding to a plurality of predefined ultrasound image target views, such as a head transcerebellar plane view, a cross-sectional sagittal plane view, a facial coronal plane view, a sagittal spinal view, a four-chamber heart view, an unknown view, or any suitable target view. Each neuron in each layer may perform a processing function and pass the processed image information to one of a plurality of neurons in a downstream layer for further processing. For example, neurons in a first layer may learn to identify structural edges in image data. The neurons in the second layer can learn to recognize shapes based on detected edges from the first layer. The neurons in the third layer can learn the positions of the recognized shapes relative to landmarks in the image data. The processing performed by the deep neural network can recognize with high probability the target view provided by the acquired ultrasound image view.

[0039] The signal processor 132 may include an anatomical structure detection processor 150, which includes suitable logic components, circuits, interfaces and / or codes, which logic components, circuits, interfaces and / or codes are operable to determine whether anatomical features and / or image features associated with the detected target view are present in the acquired ultrasound image view. For example, the associated protocol may define that the acquired protocol-compliant ultrasound image view of a particular target view detected by the view detection processor 140 includes specific anatomical features and / or image features. For example, a head transcerebellar plane view for a second-trimester obstetric fetal examination may be defined by the protocol to include anatomical features such as the cerebellum, the cavity of the septum pellucidum, the cisterna magna, the midline falx and the symmetry of the brain, as well as image features such as a specific magnification of the acquired ultrasound image view. The anatomical structure detection processor 150 may include suitable logic components, circuits, interfaces and / or codes, which logic components, circuits, interfaces and / or codes are operable to provide image analysis techniques to determine the presence and absence of features in the acquired ultrasound image view defined by the protocol associated with the target view detected by the view detection processor 140. For example, the anatomical structure detection processor 150 may determine a spatial probability distribution of a set of anatomical structures defined as being present in a particular view.

[0040] In various embodiments, the anatomical structure detection processor 150 may include, for example, an artificial intelligence image analysis algorithm, one or more deep neural networks (e.g., convolutional neural networks, such as u-net) and / or may utilize any suitable form of artificial intelligence image analysis technology or machine learning processing functionality configured to determine the presence and absence of features in the acquired ultrasound image views. Additionally and / or alternatively, the artificial intelligence image analysis technology or machine learning processing functionality configured to provide feature presence determination functionality may be provided by different processors or distributed on multiple processors at the ultrasound system 100 and / or distributed on a remote processor communicatively coupled to the ultrasound system 100. For example, the feature presence determination functionality may be provided as a deep neural network, which may be composed of, for example, an input layer, an output layer, and one or more hidden layers between the input layer and the output layer. Each layer may be composed of multiple processing nodes, which may be referred to as neurons. For example, the feature presence determination functionality may include an input layer having a neuron for each pixel or group of pixels from the acquired ultrasound image view. The output layer may have neurons corresponding to each combination of the presence and / or absence of features in the acquired ultrasound image view. Each neuron in each layer may perform a processing function and pass the processed image information to one of the neurons in the downstream layer for further processing. For example, neurons in the first layer may learn to recognize edges of structures in the image data. Neurons in the second layer may learn to recognize shapes based on detected edges from the first layer. Neurons in the third layer may learn the location of the recognized shapes relative to landmarks in the image data. The processing performed by the deep neural network may determine with a high degree of probability the presence or absence of protocol-defined features provided by the acquired ultrasound image views.

[0041] The signal processor 132 may include a user interface element processor 160 including suitable logic, circuitry, interfaces, and / or code operable to generate and present user interface elements 220-270 at the display system 134 that identify anatomical structures present and / or absent in the acquired ultrasound image view determined by the anatomical structure detection processor 150. For example, the user interface elements 220-270 may include graphical identifiers 220 such as pictograms 222, 240 and / or structure overlays 250 with indicia 224, 226 corresponding to anatomical features and / or image features detected as present 224 and / or absent 226 in the acquired ultrasound image view 210 corresponding to the target view. The pictogram 222 may be presented in a side panel, a floating panel 200C, and / or a display 200B that is separate from a primary display 200A presenting the acquired ultrasound image view 210. In various embodiments, the user interface element processor 160 may be configured to align the pictogram template 240 or the structure overlay template 250 with the acquired ultrasound image view 210 and present the pictogram template 240 or the structure overlay template 250 overlaid on the acquired ultrasound image view 210 with markers 224, 226, or other identifiers indicating the presence 224 and / or absence 226 of anatomical features and / or image features in the acquired ultrasound image view 210.

[0042] As another example, the user interface elements 220 to 270 may include a list 230 of anatomical features and / or image features detected as being present 232 and / or missing 234 in the acquired ultrasound image view 210 corresponding to the target view. The list 230 may be presented in a side panel, a center panel, a floating panel 200C, and / or a display 200B separate from the main display 200A presenting the acquired ultrasound image view 210. As another example, the user interface element may include a three-dimensional (3D) anatomical model 260 having a representation 262 of the location of the acquired ultrasound image view 210. For example, an acquired ultrasound image view 210 of a head transcerebellar plane view for a second trimester obstetric fetal examination may include user interface elements 220 to 270 including a 3D model 260 of a fetus and a plane 262 showing the current location of the acquired ultrasound image view 210 through the 3D model 260 of the fetus. In another exemplary embodiment, the user interface elements 220 to 270 may additionally and / or alternatively include instructions 270 for manipulating the ultrasound probe to acquire a protocol compliance view. For example, the instructions 270 may include text, directional icons, audio, etc. that provide feedback to the operator for manipulating the position and / or orientation of the ultrasound probe 104 and / or adjusting imaging settings to acquire a protocol compliance view that depicts anatomical features and / or image features of a protocol compliance view for a detected target view. The imaging settings may include gain, depth, zoom level, and / or any suitable image settings.

[0043] The user interface element processor 160 may comprise suitable logic, circuitry, interfaces, and / or code operable to generate and present the user interface elements 220-270 at one or more displays 200A, 200B, 200C of the display system 134. Various combinations of the user interface elements 220-270 may be displayed at various locations within the displays 200A, 200B, 200C of the display system 134. The generation and presentation of the user interface elements 220-270 by the user interface element processor 160 may be based on the exam type, default settings, user-defined settings, etc.

[0044] Figure 2 2 is an exemplary display 200, 200B presenting an acquired ultrasound image view 210 and user interface elements 220-234 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-234 being presented at a side panel of the display 200, 200B according to various embodiments. Figure 2The display 200 may be a touch screen display 200B, a main display, or any suitable display of the display system 134. The display 200 may include an acquired ultrasound image view 210 and user interface elements 220 to 234, among others. The acquired ultrasound image view 210 may correspond to a target view of the protocol. For example, Figure 2 The acquired ultrasound image view 210 shows a head transcerebellar plane view for a second trimester obstetric fetal examination. For example, a protocol associated with the head transcerebellar plane view may include anatomical features such as the cerebellum, the cavity of the septum pellucidum, the cisterna magna, the midline falx, and the symmetry of the brain, as well as image features such as a specific magnification of the acquired ultrasound image view. User interface elements 220 to 234 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying anatomical features and / or image features that are present 224, 232 and / or absent 226, 234 in the acquired ultrasound image view 210. User interface elements 220 to 234 may include a graphical identifier 220 and a list 230, among others. The graphical identifier 220 may include a pictogram 222 of an anatomical structure and a mark identifying the presence 224 and / or absence 226 of an anatomical feature and / or image feature. List 230 may include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present. Figure 2 , the labels 224, 226 and list indicators 232, 234 may correspond to, for example, the cerebellum, the cavity of the septum pellucidum, the cisterna magna, the midline falx, the symmetry of the brain, and a particular magnification of the acquired ultrasound image view 210, as defined by the protocol for the head transcerebellar plane view for second trimester obstetric fetal examination. The labels 224, 226 and list indicators 232, 234 may distinguish between the presence and absence of features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, or any suitable mechanism. Figure 2 As shown, the user interface elements 220 - 234 may be presented at the side panels of the display 200B, with the acquired ultrasound image view 210 presented at the center panel of the display 200B.

[0045] Figure 3 An exemplary display 300, 200A, 200B is shown presenting an acquired ultrasound image view 210 and user interface elements 220-234 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-234 being presented at a side panel of a main display 200A and at a touch screen display 200B in accordance with various embodiments. Figure 3, the display 300 may include a main display 200A, a touch screen display 200B and / or any suitable display of the display system 134 . Figure 3 The main display 200A of the exemplary embodiment of the can include the acquired ultrasound image view 210 and user interface elements 220 to 234, etc. The acquired ultrasound image view 210 can correspond to the target view of the protocol. The user interface elements 220 to 234 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the anatomical features and / or image features present 224, 232 and / or missing 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 234 may include a graphic identifier 220 and a list 230, etc. The graphic identifier 220 may include a pictogram 222 of an anatomical structure and a mark identifying the presence 224 and / or absence 226 of an anatomical feature and / or image feature. The list 230 may include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature exists. The labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, or any suitable mechanism. Figure 3 As shown, the user interface elements 220 to 234 may be presented at the side panels of the main display 200A, wherein the acquired ultrasound image view 210 is presented at the center panel of the main display 200A. In addition and / or alternatively, the user interface elements 220 to 234 may be presented at the touch screen display 200B of the display system 134.

[0046] Figure 4 2 is an exemplary display 400, 200B, 200C presenting an acquired ultrasound image view 210 and user interface elements 220-234 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-234 being presented at a floating panel 200C of the display 400, 200B, 200C according to various embodiments. Figure 4, the display 400 may be any suitable display of the touch screen display 200B, the floating display 200C, the main display, or the display system 134. For example, the display 400 may include the acquired ultrasound image view 210 presented at the touch screen display 200B and the user interface elements 220 to 234 presented at the floating display 200C within the touch screen display 200B. The acquired ultrasound image view 210 may correspond to the target view of the protocol. The user interface elements 220 to 234 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the anatomical features and / or image features present 224, 232 and / or absent 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 234 may include a graphical identifier 220 and a list 230, among others. The graphical identifier 220 may include a pictogram 222 of an anatomical structure and a mark identifying the presence 224 and / or absence 226 of an anatomical feature and / or image feature. List 230 may include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. Labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, or any suitable mechanism. Figure 4 As shown, the acquired ultrasound image view 210 may be presented at the touch screen display 200B and the user interface elements 220 - 234 may be presented in a floating panel 200C within the touch screen display 200B.

[0047] Figure 5 An exemplary display 500, 200A, 200B, 200C is shown presenting an acquired ultrasound image view 210 and user interface elements 220-234 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-234 being presented at a floating panel 200C of a primary display 200A and at a touch screen display 200B, according to various embodiments. Figure 5 , the display 500 may include a main display 200A, a touch screen display 200B, a floating display 200C within the main display 200A, and / or any suitable display of the display system 134. Figure 5The main display 200A of the exemplary embodiment of the can include the acquired ultrasound image view 210 and the floating display 200C presenting the user interface elements 220 to 234, etc. The acquired ultrasound image view 210 can correspond to the target view of the protocol. The user interface elements 220 to 234 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the anatomical features and / or image features present 224, 232 and / or missing 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 234 can include a graphical identifier 220 and a list 230, etc. The graphical identifier 220 can include a pictogram 222 of an anatomical structure and a mark identifying the presence 224 and / or absence 226 of an anatomical feature and / or image feature. The list 230 can include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. The labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, and / or any suitable mechanism. Figure 5 As shown, the user interface elements 220 to 234 may be presented in a floating display 200C presented within the main display 200A, wherein the acquired ultrasound image view 210 is presented in the main display 200A. In addition and / or alternatively, the user interface elements 220 to 234 may be presented at the touch screen display 200B of the display system 134.

[0048] Figure 6 2 is an exemplary display 600, 200B presenting an acquired ultrasound image view 210 and user interface elements 220-240 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-240 including a pictogram 240 superimposed on the acquired ultrasound image view 210, according to various embodiments. Figure 6, the display 600 may be a touch screen display 200B, a main display, or any suitable display of the display system 134. The display 600 may include an acquired ultrasound image view 210 and user interface elements 220 to 240, among others. The acquired ultrasound image view 210 may correspond to a target view of a protocol. The user interface elements 220 to 240 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the presence 224, 232 and / or absence 226, 234 of anatomical features and / or image features in the acquired ultrasound image view 210. The user interface elements 220 to 240 may include a graphical identifier 220 and a list 230, among others. The graphical identifier 220 may include a pictogram 240 of an anatomical structure registered to and superimposed on the acquired ultrasound image view 210 and a mark identifying the presence 224 and / or absence 226 of an anatomical feature and / or image feature. List 230 may include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. Labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, or any suitable mechanism. Figure 6 As shown, user interface elements 220 - 240 may be presented at the touch screen display 200B along with the acquired ultrasound image view 210 .

[0049] Figure 7 An exemplary display 700, 200A, 200B is shown presenting an acquired ultrasound image view 210 and user interface elements 220-240 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-240 including a pictogram 240 overlaid on the acquired ultrasound image view 210 presented at the primary display 200A and user interface elements 220-234 presented at the touch screen display 200B, in accordance with various embodiments. Figure 7 , the display 700 may include a main display 200A, a touch screen display 200B and / or any suitable display of the display system 134. Figure 7The main display 200A of the exemplary embodiment of the can include the acquired ultrasound image view 210 and user interface elements 220 to 240, etc. The acquired ultrasound image view 210 can correspond to the target view of the protocol. The user interface elements 220 to 240 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the anatomical features and / or image features present 224, 232 and / or missing 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 240 can include a graphic identifier 220 and a list 230, etc. The graphic identifier 220 can include a pictogram 240 of an anatomical structure registered to and superimposed on the acquired ultrasound image view 210 and a mark identifying the presence 224 and / or absence 226 of the anatomical features and / or image features. The list 230 can include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. The labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, and / or any suitable mechanism. Figure 7 As shown, the user interface elements 220 to 240 may be presented at the primary display 200A along with the acquired ultrasound image view 210. Additionally and / or alternatively, the user interface elements 220 to 234 may be presented at the touch screen display 200B of the display system 134.

[0050] Figure 8 An exemplary display 800, 200A, 200B is shown presenting an acquired ultrasound image view 210 and user interface elements 220-240 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 230-234 being presented at a primary display 200A and including a pictogram 240 overlaid on the acquired ultrasound image view 210 presented at a touch screen display 200B, in accordance with various embodiments. Figure 8 , the display 800 may include a main display 200A, a touch screen display 200B and / or any suitable display of the display system 134. Figure 8The touch screen display 200B of the exemplary embodiment of the can include an acquired ultrasound image view 210 and user interface elements 220 to 240, etc. The acquired ultrasound image view 210 can correspond to the target view of the protocol. The user interface elements 220 to 240 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the anatomical features and / or image features present 224, 232 and / or missing 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 240 can include a graphic identifier 220 and a list 230, etc. The graphic identifier 220 can include a pictogram 240 of an anatomical structure registered to and superimposed on the acquired ultrasound image view 210 and a mark identifying the presence 224 and / or absence 226 of the anatomical features and / or image features. The list 230 can include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. The labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, and / or any suitable mechanism. Figure 8 As shown, the user interface elements 220 to 240 may be presented at the touch screen display 200B along with the acquired ultrasound image view 210. Additionally and / or alternatively, the user interface elements 220 to 234 and the acquired ultrasound image view 210 may be presented on the main display 200A of the display system 134.

[0051] Fig. 9 2 is an exemplary display 900, 200B presenting an acquired ultrasound image view 210 and user interface elements 220-234, 250 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-234, 250 including structure markers 250 superimposed on the acquired ultrasound image view 210, according to various embodiments. Fig. 9, the display 900 may be a touch screen display 200B, a main display, or any suitable display of the display system 134. The display 900 may include an acquired ultrasound image view 210 and user interface elements 220 to 234, 250, etc. The acquired ultrasound image view 210 may correspond to a target view of the protocol. The user interface elements 220 to 234, 250 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the presence 224, 232 and / or absence 226, 234 of anatomical features and / or image features in the acquired ultrasound image view 210. The user interface elements 220 to 234, 250 may include a graphical identifier 220 and a list 230, etc. The graphical identifier 220 may include a structure marker 250 (also referred to as an overlaid anatomical structure 250) registered to and superimposed on the acquired ultrasound image view 210 and a marker identifying the presence 224 and / or absence 226 of anatomical features and / or image features. List 230 may include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. Labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, or any suitable mechanism. Fig. 9 As shown, user interface elements 220 - 234 , 250 may be presented along with the acquired ultrasound image view 210 at the touch screen display 200B.

[0052] Fig.10 An exemplary display 1000, 200A, 200B is shown presenting an acquired ultrasound image view 210 and user interface elements 220-234, 250 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 210, the user interface elements 220-234, 250 including structure markers 250 superimposed on the acquired ultrasound image view 210 presented at the primary display 200A and the user interface elements 220-234 presented at the touch screen display 200B, in accordance with various embodiments. Fig.10 , the display 1000 may include a main display 200A, a touch screen display 200B and / or any suitable display of the display system 134. Fig.10The main display 200A of the exemplary embodiment of the can include the acquired ultrasound image view 210 and user interface elements 220 to 234, 250, etc. The acquired ultrasound image view 210 can correspond to the target view of the protocol. The user interface elements 220 to 234, 250 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying the anatomical features and / or image features present 224, 232 and / or missing 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 234, 250 may include a graphic identifier 220 and a list 230, etc. The graphic identifier 220 may include a structure marker 250 (also referred to as an overlaid anatomical structure 250) registered to and superimposed on the acquired ultrasound image view 210 and a marker identifying the presence 224 and / or absence 226 of the anatomical features and / or image features. List 230 may include, for example, a list of anatomical features and / or image features present in the protocol compliance view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. Labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, location, shape, color, and / or any suitable mechanism. Fig.10 As shown, the user interface elements 220 to 234, 250 may be presented at the primary display 200A along with the acquired ultrasound image view 210. Additionally and / or alternatively, the user interface elements 220 to 234 may be presented at the touch screen display 200B of the display system 134.

[0053] Fig.11 An exemplary display 1100, 200B presenting an acquired ultrasound image view 210 and user interface elements 220-234, 260-270 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 1100, 200B, the user interface elements 220-234, 260-270 including a three-dimensional (3D) model 260 having a representation 262 of the location of the acquired ultrasound image view 210 and instructions 270 for manipulating the ultrasound probe 104 to acquire a protocol compliance view, according to various embodiments. Fig.11, the display 1100 may be a touch screen display 200B, a main display, or any suitable display of the display system 134. The display 1100 may include an acquired ultrasound image view 210 and user interface elements 220 to 234, 260-270, etc. The acquired ultrasound image view 210 may correspond to a target view of the protocol. The user interface elements 220 to 234, 260 to 270 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying anatomical features and / or image features present 224, 232 and / or missing 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 234, 260 to 270 may include a graphical identifier 220 and a list 230, etc. The graphical identifier 220 may include a 3D model 260 of the anatomical structure, a representation 262 of a plane relative to the 3D model corresponding to the acquired ultrasound image view 210, instructions 270 for manipulating the ultrasound probe 104 to acquire a protocol-compliant view, a pictogram 222, and / or a marker identifying the presence 224 and / or absence 226 of an anatomical feature and / or image feature. The instructions 270 may include text, a directional icon, and / or any suitable instructions for adjusting probe settings and / or manipulating probe position and / or orientation to acquire an ultrasound image view 210 having anatomical features and / or image features for a detection view defined by the protocol. The list 230 may include, for example, a list of anatomical features and / or image features present in the protocol-compliant view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. The markers 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, or any suitable mechanism. Fig.11 As shown, user interface elements 220 - 234 , 260 - 270 may be presented at the touch screen display 200B along with the acquired ultrasound image view 210 .

[0054] Fig.12 An exemplary display 1200, 200A, 200B is shown presenting an acquired ultrasound image view 210 and user interface elements 220-234, 260-270 identifying anatomical features present 224, 232 and absent 226, 234 in the acquired ultrasound image view 1100, 200B, the user interface elements 220-234, 260-270 including a three-dimensional (3D) model 260 having a representation 262 of the location of the acquired ultrasound image view, instructions 270 for manipulating the ultrasound probe 104 to acquire a protocol compliance view presented at the primary display 200A, and the interface elements 220-234 presented at the touch screen display 200B, in accordance with various embodiments. Reference Fig.12 , the display 1200 may include a main display 200A, a touch screen display 200B and / or any suitable display of the display system 134. Fig.12 The main display 200A of the exemplary embodiment of may include the acquired ultrasound image view 210 and user interface elements 220 to 234, 260 to 270, etc. The acquired ultrasound image view 210 may correspond to the target view of the protocol. The user interface elements 220 to 234, 260 to 270 provide feedback on whether the acquired ultrasound image view 210 is a protocol compliance view by identifying anatomical features and / or image features present 224, 232 and / or missing 226, 234 in the acquired ultrasound image view 210. The user interface elements 220 to 234, 260 to 270 may include a graphical identifier 220 and a list 230, etc. The graphical identifier 220 may include a 3D model 260 of the anatomical structure, a representation 262 of a plane relative to the 3D model corresponding to the acquired ultrasound image view 210, instructions 270 for manipulating the ultrasound probe 104 to acquire a protocol-compliant view, a pictogram 222, and / or a marker identifying the presence 224 and / or absence 226 of anatomical features and / or image features. The instructions 270 may include text, a directional icon, and / or any suitable instructions for adjusting probe settings and / or manipulating probe position and / or orientation to acquire an ultrasound image view 210 having anatomical features and / or image features for a detection view defined by the protocol. The list 230 may include, for example, a list of anatomical features and / or image features present in a protocol-compliant view and an indication of whether each anatomical feature and / or image feature is present 232 or absent 234. The labels 224, 226 and list indicators 232, 234 may distinguish between present and absent features and / or distinguish between different anatomical structures and / or image features by text, number, position, shape, color, and / or any suitable mechanism. Fig.12 As shown, the user interface elements 220, 230 to 234, 260 to 270 may be presented at the primary display 200A along with the acquired ultrasound image view 210. Additionally and / or alternatively, the user interface elements 220 to 234 may be presented at the touch screen display 200B of the display system 134.

[0055] Reference again Figure 1, the display system 134 can be any device capable of conveying visual information to a user. For example, the display system 134 can include a liquid crystal display, a light emitting diode display, and / or any suitable one or more displays. The display system 134 can be operable to display information from the signal processor 132 and / or the archive 138, such as the acquired ultrasound image view 210, user interface elements 220 to 270, such as pictograms 222, labels 224, 226, list items 230, 232, 234, superimposed pictograms 240, superimposed anatomical structures 250 (also referred to as structure labels 250), 3D anatomical models 260, spatial representations of the current image plane 262, instructions 270 for manipulating the ultrasound probe 104, and / or any suitable information. In various embodiments, one or more displays of the display system 134 can be and / or include a touch screen display 200B.

[0056] The archive 138 may be one or more computer-readable memories, such as a picture archiving and communication system (PACS), an enterprise archive (EA), a vendor-independent archive (VNA), a server, a hard disk, a floppy disk, a CD, a CD-ROM, a DVD, a compact storage device, a flash memory, a random access memory, a read-only memory, an electrically erasable and programmable read-only memory, and / or any suitable memory, that are integrated with and / or communicatively coupled (e.g., via a network) to the ultrasound system 100. The archive 138 may include, for example, a database, a library, a collection of information, or other memory that is accessed by and / or coupled to the signal processor 132. For example, the archive 138 may be capable of storing data temporarily or permanently. The archive 138 may be capable of storing medical image data, data generated by the signal processor 132, and / or instructions readable by the signal processor 132, etc. In various embodiments, the archive 138 stores acquired ultrasound image views 210, instructions for detecting views of the acquired ultrasound image views 210, instructions for detecting anatomical features and / or image features in the acquired ultrasound image views 210, and / or instructions for presenting user interface elements 220 to 270 based on the presence and / or absence of the detected features in the acquired ultrasound image views 210 associated with the detected target views, etc.

[0057] Fig.13 13 is a flow chart 1300 illustrating exemplary steps 1302 to 1318 that may be used to adjust user interface elements 220 to 270 based on real-time anatomical structure recognition in an acquired ultrasound image view 210 according to an exemplary embodiment. Fig.13, which shows a flowchart 1300 including exemplary steps 1302 to 1318. Certain embodiments may omit one or more steps, and / or perform the steps in a different order than listed, and / or combine certain steps discussed below. For example, some steps may not be performed in certain embodiments. For another example, certain steps may be performed in a different time sequence than listed below, including being performed simultaneously.

[0058] At step 1302, an ultrasound examination may be initiated at the ultrasound system 100. For example, an operator of the ultrasound system 100 may select an examination type, such as an obstetric fetal examination, a gynecological examination, a cardiac examination, etc., via the user input device 130. The selected examination type may be associated with an examination protocol that defines a plurality of specific target views and criteria for compliance with the target views based on the presence of certain anatomical features. For example, a protocol for a second trimester obstetric fetal examination may include a plurality of predefined views, such as a head transcerebellar plane view, a cross-sectional sagittal plane view, a facial coronal plane view, a sagittal spinal view, a four-chamber heart view, etc. Each predefined view may include criteria for compliance with the protocol, such as the presence of certain anatomical features, image features, etc. For example, a protocol compliance head transcerebellar plane view for a second trimester obstetric fetal examination may include anatomical features such as the cerebellum, the cavity of the septum pellucidum, the cisterna magna, the midline falx, and the symmetry of the brain, as well as image features such as a specific magnification of the acquired ultrasound image view.

[0059] At step 1304, the ultrasound system 100 may acquire a real-time ultrasound image and receive an instruction to freeze the acquired ultrasound image view 210. For example, the ultrasound probe 104 of the ultrasound system 100 may acquire a real-time ultrasound image of an anatomical structure. The signal processor 132 may receive an instruction from the user input device 130 to freeze the acquired ultrasound image view 210.

[0060] At step 1306, the signal processor 132 of the ultrasound system 100 may automatically detect whether the acquired ultrasound image view 210 is one of a set of target views for the ultrasound examination. For example, the view detection processor 140 of the signal processor 132 may be configured to detect the target view provided by the acquired ultrasound image view 210. For example, if a second trimester obstetric fetal examination is selected at step 1302, the associated protocol may define a plurality of views to be acquired, such as a head transcerebellar plane view, a cross-sectional sagittal plane view, a facial coronal plane view, a sagittal spinal view, a four-chamber heart view, etc. The view detection processor 140 may be operable to provide an image analysis technique, such as an artificial intelligence image analysis algorithm, one or more deep neural networks (e.g., a convolutional neural network such as a u-net), and / or any suitable form of artificial intelligence image analysis technique or machine learning processing function, to determine which target view is provided in the acquired ultrasound image view 210 acquired at step 1304. In various embodiments, if the detected view is an unknown view or is otherwise not one of the target views, process 1300 may return to step 1304 to acquire a different ultrasound image view 210 .

[0061] At step 1308, the signal processor 132 of the ultrasound system 100 may automatically determine the presence and / or absence of anatomical structures associated with the detected target view in the acquired ultrasound image view 210. For example, the anatomical structure detection processor 150 of the signal processor 132 may be configured to determine whether anatomical features and / or image features associated with the detected target view are present in the acquired ultrasound image view 210. The protocol associated with the exam type selected at step 1302 may define that the acquired ultrasound image view 210 includes specific anatomical features and / or image features as determined by the protocol compliance of a particular target view as detected by the view detection processor 140 at step 1306. For example, a head transcerebellar plane view for a second trimester obstetric fetal exam may be defined by the protocol to include anatomical features such as the cerebellum, cavum septum pellucidum, cisterna magna, midline falx, and cerebral symmetry, as well as image features such as a particular magnification of the acquired ultrasound image view. The anatomical structure detection processor 150 is operable to provide image analysis techniques, such as artificial intelligence image analysis algorithms, one or more deep neural networks (e.g., convolutional neural networks such as u-net), and / or any suitable form of artificial intelligence image analysis techniques or machine learning processing functionality to determine features that are present and absent in the acquired ultrasound image views 210 as defined by the protocol associated with the target view detected by the view detection processor 140 at step 1306. In various embodiments, the anatomical structure detection processor 150 may determine a spatial probability distribution of a set of anatomical structures defined as being present in a particular view.

[0062] At step 1310, the signal processor 132 of the ultrasound system 100 may present identifications 220-234 of anatomical structures that are present 224, 232 and / or absent 226, 234 in the acquired ultrasound image view 210. For example, the user interface element processor 160 of the signal processor 132 may be configured to generate and present, at the display system 134, user interface elements 220-234 that identify the anatomical structures that are present 224, 232 and / or absent 226, 234 in the acquired ultrasound image view 210 as determined by the anatomical structure detection processor 150 at step 1308. The user interface elements 220-234 may include a graphical identifier 220, such as a pictogram 222 having a label 224, 226 that corresponds to the anatomical features and / or image features that are present 224 and / or absent 226 in the acquired ultrasound image view 210 detected at step 1306 as corresponding to the target view. The pictogram 222 may be presented in a side panel, a floating panel 200C, and / or a display 200B separate from the primary display 200A presenting the acquired ultrasound image view 210, such as Figures 2 to 5 As shown and described above. As another example, the user interface elements 220 to 234 may include a list 230 of anatomical features and / or image features present 232 and / or missing 234 in the acquired ultrasound image view 210 that are detected as corresponding to the target view at step 1306. The list 230 may be presented in a side panel, a center panel, a floating panel 200C, and / or a display 200B that is separate from the main display 200A presenting the acquired ultrasound image view 210. In various embodiments, if the acquired ultrasound image view 210 does not comply with the protocol (e.g., is missing anatomical features and / or image features), the process 1300 may return to step 1304 to acquire a different ultrasound image view 210.

[0063] At step 1312, the signal processor 132 of the ultrasound system 100 may spatially register the pictogram template 240 with the acquired ultrasound image view 210. For example, the user interface element processor 160 may be configured to register the pictogram template 240 or the structure overlay template 250 with the acquired ultrasound image view 210. The pictogram template 240 and / or the structure overlay template 250 may be associated with a particular target view and correspond to an anatomical structure depicted in the acquired ultrasound image view 210.

[0064] At step 1314, the signal processor 132 of the ultrasound system 100 may present a pictogram 240 overlaid on the acquired ultrasound image view 210 that identifies the anatomical structures present 224, 232 and / or absent 226, 234 in the acquired ultrasound image view 210. For example, the user interface element processor 160 of the signal processor 132 may be configured to present a graphical identifier 220, such as a pictogram 240 and / or a structure overlay 250 having indicia 224, 226 corresponding to the anatomical features and / or image features present 224 and / or absent 226 in the acquired ultrasound image view 210 detected at step 1306 as corresponding to the target view, such as Figures 6 to 10 In various embodiments, if the acquired ultrasound image view 210 does not comply with the protocol (eg, is missing anatomical features and / or image features), the process 1300 can return to step 1304 to acquire a different ultrasound image view 210 .

[0065] At step 1316, the signal processor 132 of the ultrasound system 100 may spatially register the acquired ultrasound image view 210 with the 3D model 260 of the corresponding anatomical structure. For example, the user interface element processor 160 of the signal processor 132 may be configured to register the acquired ultrasound image view 210 of the fetal anatomical structure with the 3D model 260 of the fetus.

[0066] At step 1318, the signal processor 132 of the ultrasound system 100 may present the 3D model 260 with the identifier of the acquired ultrasound image view 210 and / or instructions 270 for manipulating the ultrasound probe 104 to acquire the protocol-compliant ultrasound image view. For example, the user interface element processor 160 of the signal processor 132 may be configured to present the 3D model 260 generated at step 1316 and a representation 262 of the location of the ultrasound image view 210 acquired at the display system 134. As another example, the user interface element processor 160 may be configured to generate and present instructions 270 for manipulating the ultrasound probe 104 to acquire the protocol-compliant view. For example, the instructions 270 may include text, directional icons, audio, etc. that provide feedback to the operator for manipulating the position and / or orientation of the ultrasound probe 104 and / or adjusting imaging settings to acquire a protocol-compliant view that depicts anatomical features and / or image features of the protocol-compliant view for the detected target view. The imaging settings may include gain, depth, zoom level, and / or any suitable image settings. The 3D model 260, planar representation 262, and / or instructions 270 may be presented on a display 1100, 1200, 200A of the display system 134, for example, as Figure 11 to Figure 12In various embodiments, process 1300 may return to step 1304 to acquire a different ultrasound image view 210 according to instructions 270 .

[0067] Aspects of the present disclosure provide a system 100 and method 1300 for adjusting user interface elements 220-270 based on real-time anatomical structure recognition in an acquired ultrasound image view 210. According to various embodiments, the method 1300 may include acquiring 1304, by the ultrasound system 100, the ultrasound image view 210. The method 1300 may include automatically detecting 1306, by at least one processor 132, 140 of the ultrasound system 100, a target view from a set of target views. The target view corresponds to the ultrasound image view 210. The method 1300 may include automatically determining 1308, by at least one processor 132, 150, one or both of the presence or absence of a plurality of anatomical features associated with the target view in the ultrasound image view 210. Method 1300 may include presenting 1310, 1314, 1318 at least one user interface element 220 to 270 at a display system 134 by at least one processor 132, 160, the at least one user interface element indicating one or both of the presence 224, 232 or absence 226, 234 of each of a plurality of anatomical features.

[0068] In a representative embodiment, the method 1300 may include receiving 1302, by at least one processor 132, a selection of an examination type associated with a set of target views. In an exemplary embodiment, at least one user interface element 220 to 270 includes a pictogram 222, 240 of an anatomical structure of the target view. The pictogram 222, 240 may include indicia 224, 226 indicating one or both of the presence 224 or absence 226 of each of a plurality of anatomical features. In various embodiments, the method 1300 may include registering 1312, by at least one processor 132, 160, the pictogram 240 to the ultrasound image view 210. The method 1300 may include overlaying 1314, by at least one processor 132, 160, the pictogram 240 on the ultrasound image view 210. In certain embodiments, at least one user interface element 220 to 270 includes a list 230 indicating one or both of the presence 232 or absence 234 of each of a plurality of anatomical features. In a representative embodiment, at least one user interface element 220-270 includes a three-dimensional (3D) model 260 of an anatomical structure having a representation 262 of the location of the ultrasound image view 210. In an exemplary embodiment, at least one user interface element 220-270 includes instructions for one or both of adjusting imaging settings or manipulating one or both of the position and orientation of the ultrasound probe 104 of the ultrasound system 100.

[0069] Various embodiments provide an ultrasound system 100 for adjusting user interface elements 220 to 270 based on real-time anatomical structure recognition in an acquired ultrasound image view 210. The ultrasound system 100 may include an ultrasound probe 104, at least one processor 132, 140, 150, 160, and a display system 134. The ultrasound probe 104 may be configured to acquire an ultrasound image view 210. The at least one processor 132, 140 may be configured to automatically detect a target view from a set of target views. The target view corresponds to the ultrasound image view 210. The at least one processor 132, 150 may be configured to automatically determine one or both of the presence or absence of a plurality of anatomical features associated with the target view in the ultrasound image view 210. The at least one processor 132, 160 may be configured to generate at least one user interface element 220 to 270 indicating one or both of the presence 224, 232 or the absence 226, 234 of each of the plurality of anatomical features. The display system may be configured to present at least one user interface element 220 - 270 and the ultrasound image view 210 .

[0070] In an exemplary embodiment, the ultrasound system 100 includes a user input device 130 configured to provide a selection of an examination type associated with the set of target views to the at least one processor 132. In various embodiments, at least one user interface element 220 to 270 includes a pictogram 222, 240 of an anatomical structure of the target view. The at least one processor 132, 160 may be configured to superimpose a marker 224, 226 indicating one or both of the presence 224 or absence 226 of each of the plurality of anatomical features on the pictogram 222, 240. In certain embodiments, the at least one processor 132, 160 may be configured to register the pictogram 240 to the ultrasound image view 210 and superimpose the pictogram 240 on the ultrasound image view 210. In a representative embodiment, the at least one user interface element 220 to 270 includes a list 230 indicating one or both of the presence 232, 234 of each of the plurality of anatomical features. In an exemplary embodiment, at least one user interface element 220-270 includes a three-dimensional (3D) model 260 of the anatomical structure having a representation 262 of the location of the ultrasound image view 210. In various embodiments, at least one user interface element 220-270 includes instructions 270 for one or both of adjusting imaging settings or manipulating one or both of the position and orientation of the ultrasound probe 104 of the ultrasound system 100.

[0071] Certain embodiments provide a non-transitory computer-readable medium having a computer program stored thereon, the computer program having at least one code segment. The at least one code segment is executable by a machine to cause the ultrasound system 100 to perform step 1300. Step 1300 may include acquiring 1304 an ultrasound image view 210. Step 1300 may include automatically detecting 1306 a target view from a set of target views. The target view corresponds to the ultrasound image view 210. Step 1300 may include automatically determining 1308 one or both of the presence or absence of a plurality of anatomical features associated with the target view in the ultrasound image view 210. Step 1300 may include presenting 1310, 1314, 1318 at least one user interface element 220 to 270 at the display system 134, the at least one user interface element indicating one or both of the presence 224, 232 or the absence 226, 234 of each of the plurality of anatomical features.

[0072] In various embodiments, at least one user interface element 220 to 270 includes a pictogram 222, 240 of an anatomical structure of a target view. The pictogram 222, 240 may include markers 224, 226 indicating one or both of the presence 224 or absence 226 of each of a plurality of anatomical features. In certain embodiments, step 1300 may include registering 1312 the pictogram 240 to the ultrasound image view 210. Step 1300 may include overlaying 1314 the pictogram 240 on the ultrasound image view 210. In a representative embodiment, at least one user interface element 220 to 270 includes a list 230 indicating one or both of the presence 232 or absence 234 of each of a plurality of anatomical features. In an exemplary embodiment, at least one user interface element 220 to 270 includes a three-dimensional (3D) model 260 of an anatomical structure having a representation 262 of the location of the ultrasound image view 210. In various embodiments, at least one user interface element 220 - 270 includes instructions 270 for one or both of adjusting imaging settings or manipulating one or both of the position and orientation of the ultrasound probe 104 of the ultrasound system 100 .

[0073] As used herein, the term "circuit" refers to physical electronic components (i.e., hardware) and any software and / or firmware ("code") that can configure hardware, is executed by hardware, and / or is otherwise associated with hardware. For example, as used herein, when executing one or more first codes, a specific processor and memory may include a first "circuit", and when executing one or more second codes, a specific processor and memory may include a second "circuit". As used herein, "and / or" represents any one or more of the items in the list connected by "and / or". For example, "x and / or y" represents any element in the three-element set {(x), (y), (x, y)}. As another example, "x, y, and / or z" represents any element in the seven-element set {(x), (y), (z), (x, y), (x, z), (y, z), (x, y, z)}. As used herein, the term "exemplary" means used as a non-limiting example, instance, or illustration. As used herein, the terms "eg" and "for example" introduce a list of one or more non-limiting examples, instances, or illustrations. As used herein, a circuit is "used to" or "configured to" perform a function whenever the circuit includes the necessary hardware and code (if necessary) to perform the function, regardless of whether the performance of the function is disabled or not enabled by some user-configurable setting.

[0074] Other embodiments may provide a computer-readable device and / or a non-transitory computer-readable medium, and / or a machine-readable device and / or a non-transitory machine-readable medium having stored thereon machine code and / or a computer program having at least one code segment executable by a machine and / or computer, so that the machine and / or computer performs the steps described herein for adjusting user interface elements based on real-time anatomical structure recognition in acquired ultrasound image views.

[0075] Therefore, the present disclosure may be implemented in hardware, software, or a combination of hardware and software. The present disclosure may be implemented in a centralized manner in at least one computer system, or in a distributed manner, where different elements are distributed across several interconnected computer systems. Any type of computer system or other device suitable for executing the methods described herein is suitable.

[0076] The various embodiments may also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein and which, when loaded into a computer system, is capable of carrying out these methods. A computer program herein refers to any expression of a set of instructions in any language, code or notation, which is intended to cause a system with information processing capabilities to perform specific functions directly or after either or both of the following: a) conversion into another language, code or notation; b) reproduction in a different material form.

[0077] Although the present disclosure has been described with reference to certain embodiments, it will be appreciated by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the present disclosure. In addition, many modifications may be made to adapt specific circumstances or materials to the teachings of the present disclosure without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the specific embodiments disclosed, but the present disclosure will include all embodiments falling within the scope of the appended claims.

Claims

1. A method comprising: acquiring ultrasound image views by an ultrasound system; automatically detecting, by at least one processor of the ultrasound system, a target view corresponding to the ultrasound image view from a set of target views of a protocol associated with an examination type, wherein the protocol includes the set of target views and criteria for compliance with the target view, the criteria being based on the presence of each of a plurality of anatomical features; automatically determining, by the at least one processor, one or both of the presence or absence of a plurality of anatomical features associated with the target view in the ultrasound image view; as well as presenting, by the at least one processor, at a display system, at least one user interface element indicating one or both of the presence or absence of each of the plurality of anatomical features, and The at least one user interface element includes instructions for one or both of adjusting imaging settings or manipulating one or both of a position and orientation of an ultrasound probe of the ultrasound system to acquire a protocol compliance view. 2 . The method of claim 1 , comprising receiving, by the at least one processor, a selection of an examination type associated with the set of target views.

3. A method according to claim 1, wherein the at least one user interface element includes a pictogram of the anatomical structure of the target view, the pictogram including a marking indicating one or both of the presence or absence of each of the multiple anatomical features.

4. The method according to claim 3, comprising: registering, by the at least one processor, the pictogram to the ultrasound image view, and The pictogram is overlaid on the ultrasound image view by the at least one processor. 5 . The method of claim 1 , wherein the at least one user interface element comprises a list indicating the one or both of the presence or absence of each of the plurality of anatomical features. 6 . The method of claim 1 , wherein the at least one user interface element comprises a three-dimensional (3D) model of an anatomical structure having a representation of a location of the ultrasound image view.

7. An ultrasound system comprising: an ultrasound probe configured to acquire ultrasound image views; at least one processor, the at least one processor being configured to: automatically detecting a target view corresponding to the ultrasound image view from a set of target views of a protocol associated with the exam type, wherein the protocol includes the set of target views and criteria for compliance with the target view, the criteria being based on the presence of each of a plurality of anatomical features; automatically determining one or both of the presence or absence of a plurality of anatomical features associated with the target view in the ultrasound image view; and generating at least one user interface element indicating one or both of the presence or absence of each of the plurality of anatomical features, and The at least one user interface element includes instructions for one or both of: adjusting imaging settings or manipulating one or both of a position and orientation of an ultrasound probe of the ultrasound system to acquire a protocol compliance view; as well as A display system is configured to present the at least one user interface element and the ultrasound image view.

8. The system of claim 7, comprising a user input device configured to provide the at least one processor with a selection of an inspection type associated with the set of target views.

9. A system according to claim 7, wherein the at least one user interface element includes a pictogram of an anatomical structure of the target view, and wherein the at least one processor is configured to superimpose a marker on the pictogram, the marker indicating one or both of the presence or absence of each of the multiple anatomical features.

10. The system of claim 9, wherein the at least one processor is configured to register the pictogram to the ultrasound image view and overlay the pictogram on the ultrasound image view.

11. The system of claim 7, wherein the at least one user interface element comprises a list indicating the one or both of a presence or absence of each of the plurality of anatomical features. 12 . The system of claim 7 , wherein the at least one user interface element comprises a three-dimensional (3D) model of an anatomical structure having a representation of a location of the ultrasound image view.

13. A non-transitory computer readable medium having a computer program stored thereon, the computer program having at least one code segment executable by a machine to cause an ultrasound system to perform steps comprising: Acquiring ultrasound image views; automatically detecting a target view corresponding to the ultrasound image view from a set of target views of a protocol associated with the exam type, wherein the protocol includes the set of target views and criteria for compliance with the target view, the criteria being based on the presence of each of a plurality of anatomical features; automatically determining one or both of the presence or absence of a plurality of anatomical features associated with the target view in the ultrasound image view; and presenting at a display system at least one user interface element indicating one or both of the presence or absence of each of the plurality of anatomical features, and The at least one user interface element includes instructions for one or both of adjusting imaging settings or manipulating one or both of a position and orientation of an ultrasound probe of the ultrasound system to acquire a protocol compliance view.

14. A non-transitory computer-readable medium according to claim 13, wherein the at least one user interface element includes a pictogram of an anatomical structure of the target view, the pictogram including a marking indicating one or both of the presence or absence of each of the plurality of anatomical features.

15. The non-transitory computer readable medium of claim 14, comprising: registering the pictogram to the ultrasound image view, and The pictogram is superimposed on the ultrasound image view.

16. The non-transitory computer-readable medium of claim 13, wherein the at least one user interface element comprises a list indicating the one or both of a presence or absence of each of the plurality of anatomical features. 17 . The non-transitory computer readable medium of claim 13 , wherein the at least one user interface element comprises a three-dimensional (3D) model of an anatomical structure having a representation of a location of the ultrasound image view.

Images