System and method for guiding the positioning and orientation of an ultrasonic probe

Abstract

A system and method for positioning and orienting an ultrasound probe includes receiving data sets derived from the ultrasound probe, the data sets including at least one data set acquired during pulsed Doppler mode operation of the probe; analyzing the data sets to identify a current position and orientation of the probe relative to a target position and orientation that aligns the probe to accurately acquire a selected view of a body part; and communicating the current position and orientation of the probe relative to the target position and orientation.

Description

TECHNICAL FIELD

[0001] The present invention relates to the field of guiding the positioning and orientation of an ultrasound probe, and more particularly, to a system and method that uses data acquired in a pulsed Doppler mode to generate visual cues for guiding the positioning and orientation of an ultrasound probe. BACKGROUND ART

[0002] Ultrasound scanners are widely used in a wide range of clinical scenarios. When used by experienced professionals, the utility of point-of-care ultrasound scanning for evaluating the anatomical structure and function of organs is well established. However, in several important clinical situations where rapid assessment of organ anatomy and function can facilitate patient care (e.g., primary care offices, intensive care units, emergency rooms, remote settings, etc.), experienced professionals for point-of-care ultrasound scanning may not be readily available. Ultrasound scanners capable of operating in different modes such as pulsed Doppler mode are known. SUMMARY OF THE INVENTION

[0003] Some embodiments of the present invention can provide a system for positioning and oriented an ultrasound probe, the system may include a computer processor and one or more sets of instructions, the one or more sets of instructions, when executed, cause the computer processor to receive or determine a dataset indicating the type, direction and measure of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, the target position and orientation being such that the ultrasound probe aligns and accurately obtains a selected view of a body part; generate one or more images, each containing one or more visual cues indicating the type, direction and measure of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, and cause the one or more images to be displayed on a display.

[0004] In some embodiments, each of the one or more images may include a first visual cue indicating the target position and orientation of the ultrasonic probe, and a second visual cue indicating the current position and orientation of the ultrasonic probe relative to the target position and orientation of the ultrasonic probe.

[0005] In some embodiments, the relative position and orientation between the second visual cue and the first visual cue indicates the type and direction of the movement required to guide the ultrasound probe from its current position and orientation to its target position and orientation, and the distance between a designated point on the second visual cue and a corresponding designated point on the first visual cue indicates the scale of the movement required to guide the ultrasound probe from its current position and orientation to its target position and orientation.

[0006] In some embodiments, the first visual cue may include a cross figure having two bars perpendicular to each other and intersecting at an intersection, wherein the cross figure represents the proximal end of the ultrasonic probe in its target position and orientation, the intersection represents the central longitudinal axis of the ultrasonic probe in its target position and orientation, and the plane defined by the bars represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe in its target position and orientation.

[0007] In some embodiments, the first visual cue may further include a visual marker corresponding to the position of a corresponding physical marker on the ultrasonic probe.

[0008] In some embodiments, the second visual cue may include a 2D projection of a 3D representation of the ultrasonic probe in its current position and orientation, and a second cross diagram having two second bars perpendicular to each other and intersecting at a second intersection, wherein the second cross diagram represents the proximal end of the ultrasonic probe in its current position and orientation, the second intersection represents the central longitudinal axis of the ultrasonic probe in its current position and orientation, and the plane defined by the second bars represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe in its current position and orientation.

[0009] In some embodiments, the second visual cue may further include a second visual marker corresponding to the position of a corresponding physical marker on the ultrasonic probe.

[0010] In some embodiments, the second visual cue may include an arrow, the shape of which indicates the type of motion required to guide the ultrasonic probe from its current position and orientation to its target position and orientation, the direction of which indicates the direction of motion, and the size of which indicates the scale of motion.

[0011] In some embodiments, the second visual cue may include a text indicator having a numerical value for quantifying the measure of the motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation.

[0012] In some embodiments, one or more sets of instructions, when executed, cause the computer processor to perform the steps of: receiving at least one ultrasound image acquired by the ultrasound probe in its current position and orientation; and supplying the at least one ultrasound image and the selected view of the body part as input to a neural network, the neural network being implemented on the computer processor and configured to output the dataset.

[0013] Some embodiments of the present invention can provide a method for positioning and oriented an ultrasound probe, the method comprising: receiving or determining a dataset by a computer processor indicating the type, direction and scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, the target position and orientation aligning the ultrasound probe and accurately obtaining a selected view of a body part; the computer processor generating one or more images, each containing one or more visual cues indicating the type, direction and scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, based on at least a portion of the dataset; and causing the computer processor to display the one or more images on a display.

[0014] In some embodiments, each of the one or more images may include a first visual cue indicating the target position and orientation of the ultrasonic probe, and a second visual cue indicating the current position and orientation of the ultrasonic probe relative to the target position and orientation of the ultrasonic probe.

[0015] In some embodiments, the relative position and orientation between the second visual cue and the first visual cue indicates the type and direction of the movement required to guide the ultrasound probe from its current position and orientation to its target position and orientation, and the distance between a designated point on the second visual cue and a corresponding designated point on the first visual cue indicates the scale of the movement required to guide the ultrasound probe from its current position and orientation to its target position and orientation.

[0016] In some embodiments, the first visual cue may include a cross diagram having two bars perpendicular to each other and intersecting at an intersection, wherein the cross diagram represents the proximal end of the ultrasonic probe in its target position and orientation, the intersection represents the central longitudinal axis of the ultrasonic probe in its target position and orientation, and the plane defined by the bars represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe in its target position and orientation.

[0017] In some embodiments, the first visual cue may further include a visual marker corresponding to the position of a corresponding physical marker on the ultrasonic probe.

[0018] In some embodiments, the second visual cue may include a 2D projection of a 3D representation of the ultrasonic probe in its current position and orientation, and a second cross diagram having two second bars perpendicular to each other and intersecting at a second intersection, wherein the second cross diagram represents the proximal end of the ultrasonic probe in its current position and orientation, the second intersection represents the central longitudinal axis of the ultrasonic probe in its current position and orientation, and the plane defined by the second bars represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe in its current position and orientation.

[0019] In some embodiments, the second visual cue may further include a second visual marker corresponding to the position of a corresponding physical marker on the ultrasonic probe.

[0020] In some embodiments, the second visual cue may include an arrow, the shape of which indicates the type of motion required to guide the ultrasonic probe from its current position and orientation to its target position and orientation, the direction of which indicates the direction of motion, and the size of which indicates the scale of motion.

[0021] In some embodiments, the second visual cue may include a text indicator having a numerical value for quantifying the measure of the motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation.

[0022] In some embodiments, the method may further include the steps of: having the computer processor receive at least one ultrasound image acquired by the ultrasound probe in its current position and orientation; and having the computer processor supply the at least one ultrasound image and the selected view of the body part as input to a neural network, the neural network being implemented on the computer processor and configured to output the dataset.

[0023] According to an embodiment of the present invention, a method for positioning and orienting an ultrasound probe comprises the steps of: receiving a dataset derived from the ultrasound probe, wherein the dataset includes at least one dataset acquired during pulsed Doppler mode operation of the probe; analyzing the dataset to identify the current position and orientation of the probe relative to a target position and orientation, wherein the target position and orientation align the probe to accurately acquire a selected view of a body part; and communicating the current position and orientation of the probe relative to the target position and orientation to a user of the probe.

[0024] According to some embodiments, the dataset includes an image derived from signals acquired by the ultrasound probe.

[0025] According to some embodiments, the dataset is received by monitoring a display in communication with the ultrasound probe.

[0026] According to some embodiments, the at least one dataset acquired during pulsed Doppler mode operation of the probe includes an image and Doppler information.

[0027] According to some embodiments, the image is augmented with Doppler information.

[0028] According to some embodiments, analyzing the dataset comprises using an artificial intelligence process.

[0029] According to some embodiments, the analyzing comprises analyzing motion within the body part based on pulsed Doppler mode information.

[0030] According to some embodiments, the motion is motion of a fluid within the body part.

[0031] According to some embodiments, the artificial intelligence process outputs at least one of the current position and orientation of the ultrasonic probe relative to the selected view, and an indication of the quality of the image generated by the ultrasonic probe at its current position and orientation, wherein the quality of the image corresponds to whether the selected view has been achieved.

[0032] According to some embodiments, the transmitting step includes generating one or more images, each containing one or more visual cues indicating the current position and orientation, based on at least a portion of the dataset, and presenting the one or more images on a display.

[0033] According to some embodiments, the one or more visual cues include at least one representation of the type, direction, and scale of motion required to guide the probe from its current position and orientation to its target position and orientation.

[0034] According to some embodiments, the communication step includes presenting an image quality display scale on a display.

[0035] According to one embodiment, a method is provided for correcting the position and orientation of an ultrasonic probe, the method comprising: receiving an image derived from the ultrasonic probe, the image being superimposed with fluid flow information acquired during pulsed Doppler mode operation of the probe; analyzing the image and determining the current position and orientation of the probe relative to a target position and orientation, the target position and orientation being such that the probe is aligned to accurately obtain a selected view of a body part; and communicating to the user of the probe the current position and orientation of the probe relative to the target position and orientation, and a display of the quality of the image as the selected view.

[0036] According to one embodiment, a system for positioning and oriented an ultrasonic probe is disclosed, the system comprising a computer processor and a memory containing one or more sets of instructions, the one or more sets of instructions, when executed, cause the computer processor to perform the following steps: receive a dataset derived from the ultrasonic probe, the dataset containing at least one dataset acquired during pulsed Doppler mode operation of the probe; analyze the dataset to identify the current position and orientation of the probe relative to a target position and orientation, the target position and orientation aligning the probe to accurately obtain a selected view of a body part; and communicate the current position and orientation of the probe relative to the target position and orientation to a user of the probe.

[0037] According to some embodiments, the processor performs an artificial intelligence process to analyze the dataset.

[0038] According to some embodiments, the analysis includes analyzing the movement within the body part based on pulsed Doppler mode information.

[0039] According to some embodiments, the artificial intelligence process outputs at least one of the current position and orientation of the ultrasonic probe relative to the selected view, and a display of the quality of the image generated by the ultrasonic probe at its current position and orientation, wherein the quality of the image corresponds to whether the selected view has been achieved.

[0040] According to some embodiments, the transmitting step includes generating one or more images, each containing one or more visual cues indicating the current position and orientation, based on at least a portion of the dataset, and presenting the one or more images on a display.

[0041] According to some embodiments, the transmission step further includes the step of displaying an image quality display scale.

[0042] According to some embodiments, the one or more visual cues include at least one representation of the type, direction, and scale of motion required to guide the probe from its current position and orientation to its target position and orientation.

[0043] These additional and / or other aspects and / or advantages of the present invention are described in the following detailed description, and are perhaps inferred from that detailed description and / or can be learned through the practice of the present invention. [Brief explanation of the drawing]

[0044] To better understand embodiments of the present invention and to illustrate how they can be implemented, the accompanying drawings are referenced here purely as examples, where similar figures indicate corresponding elements or sections throughout.

[0045] [Figure 1] This is a block diagram of a system for guiding the positioning and orientation of an ultrasonic probe according to some embodiments of the present invention. [Figure 2] This is a schematic diagram of a display that presents data showing a set of possible views of a body part of an object scannable using an ultrasound probe, according to some embodiments of the present invention. [Figure 3] This is a schematic diagram of a display that presents an image including visual cues indicating the target position and orientation of an ultrasound probe to at least a portion of a subject, according to some embodiments of the present invention. [Figure 4A] A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4B]A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4C] A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4D] A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4E] A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4F] A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4G] A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4H] A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 4I]A schematic diagram of an image-presenting display, according to some embodiments of the present invention, including visual cues indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation. [Figure 5] This is a flowchart of a method for guiding the positioning and orientation of an ultrasonic probe according to several embodiments of the present invention. [Figure 6] This is a flowchart of the method according to one embodiment of the present invention. [Figure 7] This is a schematic diagram of a display according to one embodiment of the present invention. [Figure 8] This is a schematic diagram of a system according to one embodiment of the present invention.

[0046] To make the illustrations concise and clear, it should be understood that the elements shown in the figures are not necessarily drawn to scale. For example, the dimensions of some elements may be exaggerated relative to others for clarity. Furthermore, where deemed appropriate, reference numbers may be repeated between figures to indicate corresponding or similar elements. [Modes for carrying out the invention]

[0047] The following description outlines various aspects of the present invention. For explanatory purposes, specific configurations and details are described to provide a complete understanding of the invention. However, it will also be apparent to those skilled in the art that the invention can be carried out without the specific details presented herein. Furthermore, well-known features can be omitted or simplified in order not to obscure the invention. In particular, with reference to the drawings, it is emphasized that the details shown are illustrative and are presented solely for the purpose of describing the invention, and are provided to what is considered to be the most useful and easily understandable explanation of the principles and conceptual aspects of the invention. In this regard, no attempt is made to show structural details of the invention in more detail than necessary for a basic understanding of the invention, and the description provided in conjunction with the drawings will make it clear to those skilled in the art how some forms of the invention can actually be carried out.

[0048] Before describing in detail at least one embodiment of the present invention, it should be understood that the present invention is not limited in its application to the configuration details and arrangement of components described below or shown in the drawings. The present invention is applicable to other embodiments that may be carried or performed in various ways, as well as combinations of the disclosed embodiments. It should also be understood that the expressions and terms used herein are for illustrative purposes only and should not be considered limiting.

[0049] Unless otherwise specified, as will be apparent from the following description, throughout this specification, any use of terms such as “processing,” “calculating,” “calculating,” “determining,” and “facilitating” should be understood to refer to the operation and / or processing of a computer or computing system, or similar electronic computing device, that manipulates and / or converts data, which is represented as an electronic quantity as a physical quantity in the registers and / or memory of the computing system, to other data, which is similarly represented as a physical quantity in the memory, registers, or other such information storage devices, transmitting devices, or display devices of the computing system. Any of the disclosed modules or units can be implemented at least partially by a computer processor.

[0050] Referring now to Figure 1, this figure is a block diagram of a system 100 for guiding the positioning and orientation of an ultrasonic probe according to several embodiments of the present invention.

[0051] Referring also to Figure 2, this figure is a schematic diagram of a display 120 that presents data showing a set 210 of possible views 210a to 210n of body parts of an object scannable using an ultrasonic probe, according to several embodiments of the present invention.

[0052] Referring also to Figure 3, this figure is a schematic diagram of a display 120 that presents an image 300 including visual cues 310, 320 indicating the target position and orientation of an ultrasound probe to at least a portion of a subject, according to several embodiments of the present invention.

[0053] See also Figures 4A to 4I, these figures are schematic diagrams of a display 120 presenting images 400 including visual cues 410, 420 indicating the type, direction, and scale of motion required to guide an ultrasonic probe from its current position and orientation to its target position and orientation, according to several embodiments of the present invention.

[0054] According to some embodiments of the present invention, the system 100 may include a computer processor 110, a display 120, an input device 130, and a memory 140 containing one or more sets of instructions 142. When executed, one or more sets of instructions 142 can cause the computer processor 110 to perform the functions described herein.

[0055] According to some embodiments, the computer processor 110 may generate an image 200 containing data showing a set 210 of possible views 210a, ..., 210n of body parts of an object scannable using an ultrasound probe (for example, as shown in Figure 2). The image 200 may include, for example, figures of views 210a, ..., 210n, lists of views 210a, ..., 210n, etc. The computer processor 110 may cause the image 200 to be displayed on the display 120. The set 210 may include at least some data collected during pulsed Doppler mode operation of the ultrasound probe.

[0056] According to some embodiments, the computer processor 110 may receive a selection of views 210 from a set of possible views 210a, ..., 210n of a body part. For example, the computer processor 110 may receive the selection using an input device 130.

[0057] According to some embodiments, the computer processor 110 can generate an image 300 (for example, as shown in Figure 3). The image 300 may include one or more visual cues indicating the target position and orientation of the ultrasound probe relative to at least a portion of the subject. The target position and orientation align the ultrasound probe and accurately obtain a selected view of the body portion.

[0058] In some embodiments, the image 300 may include a first visual cue 310 that includes a visual representation of at least a portion of the subject (for example, the torso of the subject schematically shown in Figure 3).

[0059] In some embodiments, image 300 may include a second visual cue 320, which includes a visual representation 322 of the ultrasound probe in its target position and orientation relative to the subject. In some embodiments, the visual representation 322 of the ultrasound probe may include a two-dimensional (2D) projection of a three-dimensional (3D) representation of the ultrasound probe in its target position and orientation (as shown, for example, in Figure 3).

[0060] In some embodiments, the ultrasound probe (e.g., a physical ultrasound probe) may include a physical marker on one of its sides. In some embodiments, the visual representation 322 of the ultrasound probe may include a visual marker 322a at a position corresponding to the position of the corresponding physical marker on the ultrasound probe.

[0061] In some embodiments, image 300 may include a text indicator 330 containing, for example, a written instruction (such as shown in Figure 3) or other written instructions describing the target position and orientation of the ultrasound probe relative to the subject.

[0062] According to some embodiments, the computer processor 110 may receive a dataset indicating the type of motion (e.g., sliding, rotating, tilting, oscillating), direction (e.g., upward, downward, rightward, leftward, clockwise, counterclockwise, etc.), and scale (e.g., inches, degrees, quaternions, coordinates, etc.) necessary to guide the ultrasonic probe from its current position and orientation to its target position and orientation.

[0063] According to some embodiments, the computer processor 110 can generate a dataset indicating the type, direction, and scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation. In some embodiments, the computer processor 110 can generate a dataset based on a selected view of a body part and at least one ultrasound image acquired by the ultrasound probe at its current position and orientation. The at least one ultrasound image can be received, for example, from an ultrasound device. In some embodiments, the computer processor 110 may determine the dataset using, for example, a trained neural network implemented on the computer processor 110. For example, the computer processor 110 can be supplied with at least one ultrasound image and a selected view of a body part as input to a neural network, which can output a dataset.

[0064] According to some embodiments, the computer processor 110 may generate one or more images 400 based on the dataset (for example, as shown in Figures 4A to 4I). Each of the one or more images 400 may include one or more visual cues indicating, for example, the type, direction, and / or scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation. The computer processor 110 may cause the presentation of one or more images 400 on the display 120.

[0065] In some embodiments, each of one or more images 400 may include a first visual cue 410 indicating the target position and orientation of the ultrasound probe. In some embodiments, the first visual cue 410 may include a cross diagram 412 having two bars 412a, 412b that are perpendicular to each other and intersect at intersection 412c. The cross diagram 412 may, for example, represent the proximal end of the ultrasound probe, the intersection 412c may represent the central longitudinal axis of the ultrasound probe in its target position and orientation, and the plane defined by the bars 412a, 412b of the cross diagram 412 may represent a plane perpendicular to the central longitudinal axis of the ultrasound probe in its target position and orientation. In some embodiments, the first visual cue 410 may include a visual marker 414 corresponding to the position of a corresponding physical marker on the ultrasound probe (for example, schematically shown by two arches in Figures 4A to 4I).

[0066] In some embodiments, each of one or more images 400 may include a second visual cue 420 indicating the current position and orientation of the ultrasound probe relative to the target position and orientation of the ultrasound probe. In some embodiments, the second visual cue 420 may include a 2D projection of a 3D representation of the ultrasound probe 422 in its current position and orientation. In some embodiments, the second visual cue 420 may include a cross diagram 424 having two bars 424a, 424b that are perpendicular to each other and intersect at intersection 424c. The cross diagram 424 may represent the proximal end of the ultrasound probe in its current position and orientation, the intersection 424c may represent the central longitudinal axis of the ultrasound probe in its current position and orientation, and the plane defined by the bars 424a, 424b of the cross diagram 424 may represent a plane perpendicular to the central longitudinal axis of the ultrasound probe in its current position and orientation. In some embodiments, the second visual cue 420 may include a visual marker 426 that corresponds to the position of a corresponding physical marker on the ultrasound probe (for example, schematically shown by two arches in Figures 4A to 4I).

[0067] The relative position and orientation between the second visual cue 420 and the first visual cue 410 may indicate the type, direction, and / or scale of movement required to guide the ultrasound probe from its current position and orientation to its target position and orientation.

[0068] For example, as schematically shown in Figure 4A, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be slid to the right relative to its current position and orientation, or moved in other ways, in order to guide the ultrasonic probe to its target position and orientation.

[0069] In another example, as schematically shown in Figure 4B, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be slid to the left relative to its current position and orientation, or otherwise moved, in order to guide the ultrasonic probe to its target position and orientation.

[0070] In another example, as schematically shown in Figure 4C, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be slid downward relative to its current position and orientation, or otherwise moved, in order to guide the ultrasonic probe to its target position and orientation.

[0071] In another example, as schematically shown in Figure 4D, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be rotated counterclockwise relative to its current position and orientation in order to guide the ultrasonic probe to its target position and orientation.

[0072] In another example, as schematically shown in Figure 4E, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be tilted to the left relative to its current position and orientation in order to guide the ultrasonic probe to its target position and orientation.

[0073] In another example, as schematically shown in Figure 4F, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be tilted to the right relative to its current position and orientation in order to guide the ultrasonic probe to its target position and orientation.

[0074] In another example, as schematically shown in Figure 4G, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be tilted upward relative to its current position and orientation in order to guide the ultrasonic probe to its target position and orientation.

[0075] In another example, as schematically shown in Figure 4H, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicate that the ultrasonic probe should be tilted downward relative to its current position and orientation in order to guide the ultrasonic probe to its target position and orientation.

[0076] In another example, as schematically shown in Figure 4I, the relative position and orientation between the second visual cue 420 and the first visual cue 410 indicates that the ultrasound probe is in its target position and orientation. In some embodiments, the second visual cue 420 may include an indicator 427 (e.g., a text indicator 427 as schematically shown in Figure 4I) that commands the ultrasound probe to maintain its position and orientation. In some embodiments, the image 400 may include a progress bar (not shown) or other visual progress indicators (e.g., a percentage, an hourglass, etc.) that show the progress of the ultrasound scan.

[0077] In some embodiments, the distance between a designated point on a second visual cue 420 and a corresponding point on a first visual cue 410 may indicate the scale of motion (e.g., inches, degrees, quaternions, coordinates, etc.) required to guide the ultrasound probe from its current position and orientation to its target position and orientation. For example, the distance between (i) the intersection 424c of the cross diagram 424 of the second visual cue 420 and (ii) the intersection 414c of the cross diagram 412 of the first visual cue 410 may indicate the scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation. In some embodiments, the second visual cue 420 may include a text indicator 428 with a numerical value for quantifying the scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation. For example, as schematically shown in Figure 4D, the text indicator 428 indicates that the ultrasound probe should be rotated 45° counterclockwise relative to its current position and orientation in order to guide it to its target position and orientation. Please note that the text indicator 428 is shown only in Figure 4D and is not shown in Figures 4A-4C and 4E-4I for clarity.

[0078] In some embodiments, the second visual cue 420 may include an arrow 429, the shape of which may indicate the type of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, the direction of which may indicate the direction of motion, and / or the size of which may indicate the scale of motion. For example, as schematically shown in Figure 4D, the arrow 429 indicates that the ultrasound probe should be rotated counterclockwise relative to its current position and orientation in order to guide it to its target position and orientation. Note that the arrow 429 is shown only in Figure 4D and, for clarity, is not shown in Figures 4A-4C and 4E-4I. Also note that different combinations of visual cues described herein with respect to Figures 4A-4I are possible.

[0079] According to some embodiments, the computer processor 110 can generate one or more sound cues based on a dataset that indicate the type, direction, and / or scale of movement required to guide the ultrasound probe from its current position and orientation to its target position and orientation. For example, one or more sound cues may include one or more voice or audio commands such as, for example, “rotate the ultrasound probe to the left,” “move the ultrasound probe 4 inches to the right,” and “hold the position of the ultrasound probe.” In another example, one or more sound cues may include a first sound indicating that the ultrasound probe is at its target position and orientation and that the ultrasound probe is acquiring an ultrasound image. In yet another example, one or more sound cues may include a second sound indicating that the ultrasound probe has completed acquiring an ultrasound image.

[0080] Referring now to Figure 5, this figure is a flowchart of a method for guiding the positioning and orientation of an ultrasonic probe according to several embodiments of the present invention.

[0081] In some embodiments, the method may include step 502 in which a computer processor receives or determines a dataset indicating at least one of the type, direction, and scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, the target position and orientation being used to align the ultrasound probe and accurately obtain a selected view of the body part. For example, the computer processor 110 and dataset described above with respect to Figure 1.

[0082] The method may include step 504, in which a computer processor generates one or more images based on a dataset, each of which includes one or more visual cues indicating the type, direction, and / or scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation. For example, the visual cues 410, 420 described above with respect to Figures 4A to 4I.

[0083] The method may include step 506, in which a computer processor causes the display of one or more images generated on a display. For example, the display 120 described above with respect to Figure 1.

[0084] Referring here to Figures 6, 7, and 8, embodiments of the present invention may use data acquired in pulsed Doppler mode operation of an ultrasound probe to identify the position and orientation of the ultrasound probe and potentially assist the user in correcting or adjusting the probe's position and orientation to accurately obtain a selected / desired view of a body part. An ultrasound probe operating in pulsed Doppler mode uses the principle that moving objects affect the properties of sound waves. By transmitting short, rapid pulses of sound, an ultrasound machine (e.g., probe software) can measure the speed of movement within the body, for example, the speed of movement of fluids (e.g., blood), the movement of lungs during respiration, and the speed of movement along the digestive system, all in real time at specific locations within the body. Since blood flows according to a periodic cardiac cycle (e.g., the processes of contraction and relaxation involved in a single heartbeat), the data and / or images obtained by a probe operating in pulsed Doppler mode can be analyzed to explain variations in how the ultrasound image may appear. For example, a computer vision system may inaccurately determine the position and orientation of an ultrasound probe due to how the images obtained at that position and orientation may change as a result of specific timings in the cardiac cycle: in some images the heart may appear larger, and in others it may appear smaller (the morphology of the heart changes dramatically at different times along the cardiac cycle, and the volume of the left ventricle changes by more than 50-70% along the cycle, for example, in a healthy heart). These variations / distortions due to the temporal degrees of freedom of the ultrasound images can deceive the computer vision system into determining an inaccurate position and orientation of the ultrasound probe. In embodiments of the present invention, by using implicit or explicit information on blood flow, artificial intelligence can be helped to account for changes caused by specific timings along the cycle.

[0085] Figure 6 is a flowchart of method 600 for positioning and oriented an ultrasonic probe. Method 600 may include a step (602) of receiving a dataset derived from the ultrasonic probe. The dataset derived from the ultrasonic probe may be a dataset obtained directly from the ultrasonic probe or a dataset obtained indirectly. For example, a dataset obtained directly from the ultrasonic probe may be a time series of transducer signal data, e.g., a time series of reflection frequency measurements. A dataset obtained indirectly from the ultrasonic probe may include one (or more) images derived from measurements obtained by the ultrasonic probe. Such images may be derived by processing software / hardware and may be displayed on a computer display communicating (e.g., via wired communication) with the ultrasonic probe. Embodiments of the present invention may monitor such a display (e.g., using computer vision techniques) to receive the dataset / images.

[0086] According to a preferred embodiment, the received dataset includes at least one dataset acquired during the pulsed Doppler mode operation of the probe. The dataset acquired during the pulsed Doppler mode operation of the probe may include Doppler information / data and may include an image containing Doppler information or an image enhanced with Doppler information. The Doppler-enhanced image may be a type of image obtained during the B-mode operation of the ultrasound probe, superimposed (e.g., edited and shown by software) with colored regions (e.g., Doppler information) indicating fluid flow. For example, the Doppler-enhanced image / dataset may indicate, for example, blue, regions (e.g., pixels or data points) where fluid is flowing out of the probe by associating a first color with those regions (or "tagging" the associated data with a string, for example). Thus, in an image obtained from the probe, the blue regions can indicate that, at the time the probe was operating, those regions contained fluid (e.g., blood) that was moving away from the probe. Similarly, regions where fluid is flowing towards the probe may be associated with a second color, such as red. The fluid velocity may also be indicated by assigning color shading on a stepped scale corresponding to the velocity. For example, a rapidly flowing fluid moving toward the probe (e.g., 19 cm / sec) may be represented by dark red, while a slowly flowing fluid moving toward the probe (e.g., 4.9 cm / sec) may be represented by light red. Similarly, the velocity of a fluid moving away from the probe may be assigned to take the blue spectrum, with shading distributed according to a range of velocities from low to high (e.g., 1.5–7.1 cm / sec).

[0087] Method 600 may include a step of analyzing a dataset to identify the current position and orientation of the probe relative to a target position and orientation. The target position and orientation may be such that they represent the required position and orientation that will align the probe to accurately obtain a selected view of a body part, for example, a four-chamber view of the heart. The user of the probe (or, for example, a machine guidance process such as computer numerical control (CNC)) may change, adjust, or move the probe in a different way to match its position and orientation to the target position and orientation, and thus align the probe to obtain the desired view. According to some embodiments, the step of analyzing a dataset may include using an artificial intelligence (AI) process, for example, a neural network trained on a set of training images (e.g., a training corpus or a large collection of images). The AI ​​process may have been previously trained in a supervised or unsupervised manner. The AI ​​process may have been trained using labeled training data, for example, (e.g., labeled) ultrasound datasets (or images derived from such datasets) correlated with specific positions and / or orientations and / or views acquired by the probe. Training an AI process according to embodiments of the present invention may enable the AI ​​process to output a representation of the position and orientation of the ultrasound probe, separated from the temporal degrees of freedom within the ultrasound image. For example, images of the heart taken at the same probe position at different times may appear different and may be misinterpreted by the AI ​​algorithm as being taken from different probe positions. Since the velocity and direction of blood flow are driven by the periodic cardiac cycle, guidance in pulsed Doppler mode retains significantly more information about the timing of each frame along the cardiac cycle than B-mode ultrasound images. Furthermore, because the body is rich in blood vessels, pulsed Doppler mode images retain such information even when the heart is not in the image.

[0088] The artificial intelligence process may be a neural network (NN). The neural network may include neurons or nodes organized into layers, and links between neurons transmit outputs between them. The NN may be weighted; for example, links may have weights, and training may include adjusting the weights. Positive weights may indicate excitatory connections, and negative weights may indicate inhibitory connections. The NN is executed such that neurons, nodes, or links are "virtual" and represented by software and equations, and may be represented as equations or relationships between nodes or neurons, and the training or execution of the NN is performed, for example, by a conventional computer or a GPU (device 100 in Figure 1, etc.).

[0089] According to some embodiments, an artificial intelligence process can analyze motion within a received dataset, for example, within a body part imaged by a probe. The motion may be analyzed based on pulsed Doppler mode information received as part of the dataset. For example, the artificial intelligence process may receive Doppler-enhanced / augmented images obtained by monitoring a display communicating with an ultrasound probe. The motion can then be inferred, for example, by identifying colored regions in the monitoring image that correspond to the velocity of motion toward / away from the probe. The motion may be due to the motion of a fluid flowing through a body part at some velocity, for example, the flow of blood through a body part.

[0090] According to some embodiments, Method 600 may include the step of outputting, by an AI process, at least one of the current position and orientation of the ultrasound probe relative to a selected view, and an indication of the quality of the image produced by the ultrasound probe at its current position and orientation, wherein the image quality corresponds to whether the selected view has been achieved. The current position and orientation relative to the selected view may be communicated to the user in a manner discussed herein. The current position and orientation relative to the selected view may be the current position and orientation of the ultrasound probe compared to the position and orientation required to achieve a selected / target view of a body part. The indication of image quality may refer to the "accuracy" of the alignment of the ultrasound probe with respect to the target position and orientation required to obtain a selected view of a body part, and whether this selected view has been achieved. In other words, the AI ​​process outputs an indication of the quality of the image produced by the ultrasound probe at its current position and orientation compared to a selected view. For example, a high-quality image may be obtained when the ultrasound probe is at the strictly precise position and orientation required to obtain a selected view of a body part, such as a parasternal long-axis view (PLAX) of the heart or an apical 4C (four-chamber) view of the heart. Low-quality images may be those obtained when the ultrasound probe is positioned and oriented far from the required / target position and orientation. As used herein, image quality does not necessarily refer to image aberrations, e.g., pixelation of the ultrasound image, but rather, as described, is a measure of how accurately the position and orientation of the ultrasound probe producing the image in question corresponds to the target position and orientation required to obtain a target / selected view of the body part. In identifying spatial and temporal degrees of freedom, embodiments of the present invention can improve ultrasound probe positioning compared to existing methods by providing guidance that takes this spatial and temporal relationship into account. According to some embodiments, Method 600 includes the step of identifying the current position and orientation of the probe relative to a target position and orientation based on at least one of the spatial and temporal degrees of freedom.

[0091] Method 600 may include a step (606) of communicating the current position and orientation of the probe relative to a target position and orientation to, for example, the user of the probe. For example, according to some embodiments, the communication step may include generating one or more images, each containing one or more visual cues indicating the current position and orientation of the probe (and, in some embodiments, the target position and orientation), based on at least a portion of the dataset, and causing the presentation of one or more images on a display. The visual cues may be, for example, cues as depicted in Figures 4A to 4I. The communication step may also include showing a graphic representation of the probe's position and orientation (P&O) and / or a graphic representation of the target position and orientation. The user can then manipulate the probe to guide it from its current P&O to the target P&O.

[0092] Alternatively, or complementary, the communication step may include presenting an image quality display scale (e.g., scale 750 in Figure 7) on the display. As described above, the image quality display may refer to a measure of the fit / alignment of the probe P&O with the target P&O required to produce a selected view of the body part. The probe P&O and the resulting image quality may also be related to motion within the body; for example, the probe may have accurate P&O to obtain a PLAX view of the heart, but the movement of the lungs during respiration obscures the heart, and therefore the image quality is lower compared to the selected PLAX view. Thus, the probe's P&O is usually accurate, but the image quality is low because the view captured by the probe at that point is not the selected / desired view. The quality display scale may be a continuous scale and may include a graphic element such as a circle (e.g., 755 in Figure 7) that can "slide" on the scale (e.g., up and down) as the determined image quality changes. Therefore, the user can fine-tune the probe's P&O (point and output) by manipulating the slider on the scale to obtain an acceptable image quality.

[0093] The communication step may also include providing one or more visual cues relating to at least one of the indications of the type, direction, and scale of motion required to move the probe from its current P&O to its target P&O, for example, by indicating arrows that show the direction of translational and / or rotational motion that the user of the probe should follow in order to accurately align the probe.

[0094] According to some embodiments, a method is provided for correcting the position and orientation of an ultrasonic probe. This method may include the step of receiving an image derived from the ultrasonic probe, for example, an image superimposed with fluid flow information acquired during pulsed Doppler mode operation of the probe. As described above, the image superimposed with fluid flow information acquired during pulsed Doppler mode operation of the probe may include colored regions indicating flow toward and / or away from the probe, and may provide an indication of fluid velocity.

[0095] The method may further include the step of analyzing an image and determining the current position and orientation of the probe relative to a target position and orientation, such that the target position and orientation align the probe to accurately obtain a selected view of the body part.

[0096] The determination step may be performed, for example, by an AI process, taking into account the probe's position and orientation based on the relationship between the temporal degrees of freedom and at least one spatial degree of freedom at the captured point in time within the periodic cycle of the fluid flow. For example, the estimated point in the periodic fluid cycle (e.g., estimated from Doppler information) may be incorporated when outputting the position and orientation and / or image quality display.

[0097] The method may also include, for example, a step of communicating to the probe user the current position and orientation of the probe relative to the target position and orientation, and an indication of the image quality as a selected view. For example, the quality indication may be high if the image is a selected view (e.g., corresponding to a selected view), and low if the image is not a selected view (e.g., not showing a selected view or not related to a selected view).

[0098] Figure 7 shows a schematic diagram of an exemplary display view 700 that may be communicated to the user of the ultrasound probe. The display view 700 may be displayed on a computer display, for example, on a display that communicates with the ultrasound probe (e.g., via a wired or wireless connection). The display view 700 may include an image 710 derived from signals acquired by the ultrasound probe (e.g., ultrasound measurements). The display view 700 may, for example, show a parasternal long axis (PLAX) view of the heart. The display 700 may also include a graphic representation of the probe's current position and orientation 725 relative to the object being observed 720 (e.g., the human body).

[0099] The display view 700 may include a tutorial (not shown), for example, text or graphical instructions on how to move the probe from its current position and orientation to a target position and orientation.

[0100] The display view 700 may also include an image quality indicator, such as an image quality scale 750. The image quality scale 750 may include graphical elements such as a slider 755 to indicate to the user the quality of the image 710, as currently obtained with the probe's P&O 725. For example, if the desired view is an apical four-ventricular view of the heart, but the captured image does not currently show a clear view of all ventricular areas, the image quality scale may indicate that the image quality is poor. Poor image quality can be corrected by moving the ultrasound probe to the target position and orientation, and the slider 755 can be moved accordingly so that the user can make final adjustments to obtain a selected view of the body part.

[0101] Region 711 of image 710 may be augmented (e.g., superimposed) with Doppler information. The augmentation may be performed by at least one processor communicating with the probe and the display. The display view 700 may show image 710 as having regions that represent motion, such as fluid motion. The display view 700 may indicate regions 712 moving toward the probe by displaying such regions in a first color, e.g., red (in the drawing, hatching and stippling are used instead of color). A scale on the display may indicate the velocity of motion, such as a shaded color scale with shading 716 representing positive velocities in the direction toward the probe, e.g., in the range of approximately 0 to 59.8 cm / sec. The display view 700 may indicate regions 714 moving away from the probe by displaying such regions in a second color, e.g., blue. The scale on the display may indicate the velocity of motion, such as a color scale of shades with shades 718 representing negative velocities in the direction away from the probe, for example, in the range of approximately 0 to -59.8 cm / second. The motion may be that of a fluid, such as blood. Embodiments of the present invention can monitor a display (e.g., a display including Doppler information) as shown in Figure 7, and computer vision techniques, screen grabs of the displayed image, and / or screen captures can be used as input to an analysis process, such as an artificial intelligence process, such as a neural network. The AI ​​process can then analyze the image and Doppler information to output an image quality display on the probe's current position 725 and / or image quality scale 750.

[0102] According to several embodiments, a system is provided that can perform one or more steps of the methods described herein. For example, according to one embodiment, a system for positioning and aligning an ultrasound probe includes a computer processor and a memory containing one or more sets of instructions, the one or more sets of instructions, when executed, cause the computer processor to receive a dataset derived from an ultrasound probe, the dataset containing at least one dataset acquired during pulsed Doppler mode operation of the probe; analyze the dataset to identify the current position and orientation of the probe relative to a target position and orientation, the target position and orientation, align the probe to accurately obtain a selected view of a body part; and communicate the current position and orientation of the probe relative to the target position and orientation to the user of the probe.

[0103] The system may be as described in Figure 1, and may operate in conjunction with a display that communicates with an ultrasonic probe, for example, by direct monitoring of the display or by interfacing with a communication feed for the display. The system's processor may perform artificial intelligence processes to analyze the dataset, as described above.

[0104] Figure 8 shows the architecture of System 800 according to several embodiments of the present invention. System 800 may be embodied as a Software-as-a-Service (SAAS) product, such as an application / app that can be deployed on or in conjunction with an existing ultrasonic processing platform, such as ultrasonic probe systems developed by Philips (Koninklijke Philips NV), General Electric Company, Clarius, Butterfly, Exo, and Fujifilm SonoSite. For example, embodiments of the present invention may function in parallel with any of the following: EPIQ, Affiniti, CX50, Lumify, and / or Sparq developed by Philips; Vscan, Vscan Air, Vscan Extend, Venue, Venue Fit, Venue Go, Vivid, Versana, NextGen LOGIQ, and / or LOGIQ developed by GE; Clarius handheld probes; Butterfly IQ and IQ; and / or Sonosite PX, Sonosite LX, Sonosite S, Sonosite EDGE, Sonosite X-PORTE, and / or Sonosite M-Turbo developed by Sonosite.

[0105] The system 800 may include, for example, a front end 802 that can be viewed by the user on a display device. The front end 802 may display a display view 806, as described in the display view 700 of Figure 7. The display view may be augmented with Doppler information. The display view 806 may include the current ultrasound image 808, a graphical user interface 810, and / or an image quality indicator 812 (as described above with respect to scale 750).

[0106] The application backend 804 may receive multiple ultrasound images 808 and store these images for input 811 to the neural network 818. The neural network 818 may also receive metadata 814, which may include a timestamp, Doppler data, ultrasound signal data (e.g., frequency, reflectance), and data such as the patient's weight, height, age, sex, and known medical conditions. The neural network 818 may also receive a target view 816 (e.g., a desired view selected by user input) and additional parameters such as the required image quality.

[0107] The neural network 818 may analyze these inputs to determine, for example, the current position and orientation of the probe relative to the target position and orientation that will achieve the target field of view, as well as to determine the image quality display.

[0108] Post-processing operation 820 may be performed to communicate guidance to the user via the front-end graphical user interface and image quality indicators. The post-processing operation may include any logic performed to communicate navigation output and quality to the user. Input to this logic may include the output of a neural network. For example, smoothing of the neural network output may be performed before displaying it to the user, for example, by averaging across multiple outputs to minimize anomalous results.

[0109] Aspects of the present invention have been described above with reference to flowcharts and / or partial diagrams of methods, apparatus (systems) and computer program products according to embodiments of the present invention. It will be understood that each part of the flowcharts and / or partial diagrams, and combinations of parts of the flowcharts and / or partial diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a dedicated computer, or other programmable data processing device, and can generate means for performing functions / operations specified in the flowcharts and / or partial diagrams or their parts, thereby instructions executed via the processor of the computer or other programmable data processing device.

[0110] Furthermore, these computer program instructions can be stored in a computer-readable medium that can instruct a computer, other programmable data processing device, or other device to function in a specific manner, thereby generating a product in which the instructions stored in the computer-readable medium include instructions that perform functions / actions specified in the flowchart and / or sub-diagram portion or part thereof. Alternatively, computer program instructions can be loaded into a computer, other programmable data processing device, or other device to execute a series of operational steps on the computer, other programmable device, or other device, thereby generating a computer implementation process such that the instructions executed on the computer or other programmable device provide a process for performing functions / actions specified in the flowchart and / or sub-diagram portion or part thereof.

[0111] The flowcharts and diagrams described above illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each part of a flowchart or sub-diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions shown in that part may occur in an order different from the order shown in the diagram. For example, two parts shown consecutively may actually be executed substantially simultaneously, or they may be executed in reverse order depending on the functions involved. It should also be noted that each part of a sub-diagram and / or flowchart, and combinations of parts of a sub-diagram and / or flowchart, may be implemented by a dedicated hardware-based system or a combination of dedicated hardware and computer instructions that performs a specified function or operation.

[0112] In the above description, embodiments are examples or practices of the present invention. The various appearances of “one embodiment,” “a certain embodiment,” “a particular embodiment,” or “several embodiments” do not necessarily all refer to the same embodiment. Various features of the present invention can be described in the context of a single embodiment, but features can also be provided individually or in any preferred combination. Conversely, the present invention can be described herein in the context of individual embodiments for clarity, but the present invention can also be practiced in a single embodiment. A particular embodiment of the present invention may include features from different embodiments disclosed above, and a particular embodiment may incorporate elements from other embodiments disclosed above. The disclosure of elements of the present invention in the context of a particular embodiment should not be construed as limiting their use to that particular embodiment only. Furthermore, it should be understood that the present invention can be carried out or implemented in a variety of ways, and that the present invention can also be carried out in specific embodiments other than those outlined in the above description.

[0113] The present invention is not limited to these figures or corresponding descriptions. For example, the flow does not need to move through each illustrated box or state, nor does it need to move in the exact same order as illustrated and described. Unless otherwise defined, the meanings of technical and scientific terms used herein should be understood by those skilled in the art to which the present invention pertains. The present invention has been described in relation to a limited number of embodiments, but these should not be construed as limitations on the scope of the invention, but rather as examples of preferred embodiments. Other possible variations, modifications, and applications are also within the scope of the invention. Accordingly, the scope of the invention should not be limited by what has been described herein, but should be limited by the appended claims and their legal equivalents.

Claims

1. A method for positioning and aligning an ultrasonic probe, A step of receiving a dataset derived from the ultrasound probe, wherein the dataset includes at least one ultrasound image of the subject's heart acquired together with associated blood flow information, and the associated blood flow information provides information regarding the timing of the cardiac cycle in the ultrasound image. An artificial intelligence process trained using ultrasound images of another subject's heart and associated blood flow information, the process being trained to distinguish between image changes due to changes in probe position and orientation and image changes caused by fluid flow during the cardiac cycle, the artificial intelligence process analyzing at least one ultrasound image and the associated blood flow information by applying the trained distinction to identify the current position and orientation of the ultrasound probe relative to a target position and orientation, thereby aligning the ultrasound probe to accurately obtain a selected view of the subject's heart. The steps include communicating to the user of the ultrasonic probe the current position and orientation of the ultrasonic probe relative to the target position and orientation, Methods that include...

2. The method according to claim 1, wherein the dataset is received using at least one of screen grabbing or screen capturing of an image on a display communicating with the ultrasonic probe.

3. The method according to claim 1, wherein the artificial intelligence process also outputs a display of the quality of an image generated by the ultrasonic probe at its current position and orientation, the quality of the image corresponding to whether the selected view has been achieved.

4. The method according to claim 1, wherein the transmission step includes generating one or more images, each containing one or more visual cues indicating the current position and orientation, based on at least a portion of the dataset, and presenting the one or more images on a display.

5. The method according to claim 4, wherein the one or more visual cues include at least one representation of the type, direction, and scale of motion required to guide the ultrasonic probe from its current position and orientation to its target position and orientation.

6. The method according to claim 3, wherein the communication step includes presenting an image quality display scale on a display.

7. A method for correcting the position and orientation of an ultrasonic probe, The steps include receiving an image of a subject's heart derived from the ultrasound probe, wherein the image is superimposed with fluid flow information acquired together with the image, and the fluid flow information provides information regarding the cardiac cycle timing of the image; An artificial intelligence process trained with ultrasound images of a subject's heart and associated fluid flow information, comprising the steps of: using an artificial intelligence process trained to analyze the images and associated fluid flow information and to use information regarding cardiac cycle timing to distinguish between image changes caused by changes in the position and orientation of the ultrasound probe and image changes caused by the fluid flow of the cardiac cycle, wherein the artificial intelligence process applies the trained distinction to determine the current position and orientation of the ultrasound probe relative to a target position and orientation, thereby aligning the ultrasound probe to accurately obtain a selected view of a body part; A method comprising the step of communicating to the user of the ultrasound probe the current position and orientation of the ultrasound probe relative to the target position and orientation, and a display of the quality of the image as the selected view.

8. A system for positioning and oriented an ultrasonic probe, Computer processor and A memory containing one or more sets of instructions, wherein when the one or more sets of instructions are executed, the computer processor is: A step of receiving a dataset derived from the ultrasound probe, wherein the dataset includes at least one ultrasound image of a subject's heart acquired together with associated blood flow information, and the blood flow information provides information regarding the timing of the cardiac cycle in the ultrasound image. An artificial intelligence process trained on ultrasound images of a subject's heart and associated blood flow information, the process trained to distinguish between image changes caused by changes in probe position and orientation and image changes caused by fluid flow during the cardiac cycle, using information regarding cardiac cycle timing, the process applies the trained distinction to identify the current position and orientation of the ultrasound probe relative to a target position and orientation, thereby aligning the ultrasound probe and accurately obtaining a selected view of a body part. A system that causes the user of the ultrasonic probe to perform the steps of: communicating the current position and orientation of the ultrasonic probe relative to the target position and orientation.

9. The system according to claim 8, wherein the artificial intelligence process also outputs at least one of the current position and orientation of the ultrasonic probe relative to the selected view, and a display of the quality of the image generated by the ultrasonic probe at its current position and orientation, the quality of the image corresponding to whether the selected view has been achieved.

10. The system according to claim 8, wherein the transmission step includes generating one or more images, each containing one or more visual cues indicating the current position and orientation of the ultrasound probe, based on at least a portion of the dataset, and presenting the one or more images on a display.

11. The system according to claim 10, further comprising the step of displaying an image quality display scale.

12. The system according to claim 10, wherein the one or more visual cues include at least one of the indications of the type, direction, and scale of motion required to guide the ultrasonic probe from its current position and orientation to its target position and orientation.

13. A system for positioning and oriented an ultrasonic probe, wherein the system is Computer processor and A set comprising one or more sets of instructions, When one or more of the above sets of instructions are executed, the computer processor will: A step of receiving or determining a dataset indicating the type, direction, and scale of motion required to guide an ultrasound probe from its current position and orientation to its target position and orientation, wherein the target position and orientation aligns the ultrasound probe and accurately obtains a selected view of a body part. The steps of generating one or more images based on at least a portion of the dataset, each image containing one or more visual cues indicating the type, direction, and scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, The steps include: causing one or more images to be displayed on the display, Each of the one or more images mentioned above is: A first visual cue indicating the target position and orientation of the ultrasonic probe, Includes a second visual cue indicating the current position and orientation of the ultrasonic probe relative to the target position and orientation of the ultrasonic probe, The first visual cue includes a cross diagram having two bars perpendicular to each other and intersecting at an intersection, The cross diagram above shows the proximal end of the ultrasonic probe at the target position and orientation. The aforementioned intersection represents the longitudinal axis of the center of the ultrasonic probe in the target position and orientation. The system wherein the plane defined by the bar represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe at the target position and orientation.

14. The relative position and orientation between the second visual cue and the first visual cue indicate the type and direction of the movement required to guide the ultrasonic probe from its current position and orientation to its target position and orientation. The system according to claim 13, wherein the distance between the designated point on the second visual cue and the corresponding designated point on the first visual cue represents the measure of the movement required to guide the ultrasonic probe from its current position and orientation to its target position and orientation.

15. The system according to claim 13, wherein the first visual cue further comprises a visual marker corresponding to the position of a corresponding physical marker on the ultrasonic probe.

16. The second visual cue is, The 2D projection of the 3D representation of the ultrasonic probe in its current position and orientation, A second cross diagram comprising two second bars perpendicular to each other and intersecting at a second intersection, The second cross diagram above shows the proximal end of the ultrasonic probe in its current position and orientation. The second intersection represents the central longitudinal axis of the ultrasonic probe in its current position and orientation. The system according to claim 13, wherein the plane defined by the second bar represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe in its current position and orientation.

17. The system according to claim 16, wherein the second visual cue further comprises a second visual marker corresponding to the position of a corresponding physical marker on the ultrasonic probe.

18. When one or more of the above sets of instructions are executed, the computer processor will: The steps include receiving at least one ultrasound image acquired by the ultrasound probe at its current position and orientation, A step of supplying the at least one ultrasound image and the selected view of the body part as input to a neural network, wherein the neural network is implemented on the computer processor and configured to output the dataset, The system according to claim 13, which further performs the following.

19. The system according to claim 18, wherein the neural network analyzes fluid motion within a body part based on relevant blood flow information.

20. A method for positioning and aligning an ultrasonic probe, A computer processor receives or determines a dataset indicating the type, direction, and scale of motion required to guide an ultrasound probe from its current position and orientation to its target position and orientation, wherein the target position and orientation aligns the ultrasound probe and accurately obtains a selected view of a body part. The steps include: generating one or more images, each containing one or more visual cues indicating the type, direction, and scale of motion required to guide the ultrasound probe from its current position and orientation to its target position and orientation, based on at least a portion of the dataset; The steps include causing the computer processor to display one or more images on a display, Each of the one or more images mentioned above is: A first visual cue indicating the target position and orientation of the ultrasonic probe, Includes a second visual cue indicating the current position and orientation of the ultrasonic probe relative to the target position and orientation of the ultrasonic probe, The first visual cue includes a cross diagram having two bars perpendicular to each other and intersecting at an intersection, The cross diagram above shows the proximal end of the ultrasonic probe at the target position and orientation. The aforementioned intersection represents the longitudinal axis of the center of the ultrasonic probe in the target position and orientation. A method wherein the plane defined by the bar represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe at the target position and orientation.

21. The relative position and orientation between the second visual cue and the first visual cue indicate the type and direction of the movement required to guide the ultrasonic probe from its current position and orientation to its target position and orientation. The method according to claim 20, wherein the distance between the designated point on the second visual cue and the corresponding designated point on the first visual cue represents the measure of the movement required to guide the ultrasonic probe from its current position and orientation to its target position and orientation.

22. The method according to claim 20, wherein the first visual cue further comprises a visual marker corresponding to the position of a corresponding physical marker on the ultrasonic probe.

23. The second visual cue is, The 2D projection of the 3D representation of the ultrasonic probe in its current position and orientation, A second cross diagram comprising two second bars perpendicular to each other and intersecting at a second intersection, The second cross diagram above shows the proximal end of the ultrasonic probe in its current position and orientation. The second intersection represents the central longitudinal axis of the ultrasonic probe in its current position and orientation. The method according to claim 20, wherein the plane defined by the second bar represents a plane perpendicular to the central longitudinal axis of the ultrasonic probe in its current position and orientation.

24. The method according to claim 20, wherein the second visual cue comprises a text indicator having a numerical value for quantifying the measure of the motion required to guide the ultrasonic probe from its current position and orientation to its target position and orientation.

25. The computer processor receives at least one ultrasound image acquired by the ultrasound probe in its current position and orientation. The method according to claim 20, further comprising the steps of supplying the computer processor with the at least one ultrasound image and the selected view of the body part as input to a neural network, wherein the neural network is implemented on the computer processor and configured to output the dataset.

26. The method according to claim 25, wherein the neural network analyzes fluid motion within a body part based on relevant blood flow information.

Images