User guidance in ultrasound imaging

Abstract

An apparatus for providing guidance to a user of an ultrasound acquisition system to acquire a standardized image of a target anatomy of a patient is provided. The processing unit is configured to switch the user interface between two modes: a guidance mode in which guidance information is presented only on the user interface, and an imaging mode in which the received ultrasound image is presented on the user interface. The processing unit switches the user interface between the two modes based on the spatial relationship between the current probe position and the target view. When the ultrasound acquisition system is within a threshold distance of the target view, the processing unit switches the user interface to display an imaging mode, otherwise, displays a guidance mode.

Description

Technical Field

[0001] The present invention relates generally to the field of ultrasound imaging, and more particularly to the field of providing guidance information to a user of an ultrasound acquisition system. Background Art

[0002] Ultrasound imaging is often used to obtain images of a patient's internal anatomical structures. An ultrasound system typically includes an ultrasound transducer probe that includes a transducer array coupled to a probe housing. The transducer array is activated to vibrate at an ultrasonic frequency to transmit ultrasonic energy into the patient's anatomy, and then receives ultrasonic echoes reflected or backscattered by the patient's anatomy to create an image. These transducers can be used to continuously transmit and receive several ultrasonic pressure waves through various tissues of the body. The various ultrasonic responses can also be processed by the ultrasound imaging system to display various structures and tissues of the body.

[0003] A sonographer may desire to obtain an ultrasound image representing a particular view or imaging plane of an organ in order to evaluate the condition of the organ and / or make measurements on the organ. For example, particular acoustic imaging windows of the heart that a sonographer may desire to obtain include "tip," "subcostal" (subxiphoid), "parasternal," and "suprasternal" windows. Obtaining these views involves positioning an ultrasound probe at a particular region of the patient's body and orienting the probe to obtain an image at the desired view. The movements used by the sonographer to position and orient the probe may be complex and may involve several degrees of freedom in three-dimensional space. Therefore, it can be challenging for an experienced sonographer to achieve the desired view.

[0004] It is important that the images produced by an ultrasound imaging system be as clear and accurate as possible in order to give the user a realistic interpretation of the object being scanned. This is particularly true when the object in question is a patient undergoing a medical ultrasound scan. In this case, the clinician's ability to make an accurate diagnosis depends on the quality of the images produced by the ultrasound imaging system, which in turn depends on the clinician's ability to correctly position the probe in order to acquire a targeted view of the anatomical structure of interest.

[0005] A growing area of ​​interest is the use of ultrasound for whole body symptom-based examinations, where ultrasound images can be acquired anywhere on the body for rapid triage based on specific symptoms or points of interest. Most of these examinations are performed by novice ultrasound operators. Traditionally, ultrasound image views are acquired "freehand" by experienced users. The probe can be moved without any constraints on position or orientation, and all acquisition settings are configurable. It is up to the user to decide how and when images are acquired.

[0006] However, novice users often do not have sufficient experience in data acquisition and data interpretation to perform complex imaging.

[0007] The use of AI algorithms to provide probe guidance and automatic image interpretation is already known. In particular, algorithms are known that can interpret acquired ultrasound images and generate probe guidance information to be presented to a user in real time, often alongside the acquired images. However, in known systems, the information content of the guidance is often insufficient to enable a novice user to perform an imaging procedure. In particular, known forms of guidance can be confusing and overwhelming, especially for an inexperienced user who starts with an ultrasound acquisition system (i.e., ultrasound probe) far from the target anatomy that it wishes to image. The greater affordability of 3D ultrasound probes has made 3D acquisition available to new users, which may make navigation easier due to the available volume information. However, guidance remains a challenge for inexperienced users.

[0008] Another challenge in the field of ultrasound imaging is to facilitate more reproducible results. In the prior art, quantitative imaging on ultrasound is very difficult because the images cannot be relied upon to capture a consistent view. This is true not only for images acquired for different users, but also for the same user navigating to the same view at different instances.

[0009] Therefore, an improved means for providing guidance to ultrasound users that can address one or more of the above-mentioned issues would be valuable. Summary of the invention

[0010] The invention is defined by the claims.

[0011] According to an example according to one aspect of the present invention, there is provided a device for providing guidance to a user of an ultrasound acquisition system to acquire a target view of a target anatomical structure of a patient. The device comprises: a receiving unit, which is suitable for receiving an ultrasound image acquired by the user using an ultrasound acquisition system. The device also comprises a processing unit, which comprises: a view analyzer module, which is suitable for determining a spatial relationship between the received ultrasound image and the target view, and calculating at least one distance metric for the acquired ultrasound image based on the spatial relationship; and a guidance module, which is suitable for generating guidance information based on the spatial relationship, the guidance information indicating a change in the position and / or orientation of the ultrasound acquisition system for acquiring another ultrasound image. The device also comprises: an input / output unit, which is suitable for operably coupling the processing unit with a user interface.

[0012] The processing unit is suitable for selectively switching the user interface between the following two during use: a guidance mode, in which the guidance information generated by the guidance module is provided on the user interface and the received ultrasound image is not provided on the user interface; and an imaging mode, in which the received ultrasound image is provided on the user interface.

[0013] The processing unit is adapted to set the user interface to the guidance mode if the at least one distance metric exceeds a predefined threshold, and to set the user interface to the imaging mode otherwise.

[0014] Therefore, an embodiment provides a guidance scheme for navigating an ultrasound imaging unit toward a target view, wherein the actual ultrasound image information is presented on the screen only once the imaging unit is within a defined spatial region or window of the target view plane. This improves navigation and reduces human error by constraining the information provided to the user of the ultrasound probe while it is still a significant distance away from the target view position. During this navigation phase, the ultrasound image data has poor quality, thereby providing a blurry and unclear image that potentially confuses the user. Therefore, for novice users, navigation is greatly improved and human error is reduced by suppressing this image information during the initial probe navigation phase of the process, thereby allowing the user to focus on following more intuitive dedicated guidance information. In other words, navigation is improved by suppressing information that is actually irrelevant to the navigation process or unhelpful to it due to its poor quality. Such irrelevant or unhelpful information, if not suppressed, may interfere with accurate navigation. To this end, it is particularly proposed that during the guidance mode, the ultrasound image is not displayed to the user at all, so that the user is only provided with guidance information. For example, the user interface may include one or more display devices, and wherein, during the guidance mode, the ultrasound image is not presented on any display device included by the user interface.

[0015] Once the user has moved the probe to within a threshold proximity of the target view, image suppression ceases and the user is free to use the image data to improve probe placement. At this point, the image information becomes relevant and aids the task of positioning the probe.

[0016] Existing solutions for probe navigation maintain full navigational freedom for the ultrasound user during the probe navigation phase. The user is required to steer the probe based on complex and scattered imaging information. Non-expert or new users do not understand this information because it is only indirectly related to the process of navigating the probe. Even for expert users, this scattered imaging information does not directly help navigate the probe and complicates navigation.

[0017] In some embodiments, in addition to the received ultrasound image, guidance information may be output to the user interface in the imaging mode. This allows the user to continue to further refine the position of the probe so that it can more closely match the target view even when the ultrasound acquisition system's distance metrics to the target view are all within their predefined thresholds. This also allows more experienced ultrasound users to receive guidance while still having access to the images they are acquiring.

[0018] In some embodiments, the processing unit may be capable of communicating with a memory storing a database of standardized image views of a plurality of different anatomical structures, and wherein the target view is a view of the target anatomical structure selected from the database. This allows a user to select a specific target view of the anatomical structure they are interested in acquiring images of, which view is one of a set of clinically relevant standardized views.

[0019] The processing unit may be capable of communicating with a memory storing a database of previously acquired ultrasound images of the target anatomical structure, and wherein the target view is determined to be a view represented by the selected one of the images.

[0020] Previously acquired images can be historical images of the target anatomical structure of the same patient. This facilitates clearer comparison of images of the same structure of a patient over time. In particular, the historical image and the currently acquired image will accurately match in terms of the view represented, which enables easier detection of changes in clinically relevant information. For example, the progression of a disease will be easier to analyze using two images sharing the same view.

[0021] The previously acquired images may also be historical images of the target anatomical structure of a different patient. This allows the user to accurately reproduce the view of the ultrasound image frame of the target anatomical structure of a different patient, thereby facilitating a clearer comparison between the two images that may yield clinically relevant information. For example, healthy anatomical structures may be more easily compared to unhealthy anatomical structures from two images that share the same view.

[0022] Each of the images stored in the database may be associated with a set of acquisition settings of the ultrasound acquisition system, and in the imaging mode, the processing unit may be adapted to transmit the corresponding set of ultrasound acquisition settings associated with the selected image to the ultrasound acquisition system. This allows the acquired ultrasound image to more reliably match the target view, thereby further improving the reproducibility of the ultrasound image.

[0023] In the imaging mode, the processing unit may also be adapted to output an electronic steering direction to the ultrasound acquisition system to steer the formed ultrasound beam so that the acquired image matches the target view. This allows the acquired ultrasound image to more closely match the target view, thereby further improving the reproducibility of the ultrasound image.

[0024] The guidance information may include guidance for three rotational degrees of freedom and three translational degrees of freedom. This provides the user with clear guidance on probe positioning in all three dimensions in order to reach the target view, making the navigation guidance more intuitive and comprehensive. As a result, this promotes subsequently acquired images to more closely match the target view.

[0025] During the imaging mode, the processing unit may be adapted to record selected image frames in a memory to compile an examination imaging data set for the patient, and wherein the processing unit is adapted to store the image frames in the data set only if the image frames match the target view. This again improves the reproducibility of the acquired images by constraining image acquisition to only those image frames that match the target view, thereby reducing human errors.

[0026] The processing unit may be configured to guide the user to acquire a sequence of target views. This may be relevant, for example, in the context of performing a symptom check, where multiple anatomical structures are of interest in order to investigate the cause of a set of symptoms.

[0027] Another aspect of the present invention also provides a system for providing guidance to a user of an ultrasound acquisition system to acquire a target view of an anatomical structure, the system comprising: an apparatus as described above, or an apparatus according to any other example or embodiment in the present disclosure; and a user interface operably coupled to an input / output of a processing unit.

[0028] The system may further include an ultrasound acquisition system operatively coupled to the receiving unit. This allows the device to communicate directly with the ultrasound acquisition system, thereby facilitating the transfer of information such as instructions for electronic steering and ultrasound acquisition settings to the ultrasound acquisition system.

[0029] Another aspect of the present invention also provides a computer-implemented method for providing guidance to a user of an ultrasound acquisition system to acquire a target view of a target anatomical structure of a patient, the method comprising: receiving an ultrasound image acquired by the user using the ultrasound acquisition system; determining a spatial relationship between the received ultrasound image and the target view, and calculating at least one distance metric for the acquired ultrasound image based on the spatial relationship; generating guidance information based on the spatial relationship, the guidance information indicating a change in a position and / or orientation of the ultrasound acquisition system for acquiring another ultrasound image; and switching a user interface between:

[0030] a guidance mode in which guidance information is provided on the user interface and the received ultrasound image is not provided on the user interface; and

[0031] an imaging mode in which the received ultrasound image is provided on the user interface;

[0032] The method further includes: setting the user interface to the guiding mode when the at least one distance metric exceeds a predefined threshold, and otherwise setting the user interface to the imaging mode.

[0033] Yet another aspect of the present invention provides a computer program product comprising a code module, wherein when the code module is executed on a processor, the code module is configured to cause the processor to perform the above computer-implemented method.

[0034] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] For a better understanding of the invention and to show more clearly how it may be carried into effect, reference will now be made, by way of example only, to the accompanying drawings, in which:

[0036] Figure 1 A schematic diagram showing an apparatus for providing guidance to a user of an ultrasound acquisition system according to an embodiment of the present disclosure is shown;

[0037] Figure 2 (a) shows an example of a user interface in a guided mode according to an embodiment of the present disclosure;

[0038] Figure 2 (b) shows another example of a user interface in a guide mode according to an embodiment of the present disclosure;

[0039] Figure 2 (c) shows an example of a user interface in imaging mode according to an embodiment of the present disclosure;

[0040] Figure 3 An example of a proximal zone in two spatial dimensions of an ultrasound acquisition system according to an embodiment of the present disclosure is shown;

[0041] Figure 4 shows examples of angular dimensions of the proximal region according to embodiments of the present disclosure;

[0042] Figure 5 A schematic diagram of an apparatus for providing guidance to a user of an ultrasound acquisition in communication with a memory according to an embodiment of the present disclosure is shown; and

[0043] Figure 6 A flow chart of a method for providing guidance to a user of an ultrasound acquisition system is shown. DETAILED DESCRIPTION

[0044] The present invention will be described with reference to the accompanying drawings.

[0045] It should be understood that the detailed description and specific examples are intended for illustration purposes only and are not intended to limit the scope of the invention when indicating exemplary embodiments of the device, system and method. These and other features, aspects and advantages of the device, system and method of the present invention will become better understood from the following description, claims and drawings. It should be understood that the drawings are merely schematic and are not drawn to scale. It should also be understood that the same reference numerals are used throughout the drawings to indicate the same or similar parts.

[0046] The present invention provides an apparatus for facilitating improved ultrasound probe navigation guidance for acquiring ultrasound images. A navigation scheme is implemented, which includes two navigation phases: one navigation phase adopted when the ultrasound probe is far away from the target image view, and another navigation phase adopted once the probe has been successfully navigated into the defined proximity field of the target view. The proximity field can be defined in terms of the translation proximity of the current imaging view of the probe and the target imaging view, and optionally also the orientation proximity. By defining these two phases, the characteristics and content of the information provided to the user in each phase can be customized. During the more distant phase, the information may be more restrictive, such as simply giving guidance on moving the probe toward the proximal region. Once in the proximal region, the information can additionally include ultrasound image data acquired by the imaging system, so that the user can adjust the imaging view more accurately. By suppressing the display of image data during the initial navigation phase, this reduces the scope of human error and more narrowly constrains the user's freedom of adjustment, which ultimately leads to improved navigation for the target imaging view.

[0047] Figure 1 1 shows an apparatus 100 for providing guidance to a user of an ultrasound acquisition system ("U / S system") to acquire a target view of a target anatomical structure of a patient in accordance with one or more embodiments. It should be noted that the apparatus 100 may be a separate unit from the ultrasound acquisition system 118, such as Figure 1 As shown, or can be integrated as a component of an ultrasound acquisition system.

[0048] The apparatus 100 comprises a receiving unit 110 adapted to receive ultrasound images acquired by a user using an ultrasound acquisition system 118. For example, the ultrasound acquisition system may comprise a probe whose position and orientation may be freely adjusted by the user by hand. In some cases, the receiving unit may receive a series of ultrasound images, such as a stream of ultrasound images. It may process each received image in turn.

[0049] The apparatus 100 also includes a processing unit 120, which itself includes a view analyzer module 122 and a guide module 124. It should be noted that these can be software modules or hardware modules. In addition, although they are Figure 1Although shown as separate elements in the figures, they may simply represent software functions or routines and both may in practice be implemented by the same processing element and / or program instruction set.

[0050] The view analyzer module 122 is adapted to determine a spatial relationship between a received ultrasound image and a target view, and to calculate at least one distance metric for the acquired ultrasound image based on the spatial relationship. The distance metric may include a spatial distance portion that is determined, for example, in three dimensions and indicates a translation distance from a current probe position and a probe position required to acquire the target view. The distance metric may include an orientation component that indicates a difference between a current probe orientation and an orientation required to acquire the target view. In some embodiments, the view analyzer module 122 may determine a position and orientation of an ultrasound acquisition system (e.g., a probe of the ultrasound acquisition system) based on the received ultrasound image. The position may be defined relative to a reference system of the anatomy being imaged.

[0051] In some embodiments, the target view can be represented in terms of a target position and orientation of an ultrasound acquisition system used to acquire the target view. This can be represented by position information including values ​​associated with one or more physical dimensions or geometric parameters, such as position coordinates of the probe (e.g., xyz coordinates, spherical coordinates, cylindrical coordinates) and angular information of the probe (e.g., sector, rotation, yaw).

[0052] The guidance module 124 is adapted to generate guidance information based on the spatial relationship, which indicates a change in a position and / or orientation of the ultrasound acquisition system 118 for acquiring another ultrasound image closer to the target view.

[0053] In some embodiments, the guidance information is used to induce movement of a user of the ultrasound acquisition system, which includes one or more adjustments of the ultrasound transducer unit, for example including one or more of the following: lateral sliding movement, sweeping movement, rocking movement, fanning movement, rotational movement, compression movement or decompression movement.

[0054] In the case of 3D ultrasound acquisition, the acquired volume information can be used to help further refine the guidance information and / or electronically steer the probe without the user having to physically reorient the probe. This is possible because the view presented to the user of the 3D ultrasound acquisition system will often be a 2D image, and therefore a 2D plane can be selected for presentation to the user based on the 3D information being acquired by the probe.

[0055] The apparatus further comprises an input / output 130 adapted to operatively couple the processing unit 120 with a user interface 132. The input / output 130 may output guidance information and / or imaging information to the user interface 132. The user interface may comprise one or more display devices.

[0056] Figure 2 The use of a system according to one or more embodiments is illustrated. Figure 2 (a)-(c) show the output of the user interface 132 at different stages during overall probe navigation and imaging during an ultrasound examination of a patient. An example ultrasound imaging probe 210 is illustrated being applied to a patient.

[0057] Figure 2 (a) illustrates the start of the examination process, where the user first applies the probe 210 to the body. The device 100 is configured with a defined target view of a specific target anatomical structure to be acquired. This can be manually configured in advance by the user, or can be automatically set, for example, according to a predefined imaging workflow. Options in this regard will be described in more detail later.

[0058] exist Figure 2 In (a), the starting position of the probe 210 is relatively far from the position required for acquiring the target view. The receiving unit 110 receives an ultrasound image obtained using echo data acquired using the probe at the starting position, and processes the image to determine a distance metric for the acquired ultrasound image, the distance metric indicating the distance between the current ultrasound image and the target view. For example, the processing unit 120 determines whether the probe is within a threshold distance of the desired position for the target view. For example, the processing unit can determine whether the probe is within a defined threshold proximity zone or window or field relative to the desired target view, where this can be defined in terms of translation proximity and optionally also orientation proximity of the probe.

[0059] exist Figure 2 In (a), the probe 210 is well outside the proximity field to the target view, and therefore the processing unit 120 determines to keep the device 100 in the guided mode, or to switch the device to the guided mode if the device was not previously in the guided mode.

[0060] Figure 2 (a) shows the corresponding output to the user interface 132 during the guidance mode. The user interface 205 displays guidance information 220, which indicates a change in the position and / or orientation of the ultrasound acquisition system 118 for acquiring another ultrasound image. The indicated change is used to bring the probe 210 closer to the position required to acquire the target view. It is used to bring the probe closer to the target proximity field. In some examples, such as Figure 2As shown in (a), the guidance information may include a visual representation of the relative position of the probe 305 and the proximal zone 310 to convey the positional displacement of the probe from the target view. In the guidance mode, the guidance information 220 generated by the guidance module 124 is output to the user interface 132 without the received ultrasound image 230 (i.e., the received ultrasound image is not provided on the user interface). Therefore, the image information is suppressed.

[0061] By suppressing image information, user errors are reduced and navigation accuracy is improved. By way of example, this is particularly useful for ultrasound acquisition systems employing 1D probes, where understanding the images on the screen (especially during the navigation process) requires a lot of experience and skill. When the probe is far from the target view, the imaging information is confusing and only indirectly relevant to navigation. However, the concept is advantageous for all image acquisition types, including systems using 2D probes.

[0062] exist Figure 2 In (b), the user has followed the guidance information 220 and moved the probe 210 closer to the target view position. The probe is still outside the threshold distance from the target view, i.e., outside the near side zone, and therefore the system remains in the guidance mode. Therefore, only the guidance information is displayed on the user interface display 132.

[0063] Regarding guidance information, in some embodiments, the guidance information 220 includes probe movement guidance for one or more rotational degrees of freedom of the probe 210. Preferably, the guidance is for three rotational degrees of freedom of the probe. In some embodiments, the guidance information includes movement guidance for three translational degrees of freedom of the probe. This allows the user to receive guidance on how to position the probe in all dimensions, thereby allowing the acquired images to more closely match the target view.

[0064] Figure 2 (a) and 2(b) show examples of simplified 2D pictures on the user interface 132 consisting of a ring, where the picture is an example of the guidance information 220. The center of the ring is the position corresponding to the target view. The guidance information may include guidance for adjusting the probe position (e.g., in three degrees of freedom for rotation and three degrees of freedom for translation).

[0065] In some examples, the guidance information may include a generated visual element for display on a screen that represents guidance information for multiple degrees of freedom of the probe, preferably all six degrees of freedom, in a single element. For example, this may be a generated image representing movement guidance for multiple degrees of freedom. The guidance information may include static visual indications, and / or may include moving visual indications, such as video images.

[0066] In some embodiments, the guidance information 220 may include a rendered visual representation of a virtual landscape or environment, and wherein movement of the probe 210 is visually rendered as movement through the virtual landscape or environment, and wherein the user is guided through a virtual trajectory in the landscape / environment, and wherein the virtual trajectory corresponds to a real trajectory of the probe toward a target view location.

[0067] Figure 2 The user interface 132 is shown in the form of a display unit having a 2D display screen. In some embodiments, the user interface 132 may include headphones or smart glasses for generating the guidance information 220 in the form of virtual reality visual information and / or augmented reality visual information.

[0068] Figure 2 (c) shows an output to the user interface 132 once the user has moved the probe 210 to within a threshold distance from the target view (i.e., within the proximal zone 310). At this point, the processing unit 120 switches the device 100 to the imaging mode. As illustrated, in the imaging mode, the processing unit controls the user interface to display the ultrasound image 230 received from the ultrasound imaging device 118. Thus, in the imaging mode, the image information is no longer suppressed, and the user can utilize the image information to refine the positioning of the probe.

[0069] Optionally, guidance information 220 may continue to be generated and displayed on the user interface display 132 in imaging mode to help the user refine the placement of the probe 210. Thus, in some embodiments, in addition to the received ultrasound image 230, there is an option to output guidance information 220 to the user interface 205 in imaging mode. This allows the user to continue to further refine the position of the probe to more closely match the target view, even when the distance metrics are all within their predefined thresholds (e.g., their proximal regions). This also allows more experienced ultrasound users to receive guidance while still having access to the acquired images. In some examples, whether guidance information is presented to the user during imaging mode may be determined by the specific target organ or target view to be acquired. An optimization algorithm may be implemented that may adjust the information presented to the user to fit the accurate guidance required for a given target view.

[0070] Thus, it can be seen that the processing unit 120 is adapted, in use, to selectively switch the user interface 132 between a guidance mode displaying guidance information 220 and an imaging mode displaying received ultrasound images 230. Once the probe 210 is moved within sufficient proximity of the target view, the processing unit switches to the imaging mode.

[0071] When acquiring images from a desired anatomical view within a limited window or proximal region, only actual image information 230 is shown to the user. In other words, the user interface 132 will only provide ultrasound images to the user when the ultrasound probe 210 is sufficiently close to a position and orientation that will acquire an image that matches the target view of the target anatomy. This simplification reduces the margin for human error by avoiding confusing image information from the user. The intent is to limit the options for novice ultrasound users by minimizing their exposure to complex, "fuzzy" image information during their navigation to the target view, and instead converting that information to a more intuitive guidance mode, where only guidance information 220 is output to the user interface 132. This ensures that there is less human error when navigating to a target ultrasound view, and over time, the system can learn from previous acquisitions to improve its conversion of complex image information to intuitive guidance information.

[0072] In practice, the receiving unit 110 can receive the image stream 230 from the ultrasound acquisition system 118 in real time, and can process each image together with the view analyzer module 122, and re-evaluate for each image which mode the device should be configured in: guidance mode or imaging mode based on the output of the view analyzer module. The image is then either suppressed from being displayed on the user interface in the case of guidance mode in preference to guidance information 220, or displayed on the user interface 132 (optionally in combination with guidance information) in the case of imaging mode. In some embodiments, the guidance module can generate guidance information for each image in both modes. In other embodiments, the guidance module can generate guidance information only in guidance mode, for example, in response to a guidance mode control signal from the view analyzer module or another module of the processing unit.

[0073] During the imaging mode, the processing unit 120 may be adapted to record selected image frames in a memory to compile an examination imaging data set for the patient. In some advantageous embodiments, the processing unit may be adapted to store the image frame in the data set only when the image frame matches a target view. In other words, capturing ultrasound images is constrained so that only image frames that match the target view can be captured. In some examples, image capture and storage may be automatically controlled by the processing unit, for example via a control signal sent along a communication link with the ultrasound acquisition system based on the current image view matching the target image view. In other examples, a user may trigger image capture and storage, but wherein this is constrained so that the user can only capture and store images when the target image view is matched.

[0074] This again improves the reproducibility of the acquired images by limiting the image acquisition to only those image frames that match the target view and thus reduces artifacts.

[0075] In some embodiments, the processing unit 120 may be adapted to calculate a quantitative metric or score indicating image similarity / dissimilarity between the newly captured image and the target image view. This provides an image quality metric. When the captured image is saved in the patient's examination imaging dataset, the captured image may be tagged or identified with the metric or score.

[0076] Regarding the generation of the guidance information 220, there are known solutions for achieving this.

[0077] For example, there are known AI tools for generating ultrasound probe navigation guidance information 220. At least some of these tools are adapted to classify and annotate images acquired from areas outside a threshold distance from a target image view, and convert the image information into user interface navigation information to support the user in reaching the target proximal region.

[0078] One such example is described in US2021 / 000446, which details the use of at least one convolutional neural network as part of a prediction network that is applied to an acquired ultrasound image to obtain a motion control configuration for repositioning an imaging device from a first imaging position to a second imaging position. The motion control configuration is used to generate instructions to be displayed to a user, which can prompt the user to operate a control component that communicates with the imaging device so that the imaging device is repositioned to a second imaging position that is closer to a desired position for capturing a target image view. The tool can be used in the current application to help generate navigation guidance information 220.

[0079] Although in the above example, the ultrasound acquisition system 118 is described as including a probe 210, and wherein the guidance information 220 is used to guide the movement of the probe, the present invention is applicable to any type of ultrasound transducer unit. For example, instead of a probe, the ultrasound transducer unit can take the form of a patch having one or more ultrasound transducers integrated therein. Ultrasound patches are useful for long-term ultrasound monitoring functions. The guidance information is used in this case to guide the placement of the patch. The patch typically has the ability to scan anatomy, has 3D or 2D functionality, and therefore, during the positioning of the patch, if the patch is too far from the target view, the guidance information can be used to improve the placement.

[0080] As described above, the processing unit 120 is adapted to determine a distance metric for each acquired ultrasound image based on the determined spatial relationship between the received ultrasound and the target view. The processing unit then uses the distance metric with reference to a threshold to determine whether the device should be switched to a guidance mode or an imaging mode. Options for deriving a distance metric and for selecting a mode based on a distance metric threshold will now be briefly discussed.

[0081] A preferred method according to one or more embodiments is to define the distance metric threshold in terms of a target field or a proximal region relative to a target view. The field or proximal region may be defined in terms of translational proximity and optionally also orientation / rotational proximity of the current imaging view of the ultrasound transducer unit and the target imaging view. At least it defines a threshold translational distance of the ultrasound transducer unit from a position associated with the target view.

[0082] Figure 3 and Figure 4 An example of a predefined threshold value for a distance metric in the form of a target proximal region is schematically illustrated.

[0083] Figure 3 An example of a target lateral proximal zone 310 on a lateral surface of a patient's body 320 is schematically illustrated. The boundary of the lateral proximal zone is defined by a threshold lateral distance between the current position of the ultrasound transducer unit and the target position required to acquire the target view. The target position is, for example, at the center of the proximal zone 310.

[0084] If the ultrasound acquisition system 330 is within this proximal zone 310, the processing unit 120 may set the user interface 132 to imaging mode, otherwise the user interface may be set to guidance mode. The target lateral proximal zone 310 represents a zone outside of which the device 100 remains in guidance mode.

[0085] Figure 4 An example of an optional target rotation proximal zone 410 on the rotation axis 420 is provided. Optionally, the system can remain in the guidance mode until the probe is within a certain range or field of the target orientation of the probe for acquiring the target view. If the ultrasound acquisition system 330 is within this proximal zone 410, the processing unit 120 can set the user interface 132 to the imaging mode, otherwise the user interface can be set to the guidance mode. The target rotation proximal zone 410 represents the following zone in the orientation space: outside this zone, the device 100 remains in the guidance mode.

[0086] The processing unit 120 may be configured to set the user interface 132 to the imaging mode only when the ultrasound acquisition system 330 is within at least a subset of all translational and rotational proximal zones, otherwise the user interface may be set to the guidance mode.

[0087] The proximal zone may be determined by a translational and / or rotational deviation between a current probe pose and a probe pose required to obtain a target view. A coordinate system may be defined that includes three rotational coordinates and three translational coordinates, and wherein the current probe position is defined or represented with reference to the coordinate system, and wherein the proximal zone is defined or represented with reference to the same coordinate system.

[0088] The predefined threshold for the distance metric may be personalized for a given user of the apparatus 100. The predefined threshold for the distance metric may be adjusted over time for a given user. For example, as the user's skill increases, the threshold may be varied so that the proximal zone defining the switch to the imaging mode is narrower, i.e., so that the user must navigate closer to the target view before triggering the imaging mode.

[0089] Regarding the target view to be acquired, there are different options as to how this can be configured or selected prior to the guidance and imaging operation.

[0090] In some embodiments, the processing unit 120 may be in communication with a memory storing a database of predefined image views of a plurality of different anatomical structures. In this embodiment, a target view may be selected (automatically or manually) as a view of a given target anatomical structure selected from the database. It may be manually selected by a user before starting the examination, or may be automatically selected, for example, according to a predefined imaging protocol or when the proximity of the ultrasound probe to a certain anatomical structure is recorded / detected.

[0091] Figure 5 An example device is illustrated in which the processing unit 120 is arranged to communicate with a memory 510 storing a database of predetermined image views. In the example shown, the memory takes the form of a cloud-based memory or a data storage device. The processing unit can be arranged to communicate with the cloud-based memory via the Internet or a network link. However, in other examples, the memory 510 can alternatively be a local memory. At least a subset of the predefined image views can correspond to clinical standardized image views for each of a plurality of different anatomical structures. This means image views that form part of a clinical standard imaging protocol for a given anatomical structure. For example, for imaging the heart, standardized image views include parasternal long axis, parasternal short axis, apical four-chamber, and subcostal four-chamber, etc.

[0092] When using standardized anatomy views, this may be referred to as "standard acquisition settings" mode, however, it may be referred to by any other suitable name. Views are defined relative to the position and / or rotation of the anatomy in the image. This allows the user to select a specific target view of the anatomy to be imaged, and wherein the view is guaranteed to be a standardized clinically relevant view.

[0093] Each predefined image view in the database may be labeled with a name so that it may be identified, and may be associated with a specific pose or position of the probe 210 relative to the relevant anatomy, which may include the translational and orientation positions of the probe.

[0094] In some embodiments, the processing unit 120 may be in communication with a memory 510 storing a database of previously acquired ultrasound images of the target anatomical structure, and wherein the target view is determined to be the view represented by the selected one of the images. Thus, in this case, the database does not store direct representations of image views, but rather stores images that each represent a specific view.

[0095] Within this set of embodiments, there are again a number of different options.

[0096] In some embodiments, previously acquired images stored in the database may include historical images of target anatomical structures of the same patient being examined. This allows the user to accurately reproduce the view of the ultrasound image of the target anatomical structure of the same patient. In particular, this will make it easier to detect changes in clinically relevant information. For example, the progression of a disease will be easier to analyze using two images sharing the same view. In some embodiments, in imaging mode, the processing unit 120 may allow the user to upload a newly acquired image to a patient-specific database of image views for later use as a target view in a subsequent examination.

[0097] In further embodiments, previously acquired images stored in the database may include historical images of target anatomical structures of a patient different from the patient being examined. This allows a user to accurately reproduce the view of an ultrasound image of a target anatomical structure of a different patient, thereby facilitating a clearer comparison between the two images, which may yield clinically relevant information. For example, it may be easier to compare healthy anatomical structures to unhealthy anatomical structures when the images have the same view. This approach is also helpful in situations where the patient has never been examined before and therefore patient-specific historical images do not exist.

[0098] In some embodiments, the database may store a previously acquired set of ultrasound images that were acquired by a particular other user and are marked with the name or another identifier of the user who acquired them. For example, the images may be images acquired by an expert or key opinion leader. The target view is set to a view represented by a selected one of the images acquired by these experts. In this case, the database may be stored on a cloud-based data storage device 510 that is accessible to multiple different users potentially at different institutions. The acquisitions stored in the database may include all acquisition information and may potentially include diagnostic result information. In this way, ultrasound users can continuously improve their acquisition skills by having access to this information and learning from the previous acquisitions of experts. Standardized views may be marked in the database as being acquired by a particular user. This approach greatly enhances image acquisition quality and reproducibility because even new users can acquire image frames that accurately match imaging views such as those acquired by expert users.

[0099] Standardized or expert or key opinion leader anatomy views may be delivered as a service. For example, an online portal may be established that allows access to a set of pre-acquired imaging views from certain experts, wherein access to downloading the imaging views is restricted to authorized users, for example, according to a subscription program for which payment must be made. Standard anatomy views may also be part of a standard protocol in a medical facility, such as a standard protocol that defines a specific sequence of imaging views to be captured. Incidental findings may be minimized by using expert-defined imaging views.

[0100] Using previously acquired images to represent the target view ensures optimal reproducibility for a range of uses.

[0101] For example, with a 2D probe, 3D information is acquired, which can then be used to further improve the guidance information or allow electronic steering of the probe. Once the 2D probe has acquired a 3D scan by acquiring information from multiple planes in the volume, electronic steering can then allow the 2D probe to acquire an image from a target plane without any physical movement. This information can be used to create a transfer function for an image that is as close as possible to a previously acquired image.

[0102] Such reproducibility will optimally support the extraction of quantitative data from the acquired images.

[0103] In some embodiments, the processing unit is configured to guide the user to acquire a sequence of target views. This imaging of a sequence of target anatomical structures, which may be referred to as a navigation track, may be based on previously acquired images acquired by an expert user and / or a key opinion leader. This may be enhanced with a dedicated graphical user interface. The dedicated graphical user interface will allow the ultrasound user to more easily receive guidance when performing a symptom check, where multiple anatomical structures are of interest, and thus the user may be guided to acquire a sequence of target views of the anatomical structures.

[0104] In some embodiments, each image stored in the memory 510 is associated with a set of acquisition settings of the ultrasound acquisition system 118. In the imaging mode, the processing unit 120 may be adapted to transmit the corresponding set of ultrasound acquisition settings associated with the selected image to the ultrasound acquisition system. This allows the acquired ultrasound image to more closely match the target view, thereby further improving the reproducibility of the ultrasound image.

[0105] In some embodiments, additional sensors, such as an inertial measurement unit in the probe, may be implemented for sensing the probe orientation. This allows even further improvement of the probe positioning and improves the reproducibility of the ultrasound images.

[0106] In another embodiment, the standardized view settings may be communicated to the ultrasound acquisition system 118 as the probe 210 approaches the target view, or the settings may be automatically set prior to acquisition.

[0107] In some embodiments, during the imaging mode, the processing unit 120 may be adapted to output electronic steering directions to the ultrasound acquisition system 118 to steer the formed ultrasound beam so that the acquired image matches the target view. Typically, this is used for 2D probes with the ability to acquire 3D imaging information. This can ensure increased reproducibility relative to the acquisition of a previous acquisition selected as the target view. With a 3D sensor, this feature can be included to ensure increased stability of the image in the absence of steering possibilities.

[0108] Another aspect of the present invention also provides a system for providing guidance to a user of an ultrasound acquisition system 118 to acquire a target view of an anatomical structure, the system comprising: an apparatus 100 according to any of the examples or embodiments outlined in the present disclosure; and a user interface 132 operably coupled to an input / output portion 130 of a processing unit 120.

[0109] This facilitates communication between the apparatus 100 and the user interface 132 , which may display guidance 220 and imaging 230 information to the user.

[0110] The system may also include an ultrasound acquisition system 118 operatively coupled to the receiving unit 110 in certain embodiments. This allows the apparatus 100 to communicate with the ultrasound acquisition system, thereby facilitating the transfer of information such as instructions for electronic steering and ultrasound acquisition settings to the ultrasound acquisition system.

[0111] Figure 6 The steps of a computer-implemented method for providing guidance to a user of an ultrasound acquisition system 118 to acquire a target view of a target anatomical structure of a patient are outlined.

[0112] In step 610 , an ultrasound image acquired by a user using the ultrasound acquisition system 118 is received.

[0113] In step 620 , a spatial relationship between the received ultrasound image and the target view is determined, and at least one distance metric for the acquired ultrasound image is calculated based on the spatial relationship.

[0114] In step 630 , guidance information 220 is generated based on the spatial relationship, indicating a change in a position and / or orientation of the ultrasound acquisition system for acquiring another ultrasound image.

[0115] In step 640, the user interface 132 is switched between: a guidance mode, in which guidance information is provided on the user interface in the absence of a received ultrasound image; and an imaging mode, in which a received ultrasound image 230 is provided on the user interface, wherein the processing unit 120 is suitable for setting the user interface to the guidance mode when at least one distance metric exceeds a predefined threshold, otherwise setting the user interface to the imaging mode.

[0116] Another aspect of the present invention provides a computer program product comprising code modules, which are configured to, when executed on a processor, cause the processor to perform the above-mentioned computer-implemented method.

[0117] The various embodiments of the present invention described above provide a number of advantages in the context of ultrasound imaging.

[0118] The above-described embodiments advantageously limit the imaging information provided to the user of the ultrasound acquisition system, which thereby avoids presenting poor quality and potentially confusing images to the user, thereby allowing the user to focus on following the more intuitive guidance information 220. In addition, directing the user to acquire an image that matches the target view increases the reproducibility of the ultrasound image. In this regard, embodiments of the present disclosure advantageously provide an intuitive, probe-centric interface for guiding ultrasound imaging procedures that involves less mental manipulation or translation for the operator to follow on-screen instructions to move the ultrasound acquisition system.

[0119] Embodiments provide benefits not only for inexperienced users but also for expert users with improved reproducibility. Embodiments improve navigation accuracy and speed. For example, using previously acquired ultrasound images can help an experienced user perform ultrasound examinations faster in subsequent examinations, relying on the guidance information 220 to ensure that they reach the same target view as the previously acquired image.

[0120] Embodiments disclosed herein may facilitate improved remote health solutions, maneuvering a probe at a distance, or helping inexperienced users maneuver a probe.

[0121] The present invention can also be used to quickly perform ultrasound whole body examinations by novices and irregular users inside and outside the hospital. With the development of the field, the formation factor of ultrasound systems is reduced, and the number of ultrasound users is expected to increase 10 times in the next 5-10 years. The above-mentioned embodiments of the present invention adopt a processing unit. The processing unit can generally include a single processor or multiple processors. It can be located in a single accommodating device, structure or unit, or it can be distributed between multiple different devices, structures or units. Therefore, a reference to a processing unit suitable for or configured to perform a specific step or task can correspond to a step or task performed by any one or more of a plurality of processing components individually or in combination. The technician will understand how such a distributed processing device can be implemented. The processing unit may include a communication module or input / output unit for receiving data and outputting data to another component.

[0122] The one or more processors of the processing unit can be implemented in many ways using software and / or hardware to perform the various functions required. The processors typically employ one or more microprocessors that can be programmed using software (e.g., microcode) to perform the required functions. The processor can be implemented as a combination of dedicated hardware that performs some functions and one or more programmable microprocessors and associated circuits that perform other functions.

[0123] Examples of circuits that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, application specific integrated circuits (ASICs), and field programmable gate arrays (FPGAs).

[0124] In various embodiments, the processor may be associated with one or more storage media, such as volatile and non-volatile computer memory, such as RAM, PROM, EPROM, and EEPROM. The storage media may be encoded with one or more programs that perform the desired functions when run on one or more processors and / or controllers. The various storage media may be fixed within the processor or controller or may be transportable so that one or more programs stored thereon may be loaded into the processor.

[0125] By studying the drawings, the specification and the appended claims, those skilled in the art can understand and implement variations of the disclosed embodiments when practicing the claimed invention. In the claims, the word "comprising" does not exclude other elements or steps, and the word "one" or "an" does not exclude a plurality.

[0126] The functions implemented by a processor may be implemented by a single processor or by multiple separate processing units, which may be collectively considered to constitute a “processor.” In some cases, such processing units may be remote from each other and communicate with each other in a wired or wireless manner.

[0127] The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

[0128] The computer program may be stored / distributed on suitable media, such as optical storage media or solid-state media provided together with or as part of other hardware, but the computer program may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.

[0129] If the term "suitable for" is used in the claims or the description, it should be noted that the term "suitable for" is intended to be equivalent to the term "configured to". If the term "device" is used in the claims or the description, it should be noted that the term "device" is intended to be equivalent to the term "system", and vice versa.

[0130] Any reference signs in the claims should not be construed as limiting the scope.

Claims

1. An apparatus for providing guidance to a user of an ultrasound acquisition system to acquire a target view of a target anatomical structure of a patient, the apparatus comprising: A receiving unit (110), adapted to receive an ultrasound image acquired by the user using an ultrasound acquisition system; A processing unit (120), comprising: a view analyzer module (122) adapted to determine a spatial relationship between a received ultrasound image and a target view and to calculate at least one distance metric for the acquired ultrasound image based on the spatial relationship, and a guidance module (124) adapted to generate guidance information based on the spatial relationship, the guidance information indicating a change in a position and / or orientation of the ultrasound acquisition system for acquiring another ultrasound image; and an input / output portion (130) adapted to operatively couple the processing unit to a user interface, The processing unit is adapted to selectively switch the user interface between the following two in use: a guidance mode, in which guidance information (220) generated by the guidance module is provided on the user interface, and the received ultrasound image is not provided on the user interface; and an imaging mode in which the received ultrasound image is provided on the user interface (230); and The processing unit is adapted to set the user interface to the guiding mode when the at least one distance metric exceeds a predefined threshold, and to set the user interface to the imaging mode otherwise.

2. The device according to claim 1, wherein: The guide information is output to the user interface in the imaging mode in addition to the received ultrasound image.

3. The device according to claim 1 or 2, wherein: The processing unit is capable of communicating with a memory (510) storing a database of standardized image views of a plurality of different anatomical structures, and wherein the target view is a view of the target anatomical structure selected from the database.

4. The device according to claim 1 or 2, wherein: The processing unit can be in communication with a memory storing a database of previously acquired ultrasound images of the target anatomical structure, and wherein the target view is determined to be the view represented by the selected one of the images.

5. The device according to claim 4, wherein: The previously acquired images are historical images of the target anatomical structure of the same patient.

6. The device according to claim 4, wherein: The previously acquired images are historical images of the target anatomical structure of different patients.

7. The device according to claim 4, wherein: Each of the images stored in the database is associated with a set of acquisition settings for the ultrasound acquisition system; and In the imaging mode, the processing unit is adapted to transmit a corresponding set of ultrasound acquisition settings associated with the selected image to the ultrasound acquisition system.

8. The device according to any one of claims 1 to 7, wherein: In the imaging mode, the processing unit is further adapted to output an electronic steering direction to the ultrasound acquisition system to steer the formed ultrasound beam so that the acquired image matches the target view.

9. The device according to any one of claims 1 to 8, wherein: The guidance information includes guidance for three rotational degrees of freedom and three translational degrees of freedom.

10. The device according to any one of claims 1 to 9, wherein: During the imaging mode, the processing unit is adapted to record selected image frames in a memory to compile an examination imaging dataset for the patient, and wherein the processing unit is adapted to store image frames in the dataset only if the image frames match the target view.

11. The device according to any one of claims 1 to 10, wherein: The processing unit is configured to guide the user to acquire a sequence of target views.

12. A system for providing guidance to a user of an ultrasound acquisition system to acquire a target view of an anatomical structure, the system comprising: The device according to any one of claims 1 to 11; as well as A user interface is operatively coupled to the input / output of the processing unit.

13. The system of claim 12, further comprising an ultrasound acquisition system operably coupled to the receiving unit.

14. A computer-implemented method for providing guidance to a user of an ultrasound acquisition system to acquire a target view of a target anatomical structure of a patient, the method comprising: receiving an ultrasound image acquired by the user using an ultrasound acquisition system; determining a spatial relationship between the received ultrasound image and the target view, and calculating at least one distance metric for the acquired ultrasound image based on the spatial relationship; generating guidance information based on the spatial relationship, the guidance information indicating a change in a position and / or orientation of the ultrasound acquisition system for acquiring another ultrasound image; as well as Toggles the user interface between: a guidance mode, in which guidance information is provided on the user interface and the received ultrasound image is not provided on the user interface; as well as an imaging mode in which the received ultrasound image is provided on the user interface; The method further includes: setting the user interface to the guiding mode when the at least one distance metric exceeds a predefined threshold, and otherwise setting the user interface to the imaging mode.

15. A computer program product comprising code means which, when executed on a processor, are configured to cause the processor to perform the computer-implemented method according to claim 14.

Images