Method and apparatus for assisting an ultrasound operator

The AI-assisted ultrasound system addresses the challenge of achieving optimal scan views by providing proximity-based guidance prompts, enhancing operator accuracy and efficiency in peripheral nerve block procedures.

GB2629915APending Publication Date: 2024-11-13INTELLIGENT ULTRASOUND LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
GB2024005832
Authority / Receiving Office
GB · GB
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-04-27
Filing Date
2024-04-25
Publication Date
2024-11-13

AI Technical Summary

Technical Problem

Ultrasound scan operators, especially those less confident in regional anesthesia, face challenges in accurately interpreting ultrasound images and achieving the optimal view for peripheral nerve blocks due to poor initial probe positioning, leading to inefficient scanning and reduced effectiveness of real-time highlighting tools.

Method used

An apparatus and method utilizing artificial intelligence to assess the proximity of the current scan to a desired scan, providing tailored guidance prompts, including video sequences, real-time highlighting, and schematic images, to help operators adjust the probe and achieve the correct anatomical configuration.

Benefits of technology

Enhances the accuracy and efficiency of ultrasound image interpretation by guiding operators to the optimal view through targeted prompts, improving initial probe placement and reducing the time spent on fine-tuning, thus standardizing the scanning process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

An apparatus for assisting an ultrasound operator comprising a processor 1100 and an artificial intelligence unit 1300, the processor arranged to receive one or more ultrasound images of a current scan site from an ultrasound probe and process the images using the AI unit to make an assessment of proximity of the current scan to a desired scan. Based on the assessment the apparatus is arranged to present the operator with at least one of a number of different types of guidance prompt 1400. A first type of guidance prompt may comprise a short video sequence, animation, or static image. A second prompt may comprise highlighting one or more portions of the image. A third prompt may comprise providing a signal that the current scan is sufficiently close to the correct site for performing an intended procedure.
Need to check novelty before this filing date? Find Prior Art

Description

The present invention relates to a method and an apparatus for assisting an operator during an ultrasound scan. ScanNav™ Anatomy Peripheral Nerve Block (PNB) is a system designed to enhance the accuracy and standardization of ultrasound image interpretation by providing a colour overlay of key sono-anatomical structures during a live ultrasound scan. The device is configured to provide realtime highlighting for ten commonly performed peripheral nerve blocks. Figure la shows schematically an example of such a presentation, on a monitor M, in which features 100 (muscle) , 200 (nerve) and 300 (artery) are highlighted in real time in the scan. It is intended to support users who are licensed to perform regional anaesthesia but who are not confident. The device also incorporates reference material and training videos to help demonstrate the desired probe positioning for each supported procedure. Anatomy PNB provides only indirect instructions to the operator about how to move the probe to obtain the optimum view. The operator is intended to obtain the ideal view by adjusting the probe to make the real-time highlighting of the key anatomical features match a schematic diagram. Figure lb is a schematic view of a patient's anatomy, as presented to the operator during a procedure, in which the same features shown in Figure la are instead represented schematically. Observation of trainees and experts during trial scans in which they were asked to locate the optimum view for a given procedure, has identified a key difference between their scanning techniques. The experts immediately placed the probe in the correct location (without reference to the ultrasound) and were thus able to see all the relevant anatomical features in their correct configuration. Following this, they made only very small movements towards optimizing their view. The trainees usually placed the probe in a poor initial position, where the anatomical features they were looking for were either not in the right configuration or were not visible at all. From this point, they had to spend a long time moving the probe, trying to find some features they could recognise to help them improve their view. In addition, because they are starting from a poor initial position, the real-time highlighting provided by the tool is not as useful as when they are close to the optimum view, as there are fewer clues about how to move the probe. There are previously considered systems that describe the use of AI to guide the operator to a desired view. These typically describe a system that gives the operator instructions about how to move the probe to obtain the desired view (e.g., "move left", "tilt up", "rotate right") . Such methods are complicated and difficult to implement, particularly in the general case. Embodiments of the present invention aim to provide apparatus and a method for assisting an ultrasound operator, which aim to address the aforementioned problems. The present invention is defined in the attached independent claims, to which reference should now be made. Further, preferred features may be found in the sub-claims appended thereto . According to one aspect of the present invention, there is provided an apparatus for assisting an ultrasound operator, the apparatus comprising a processor and an artificial intelligence unit, wherein the processor is arranged in use to receive one or more ultrasound images of a current scan site from an ultrasound probe, and to process the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the apparatus is arranged to present to the operator at least one of a number of different types of guidance prompt. Proximity should be understood to include (though not be limited to) any of the following meanings: Distance in physical space, similarity of the anatomical features present within the image, similarity of the visual properties of the images. Preferably, if the processor determines that the current scan site is below a first predetermined threshold proximity value of the desired scan site the apparatus presents to the operator a first type of guidance prompt. Preferably, if the processor determines that the current scan site is greater than the first predetermined threshold proximity value of the desired scan site, but less than a second predetermined threshold proximity value of it, the apparatus presents to the operator a second type of guidance prompt. Preferably, if the processor determines that the current scan site is greater than the second predetermined threshold proximity value of the desired scan site the apparatus presents to the operator a third type of guidance prompt. The first type of prompt may comprise one or more of a short video sequence, an animation or a static image. This may be provided to the operator to provide hints on how the operator should place the probe during the scan. The second type of prompt may comprise highlighting of one or more portions of the or each image, more preferably realtime highlighting, and / or at least one schematic image. This allows the operator to make small movements to fine-tune their image. It may also comprise displaying information that provides a quantitative measure of the proximity of the current scan site to the intended scan site. Finally, it may also include displaying information to the user to draw their attention to properties of the image that are currently lacking. For example, performing a nerve block may require that pressure is applied to the probe to collapse veins and the system may in this case, upon detecting that the veins are not collapsed, display a prompt to this effect to the user, in order that they can remedy it. The third type of prompt may comprise providing a signal that the current scanning position is sufficiently close to the correct site for performing the intended procedure. The prompts may be made using a display, which may be in addition to, or part of, a display used for displaying the or each scanned image. The prompts may include one or more of a visual prompt, an audible prompt or a haptic prompt. According to another aspect of the present invention, there is provided a method of assisting an ultrasound operator, the method comprising receiving one or more ultrasound images of a current scan site from an ultrasound probe, processing the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the method comprises presenting to the operator at least one of a number of different types of guidance prompt. Preferably, if the processing determines that the current scan site is below a first predetermined threshold proximity value of the desired scan site the method comprises presenting to the operator a first type of guidance prompt. Preferably, if the processing determines that the current scan site is greater than the first predetermined threshold proximity value of the desired scan site, but less than a second predetermined threshold proximity value of it, the method comprises presenting to the operator a second type of guidance prompt. Preferably, if the processing determines that the current scan site is greater than the second predetermined threshold proximity value of the desired scan site the method comprises presenting to the operator a third type of guidance prompt. In a further aspect, the invention provides a computer programme product on a computer readable medium, comprising instructions that, when executed by a computer, cause the computer to perform a method of assisting an ultrasound operator, the method comprising receiving one or more ultrasound images of a current scan site from an ultrasound probe, processing the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the method comprises presenting to the operator at least one of a number of different types of guidance prompt. The invention also comprises a program for causing a device to perform a method of assisting an ultrasound operator, the method comprising receiving one or more ultrasound images of a current scan site from an ultrasound probe, processing the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the method comprises presenting to the operator at least one of a number of different types of guidance prompt. The invention may include any combination of the features or limitations referred to herein, except such a combination of features as are mutually exclusive, or mutually inconsistent. A preferred embodiment of the present invention will now be described, by way of example only, with reference to the accompanying diagrammatic drawings, in which: Figure la shows schematically an image of an ultrasound scan including highlighted portions, being an example of a type of guidance prompt; Figure lb shows a schematic representation of part of a patient's anatomy, being another example of a type of guidance prompt; Figure 2 shows schematically a further type of guidance prompt; Figure 3 shows schematically an apparatus for assisting an operator according to an embodiment of the present invention; Figure 4 shows schematically a method for assisting an operator according to an embodiment of the present invention; Figure 5 shows schematically an optional further guidance prompt; and Figure 6 shows schematically another optional guidance prompt. In some implementations the present invention is concerned with helping an ultrasound operator locate a good initial view. The system uses an artificial intelligence (AI) unit to monitor the real-time ultrasound feed and assesses each image to determine the proximity of the current scan view to a desired target scan view, where "proximity" is as previously defined. If the current view is not in close proximity, a short video sequence (or possibly an animation or a static image) will be displayed to provide hints on how the operator should place the probe on the patient. If the current view is in close proximity to the desired view, the real-time highlighting will be shown along with the schematic, so that the operator can make small movements to fine-tune their image. The computation of proximity of the current view to the desired view is performed using deep learning. A labelled image dataset is curated which contains "good" and "bad" examples of the target view, and standard deep learning techniques are used to turn this into a classifier. Given an image, the resulting trained model generates a probability that the input image is "good". This probability is used to create a score for the current image. In a simple implementation, if the score is above a first given threshold but below a second threshold, the system will display the real-time highlighting and / or schematic anatomy, e.g. of the kind shown in Figures la and lb. If it is below the first threshold, the system will display the probe location hints instead, e.g. of the kind shown on the monitor M in Figure 2. Standard techniques for hysteresis control are applied to the scores to prevent the system from switching between the different display modes too rapidly. An embodiment of the apparatus according to the present invention is depicted schematically at 1000 in Figure 3. The apparatus comprises a processor 1100 arranged to receive ultrasound image data from an input 1200. The processor 1100 analyses the data using an artificial intelligence unit 1300 which applies to the data a trained deep learning model to identify the probability that the image data represents a current scan site that is the desired scan site. An output 1400 is at least one of a number of types, depending on the calculated probability that the current site is the desired site. For example, a highlighted scan / schematic anatomy (as in Figure la and / or Figure lb) is provided as a guidance prompt in the event that the current scan site is determined to be greater than a first predetermined proximity threshold, but less than a second threshold. Alternatively, the output 1400 may be one or more short video sequences, an animation, or a static image (as shown on monitor M in Figure 2), in the event that the current scan site is determined to be less than a first predetermined threshold of proximity to the desired scan site. This is provided to the operator to give hints on how the operator should place the probe during the scan. Figure 4 shows schematically a method of assisting an ultrasound operator according to the above-described embodiment of the present invention. At Step S100, data of the current scan image is input to the processor. At Step S200 the processor computes a proximity probability score for the current scan image. At Step S300, a determination is made as to whether the score is (a) below a first predetermined score indicating a proximity value below a first predetermined threshold, (b) above the first threshold score but below a second threshold score, indicating a proximity that is greater than the first predetermined threshold but less than a second predetermined threshold, or (c) above a second predetermined score, indicating a proximity greater than the second predetermined threshold. If the score is below the first threshold score, at Step S400 a first type of guidance is provided such as is shown in Figure 2, i.e. a hint to the operator. If the score is above a first threshold score but below a second threshold score, at Step S500, a second type of guidance prompt is provided, e.g. highlighting and / or schematic anatomy, for example as shown in Figure la / lb. If the determination is that the score is above the second predetermined threshold score, at Step S600, a third type of guidance is provided, for example being a signal or message that the current scanning location is considered to be at or near optimal, and therefore sufficiently proximal to the correct site for performing the intended procedure. The image scores determined during analysis of the current scan images may need be smoothed by averaging over several frames, and the system may need to have some degree of hysteresis control to stop the display from flicking rapidly between the hint video and the real-time highlighting if the score is close to the threshold. The system may optionally display the scores to the user, thus providing more direct feedback. This could be presented as a dial or bar chart. A further optional guidance prompt is shown in Figure 5. When the score is above the aforementioned first threshold its value may additionally be displayed to the user in some form in order to provide feedback to them on whether or not they are approaching the intended scan site. In this case, the score is indicated in the monitor M in a view score indicator 501. A still further optional guidance prompt is shown in Figure 6. The system may also be configured to assess whether certain required properties of the image are present. For example, performing a nerve block may require that pressure is applied to the probe to collapse veins and the system may in this case, upon detecting that the veins are not collapsed, display a prompt to this effect to the user, in order that they can remedy it. Assessment of these properties may also be achieved through training a machine learning classifier on a training dataset of ultrasound images annotated for presence or absence of such properties. In this example, monitor M displays a prompt 601 to the user. Whilst endeavouring in the foregoing specification to draw attention to those features of the invention believed to be of particular importance, it should be understood that the 5 applicant claims protection in respect of any patentable feature or combination of features referred to herein, and / or shown in the drawings, whether or not particular emphasis has been placed thereon.

Claims

1. An apparatus for assisting an ultrasound operator, the apparatus comprising a processor and an artificial intelligence unit, wherein the processor is arranged in use to receive one or more ultrasound images of a current scan site from an ultrasound probe, and to process the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the apparatus is arranged to present to the operator at least one of a number of different types of guidance prompt.

2. An apparatus according to Claim 1, wherein a first type of guidance prompt comprises one or more of a short video sequence, an animation or a static image.

3. An apparatus according to Claim 1 or 2, wherein a second type of guidance prompt comprises highlighting of one or more portions of the or each image.

4. An apparatus according to any of Claims 1-3, wherein a third type of guidance prompt comprises providing a signal that the current scanning position is sufficiently close to the correct site for performing an intended procedure.

5. An apparatus according to Claim 2, wherein if the processor determines that the current scan is less than a first predetermined threshold proximity of the6. An apparatus according to Claim 3, wherein if the processor determines that the current scan is greater than a first predetermined threshold proximity of the desired scan, but less than a second predetermined threshold proximity of it, the apparatus presents to the operator the second type of guidance prompt.

7. An apparatus according to Claim 4, wherein if the processor determines that the current scan is greater than a second predetermined threshold proximity of the desired scan the apparatus presents to the operator the third type of guidance prompt.

8. Apparatus according to any of the preceding claims, wherein the processor is arranged in use to calculate a probability score for each input image, which score relates to a probability that the image represents a current scan that is within / above a threshold proximity of a desired scan.

9. A method of assisting an ultrasound operator, the method comprising receiving one or more ultrasound images of a current scan site from an ultrasound probe, processing the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the method10. A computer programme product on a computer readable medium, comprising instructions that, when executed by a computer, cause the computer to perform a method of assisting an ultrasound operator, the method comprising receiving one or more ultrasound images of a current scan site from an ultrasound probe, processing the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the method comprises presenting to the operator at least one of a number of different types of guidance prompt.

11. A program for causing a device to perform a method of assisting an ultrasound operator, the method comprising receiving one or more ultrasound images of a current scan site from an ultrasound probe, processing the or each image using the artificial intelligence unit to make an assessment of the proximity of the current scan to a desired scan, wherein, based upon the assessment, the method comprises presenting to the operator at least one of a number of different types of guidance prompt.

Citation Information

Patent Citations

  • Algorithm correction method based on ultrasonic video, ultrasonic video generation method and equipment

    CN115797330A

  • Methods and system for detecting medical imaging scan planes using probe position feedback

    US20200113542A1

  • Method for developing a machine learning model of a neural network for classifying medical images

    US20200286405A1

  • Systems and methods for an adaptive interface for an ultrasound imaging system

    US20220087644A1

  • Augmented reality interface for assisting a user to operate an ultrasound device

    US10702242B2