Dynamic automated image saving and deleting

Abstract

An imaging system includes an imaging apparatus configured to perform imaging to capture images; a memory that stores instructions; and a processor that executes the instructions. When executed by the processor, the instructions cause the imaging system to: identify context for an imaging session in which images are captured by the imaging apparatus; analyze each of a plurality of images captured in the imaging session by the imaging apparatus to determine, for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; save each individual image determined to be saved; and delete each individual image determined not to be saved.

Description

DYNAMIC AUTOMATED IMAGE SAVING AND DELETINGBACKGROUND

[0001] When a patient arrives in an emergency room with blunt trauma, the emergency room team and the trauma surgery team may have limited time of less than five minutes or even less than two minutes to diagnose if the patient has internal bleeding. The patient may be assessed using ultrasound using the FAST (focused assessment with sonography in trauma) exam and eventually computed tomography (CT) scans. Diagnosis of internal bleeding may lead to emergency life-saving treatment, or careful observation. Currently, if a patient is stable, the standard of care is to use computed tomography for diagnosing internal bleeding, but if the patient is unstable, the focused assessment with sonography in trauma exam may be used for this diagnosis. In the urgency of trauma situations, medical personnel may forget to save ultrasound scans or ultrasound loops once information required for diagnosis is derived.SUMMARY

[0002] According to an aspect of the present disclosure, an imaging system includes an imaging apparatus configured to perform imaging to capture images; a memory that stores instructions; and a processor that executes the instructions. When executed by the processor, the instructions cause the imaging system to: identify context for an imaging session in which images are captured by the imaging apparatus; analyze each of a plurality of images captured in the imaging session by the imaging apparatus to determine, for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; save each individual image determined to be saved; and delete each individual image determined not to be saved.

[0003] According to another aspect of the present disclosure, an imaging method is performed by an imaging system comprising an imaging apparatus configured to perform imaging to capture images, a memory that stores instructions, and a processor that executes the instructions. The imaging method includes identifying context for an imaging session in which images are captured by the imaging apparatus; analyzing each of a plurality of images captured in the imaging session by the imaging apparatus to determine, for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session;saving each individual image determined to be saved; and deleting each individual image determined not to be saved.

[0004] According to another aspect of the present disclosure, a tangible, non-transitory computer-readable medium stores instructions. When executed by a processor, the instructions cause the processor to: identify context for an imaging session in which images are captured by the imaging apparatus; analyze each of a plurality of images captured in the imaging session by the imaging apparatus to determine, for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; save each individual image determined to be saved; and delete each individual image determined not to be saved.BRIEF DESCRIPTION OF THE DRAWINGS

[0005] The example embodiments are best understood from the following detailed description when read with the accompanying drawing figures. It is emphasized that the various features are not necessarily drawn to scale. In fact, the dimensions may be arbitrarily increased or decreased for clarity of discussion. Wherever applicable and practical, like reference numerals refer to like elements.

[0006] FIG. 1 illustrates a system for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0007] FIG. 2 illustrates another system for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0008] FIG. 3 illustrates another system for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0009] FIG. 4 illustrates an image view with a first anatomical landmark identified in dynamic automated image saving and deleting, , in accordance with a representative embodiment.

[0010] FIG. 5 illustrates an image view with autosave initiated in dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0011] FIG. 6 illustrates an image view in a flexible loop length in dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0012] FIG. 7 illustrates a method for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0013] FIG. 8 illustrates a computer system, on which a method for dynamic automated imagesaving and deleting is implemented, in accordance with another representative embodiment.DETAILED DESCRIPTION

[0014] In the following detailed description, for the purposes of explanation and not limitation, representative embodiments disclosing specific details are set forth in order to provide a thorough understanding of embodiments according to the present teachings. However, other embodiments consistent with the present disclosure that depart from specific details disclosed herein remain within the scope of the appended claims. Descriptions of known systems, devices, materials, methods of operation and methods of manufacture may be omitted so as to avoid obscuring the description of the representative embodiments. Nonetheless, systems, devices, materials and methods that are within the purview of one of ordinary skill in the art are within the scope of the present teachings and may be used in accordance with the representative embodiments. It is to be understood that the terminology used herein is for purposes of describing particular embodiments only and is not intended to be limiting. Definitions and explanations for terms herein are in addition to the technical and scientific meanings of the terms as commonly understood and accepted in the technical field of the present teachings.

[0015] It will be understood that, although the terms first, second, third etc. may be used herein to describe various elements or components, these elements or components should not be limited by these terms. These terms are only used to distinguish one element or component from another element or component. Thus, a first element or component discussed below could be termed a second element or component without departing from the teachings of the inventive concept.

[0016] As used in the specification and appended claims, the singular forms of terms ‘a,’ ‘an’ and ‘the’ are intended to include both singular and plural forms, unless the context clearly dictates otherwise. Additionally, the terms "comprises", and / or "comprising," and / or similar terms when used in this specification, specify the presence of stated features, elements, and / or components, but do not preclude the presence or addition of one or more other features, elements, components, and / or groups thereof. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0017] Unless otherwise noted, when an element or component is said to be “connected to,” “coupled to,” or “adjacent to” another element or component, it will be understood that the element or component can be directly connected or coupled to the other element or component,or intervening elements or components may be present. That is, these and similar terms encompass cases where one or more intermediate elements or components may be employed to connect two elements or components. However, when an element or component is said to be “directly connected” to another element or component, this encompasses only cases where the two elements or components are connected to each other without any intermediate or intervening elements or components.

[0018] The present disclosure, through one or more of its various aspects, embodiments and / or specific features or sub-components, is thus intended to bring out one or more of the advantages as specifically noted below.

[0019] As described herein, images may be automatically and adaptively saved or deleted based on the context in which the images are captured. The teachings herein are applicable to a variety of contexts, both non-medical and medical. Medical contexts include point of care ultrasound such as focused assessment with sonography in trauma exams in emergency rooms for trauma patients, and other types of medical imaging such as radiological imaging. Post-processing may be performed in real-time to adaptively automate and trigger saving acquisitions based on criteria that vary per context and per application, providing the user with desired data with no additional workflow tasks.

[0020] As an introductory example, focused assessment with sonography in trauma is a form of noninvasive ultrasound that can be performed to evaluate abdominal and chest trauma. A focused assessment with sonography in trauma exam may be performed in emergency rooms, in intensive care units (ICUs) or sometimes even prior to the hospital. The focused assessment with sonography in trauma is one of a variety of point of care ultrasound (POCUS) types in which excessive images may be generated. Point of care ultrasound devices were originally not connected to picture archiving and communications systems (PACS) in medical facilities, and patient registration was time consuming, so medical personnel historically have not been motivated to selectively save at least some of the ultrasound images. Additionally, medical personnel performing point of care ultrasound are typically the audience for the result of the point of care ultrasound, and may not be in the habit of saving any ultrasound images in this context. Instead, medical personnel tend to focus on the patient, scan in a fluid manner, and reduce any tasks that add to their cognitive load. Scanning with ultrasound in the point of care setting thus has unique behavioral characteristics insofar as medical personnel are typicallyfocused on using ultrasound to quickly answer a clinical question and support efficient diagnoses at the moment of use. This is sufficient for care at a moment in time, particularly if the result is positive, but does not tend to lead to selectively saving ultrasound images. As another example, if a physician wants to discuss a case with a colleague in a challenging or inconclusive case, the physician may regret the lack of saved data that is temporally relevant.

[0021] For any of the circumstances described above, a medical professional may want to review ultrasound images later. For example, as ultrasound becomes more embedded in daily use in the critical care setting, physicians see the benefit of using trends from repeated ultrasound exams to inform patient care. Saving ultrasound scan data for reporting and deriving trends over time is a growing need, but saving relevant images is hard to enforce in this setting due to competing priorities faced by physicians.

[0022] FIG. 1 illustrates a system 100 for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0023] The system 100 in FIG. 1 is a system for dynamic automated image saving and deleting and includes components that may be provided together or that may be distributed. The system 100 includes an imaging apparatus 110, a controller 150 and a user interface 181. The controller 150 may be provided as a component of the imaging apparatus 110, or may be separate from the imaging apparatus 110 as shown. The user interface 181 may also be provided as a component of the imaging apparatus 110, or may be separate from the imaging apparatus 110 as shown. The controller 150 includes at least a memory 151 that stores instructions and a processor 152 that executes the instructions. A computer that can be used to implement the controller 150 separate from the imaging apparatus 110 is depicted in FIG. 8, though a controller 150 may include more or elements than depicted in FIG. 1 or fewer elements than depicted in FIG. 8. Alternatively, a controller 150 may include some or all of the elements of the computer shown in FIG. 8.

[0024] The user interface 181 may be provided on a display of the imaging apparatus 110 or the controller 150, or may be local to the imaging apparatus 110 and the controller 150, or may be remotely connected to the imaging apparatus 110 and the controller 150. A display with the user interface 181 may be connected to the imaging apparatus 110 and the controller 150 via a local wired interface such as an Ethernet cable or via a local wireless interface such as a Wi-Fi connection. Such a display with the user interface 181 may be interfaced with other user input devices by which users can input instructions, including mouses, keyboards, thumbwheels and soon. The user interface 181 in FIG. 1 may be configured to visually indicate, for example, that individual images can be saved and / or that one or more images such as asset of images are being saved.

[0025] The controller 150 may perform some of the operations described herein directly and may implement other operations described herein indirectly. For example, the controller 150 may indirectly control operations such as by generating and transmitting content to be displayed on a display with the user interface 181. The controller 150 may directly control other operations such as logical operations performed by the processor 152 executing instructions from the memory 151 based on input received from electronic elements and / or users via the interfaces. Accordingly, the processes implemented by the controller 150 when the processor 152 executes instructions from the memory 151 may include steps not directly performed by the controller 150.

[0026] Using the system 100, a user may initiate imaging such as ultrasound imaging using an ultrasound probe as the imaging apparatus 110. In FIG. 1, the controller 150 may be configured to process a set of images. The controller 150 may perform a process including identifying context for an imaging session in which the set of images are captured by the imaging apparatus 110; analyzing each of the set of images captured in the imaging session by the imaging apparatus 110 to determine, for each individual image of the set of images, whether to save the individual image based on the context for the imaging session; saving each individual image determined to be saved; and deleting each individual image determined not to be saved.

[0027] Determinations of whether to save or delete each individual image by the system 100 or the other systems described herein may be made automatically and independent of any instruction from an operator of the imaging apparatus 110. The deletions of images may save memory, power, and processing, as well as any time impositions on reviewers who could otherwise be tasked with reviewing the images which are instead deleted. In circumstances where the number of images is large and reviewer time is valuable, the automated saving and deleting may greatly enhance the value of the imaging using the context-based saving or deleting provided by the system of FIG. 1.

[0028] FIG. 2 illustrates another system for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0029] The system 200 in FIG. 2 is a system for dynamic automated image saving and deletingand includes components that may be provided together or that may be distributed. The system 200 in FIG. 2 includes an ultrasound probe 210, an ultrasound base 220, and a display 280.

[0030] The ultrasound probe 210 includes a transducer array 213 and a processing circuit 215. The transducer array 213 includes at least a first transducer element 2131, a second transducer element 2132, and an Xth transducer element 213X. The transducer array 213 converts electrical energy into sound waves which reflect off of body tissue and receives echoes of the sound waves and converts the echoes into electrical energy. The transducer array 213 may include dozens, hundreds, or thousands of individual transducer elements. The ultrasound probe 210 may transmit a beam to produce images and may detect echoes. The processing circuit 215 may comprise a memory / processor combination, and / or an application-specific integrated circuit (ASIC) comprising hardware elements. The processing circuit 215 may process ultrasound images captured by the transducer array 213 of the ultrasound probe 210.

[0031] The ultrasound base 220 includes a first interface 221, a second interface 222, a third interface 223, and a controller 250. A computer that can be used to implement the ultrasound base 220 is depicted in FIG. 8, though an ultrasound base 220 may include more elements than depicted in FIG. 2 and more or fewer elements than depicted in FIG. 8. One or more of the interfaces may include ports, disk drives, wireless antennas, or other types of receiver circuitry that connect the controller 250 to other electronic elements. The first interface 221 connects the ultrasound base 220 to the ultrasound probe 210, and may comprise a port, an antenna, and / or another type of physical component for wired or wireless communications. The second interface 222 connects the ultrasound base 220 to the display 280, and may also comprise a port, an antenna, and / or another type of physical component for wired or wireless communications. The third interface 223 is a user interface, and may comprise buttons, keys, a mouse, a microphone, a speaker, switches, a touchscreen, or other type of display separate from the display 280, and / or other types of physical components that allow medical personnel to interact with the ultrasound base 220 such as to enter instructions and receive output.

[0032] Display 280 may be local to the ultrasound base 220 or may be remotely connected to the ultrasound base 220, such as wirelessly. Display 280 may be a monitor such as a computer monitor, a display on a mobile device, an augmented reality display, a television, an electronic whiteboard, or another screen configured to display electronic imagery. Display 280 includes a graphical user interface 281 (GUI) that displays ultrasound images and guidance to users.Display 280 may be interfaced with other user input devices by which medical personnel can input instructions, including mouses, keyboards, thumbwheels and so on. Display 280 may also include one or more input interface(s) such as those noted above that may connect to other elements or components, as well as an interactive touch screen configured to display prompts to medical personnel and collect touch input from medical personnel. The graphical user interface 281 in FIG. 2 may be configured to visually indicate that individual images are being saved.

[0033] Controller 250 includes at least a memory 251 that stores instructions and a processor 252 that executes the instructions. The memory 251 may be representative of multiple memories such as random-access memory (RAM), registers, flash memory, and other types of memory. Memory 251 may store one or more software program(s). Controller 250 may perform some of the operations described herein directly and may implement other operations described herein indirectly. For example, controller 250 may indirectly control operations such as by generating and transmitting content to be displayed on the display 280. The controller 250 may directly control other operations such as logical operations performed by the processor 252 executing instructions from the memory 251 based on input received from electronic elements and / or medical personnel via the third interface 223. Accordingly, the processes implemented by the controller 250 when the processor 252 executes instructions from the memory 251 may include steps not directly performed by the controller 250.

[0034] In FIG. 2, the system 200 comprises an ultrasound system and one or both of the ultrasound probe 210 and the ultrasound base 220 is or are an imaging apparatus comprising an ultrasound apparatus. Using the system 200, a user may initiate ultrasound imaging using the ultrasound probe 210. The ultrasound probe 210 may comprise a one-dimensional array probe or a two-dimensional matrix array probe. The ultrasound probe 210 is used to generate ultrasound images. In FIG. 2, the controller 250 may be configured to process a set of ultrasound images. The controller 250 may perform a process including identifying context for an imaging session in which images are captured by the ultrasound probe 210 as an imaging apparatus; analyzing each of a plurality of images captured in the imaging session by the ultrasound probe 210 as an imaging apparatus to determine, for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; saving each individual image determined to be saved; and deleting each individual image determined not to be saved. The deletions of images may save memory, power, and processing, as well as any timeimpositions on reviewers who could otherwise be tasked with reviewing the images which are instead deleted.

[0035] FIG. 3 illustrates another system for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0036] The system 300 in FIG. 3 is a system for dynamic automated image saving and deleting and includes components that may be provided together or that may be distributed. System 300 includes an ultrasound probe 310, a network 301, and smartphone A and smartphone B. A computer that can be used to implement smartphone A and / or smartphone B is depicted in FIG. 8, though smartphone A and / or smartphone B may include more elements than depicted in FIG. 3 and more or fewer elements than depicted in FIG. 8.

[0037] Network 301 may comprise a local wireless network such as a WiFi network, though the network 301 may also or alternatively include wired elements such as USB cables or other wires connected to smartphone A and smartphone B. Smartphone A and smartphone B are representative of mobile smart devices such as smartphones and tablets or other networked and / or networkable devices with logical processing capabilities. Additionally, smartphone A and smartphone B are used as examples to show that system 300 may include multiple different smart devices with applications or other functional capabilities that can be functionally integrated with ultrasound probes in overall systems for ultrasound imaging even though the smartphone A and smartphone B are not necessarily dedicated only to the ultrasound imaging.

[0038] The ultrasound probe 310 may comprise a portable transducer. The ultrasound probe 310 includes a transducer array 313, a lens 314, a user interface 323, a controller 350, and a wireless communication circuit 390. The controller 350 includes a memory 351 and a processor 352. The ultrasound probe 310 may comprise, for example, a CLA (curved linear array) or phased array transthoracic probe. The memory 351 may be representative of multiple memories such as random-access memory (RAM), registers, flash memory, and / or other types of memory. The memory 351 stores data and instructions. The processor 352 processes the data and instructions. The transducer array 313 includes an array of transducer elements including at least a first transducer element 3131, a second transducer element 3132, and an Xth transducer element 313X. The transducer array 313 converts electrical energy into sound waves which bounce off of body tissue and receives echoes of the sound waves and converts the echoes into electrical energy. The transducer array 313 may include dozens, hundreds, or thousands of individualtransducer elements. The ultrasound probe 310 may transmit a beam to produce images and may detect echoes. The processor 352 may process ultrasound images captured by the transducer array 313 of the ultrasound probe 310. The wireless communication circuit 390 may be used to communicate with smartphone A and smartphone B via the network 301. The ultrasound probe 310 may be configured to link to an external device such as the smartphone A and smartphone B via applications installed on the external device(s). The lens 314 may be an acoustic focusing lens for transmitting the ultrasound beams and receiving echoes of the ultrasound beams. User interface 323 may be used by medical personnel to interact with the ultrasound probe 310.

[0039] Smartphone A stores and executes an ultrasound application 399A. Smartphone B stores and executes an ultrasound application 399B. The ultrasound application 399A and the ultrasound application 399B may be configured to enable smartphone A and smartphone B to interact with the ultrasound probe 310 via the network 301. For example, ultrasound application 399 A and ultrasound application 399B may be configured to enable displays of ultrasound images from the ultrasound probe 310 and to generate and display guidance.

[0040] As set forth above, system 300 may comprise an ultrasound system with a controller 350 in an ultrasound probe 310, as well as smartphone A and smartphone B. When executed by processor 352, instructions stored in the memory 351 and / or in memories of smartphone A and / or smartphone B may cause the system 300 to implement some or all features of the method in FIG. 7. In FIG. 3, a user interface may be generated by the instructions stored in memory 351 and may be displayed on a display of smartphone A and / or smartphone B. Alternatively, the user interface may be generated by the ultrasound application 399A for smartphone A and / or the ultrasound application 399B for smartphone B. The user interface on smartphone A and / or smartphone B may provide guidance for a user consistent with the explanations herein. In FIG. 3, one or more of user interface 323, smartphone A and / or smartphone B in FIG. 3 may comprise a user interface configured to visually indicate that individual images can be saved or deleted and / or that images are being saved or deleted.

[0041] Using the system 300, a user may initiate ultrasound imaging using the ultrasound probe 310. The ultrasound probe 310 may comprise a one-dimensional array probe or a two- dimensional matrix array probe. The ultrasound probe 310 is used to generate ultrasound images. In FIG. 3, the controller 350 may be configured to process a set of ultrasound images. The controller 350 may perform a process including identifying context for an imaging session inwhich images are captured by the ultrasound probe 310 as an imaging apparatus; analyzing each of a plurality of images captured in the imaging session by the ultrasound probe 310 as an imaging apparatus to determine, for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; saving each individual image determined to be saved; and deleting each individual image determined not to be saved.

[0042] The system 200 in FIG. 2 and the system 300 in FIG. 3 may be used to provide clinical post- processing analysis on output ultrasound images. The ultrasound images may be displayed as real-time ultrasound output visible to the physician on the display 280 with the graphical user interface 281 or via a display on a screen of the smartphone A and / or the smartphone B. Post processing analysis may be provided via a software application running on the controller 250, on the controller 350 or the smartphone A and / or the smartphone B. The software application may allow a physician to set-up their own checklist and build their own customized conditions proactively to designate completeness of images in advance of imaging. The software application may auto-save exam data to capture desired data without having to stop image acquisitions. The software application enables capture and retention of only data relevant for the type of scan being performed.

[0043] Dynamic automated image saving and deleting may provide visual guidance and cues as features to the scanning physicians. The features may include visual cues of landmark(s) captured that vary based on type of scan, such as based on a target of an imaging session, the content identified in images captured during an imaging session, metadata associated with images captured in an imagine session, or user input in relation to the imaging session. The features may also or alternatively include indicators and confirmation that saving is in progress. Dynamic automated image saving and deleting may also provide flexible ultrasound loop length based on type of scan to reduce unnecessary information capture and reduce large data capture for devices with limited capacity. The deletions of images may save memory, power, and processing, as well as any time impositions on reviewers who could otherwise be tasked with reviewing the images which are instead deleted.

[0044] In embodiments based on FIG. 1 and alternative to FIG. 2 and FIG. 3, an imaging system may comprise a radiology system rather than an ultrasound system. An imaging apparatus may comprise a radiology apparatus such as an X-ray machine.

[0045] FIG. 4 illustrates an image view with a first anatomical landmark identified in dynamicautomated image saving and deleting, , in accordance with a representative embodiment.

[0046] In FIG. 4, once a first anatomical landmark is identified, conditions are met to start. In FIG. 4, a first anatomical landmark may comprise a right kidney. Various indicators may be present on the user interface shown in the image view, including a fast Al icon, a live display soft indicator, a battery strength indicator, a view suitability indicator highlighting whether the organs to detect are seen properly, a button to get to the Summary page, a soft option to save an image, another soft option to save a loop that includes the image, and various measurements relating to the first anatomical landmark identified in the image.

[0047] FIG. 5 illustrates an image view with autosave initiated in dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0048] In FIG. 5, autosave is initiated. A visual indicator of autosave in progress is provided. A voice announcement of the autosave may also be played. In FIG. 5, an auto-save indicator is shown as a soft display on the bottom right. The right kidney from FIG. 4 is shown, along with identification of a liver and a diaphragm.

[0049] FIG. 6 illustrates an image view in a flexible loop length in dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0050] In FIG. 6, a flexible length of an ultrasound loop allows for a retrospective image, a current image and a prospective image. In FIG. 6, the largest image shows an anatomical landmark of a bladder, and three thumbnails are shown towards the bottom including one indicated to be auto saved on the bottom right.

[0051] The image views in FIG. 4, FIG. 5 and FIG. 6 may be used to provide feedback to an operator as to the quality and completeness of imaging in a session. The teachings herein may be used for any point of care ultrasound (POCUS) protocol, a focused assessment with sonography in trauma (FAST) exam, a lung ultrasound including those for covid, a rapid ultrasound for shock and hypotension (RUSH) protocol, cardiac exams, a session for vascular access or to evaluate vascular health, and / or transcranial Doppler (TCD) exams. However, the teachings herein are not limited to the protocols, exams and sessions used as examples herein. Rather, the teachings herein are usable in a variety of contexts, including contexts outside of medical fields.

[0052] Most of the FIGs. herein show embodiments in the context of medical imagery, such as in the context of ultrasound imaging. However, the teachings herein are not limited to medical imagery. Rather, the dynamic automated image saving and deleting may be used for cameraimages captured by smartphones. For example, if a user keeps a button pressed to capture one hundred images in a sequence, dynamic automated image saving and deleting may identify a target of the images and request confirmation of the target from the user. For example, the user may be prompted to confirm that the user is trying to capture pictures of their child, or a group of family members. Dynamic automated image saving and deleting may accept confirmation, and then identify which images are best focused, properly lighted, and include the target of the images. Dynamic automated image saving and deleting may suggest one or several images to save, and if the user agrees, then auto delete the remaining images of the 100 captured in the sequence.

[0053] In other embodiments, dynamic automated image saving and deleting may be applied to images saved over time, such as in Microsoft’s OneDrive or in Google Drive. A user may be prompted to select an image with a target, such as their child, or a group of multiple family members. Dynamic automated image saving and deleting may accept confirmation, and then identify which images are least focused, improperly lighted, and only peripherally include the target of the images. Dynamic automated image saving and deleting may suggest one or several images to delete, and if the user agrees, then save the remaining images of those found to contain the target while deleting the ones agreed to by the user. In this way, dynamic automated image saving and deleting may help users clean up archives of images accumulated over many years.

[0054] FIG. 7 illustrates a method for dynamic automated image saving and deleting, in accordance with a representative embodiment.

[0055] At S710, context is identified for images to be taken or images already taken. The context identified at S710 may vary depending on the type of imaging, the type of imager, operator input, quality control parameters and more. For example, even for specific types of medical imaging apparatuses such as ultrasound imaging apparatuses, the context may vary based on the personnel capturing the medical images, the patient, the type of anatomy targeted in the medical imaging and other types of variable information. In other contexts, such as for security imaging apparatuses, the context may include location, time of image capture, date of week of the image capture, subject matter captured in the images and other types of variable information. The context may be identified from metadata, fixed device data such as device type or variable device data such as device settings, data input by the personnel capturing the images, or data received from other apparatuses such as peripheral devices or networked devices.

[0056] At S720, an image is analyzed. The image may be analyzed for content, such as by applying an artificial intelligence model trained to recognize specific types of anatomy or other subject matter. Artificial intelligence models may be leveraged in real-time clinical postprocessing to adaptively automate and trigger saving acquisitions based on criteria that vary per context and per application, providing the user with desired data with no additional workflow tasks. The analysis at S720 may include analysis as to the quality of the image, whether key targeted features are recognized, when a needle or other interventional tool is present in the image, or whether a targeted pathology is present or suspected in the image. The analysis at S720 may include determination of a relative quality level of an individual image.

[0057] At S730, a decision is made whether to save the image analyzed at S720. The determination of whether to save the individual image at S730 may be based on the relative quality level of the individual image. The decision at S 730 may also or alternatively be based on the analysis at S720, such as whether the analysis recognizes a targeted type of content. The decision at S730 may be based on assigning a confidence to the result of the analysis at S720, such as an 80% or higher confidence that the image includes a targeted type of anatomy. The decision at S730 may be based on whether a particular type of pathology is identified or suspected from the analysis at S720, which may trigger auto-saving for a real-time loop or one or more individual frames. The decision at S730 may also include automatically capturing measurements, such as a measurement of suspected cancerous tissue. A decision that an anatomical feature is present with a predetermined confidence may trigger a measurement of the anatomical feature.

[0058] At S740, the image is deleted if the decision at S730 is not to save the image analyzed at S720 (S730 = No). At S750, the image is saved if the decision at S730 is to save the image analyzed at S720 (S730 = Yes). The determination to save the image at S750 may involve saving more than one image. An operator may be enabled to customize the parameters for saving images, including the loop length for images to be saved once a determination is made to save one image. As a result, the operator may be enabled to save memory, power, processing capabilities and reviewing time. This tradeoff may be particularly valuable when the number of images is relatively large and the reviewer time is relatively valuable.

[0059] At S760, a determination is made as to whether the image analyzed at S720 is the last image. If the image analyzed at S720 is the last image (S760 = Yes), the process ends. In someembodiments, the determination at S760 is not necessarily a passive determination reliant on the presence of a next image. Rather, the determination at S760 may be a determination whether a medical imaging session is complete, so that the system tells the operator when the imaging may be considered complete. A controller or user device may execute an application to calculate a completeness assessment, including checklists of key features, particularly when pathology with defined conditions is identified. An operator may also be provided with feedback to indicate which key features from a checklist have not yet been captured in an image, as well as feedback to indicate whether captured images are of poor quality.

[0060] A feedback display may also indicate a checklist showing progress of completeness of user-defined areas of interest within each zone or view. Accordingly, a checklist may include multiple checklists, or multiple independent measures of completeness, including for a user- defined area of interest within each zone or view. A display may also indicate instructions to save a loop acquisition, or that a loop acquisition is already being saved. The display may indicate the start, the progress, and confirmation of the end of the loop acquisition. The display may also indicate thumbnails of images representative of loops, and indicators of whether the loops were auto saved or manually saved.

[0061] If the image analyzed at S720 is not the last image (S760 = No), at S770 a next image is captured or input for the analysis at S720 and the process from S720 repeats.

[0062] The method of FIG. 7 may be performed by the controller 150, the controller 250, the controller 350, or smartphone A or smartphone B.

[0063] The saving or deleting in the method of FIG. 7 may be customized, such as for an adaptable ultrasound imaging loop length. For example, a decision to save an image analyzed at S720 may apply to the preceding image and the subsequent image too, or for more than three total images.

[0064] An example of the method of FIG. 7 is an exam clinical application: For example, the focused assessment with sonography in trauma exam protocol has four main zones. For each of the four main zones, the operator may consider three main elements to determine if a clinically relevant scan was acquired. The first main element is the quality of the view. The second main element is to associate the organs with each zone. The third main element is a duration of ultrasound loop estimated to be long enough in duration to capture a complete sweep. The determination at S730 may be based on these three main elements.

[0065] In the example of the exam clinical application, the physician may first place the ultrasound transducer on the region of interest on the patient’s body. An ultrasound application may display an indicator of the quality of the image, as in FIG. 4. Next, as the physician investigates the zone with the transducer, for example by sliding the transducer, tilting the transducer, rotating the transducer, or rocking the transducer, the system may recognize associated feature / organ and may make measurements. The features and organs may be displayed with auto-labelling. Once the view quality is acceptable for processing by an artificial intelligence model and once at least one organ or feature associated with the view is identified, the system may initiates auto saving to provide the physician a starting point for the auto save function. Afterwards, the physician may begin to perfect the ultrasound image and scan through all necessary potential pockets. The duration of the auto saved loop may be based on an adaptive frame rate in which the loop duration varies, even within the same exam. For example, one loop might capture the most recent ten frames, and the next loop one might capture the most recent twenty frames. While the system is saving the acquisition, a visual display may indicate the start of the saving, the duration of the saving, and the stopping of the saving. The system may end the loop and save the images from the loop when the ultrasound probe loses contact and there is a black screen. When labels are no longer displayed, the auto saving may not automatically end, as landmarks may vary from frame to frame. In a longer sweep, view quality may vary from frame to frame, but the auto save may continue if minimum set conditions are met. The physician may customize these conditions per application.

[0066] In embodiments based on the method of FIG. 7, the scanner may set the requirements for auto saving, including for retrospective images and prospective images during the imaging. The scanner may set requirements that vary to best meet the clinical requirements for a view. A number of auto-saves may also be set based on preference of hospital. The dynamic automated image saving and deleting program may process all auto saved data and select the best images to represent a clinical story, such as a loop with pathology. The program may add the saved images to an electronic medical record. The program may also assess whether a scanner has performed a complete survey of the view by scoring clips against a predetermined standard.

[0067] The method of FIG. 7 is applicable to point of care ultrasound, such as FAST exams. However, the dynamic automated image saving and deleting may also be used for hands-free medical imaging, such as for needle or other interventional tool visualizations.

[0068] FIG. 8 illustrates a computer system, on which a method for dynamic automated image saving and deleting is implemented, in accordance with another representative embodiment.

[0069] Referring to FIG. 8, the computer system 800 includes a set of software instructions that can be executed to cause the computer system 800 to perform any of the methods or computer- based functions disclosed herein. The computer system 800 may operate as a standalone device or may be connected, for example, using a network 801, to other computer systems or peripheral devices. In embodiments, a computer system 800 performs logical processing based on digital signals received via an analog-to-digital converter.

[0070] In a networked deployment, the computer system 800 operates in the capacity of a server or as a client user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. The computer system 800 can also be implemented as or incorporated into various devices, such as a workstation that includes a controller, a stationary computer, a mobile computer, a personal computer (PC), a laptop computer, a tablet computer, or any other machine capable of executing a set of software instructions (sequential or otherwise) that specify actions to be taken by that machine. The computer system 800 can be incorporated as or in a device that in turn is in an integrated system that includes additional devices. In an embodiment, the computer system 800 can be implemented using electronic devices that provide voice, video or data communication. Further, while the computer system 800 is illustrated in the singular, the term “system” shall also be taken to include any collection of systems or sub-systems that individually or jointly execute a set, or multiple sets, of software instructions to perform one or more computer functions.

[0071] As illustrated in FIG. 8, the computer system 800 includes a processor 810. The processor 810 may be considered a representative example of a processor of a controller and executes instructions to implement some or all aspects of methods and processes described herein. The processor 810 is tangible and non-transitory. As used herein, the term “non- transitory” is to be interpreted not as an eternal characteristic of a state, but as a characteristic of a state that will last for a period. The term “non-transitory” specifically disavows fleeting characteristics such as characteristics of a carrier wave or signal or other forms that exist only transitorily in any place at any time. The processor 810 is an article of manufacture and / or a machine component. The processor 810 is configured to execute software instructions to perform functions as described in the various embodiments herein. The processor 810 may be a general -purpose processor or may be part of an application specific integrated circuit (ASIC). The processor 810 may also be a microprocessor, a microcomputer, a processor chip, a controller, a microcontroller, a digital signal processor (DSP), a state machine, or a programmable logic device. The processor 810 may also be a logical circuit, including a programmable gate array (PGA), such as a field programmable gate array (FPGA), or another type of circuit that includes discrete gate and / or transistor logic. The processor 810 may be a central processing unit (CPU), a graphics processing unit (GPU), or both. Additionally, any processor described herein may include multiple processors, parallel processors, or both. Multiple processors may be included in, or coupled to, a single device or multiple devices.

[0072] The term “processor” as used herein encompasses an electronic component able to execute a program or machine executable instruction. References to a computing device comprising “a processor” should be interpreted to include more than one processor or processing core, as in a multi-core processor. A processor may also refer to a collection of processors within a single computer system or distributed among multiple computer systems. The term computing device should also be interpreted to include a collection or network of computing devices each including a processor or processors. Programs have software instructions performed by one or multiple processors that may be within the same computing device or which may be distributed across multiple computing devices.

[0073] The computer system 800 further includes a main memory 820 and a static memory 830, where memories in the computer system 800 communicate with each other and the processor 810 via a bus 808. Either or both of the main memory 820 and the static memory 830 may be considered representative examples of a memory of a controller, and store instructions used to implement some, or all aspects of methods and processes described herein. Memories described herein are tangible storage mediums for storing data and executable software instructions and are non-transitory during the time software instructions are stored therein. As used herein, the term “non-transitory” is to be interpreted not as an eternal characteristic of a state, but as a characteristic of a state that will last for a period. The term “non-transitory” specifically disavows fleeting characteristics such as characteristics of a carrier wave or signal or other forms that exist only transitorily in any place at any time. The main memory 820 and the static memory 830 are articles of manufacture and / or machine components. The main memory 820 and the static memory 830 are computer-readable mediums from which data and executable softwareinstructions can be read by a computer (e.g., the processor 810). Each of the main memory 820 and the static memory 830 may be implemented as one or more of random access memory (RAM), read only memory (ROM), flash memory, electrically programmable read only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, a hard disk, a removable disk, tape, compact disk read only memory (CD-ROM), digital versatile disk (DVD), floppy disk, blu-ray disk, or any other form of storage medium known in the art. The memories may be volatile or non-volatile, secure and / or encrypted, unsecure and / or unencrypted.

[0074] “Memory” is an example of a computer-readable storage medium. Computer memory is any memory which is directly accessible to a processor. Examples of computer memory include, but are not limited to RAM memory, registers, and register files. References to “computer memory” or “memory” should be interpreted as possibly being multiple memories. The memory may for instance be multiple memories within the same computer system. The memory may also be multiple memories distributed amongst multiple computer systems or computing devices.

[0075] As shown, the computer system 800 further includes a video display unit 850, such as a liquid crystal display (LCD), an organic light emitting diode (OLED), a flat panel display, a solid-state display, or a cathode ray tube (CRT), for example. Additionally, the computer system 800 includes an input device 860, such as a keyboard / virtual keyboard or touch-sensitive input screen or speech input with speech recognition, and a cursor control device 870, such as a mouse or touch-sensitive input screen or pad. The computer system 800 also optionally includes a disk drive unit 880, a signal generation device 890, such as a speaker or remote control, and / or a network interface device 840.

[0076] In an embodiment, as depicted in FIG. 8, the disk drive unit 880 includes a computer- readable medium 882 in which one or more sets of software instructions 884 (software) are embedded. The sets of software instructions 884 are read from the computer-readable medium 882 to be executed by the processor 810. Further, the software instructions 884, when executed by the processor 810, perform one or more steps of the methods and processes as described herein. In an embodiment, the software instructions 884 reside all or in part within the main memory 820, the static memory 830 and / or the processor 810 during execution by the computer system 800. Further, the computer-readable medium 882 may include software instructions 884 or receive and execute software instructions 884 responsive to a propagated signal, so that a device connected to a network 801 communicates voice, video or data over the network 801. Thesoftware instructions 884 may be transmitted or received over the network 801 via the network interface device 840.

[0077] In an embodiment, dedicated hardware implementations, such as application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), programmable logic arrays and other hardware components, are constructed to implement one or more of the methods described herein. One or more embodiments described herein may implement functions using two or more specific interconnected hardware modules or devices with related control and data signals that can be communicated between and through the modules. Accordingly, the present disclosure encompasses software, firmware, and hardware implementations. Nothing in the present application should be interpreted as being implemented or implementable solely with software and not hardware such as a tangible non-transitory processor and / or memory.

[0078] In accordance with various embodiments of the present disclosure, the methods described herein may be implemented using a hardware computer system that executes software programs. Further, in an exemplary, non-limited embodiment, implementations can include distributed processing, component / object distributed processing, and parallel processing. Virtual computer system processing may implement one or more of the methods or functionalities as described herein, and a processor described herein may be used to support a virtual processing environment.

[0079] Accordingly, dynamic automated image saving and deleting enables automatic and adaptive saving or deletion of images based on the context in which the images are captured. The teachings herein are applicable to a variety of contexts, both non-medical and medical. Medical contexts include point of care ultrasound such as focused assessment with sonography in trauma exams in emergency rooms for trauma patients, and other types of medical imaging such as radiological imaging. Post-processing may be performed in real-time to adaptively automate and trigger saving acquisitions based on criteria that vary per context and per application, providing the user with desired data with no additional workflow tasks.

[0080] Although dynamic automated image saving and deleting has been described with reference to several exemplary embodiments, it is understood that the words that have been used are words of description and illustration, rather than words of limitation. Changes may be made within the purview of the appended claims, as presently stated and as amended, without departing from the scope and spirit of dynamic automated image saving and deleting in itsaspects. Although dynamic automated image saving and deleting has been described with reference to particular means, materials and embodiments, dynamic automated image saving and deleting is not intended to be limited to the particulars disclosed; rather dynamic automated image saving and deleting extends to all functionally equivalent structures, methods, and uses such as are within the scope of the appended claims.

[0081] The illustrations of the embodiments described herein are intended to provide a general understanding of the structure of the various embodiments. The illustrations are not intended to serve as a complete description of all of the elements and features of the disclosure described herein. Many other embodiments may be apparent to those of skill in the art upon reviewing the disclosure. Other embodiments may be utilized and derived from the disclosure, such that structural and logical substitutions and changes may be made without departing from the scope of the disclosure. Additionally, the illustrations are merely representational and may not be drawn to scale. Certain proportions within the illustrations may be exaggerated, while other proportions may be minimized. Accordingly, the disclosure and the figures are to be regarded as illustrative rather than restrictive.

[0082] One or more embodiments of the disclosure may be referred to herein, individually and / or collectively, by the term “invention” merely for convenience and without intending to voluntarily limit the scope of this application to any particular invention or inventive concept. Moreover, although specific embodiments have been illustrated and described herein, it should be appreciated that any subsequent arrangement designed to achieve the same or similar purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all subsequent adaptations or variations of various embodiments. Combinations of the above embodiments, and other embodiments not specifically described herein, will be apparent to those of skill in the art upon reviewing the description.

[0083] The Abstract of the Disclosure is provided to comply with 37 C.F.R. § 1.72(b) and is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, various features may be grouped together or described in a single embodiment for the purpose of streamlining the disclosure. This disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter may be directed to less than all of the featuresof any of the disclosed embodiments. Thus, the following claims are incorporated into the Detailed Description, with each claim standing on its own as defining separately claimed subject matter.

[0084] The preceding description of the disclosed embodiments is provided to enable any person skilled in the art to practice the concepts described in the present disclosure. As such, the above disclosed subject matter is to be considered illustrative, and not restrictive, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments which fall within the true spirit and scope of the present disclosure. Thus, to the maximum extent allowed by law, the scope of the present disclosure is to be determined by the broadest permissible interpretation of the following claims and their equivalents and shall not be restricted or limited by the foregoing detailed description.

Claims

CLAIMS:

1. An imaging system (100), comprising: an imaging apparatus (110) configured to perform imaging to capture images; a memory (151) that stores instructions; and a processor (152) that executes the instructions, wherein, when executed by the processor, the instructions cause the imaging system to: identify context (S710) for an imaging session in which images are captured by the imaging apparatus; analyze (S720) each of a plurality of images captured in the imaging session by the imaging apparatus (110) to determine (S730), for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; save (S750) each individual image determined to be saved; and delete (S740) each individual image determined not to be saved.

2. The imaging system (100) of claim 1, wherein, determinations whether to save each individual image or delete each individual image are made automatically and independent of any instruction from an operator of the imaging apparatus.

3. The imaging system (100) of claim 1, wherein the imaging system (100) comprises an ultrasound system (200 / 300) and the imaging apparatus (110) comprises an ultrasound apparatus.

4. The imaging system of claim 3, wherein determinations whether to save each individual image or delete each individual image are made in real-time.

5. The imaging system (100) of claim 1, wherein the imaging system (100) comprises a radiology system and the imaging apparatus (110) comprises a radiology apparatus.

6. The imaging system (100) of claim 1, wherein analysis of each of the plurality of images includes detection whether at least one anatomical landmark is present in the individual23image, and determination of whether to save the individual image is based on whether the anatomical landmark is present in the individual image.

7. The imaging system (100) of claim 1, further comprising: a user interface configured to visually indicate that individual images are being saved.

8. The imaging system (100) of claim 1, wherein analysis of each of the plurality of images includes determination of a relative quality level of the individual image, and determination of whether to save the individual image is based on the relative quality level of the individual image.

9. The imaging system (100) of claim 1, wherein analysis of each of the plurality of images includes determination of whether an interventional tool is present in the individual image, and determination of whether to save the individual image is based on whether the interventional tool is present in the individual image.

10. The imaging system (100) of claim 1, wherein, when executed by the processor, the instructions cause the imaging system to: save a plurality of images based on determining to save a first individual image of the plurality of images.

11. The imaging system (100) of claim 10, wherein a number of the plurality of images to be saved varies adaptively based on the context.

12. The imaging system (100) of claim 10, further comprising: a display (181) that visually indicates a start of saving the plurality of images, a duration of saving the plurality of images, and a stop of saving the plurality of images.

13. An imaging method (FIG. 7) performed by an imaging system (100) comprising an imaging apparatus (110) configured to perform imaging to capture images, a memory (151) thatstores instructions, and a processor (152) that executes the instructions, the imaging method comprising: identifying (S710) context for an imaging session in which images are captured by the imaging apparatus; analyzing (S720) each of a plurality of images captured in the imaging session by the imaging apparatus to determine (S730), for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; saving (S750) each individual image determined to be saved; and deleting (S740) each individual image determined not to be saved.

14. The imaging method (FIG. 7) of claim 13, wherein, determinations whether to save each individual image or delete each individual image are made automatically and independent of any instruction from an operator of the imaging apparatus.

15. The imaging method (FIG. 7) of claim 13, wherein the imaging system comprises an ultrasound system and the imaging apparatus comprises an ultrasound apparatus, and wherein determinations whether to save each individual image or delete each individual image are made in real-time.

16. The imaging method (FIG. 7) of claim 13, wherein analysis of each of the plurality of images includes detection whether at least one anatomical landmark is present in the individual image, and determination of whether to save the individual image is based on whether the anatomical landmark is present in the individual image.

17. The imaging method (FIG. 7) of claim 13, wherein analyzing each of the plurality of images includes determining a relative quality level of the individual image, and determining whether to save the individual image is based on the relative quality level of the individual image.

18. The imaging method (FIG. 7) of claim 13, further comprising: saving a plurality of images based on determining to save a first individual image of the plurality of images.

19. The imaging method (FIG. 7) of claim 18, wherein a number of the plurality of images to be saved varies adaptively based on the context.

20. Atangible, non-transitory computer-readable medium (151 / 251 / 820) that stores instructions, which when executed by a processor (152 / 252 / 810), cause the processor (152 / 252 / 810) to: identify (S710) context for an imaging session in which images are captured by an imaging apparatus; analyze (S720) each of a plurality of images captured in the imaging session by the imaging apparatus to determine (S730), for each individual image of the plurality of images, whether to save the individual image based on the context for the imaging session; save (S750) each individual image determined to be saved; and delete (S740) each individual image determined not to be saved.26

Images