System and method for automatic association and display of recurring themes in videos for enhanced recognition

Abstract

An imaging system and method for displaying information about a subject from an ultrasound image or ultrasound video loop on a display includes the steps of: detecting one or more organs in the ultrasound image or ultrasound video loop; creating a representative thumbnail image using frames of the ultrasound image or ultrasound video loop; selecting an organ icon representing the one or more organs detected in the ultrasound image or ultrasound video loop; and displaying the organ icon associated with the thumbnail image on the display. The system and method may also create searchable information associated with the one or more organs detected in the ultrasound image or ultrasound video loop, and store the searchable information in an electronic memory in association with the image or image video loop and the thumbnail image having the organ icon.

Description

Background Technology

[0001] The present invention relates generally to imaging systems, and more specifically to structures and methods for displaying images generated by imaging systems.

[0002] An ultrasound imaging system typically includes an ultrasound probe applied to a patient's body and a workstation or device operatively connected to the probe. The probe is controlled by the system operator and configured to transmit and receive ultrasound signals processed into ultrasound images by the workstation or device. The ultrasound images can be displayed via a display device operatively connected to the workstation or device.

[0003] After being created by the ultrasound imaging system, images can be stored in any suitable electronic storage format and / or in an electronic storage device operatively connected to the ultrasound imaging system. When accessing stored images, they can be presented on a display device in a reduced-size format, allowing multiple stored images to be displayed simultaneously, enabling the operator / user to navigate and select and view specific images of interest.

[0004] In the case of video loops acquired and / or created by an ultrasound imaging device, these loops are stored in an electronic storage device in association with representative images selected from the video loops used to identify the loops. When accessing the electronic storage device to locate the stored video loop, the representative image is presented on a display, wherein a playback icon is set on the representative image to identify the image as an indication of the video loop.

[0005] Using this identification system, when a user of an ultrasound imaging system wants to search stored video loops to locate one or more loops associated with a specific organ / anatomical structure, the user must view the available stored loops based on representative images or thumbnail images associated with each loop in the loop. However, the thumbnail images associated with a stored video loop may not necessarily be frames in the ultrasound image or video loop corresponding to the organ captured in that video loop. For example, in most cases, the first or last frame of a stored ultrasound video loop is usually selected as the representative thumbnail image of the stored video loop. However, for various reasons, these frames often do not show the organ that is the primary focus of the video loop, for example, when the video loop begins before the ultrasound probe is placed on the organ to be imaged.

[0006] Furthermore, in the presentation of stored video loops, the playback icon is positioned in the center of the thumbnail image, making it easy for users to identify the associated file as a video loop and to easily select or directly click the playback icon to start playing the stored video loop. The playback icon is placed in the center of the thumbnail image, rather than in a corner, because clicking icons placed in the corner of a thumbnail image is very difficult and error-prone, especially on touchscreen-based display devices (including devices with limited screen sizes), including smartphones and tablets.

[0007] Furthermore, regardless of whether the representative thumbnail image associated with the stored video loop corresponds to a frame within the stored video loop (in which the organ or anatomical structure, as the subject of the video loop, is presented), the details of the organ and / or anatomical structure presented within that representative thumbnail image are overlaid with the playback icon. Because the thumbnail image is relatively very small compared to the image size of the image forming the stored video loop, the presence of a play button on the small thumbnail image increases the difficulty of identifying the details of the organ / structure type shown within the thumbnail image. This problem is even more pronounced when the display device associated with the ultrasound imaging system on which the thumbnail image is presented has a very small display area (e.g., mobile devices such as smartphones and tablets), or even when a larger display is used to display a large number of thumbnail images identifying the stored video loop for user navigation and selection of specific loops.

[0008] Due to these limitations on the selection and presentation of representative thumbnail images of stored video loops, it is often difficult to easily identify the organ / anatomical structure associated with a stored video loop by thumbnail images when searching for stored video loops associated with a desired organ / anatomical structure, without having to manually view or replay each stored video loop, making the search process very time-consuming.

[0009] Therefore, it is desirable to develop a system and method for presenting thumbnail images of a stored video loop on the screen of a display device that informs the user of organs or other relevant anatomical structures within the ultrasound video loop that may not be easily visible from the thumbnail image. Summary of the Invention

[0010] According to an exemplary aspect of this disclosure, a method for displaying information about a subject of an ultrasound image or ultrasound video loop on a display includes the steps of: detecting one or more organs in the ultrasound image or ultrasound video loop; creating a representative thumbnail image using frames of the ultrasound image or ultrasound video loop; selecting an organ icon representing the one or more organs detected in the ultrasound image or ultrasound video loop; and displaying the organ icon associated with the thumbnail image on the display.

[0011] According to another exemplary aspect of this disclosure, the present invention discloses an imaging system for displaying images acquired by the imaging system on a display. The imaging system includes: an imaging probe adapted to acquire image data relating to an object to be imaged; a processor operatively connected to the probe to form one of an image or an image-video loop from the image data, and to form a thumbnail image representing the image or image-video loop; and a display operatively connected to the processor for presenting the image or image-video loop on the display, wherein the processor is configured to implement at least one of an algorithm, artificial intelligence, or machine learning method to detect one or more organs in the image or image-video loop, select organ icons representing the one or more organs detected in the ultrasound image or ultrasound video loop, and present the organ icons associated with the thumbnail image of the image or image-video loop on the display.

[0012] According to yet another exemplary aspect of this disclosure, an imaging system is disclosed for displaying images acquired by the imaging system on a display. The imaging system includes: an imaging probe adapted to acquire image data relating to an object to be imaged; a processor operatively connected to the probe to form one of an image or an image-video loop from the image data, and to form a thumbnail image representing the image or image-video loop; an electronic memory operatively connected to the processor; and a display operatively connected to the processor for presenting the image or the image-video loop on the display, wherein the processor is configured to implement at least one of an algorithm, artificial intelligence, or machine learning method to detect one or more organs in the image or the image-video loop, select organ icons representing the one or more organs detected in the ultrasound image or ultrasound-video loop, store a thumbnail and organ icon associated with the image or image-video loop in the electronic memory, and present the organ icon associated with the thumbnail image of the image or image-video loop on the display.

[0013] It should be understood that the above brief description is provided to introduce selected concepts further described in the detailed embodiments in a simplified form. This is not intended to identify key or essential features of the claimed subject matter, the scope of which is uniquely defined by the claims following the detailed embodiments. Furthermore, the claimed subject matter is not limited to embodiments that address any shortcomings mentioned above or in any part of this disclosure. Attached Figure Description

[0014] The invention will be better understood by referring to the following description of non-limiting embodiments, in which:

[0015] Figure 1 It is a schematic block diagram of an imaging system formed according to an implementation plan.

[0016] Figure 2 It is a schematic block diagram of an imaging system formed according to another implementation scheme.

[0017] Figure 3 It is based on an implementation plan for operation. Figure 1 or Figure 2 The flowchart shows the method of the imaging system.

[0018] Figure 4 It is a schematic diagram of a stored video loop thumbnail image presented on the display screen of a remote device according to an implementation scheme.

[0019] Figure 5 It is a schematic diagram of a stored video loop thumbnail image presented on the display screen of a remote device, according to another embodiment.

[0020] Figures 6A-6H It is a schematic diagram of a single thumbnail image of a video loop stored according to different implementation schemes.

[0021] Figure 7 This is a schematic diagram of the identification of stored video loop thumbnail images according to an implementation scheme.

[0022] Figures 8A-8B It is a schematic diagram of the identification of stored video loop thumbnail images according to another implementation scheme.

[0023] Figure 9 This is a schematic diagram of the identification of stored video loop thumbnail images according to an implementation scheme. Detailed Implementation

[0024] The foregoing summary of the invention and the following detailed description of certain embodiments of the invention will be better understood when read in conjunction with the accompanying drawings. For the purposes of the diagrams illustrating the functional blocks of various embodiments, these functional blocks do not necessarily represent a division between hardware circuits. One or more functional blocks (e.g., a processor or memory) may be implemented in a single piece of hardware (e.g., a general-purpose signal processor or random access memory, hard disk, etc.) or in multiple pieces of hardware. Similarly, a program may be a standalone program, may be included as a subroutine in an operating system, may be a function in an installed software package, etc. It should be understood that the various embodiments are not limited to the arrangements and tools shown in the drawings.

[0025] As used herein, elements or steps described in the singular and beginning with the word "a" or "an" should be understood to not exclude a plurality of said elements or steps, unless such exclusion is explicitly stated. Furthermore, references to "one embodiment" of the invention are not intended to be construed as excluding the existence of additional embodiments that also include the referenced features. Moreover, unless explicitly stated to the contrary, embodiments that "comprise" or "have" elements or multiple elements having a particular property may include other such elements that do not have that property.

[0026] Although various implementation schemes have been described relative to ultrasound imaging systems, these schemes can be used in conjunction with any suitable imaging system (e.g., X-ray, computed tomography, single-photon emission computed tomography, magnetic resonance imaging, or similar imaging systems).

[0027] Figure 1 This is a schematic diagram of an imaging system 200 including an ultrasound imaging system 202 and a remote device 230. The remote device 230 can be a computer, tablet, smartphone, etc., and can be an off-the-shelf device or a device specifically designed for use as a remote device 230 in conjunction with the imaging system 202. As used herein, the term "smartphone" refers to a portable device that can operate as a mobile phone and includes a computing platform configured to support operation of a mobile phone, a personal digital assistant (PDA), and various other applications. Such other applications may include, for example, a media player, a camera, a global positioning system (GPS), a touchscreen, an internet browser, Wi-Fi, etc. The computing platform or operating system may be, for example, Google Android. TM Apple iOS TM Microsoft Windows TM Blackberry TM Linux TM Furthermore, the term "tablet device" refers to portable devices, such as the Kindle. TM or iPad TMThe remote device 230 may include a touchscreen display 204 for use as a user input device and a display. The remote device 230 communicates with the ultrasound imaging system 202 to display image 214 on the display 204 based on image data acquired by the ultrasound imaging system 202. The remote device 230 also includes any suitable components for image viewing, manipulation, and storage of information related to image 214.

[0028] The probe 206 communicates with the ultrasound imaging system 202. The probe 206 is mechanically coupled to the ultrasound imaging system 202. Alternatively, the probe 206 may communicate wirelessly with the imaging system 202. The probe 206 includes an array of transducer elements / transducer elements 208 that transmit ultrasound pulses to the object 210 to be scanned (e.g., an organ of a patient). The ultrasound pulses may be backscattered from structures within the object 210, such as blood cells or muscle tissue, to generate echoes returning to the transducer elements 208. The transducer elements 208 generate ultrasound image data based on the received echoes. The probe 206 transmits the ultrasound image data to the ultrasound imaging system 202, which operates the imaging system 200. The image data of the object 210 acquired using the ultrasound imaging system 202 for forming an image 214 may be two-dimensional or three-dimensional image data, such that the image 214 may be an ultrasound image and / or video loop 214. In another alternative embodiment, the ultrasound imaging system 202 may acquire four-dimensional image data of the object 210. When generating image / video loop 214, processor 222 is also configured to automatically identify organs and / or other anatomical structures 224 within image / video loop 214 and provide identification of those organs and / or other anatomical structures 224 within image / video loop 214.

[0029] The ultrasound imaging system 202 includes a memory 212 for storing ultrasound image data. The memory 212 may be a database, random access memory, etc. A processor 222 accesses the ultrasound image data from the memory 212. The processor 222 may be a logic-based device, such as one or more computer processors or microprocessors. The processor 222 generates images based on the ultrasound image data. After being generated by the processor 222, an image / video loop 214 is optionally presented on a display 216 for viewing, either in real-time during the procedure or when accessed after the procedure is completed, such as on the display screen of a cart-based ultrasound imaging system 202 with an integrated display / monitor 216, or on the integrated display / screen 216 of a laptop-based ultrasound imaging system 200.

[0030] In one exemplary embodiment, the ultrasound imaging system 202 may present an image / video loop 214 along with a graphical user interface (GUI) or other display user interface on an associated display / monitor / screen 216. The image / video loop 214 may be a software-based display accessible from multiple locations, such as via a web-based browser, local area network, etc. In such embodiments, the image / video loop 214 may be remotely accessed and thus displayed on a remote device 230 in the same manner as when the image / video loop 214 is presented on the display / monitor / screen 216.

[0031] The ultrasound imaging system 202 also includes a transmitter / receiver 218 that communicates with the transmitter / receiver 220 of the remote device 230. The ultrasound imaging system 202 and the remote device 230 can communicate via a direct peer-to-peer wired / wireless connection or a local area network or via an Internet connection (such as via a web-based browser).

[0032] An operator can remotely access imaging data stored on the ultrasound imaging system 202 from a remote device 230. For example, the operator can log in to a virtual desktop provided on the monitor 204 of the remote device 230. The virtual desktop is remotely linked to the ultrasound imaging system 202 to access the memory 212 of the ultrasound imaging system 202. Once access to the memory 212 is gained, the operator can select image data to view. The image data is processed by the processor 222 to generate an image / video loop 214. For example, the processor 222 can generate a DICOM image / video loop 214. The ultrasound imaging system 202 transmits the image / loop 214 to the monitor 204 of the remote device 230, so that the image / video loop 214 can be viewed on the monitor 204.

[0033] Now see Figure 2 In an alternative embodiment, the imaging system 202 is completely omitted, wherein the probe 206 is configured to include a memory 207, a processor 209, and a transceiver 211 for processing ultrasound image data and transmitting the ultrasound image data directly to a remote device 230 via a wired or wireless connection. The ultrasound image data is stored in a memory 234 in the remote device 230 and is processed in a suitable manner by a processor 232 operatively connected to the memory 234 to create an image / video loop 214 and present the image / video loop on a remote display 204.

[0034] In any implementation, reference is now made to Figure 3After the image / video loop 214 is created by processors 222 and 232 in block 300, in block 302, processors 222 and 232 further perform one or more detection analyses on individual frames of image 214 / video loop 214. In the illustrated exemplary embodiment, the analysis performed in block 302 may include one or more of the following detections: 1.) detecting organs / anatomical structures presented within image / video loop frame 214 in block 304; 2.) detecting the view orientation or angle associated with the organ / anatomical structure represented within image / video loop frame 214 in block 306; and / or 3.) detecting any anomalies in the organ / anatomical structure shown within image / video loop frame 214 in block 308. For video loop 214, processors 222 and 232 will perform the selected analysis on each individual image 214 and / or frame of video loop 214. The detection of organs / anatomical structures within image / video loop frame 214 in block 304, the detection of views of organs / anatomical structures within image / video loop frame 214 in block 306, and / or the detection of any anomalies in organs / anatomical structures within image / video loop frame 214 in block 308 are all performed by processors 222 and 232 using known recognition processes and / or algorithms for image generation from ultrasound or other imaging systems. For example, conventional image processing techniques or artificial intelligence (AI)-based methods (including machine learning (ML) and deep learning (DL), or a combination of both, can be used to identify organs / anatomical structures, views, and anomalies presented within image / video loop frame 214. For AI-based recognition methods, the ultimate goal of identifying organs / anatomical structures and anomalies presented within image / video loop frame 214 can be formulated as an image segmentation, image classification, or object localization problem. Similarly, the goal of view detection of organs / anatomical structures within image / video loop frame 214 can be formulated as a classification problem. While traditional ML-based methods (such as Support Vector Machines (SVM), Random Forests (RF), etc.) can be used to address these problems, Convolutional Neural Networks (CNNs) (a class of deep learning (DL)-based models) are best suited for such tasks, resulting in better accuracy and adaptability across a variety of imaging conditions. Information from step 304 regarding the organs / anatomical structures detected within the looping image / video frame can also be used as additional input by the view detection 306 and anomaly detection 308 models, along with the input image / video looping frame, to improve the accuracy of their respective tasks. Although in the exemplary implementations of organ / structure detection, view detection, and anomaly detection, the functions are shown as being implemented by individual AI-based models in blocks 304, 306, and 308, they can also be combined and implemented within a single multi-head DL-based model, where each head in a single head implements a separate function, namely organ / anatomical structure detection, view detection, or anomaly detection.Based on multi-task learning, such multi-head DL models share a common backend layer that is relevant to all functions / tasks, followed by task-specific / function-specific layers that are trained / tuned to perform well on their respective tasks / functions.

[0035] Regarding the process of determining the presentation of one or more organs within image / video loop 214, executed by processors 222 and 232 in block 304, during the analysis of image / video loop 214, processors 222 and 223 may utilize thresholds stored in memory 212 and 234. Processors 222 and 232 utilize these thresholds, which can be preset and / or modified by the user as needed, to determine whether image / video loop 214 contains sufficient representation of organs / anatomical structures within image / video loop 214 to include organ icons 256 in thumbnail images 250 of image / video loop 214. While thresholds can be set as needed in any suitable format, in exemplary embodiments, thresholds may be based on a percentage of the total area of ​​a single image 214 of ultrasound image 214, and / or the total number or percentage of individual frames forming video loop 214 (containing at least a portion of the selected organ). For example, if analysis of image 214 shows that an organ is presented in at least 25% of the total area of ​​image 214, or if analysis of video loop 214 shows that an organ is presented in at least 15% of a single frame 214 of video loop 214, then the organ has exceeded the threshold of image / video loop 214, and processors 222, 232 determine that a representative indicator 240 for identifying the organ / anatomical structure should be included in the thumbnail image 250 of image / video loop 214.

[0036] Starting at block 304, when processors 222 and 232 have detected a specific organ / anatomical structure within image / video loop frame 214, processors 222 and 232 proceed to block 310, where processors 222 and 232 select a representative identifier 240 for use in association with image / video loop 214. Identifier 240 corresponds to the organ / anatomical structure detected in image / video loop 214 to provide an indication of the subject presented in image / video loop 214.

[0037] Once the representative identifier 240 has been selected, in block 312, processors 222 and 232 continue to generate custom data / search identifiable information for video loop 214 based on the representative identifier 240. In an exemplary embodiment, this process involves processors 222 and 232 creating classification or search identifiable information about the detected organ / anatomical structure to the electronic storage location or file containing the image / video loop 214 stored in memories 212 and 234. In block 314, this information can be added to the stored image / video loop 214 in any suitable manner, such as by adding information in the form of custom metadata or custom tags to the electronic file or electronic storage location containing the stored image / video loop 214 in memories 212 and 234. In this way, when searching for image / video loops 214 related to organs / anatomical structures detected by processors 222 and 232, such as in keyword searches (including terms contained in metadata or tags added by processors 222 and 232 to the stored image / video loops 214), the stored image or video loops 214 can be more easily located and accessed.

[0038] In addition to the information added to the stored image / video loop 214, in block 316, processors 222, 232 may use a representative identifier 240 to generate information to be directly added to a thumbnail image 250, which is used as a visual representation of the stored image / video loop 214. The thumbnail image 250 is selected from a frame forming the video loop 214 and is used as a visual identifier of the stored video loop 214 when presented on displays 216, 204. The thumbnail image 250 includes the frame selected from the video loop 214 and a playback icon 252 overlaid on the center of the thumbnail image 250. The playback icon 252 serves as a direct link to the stored video loop 214 in memories 212, 234 and can be selected by the user in any known manner to initiate playback of the video loop 214 within a frame 254 of the thumbnail image 250 or in a separate frame or window (not shown) on the display 216, 204 opened after selecting the playback icon 254.

[0039] Within the thumbnail image 250, Figures 6A-6E In one exemplary embodiment shown, the representative identifier 240 may take the form of an organ icon 256 positioned on the thumbnail image 250. The organ icon 256 is positioned within the thumbnail image 250 in a location that does not interfere with the playback icon 252 and provides a clear and easily viewable indication of the organ / anatomical structure as the subject of the video loop 214. The organ icon 256 may be rendered in any suitable color so that it is depicted from the rest of the thumbnail image 250. Figures 6A-6EIn the exemplary embodiment shown, organ icon 256 may be a kidney ( Figure 6A ),bladder( Figure 6B ),liver( Figure 6C ),heart( Figure 6D ) or a pair of lungs ( Figure 6E The organ icon 256 is in the form of ), but other shapes and colors of the organ icon 256 are also considered to be within the scope of this disclosure.

[0040] After the organ icon 256 is added to the thumbnail image 250, the modified thumbnail image 250 is stored in block 318 such that the modified thumbnail image 250 including the organ icon 256 can be displayed when the image / video loop 214 associated with the modified thumbnail image 250 is presented on the displays 216, 204.

[0041] In addition to representing organs / anatomical structures via organ icon 256, in block 316, when processors 222 and 232 operate in block 306 to detect views / view orientations / view angles associated with the organs / anatomical structures forming image / video loop 214, processors 222 and 232 may provide an indication of the detected views for image / video loop 214 in organ icon 256. (Reference) Figure 6F and Figure 6G In an exemplary embodiment, when a particular view of the image / video loop 214 is detected by processors 222, 232, the organ icon 256 to be inserted into the thumbnail image 250 may include a view line 258. The view line 258 is positioned on the organ icon 256 to represent the view of the organ / anatomical structure presented in the image / video loop 214 along its imaging / capture. Therefore, by utilizing the view line 258, in addition to the organ / anatomical structure information provided by the shape of the organ icon 256, the organ icon 256 also enables an individual to know what view of the indicated organ / anatomical structure is provided in the particular image / video loop 214 associated with the thumbnail image 250.

[0042] Now for reference Figure 3 and Figure 6HWhen processors 222 and 232 additionally determine in block 308 that an anomaly is presented within a frame of image 214 / video loop 214, in block 316, processors 222 and 232 may provide an anomaly indication or modification 259 to the organ icon 256 presenting the anomaly within image / video loop 214. In the illustrated exemplary embodiment, the anomaly indication is provided by modifying the organ icon 256 in some identifiable manner, such as by changing the color of the organ icon 256, by changing the size of the organ icon 256, by changing the brightness of the organ icon 256, by causing the organ icon 256 to blink or oscillate between different color and / or brightness levels, or by any other suitable means to distinguish the organ icon 256 that includes anomaly detection from the organ icon 256 that does not undergo anomaly detection.

[0043] In the case of any or both of the view lines 258 in the organ icon 256 and abnormal modifications, this information is stored with the thumbnail image 250 as previously described, and may also be added to custom data (i.e. metadata and tags) stored in association with the image / video loop 214.

[0044] See now Figure 4 and Figure 5 The image shows a display 204 of a remote device 230, in which multiple thumbnail images 250 are presented, each thumbnail image 250 representing a specific image / video loop 214. The thumbnail images 250 are displayed in a list view (...). Figure 4 ) or grid view ( Figure 5 The thumbnail images 250 are presented and demonstrate how organ icons 256 in each thumbnail image 250 provide an easy-to-view display of information about the organs / anatomical structures shown in each image / video loop 214 without requiring playback of each image / video loop 214. Furthermore, the size of the displayed thumbnail images 250 allows additional information, text, or details 262 about individual image / video loops 214 to be presented alongside the thumbnail images, enhancing the user's ability to quickly review each displayed thumbnail image 250 in a list or grid to determine their relevance to the search.

[0045] See now Figure 3 and Figure 7When processors 222 and 232 in block 304 detect multiple organs / anatomical structures presented within image / video loop 214, processors 222 and 232 can create multi-organ icons 260 to be presented within thumbnail image 250, which provide an indication of each of the organs / anatomical structures identified in image / video loop 214. In the illustrated exemplary embodiment, multi-organ icons 260 are a movie playback or periodic loop displaying individual organ icons 256, representing individual organs / anatomical structures detected within image / video loop 214. In this way, multi-organ icons 260 provide easily interpretable indications of multiple organs / anatomical structures viewable within image / video loop 214 identified by thumbnail image 250 (including multi-organ icons 260).

[0046] Now for reference Figure 3 and Figures 8A-8B In an alternative scenario where multiple organs / anatomical structures are detected within image / video loop 214, in block 304, processors 222 and 232 may determine which organs / anatomical structures are presented above a threshold in the frames of video loop 214. Alternatively, for a single ultrasound image 214, processors 222 and 232 may determine which organs / anatomical structures are presented above a threshold area in image 214. Once determined, processors 222 and 232 may utilize multiple organ icons 256 within a single thumbnail image 250, each representing one of the organs / anatomical structures determined to be presented in image / video loop 214 that meets or exceeds the threshold. While any ordering of the organ icons 256 is considered to be within the scope of this disclosure, in one exemplary embodiment, the organ icons 256 may be ordered in the thumbnail image 250 such that the leftmost organ icon 256 indicates the organ / anatomical structure presented most frequently in frames of image / video loop 214, and the rightmost organ icon 256 indicates the organ / anatomical structure presented in the fewest frames of image / video loop 214. Individual organ icons 256 may also each include a numeric indicator 264 that visually indicates the relative prominence of a particular organ / anatomical structure in frames of image / video loop 214, accompanying or serving as a replacement for the left-to-right ordering of the organ icons 256.

[0047] In addition to the multi-organ icon 256, in the thumbnail image 250 of the image / video loop 214 containing multiple organs / anatomical structures, if associated with a specific organ icon 256, the icon 256 may be displayed individually as a view line 258 and / or anomaly indicator 259 representing each of the organ icons 256. Alternatively, for the detection analysis (anomaly detection) performed in block 308, in one exemplary embodiment, if the processors 222, 232 detect an anomaly in any individual frame of the video loop 214, the processors 222, 232 may identify the entire video loop 216 as containing an anomaly.

[0048] See now Figure 9 As an alternative to indicating multiple organs / anatomical structures in image / video loop 214 by using multi-organ icons 256, 260 in thumbnail image 250, thumbnail image 250 may include anatomical region icons 270. Where processors 222, 232 determine that multiple organs / anatomical structures are within a specific region of the anatomical structure covered by image / video loop 214, in block 316, anatomical region icons 270 may be added to thumbnail image 250 by processors 222, 232, and the anatomical region icons 270 optimally indicate information contained within a particular image / video loop 214. Figure 9 In one exemplary embodiment, the anatomical region icon 270 is shown as a torso 272 with a highlighted abdomen 274, indicating that the image / video loop 214 focuses on organs / anatomical structures within the patient's abdomen 274. In another exemplary embodiment, the anatomical region icon 270 may have other shapes representing other parts of the patient's anatomy, such as legs, arms, etc. Furthermore, the anatomical region icon 270 may have multiple areas highlighted within the icon 270, or may have multiple icons 270 presented together with the thumbnail image 250. Figures 8A-8B Several icons in the 256 are similar.

[0049] This written description uses examples to disclose the invention, including the best mode, and also enables those skilled in the art to practice the invention, including making and using any device or system and performing any included methods. The scope of the invention is defined by the claims and may include other examples that would occur to those skilled in the art. Such other examples are intended to fall within the scope of the claims if they have structural elements that are not indistinguishable from the literal language of the claims, or if they include equivalent structural elements that have minor differences from the literal language of the claims.

Claims

1. A method for displaying information about a topic related to an ultrasound video loop on a display, the method comprising the steps of: - Detect one or more organs in the ultrasound video loop; - Create representative thumbnail images using frames from the ultrasound video loop; - Select an organ icon representing one or more organs detected in the ultrasound video loop; and - The organ icon associated with the thumbnail image is displayed on the monitor. The step of selecting organ icons includes selecting a multi-organ icon corresponding to each organ detected in the ultrasound video loop, wherein the multi-organ icon is a periodic loop displaying the organ icons corresponding to each detected organ.

2. The method of claim 1, wherein the step of detecting the one or more organs in the ultrasound video loop comprises analyzing individual frames of the ultrasound video loop to locate one or more organs in the individual frames of the ultrasound video loop.

3. The method of claim 2, wherein the step of analyzing individual frames of the ultrasound video loop comprises: - Identify a portion of a single frame in the ultrasound video loop in which the one or more organs are located; as well as - Assess whether the portion exceeds a predetermined threshold for the presentation of one or more organs in the ultrasound video loop.

4. The method of claim 1, wherein the step of analyzing individual frames of the ultrasound video loop comprises employing at least one of an algorithm, artificial intelligence, or machine learning method to identify one or more organs within a individual frame of the ultrasound video loop.

5. The method of claim 1, wherein the step of presenting the organ icon associated with the thumbnail image comprises placing the organ icon within the thumbnail image.

6. The method according to claim 1, further comprising the following steps: - Detect the view associated with the organ presented in the ultrasound video loop; as well as - Provides an indication of the view on the organ icon associated with the thumbnail image.

7. The method of claim 6, wherein the step of detecting the view in the ultrasound video loop comprises implementing at least one of an algorithm, artificial intelligence, or machine learning method to detect the view in the ultrasound video loop.

8. The method according to claim 1, further comprising the following step: - Detect anomalies in the ultrasound video loop; as well as - Provides an indication of the anomaly on the organ icon associated with the thumbnail image.

9. The method of claim 8, wherein the step of detecting the abnormality in the ultrasound video loop comprises implementing at least one of an algorithm, artificial intelligence, or machine learning method to detect the abnormality in the ultrasound video loop.

10. The method according to claim 9, further comprising the following step: - Create searchable information related to the one or more organs detected in the ultrasound video loop; as well as - The search-identifiable information is stored in an electronic memory in association with the ultrasound video loop and the thumbnail image with the organ icon.

11. An imaging system for displaying an image acquired by the imaging system on a display, the imaging system comprising: - An imaging probe, the imaging probe being adapted to acquire image data about the object to be imaged; - A processor operatively connected to the probe to form an ultrasound video loop from the image data and to form a thumbnail image representing the ultrasound video loop; and - A display, operatively connected to the processor, for presenting the ultrasound video loop on the display. The processor is configured to implement at least one of an algorithm, artificial intelligence, or machine learning method to detect one or more organs in the ultrasound video loop, select organ icons representing the one or more organs detected in the ultrasound video loop, and display the organ icons associated with the thumbnail image of the ultrasound video loop on the display. The processor is configured to select a multi-organ icon if more than one organ is detected in the ultrasound video loop. The multi-organ icon is a periodic loop that displays the organ icon corresponding to each detected organ.

12. The imaging system of claim 11, wherein the processor is configured to determine whether the percentage of the total number of frames in the ultrasound video loop in which the one or more organs are detected exceeds a predetermined threshold.

13. The imaging system of claim 11, wherein the processor is configured to implement at least one of an algorithm, artificial intelligence, or machine learning method to detect views associated with the organ in the ultrasound video loop and modify the organ icon using indications of the views.

14. The imaging system of claim 11, wherein the processor is configured to implement at least one of an algorithm, artificial intelligence, or machine learning method to detect one or more anomalies in the ultrasound video loop and modify the organ icon using indications of the one or more anomalies.

15. The imaging system of claim 11, wherein the imaging system includes an electronic memory, and wherein the processor is configured to create search-identifiable information associated with the one or more organs detected in the ultrasound video loop, and to store the search-identifiable information in the electronic memory in association with the ultrasound video loop and the thumbnail image having the organ icon.

16. An imaging system for displaying an image acquired by the imaging system on a display, the imaging system comprising: - An imaging probe, the imaging probe being adapted to acquire image data about the object to be imaged; - A processor operatively connected to the probe to form an ultrasound video loop from the image data and to form a thumbnail image representing the ultrasound video loop; - An electronic memory, which is operatively connected to the processor; and - A display, operatively connected to the processor, for presenting the ultrasound video loop on the display. The processor is configured to implement at least one of an algorithm, artificial intelligence, or machine learning method to detect one or more organs in the ultrasound video loop, select organ icons representing the one or more organs detected in the ultrasound video loop, store thumbnails and organ icons associated with the ultrasound video loop in the electronic memory, and display the organ icons associated with the thumbnail images of the ultrasound video loop on the display. The processor is configured to select a multi-organ icon if more than one organ is detected in the ultrasound video loop. The multi-organ icon is a periodic loop that displays the organ icon corresponding to each detected organ.

17. The imaging system of claim 16, wherein the processor is configured to create search-identifiable information associated with the one or more organs detected in the ultrasound video loop, and to store the search-identifiable information in the electronic memory in association with the ultrasound video loop and the thumbnail image having the organ icon.

Images