Grouped medical image display for review

Abstract

This invention provides a system and method for performing grouped medical image display for review purposes. [Solution] Current medical image management systems generally use thumbnail image grouping of images that have the same position and side. These thumbnail images can be in large groups, making it difficult for a physician (e.g., a radiologist) to quickly find a specific view they want to review. The system and method of this disclosure allows the user to select whether to group or ungroup thumbnail images in a graphical user interface. This makes it easier for clinicians to quickly find a specific view of interest, enabling more efficient review of imaging examinations.

Description

Background Art

[0001] To diagnose a patient, medical experts often instruct imaging tests that include medical image data. These imaging tests are then read by a clinician (e.g., a radiologist) to create a reading report. For reading, the medical images for the test are displayed on the graphical user interface of a display device for the clinician to read.

[0002] In some cases, the medical images are grouped into sets, and each set is represented by a thumbnail image. This thumbnail image is provided to enable the clinician to navigate the test content. The medical images grouped into sets include images having the same imaging position (e.g., craniocaudal direction (CC), mediolateral oblique direction (MLO)) and side (e.g., left, right).

[0003] When the imaging test is generated by a mammogram, the set-grouped mammography images may include one or more X-ray projection images (also known as "2D images"), auxiliary mammography views, breast tomosynthesis series images, "synthetic" images (e.g., generated from a tomosynthesis scan), technical repeat images, and / or computer-aided diagnosis (CAD) generated images. In reviewing mammography images, the clinician can read the mammography images by comparing the left and right breast images with each other (e.g., comparing the right craniocaudal (RCC) view with the left craniocaudal (LCC) view) and / or comparing images in different directions (e.g., comparing the RCC view with the RMLO view). Furthermore, due to the grouping, it becomes difficult for the clinician to determine whether a technical repeat has occurred just by looking at the thumbnail images. As a result, the clinician may not be prompted to view specific medical images that seem beneficial for their diagnosis.

Summary of the Invention

Problems to be Solved by the Invention

[0004] To handle the display of sets containing multiple images, it is common to configure the GUI to display any additional images in the set as additional pages within the viewport. For example, if a set contains two or more images, buttons may be presented in the viewport to allow the clinician to scroll (e.g., page up, page down) between the images in that set. For large sets of images, the clinician may need to page up / down through multiple images to find a specific view. As a result, the clinician may spend a considerable amount of time completing the interpretation. Grouping images that are in the same position and on the same side can make it difficult for the clinician to quickly find a specific view they want to review from the thumbnail images. [Means for solving the problem]

[0005] A system and method for displaying grouped medical images for review are disclosed. Current medical image management systems generally use thumbnail image grouping of images having the same position and lateral view. These groups of thumbnail images are large, making it difficult for a physician (e.g., a radiologist) to quickly find a specific field of view they wish to review. The system and method of this disclosure allows the user to select whether to group or ungroup thumbnail images in a graphical user interface. This makes it easier for clinicians to quickly find a specific view of interest, enabling more efficient review of imaging examinations.

[0006] In some embodiments, the technology described herein relates to methods. The method includes the steps of: receiving an image dataset from a data source, the image dataset including projected X-ray mammography images for health management examinations; determining an ungrouped thumbnail image for each projected X-ray mammography image in the image dataset, the ungrouped thumbnail image being for display on a graphical user interface of a display device; grouping the images in the image dataset into sets; determining a set-grouped thumbnail image for each set of grouped images, the set-grouped thumbnail image being for display on a graphical user interface; generating a graphical user interface, which includes displaying at least one of the set-grouped thumbnail images or the ungrouped thumbnail image on the graphical user interface; receiving user input to a user interface element; and, in response to receiving user input to a user interface element, switching the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images, or from displaying ungrouped thumbnail images to display set-grouped thumbnail images on the graphical user interface.

[0007] In some embodiments, the technology described herein relates to a medical image management system. This medical image management system comprises a network communication interface for receiving health management test results, a memory connected to the network communication interface for storing the received health management test results, a display screen connected to the memory for displaying the received health management test results, and one or more processors connected to the network communication interface, the memory, and the display screen. The one or more processors are configured to receive an image dataset containing projected X-ray mammography images for health management examinations from a data source, determine an ungrouped thumbnail image for each projected X-ray mammography image in the image dataset to be displayed on the graphical user interface of a display device, group the images in the image dataset into multiple sets, determine a set-grouped thumbnail image for each set of grouped images to be displayed on the graphical user interface, generate a graphical user interface that includes displaying at least one of the set-grouped thumbnail image or the ungrouped thumbnail image, receive user input to user interface elements, and in response to the receipt of user input to user interface elements, switch the graphical user interface from displaying the set-grouped thumbnail image to displaying the ungrouped thumbnail image, or switch the graphical user interface from displaying the ungrouped thumbnail image to displaying the set-grouped thumbnail image.

[0008] In some embodiments, the technology described herein relates to a non-temporary computer-readable storage medium on which instructions are stored. When executed by a system having at least one processor, memory, and a display screen, the instructions include: receiving an image set from a data source, the image set including projected X-ray mammography images for a health examination; determining a non-grouped thumbnail image for each projected X-ray mammography image in the image set, the non-grouped thumbnail image being for display on a graphical user interface of a display device; grouping the images in the image set into a plurality of sets; determining a set-grouped thumbnail image for each set of grouped images, the set-grouped thumbnail image being for display on a graphical user interface; and set-grouped thumbnail The method includes the steps of generating a graphical user interface which includes displaying at least one set grouped thumbnail image or an ungrouped thumbnail image in the graphical user interface; receiving user input to a user interface element; and, in response to receiving user input to a user interface element, switching the graphical user interface from displaying a set grouped thumbnail image to displaying an ungrouped thumbnail image, or switching the graphical user interface from displaying an ungrouped thumbnail image to displaying a set grouped thumbnail image in the graphical user interface.

[0009] This summary is intended to introduce a simplified concept for grouped medical image display for review, which is further explained in the following detailed description and illustrated in the drawings. This summary is not intended to identify the essential features of the subject matter of the claims, nor to be used to determine the scope of the subject matter of the claims.

[0010] The attached drawings illustrate examples and are therefore exemplary embodiments; they should not be considered to limit the scope of the claims. [Brief explanation of the drawing]

[0011] [Figure 1] This document provides an exemplary environment of a medical image management system in which aspects of the system and method of displaying grouped medical images for review are implemented. [Figure 2] This is a block diagram showing an example of a computer system architecture for displaying grouped medical images for review. [Figure 3] Examples of graphical user interface displays that can be used in the systems shown in Figures 1 and 2 for grouped medical image display for review are shown in several embodiments. [Figure 4] Examples of graphical user interface displays that can be used in the systems shown in Figures 1 and 2 for grouped medical image display for review are shown in several embodiments. [Figure 5] One or more embodiments of a method for displaying grouped medical images for review are shown. [Figure 6] This document illustrates one example of the logical representation of a medical image management system for displaying grouped medical images for review. [Modes for carrying out the invention]

[0012] Overview Disclosed is a system and method for displaying grouped medical images for review. By using the improved system and method described herein, clinicians (e.g., radiologists) can quickly find medical image data (e.g., mammography images) necessary to complete a review, thereby reducing the time required for the review, improving the clinician's user experience, enabling clinicians to work more efficiently, and improving the timeliness of patient care.

[0013] To diagnose a patient, medical professionals (e.g., physicians) often order imaging tests (e.g., health checkup tests) to image body parts (e.g., breasts, pelvis, chest). This generates medical image data, which clinicians use to prepare interpretation reports. For example, in screening mammography, an X-ray imaging device is used to generate mammography images of the breast. Mammography images may include one or more projected X-ray images (also known as "2D images") of the breast taken from different positions (e.g., craniocaudal (CC), medial-lateral oblique (MLO)) and sides (e.g., left, right). In some cases, multiple images may be generated for the same position and / or the same side.

[0014] Imaging examinations (e.g., mammography) may include images other than projected X-ray images. In the first example, existing images (e.g., 2D images) can be used with image processing applications to generate computer-generated images that highlight target tissue within the 2D images. In the second example, a series of images from breast tomosynthesis may be taken. In the third example, composite images (e.g., computer-generated images from tomosynthesis scans) can be obtained. In the fourth example, technical repeat images taken with varying degrees of breast compression may be taken. For example, if a technician operating the imaging device determines that the acquired mammography image is unsuitable (e.g., there are visible skin folds, poor tissue visualization, or motion blur), the technician may take one or more additional mammography images to avoid calling the patient back for further imaging. In the fifth example, supplementary mammography views (e.g., lateral eccentric head-to-tail (XCCL), medial eccentric head-to-tail (XCCM), medial-lateral (LM), etc.) may be acquired. In the sixth example, mammography images for examination may be analyzed via computer-aided diagnosis (CAD) (e.g., computer-aided detection (CADe)) to generate annotated mammography images for imaging examination (e.g., CAD-generated images).

[0015] Mammography images for examination are displayed on a graphical user interface (GUI) of a display device (e.g., a display monitor) for the clinician's interpretation. In one example, the GUI includes four viewports in a 2x2 grid, consisting of an upper-left viewport, lower-left viewport, upper-right viewport, and lower-right viewport. In such an exemplary configuration, images are stacked horizontally for each imaging position (view) and vertically for each side (lateral orientation). During review, the clinician can interpret the mammography images by comparing the right breast image with the left breast image (e.g., by comparing the RCC view with the LCC view), and / or by comparing images from different orientations (e.g., by comparing the RCC view with the RMLO view).

[0016] Mammography images are grouped into sets, each containing one or more image series. Mammography images grouped into a set include images from the same imaging location (e.g., CC, LMO) and side (e.g., left, right). In this way, set-grouped images may include 2D images, auxiliary mammography views, tomosynthesis series images, composite images, technically repeated images, and / or computer-aided diagnostic (CAD) generated images. Images grouped together (e.g., views) may represent different image series (e.g., 2D image series, tomosynthesis image series, composite image series, technically repeated series). Each set grouping is represented on the GUI by a thumbnail image (also referred to herein as a “thumbnail”). The term “thumbnail image” broadly refers to images of reduced display size (e.g., miniature images, images identical except for scale, reduced-resolution images, cropped images, symbols, icons, simplified depictions, line drawings, etc.).

[0017] Thumbnails are provided to help clinicians navigate the examination content. Set grouping is typically provided to reduce the number of steps in the interpretation protocol for reading images and to display mixed sets of images from different mammography image series in the viewport. However, as a result of set grouping of images with the same position and side, it may be difficult for clinicians to quickly find a specific view of interest during review via thumbnail image navigation. Furthermore, typical set grouping may make it difficult for clinicians to identify technical repetitions at a glance of the thumbnails. Consequently, clinicians may not be prompted to view specific mammography images that would be beneficial to their diagnosis.

[0018] In contrast, the systems and methods for displaying grouped medical images for review in this disclosure enable clinicians to quickly find and view the images necessary to complete a review. For example, instead of traversing the interpretation protocol and viewing a series of images using page-up / page-down scrolling, clinicians can ungroup the thumbnail images to find the thumbnail image they are looking for and view it in the viewport (for example, by dragging and dropping the thumbnail into the viewport). In this way, clinicians can more easily get an overview of the test results, thereby reducing the time required for review, improving the clinician's user experience, enabling them to work more efficiently, and improving the timeliness of patient care.

[0019] In the following description, a more complete description will be provided in detail of the grouped medical image display system and method for review of the present disclosure, which may be implemented by a medical image management system. However, it will be apparent to those skilled in the art that the disclosed system and method are executable without these specific details. In other examples, well-known structures and devices are shown in block diagrams rather than in detail, so as not to obscure the disclosed system and method. The subject matter of the embodiments of the system and method of the present disclosure for grouped medical image display for review is described herein in detail to satisfy statutory requirements. However, the description itself is not intended to limit the scope of the invention. Rather, the inventors envision that the claimed subject matter may also be embodied in other forms and, in combination with other current or future technologies, may include other steps or combinations of steps similar to those described herein.

[0020] Having already briefly described the outline of the system and method of displaying grouped medical images for review, several embodiments will be discussed with reference to Figures 1 to 6. environment

[0021] Referring generally to the drawings, and particularly to FIG. 1 at first, a medical image management system environment 100 is shown in which aspects of the disclosed system and method can be implemented. The illustrated environment 100 is merely an example of one suitable computer environment and is not intended to suggest any limitation as to the scope of use or functionality of the disclosed system and method. It will be understood by those skilled in the art that the environment 100 should not be construed as having any dependency or requirement related to any single component or combination of components shown herein. The disclosed system and method are operable in various general-purpose or special-purpose computer system environments or configurations. Examples of well-known computer systems, environments, and / or configurations suitable for use with the disclosed system and method include, by way of illustration, personal computers, server computers, handheld devices, laptop devices, multiprocessor systems, microprocessor-based systems, programmable consumer electronics, network personal computers, minicomputers, mainframe computers, distributed computer environments including any of the above systems or devices, and the like.

[0022] Aspects of the disclosed system and method can be described in the general context of computer-executable instructions, such as program modules, configured for computer execution. Generally, program modules include routines, programs, objects, components, and data structures that perform particular tasks or implement particular abstract data types, but are not limited thereto. The disclosed system and method can also be executed in a distributed computer environment where tasks are performed by remote processing devices linked through a communications network. In a distributed computer environment, program modules can be located in local and / or remote computer storage media including, by way of example, memory storage devices.

[0023] Continuing to refer to FIG. 1, an exemplary medical image management system environment 100 includes a general-purpose computer device in the form of a control server 110. The components of the control server 110 may include, without limitation, a processing unit, an internal system memory, and a suitable system bus that couples various system components including a database cluster 120 to the control server 110. The system bus may be any of a plurality of types of bus structures that use any of various bus structures such as a memory bus or memory controller, a peripheral bus, and a local bus. Such structures may include, by way of example and not limitation, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus, also known as a Mezzanine bus.

[0024] The control server 110 may contain or access various computer-readable storage media (e.g., a database cluster 120). Computer-readable storage media are any available media accessible by the control server 110, and may include volatile and non-volatile media, as well as removable and non-removable media. For example, but not limited to, computer-readable storage media may include computer storage media. Computer storage media may include, but are not limited to, volatile and non-volatile media, as well as removable and non-removable media, implemented in any way or technique for storing information such as computer-readable instructions, data structures, program modules, or other data. In this regard, computer storage media may include, but are not limited to, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage devices, magnetic cassettes, magnetic tapes, magnetic disk storage devices, or other magnetic storage devices, or any other media that can be used to store desired information and are accessible by the control server 110. Examples of communication media, though not limited to these, include wired media such as wired networks and direct wired connections, and wireless media such as acoustic, radio frequency (RF), infrared, and other wireless media. Any combination of the above may also be included within the scope of computer-readable storage media.

[0025] The computer storage medium described above, and shown in Figure 1, including the database cluster 120, provides storage for computer-readable instructions, data structures, program modules, and other data for the control server 110. The control server 110 can operate on the computer network 130 using logical connections to one or more remote computers (e.g., remote computer 140, remote computer 140', remote computer 140”). Remote computers can be located in various locations within a medical or research environment. This includes, but is not limited to, clinical laboratories (e.g., molecular diagnostic laboratories), hospitals and other inpatient facilities, veterinary environments, outpatient facilities, medical billing and finance offices, hospital administrative facilities, home healthcare environments, and clinics. Remote computers can also be physically located in non-traditional healthcare environments, enabling the integration of the entire healthcare management community via the network. Remote computers can be personal computers, servers, routers, network personal computers, peer devices, and other common network nodes, and may include some or all of the elements described above in relation to the control server 110. The devices may be personal digital assistants (PDAs) or other similar devices.

[0026] The exemplary computer network 130 may include, but is not limited to, a local area network (LAN) and / or a wide area network (WAN). Such network environments are common in offices, enterprise-wide computer networks, intranets, and the internet. When used in a WAN network environment, the control server 110 may include a modem or other means for establishing communication over the WAN, such as the internet. In the network environment, program modules or parts thereof may be stored in relation to the control server 110, in relation to the database cluster 120, or in relation to one or more remote computers (e.g., remote computer 140). For example, but not limited to, various application programs can reside in memory related to one or more remote computers. The network connection shown in the figure is an example, and it will be understood by those skilled in the art that other means are available for establishing communication links between multiple computers (e.g., the control server 110 and remote computer 140).

[0027] Clinicians include, but are not limited to, one or more treating physicians, intensive care specialists, surgeons, radiologists, cardiologists, oncologists and other specialists, emergency medical technicians, medical assistants, specialized nurses, nurses, assistant nurses, pharmacists, dietitians, microbiologists, laboratory specialists, laboratory technicians, radiologic technologists, researchers, veterinarians, and students. During operation, clinicians can input or transmit commands and information to the control server 110 via one or more remote computers (e.g., remote computer 140, remote computer 140', remote computer 140") through input devices such as keyboards, pointing devices (commonly called mice), trackballs, touchpads, and touchscreens. Other input devices may include, but are not limited to, microphones, scanners, and motion sensors. Commands and information may also be transmitted directly from the remote health management device to the control server 110. The control server 110 and / or remote computers (e.g., remote computer 140) may include other peripheral output devices such as speakers and printers.

[0028] Other internal components of the control server 110 and the remote computers (e.g., remote computer 140, remote computer 140', remote computer 140") are not shown, but those skilled in the art will understand that such components and their interconnections are well known. Therefore, no further details regarding the internal structure of the control server 110 and the remote computers are disclosed herein.

[0029] Figure 2 shows a block diagram of an example computer system architecture for displaying grouped medical images for review on, for example, a display device of a display component. It will be understood that the computer system architecture for computer system 200 shown in Figure 2 is merely an example of one suitable computer system and is not intended to have any dependencies or requirements relating to any single module / component or combination of multiple modules / components.

[0030] In one embodiment, the computer system 200 includes an examination display module 202 and one or more data sources (e.g., a database cluster 120) which include at least one image dataset of medical images for health management examinations (e.g., projected X-ray images, projected X-ray mammography images, computer-generated images, tomosynthesis images related to projected X-ray images, technical repetition images, auxiliary mammography view images, CAD-generated images, thumbnail images, etc.). The embodiments in Figures 3 to 5 describe and display health management examination information including mammography images, but in other embodiments, health management examination information may include non-mammography images.

[0031] In one example, the data sources may include at least one database 230 that stores and maintains current health management examinations, including current medical images; a database 232 that stores and maintains existing (past) health management examinations; and / or a database 234 that stores and maintains findings ("automated image analysis findings") resulting from applying one or more automated image analysis algorithms (e.g., artificial intelligence (AI) analysis algorithms) to images of current health management examinations (e.g., those stored in database 230). The data sources may include image or other examination data (e.g., medical parameter values) linked to the patient's electronic medical record (EMR). As used herein, the acronym "EMR" is not limiting and may broadly refer to any or all aspects of a patient's digitized medical record. Generally, the EMR is supported by a system configured to coordinate the storage and retrieval of personal records with the help of a computer device. As a result, a wide range of health management-related information is thus stored and accessible. One or more data sources may be kept separately. Two or more data sources may be integrated. In some embodiments, the data sources (e.g., database 230, database 232, database 234) may be a picture archiving and communication system (PACS), a vendor-neutral archive (VNA), another repository system, or another database system. The data sources may also span multiple facilities and / or locations. A single database may contain one or more other databases.

[0032] In one embodiment, a health management examination includes medical images and examination data (e.g., health management examination information). The health management examination information may include values ​​of one or more medical parameters related to the health management examination (e.g., parameter values, measured values, findings, impressions, patient demographic information, medical history / risk factors). The medical images of a health management examination may include radiographic images (e.g., mammography images), examination images, photographs, cardiovascular images (e.g., echocardiogram images), and other health management images (e.g., medical image data). A health management examination includes one or more series of one or more medical images, and the series of images may include one or more images depicting the subject of the image from various angles.

[0033] The computer system 200 includes an inspection display module 202, which includes one or more of the following: an image analysis component 210, a selection component 212, a layout generation component 214, a display manager 216, a display component 218, and an input component 220. The inspection display module 202 can reside on one or more computer devices (for example, the control server 110 described with reference to Figure 1). In one exemplary embodiment, the control server 110 includes one or more computer processors and may be a server, a personal computer, a desktop computer, a laptop computer, a handheld device, a mobile device, a consumer electronics device, etc.

[0034] The image analysis component 210 (e.g., an AI analysis component) can perform image analysis on health management examinations (e.g., medical image data stored in database 230) and generate automated image analysis findings (e.g., computer-aided detection results). The automated image analysis findings can be sent for clinician review and / or stored in a data source (e.g., database 234) for later access. Image analysis can operate one or more artificial intelligence (AI) engines and / or one or more automated image analysis algorithms running on a server (e.g., the control server 110 mentioned above, see Figure 1) to generate results showing the findings of those algorithms. The automated image analysis findings may include images from the analyzed health management examinations, or parts thereof, related to the patient's diagnosis or condition. The image analysis component 210 can analyze medical image data and mark recognized latent features within the medical image data, for example, by using one or more markers (e.g., tags, icons, arrows, pointers), to generate annotated image data (e.g., CAD-generated images) for clinician review. Thus, annotated image data can include inspection images annotated with markers to generate annotated images, or overlays containing markers displayed on top of inspection images.

[0035] The examination display module 202 can receive health management examination information (e.g., medical images) from a data source (e.g., a database via a link in the patient's EMR). For example, the selection component 212 can select health management examination information from a first data source, and the examination display module 202 can receive it. Health management examinations may include at least one current health management examination or one or more past health management examinations. Health management examination information may include annotated image data.

[0036] The selection component 212 is configured to select a health management test and is capable of accessing a data source (e.g., a database) to receive it. The selected health management test may include one or more pieces of information related to the health management test (e.g., health management test information). Health management test information may include, but is not limited to, (i) medical images (e.g., X-rays, mammograms, thumbnail images, computed tomography (CT) scans, magnetic resonance imaging (MRI), positron tomography (PET) scans, ultrasound images), (ii) computer-aided detection results, (iii) clinician annotations for one or more medical images, and / or (iv) medical records corresponding to one or more subjects for one or more medical images. Medical records may include other test data, e.g., medical parameter values ​​related to the health management test (e.g., measurements, findings, impressions, patient demographic information, and medical history / risk factors).

[0037] The selection component 212 can group one or more medical images into a set. For example, the selection component 212 may group medical images of a body part (e.g., breast) into sets based on the same imaging location (e.g., CC, LMO) and side of the body (e.g., left, right). In one example, right CC images are grouped into the RCC group, left CC images into the LCC group, right MLO images into the RMLO group, and so on. In another example, the selection component 212 may group medical images for imaging a body part into sets based on images generated during the same compression procedure during the examination (e.g., identical compression of the breast between the compression paddle and the imaging table). As a result of the grouping, the set-grouped mammography images may include 2D images, auxiliary mammography views, images from a tomosynthesis series of the breast, composite images, technical repeat images, and / or CAD-generated images from the same imaging location and / or the same side. The selection component 212 can extract features from image metadata (e.g., attributes of digital imaging and communications (DICOM) in medical applications, medical image data, image information received from an imaging device) and determine appropriate set grouping of medical images.

[0038] Using the received health management examination information, the layout generation component 214 can generate a display layout (e.g., a layout) for displaying mammography images on the graphical user interface (GUI) on the display device of the display component 218. The display layout may include two or more types of projections to provide a side-by-side comparison of projections. In one example, as shown in the embodiments of Figures 3 and 4, the display layout includes four viewports in a 2x2 grid for displaying health management examination information (e.g., mammography images). In such a configuration, the 2x2 grid includes an upper-left viewport, a lower-left viewport, an upper-right viewport, and a lower-right viewport. In such an exemplary configuration, the images are stacked horizontally for each acquisition position (view) and vertically for each side (laterality).

[0039] The display layout may include the display of at least one thumbnail image configured to allow clinicians to navigate the contents of health management examinations. The thumbnail image may be received from a data source (e.g., database cluster 120) and generated from medical image data (e.g., mammography images) by the layout generation component 214. When displayed in a GUI (e.g., within the user interface elements described later), the thumbnail image may include a numerical index representing the total number of images in the set represented by the thumbnail.

[0040] Thumbnail images can be displayed in the user interface elements of the GUI (e.g., the thumbnail bar element described below). When one or more thumbnail images are selected (e.g., by a clinician), it can result in a change in the display layout, for example, the display of one or more medical images in the GUI (e.g., in the GUI's viewports). For example, in a GUI containing four viewports in a 2x2 grid, if four thumbnails representing the first set (e.g., RCC), second set (e.g., LCC), third set (e.g., RMLO), and fourth set (e.g., LMLO) are selected, the images of the first set will be displayed in the top-left viewport, the images of the second set in the top-right viewport, the images of the third set in the bottom-left viewport, and the images of the fourth set in the bottom-right viewport. Clinicians can select thumbnail images by dragging and dropping them to perform comparison actions. For example, a clinician can select thumbnail images by dragging and dropping them into a viewport, and display the images or sets of images represented by the thumbnails on the GUI (e.g., in one or more viewports) for comparison with other viewport displays. To reverse this comparison process, the clinician can simply drag the thumbnail image back onto a GUI user interface element.

[0041] The layout generation component 214 utilizes set grouping by the selection component 212 to generate a display layout for the grouped thumbnail image mode of set grouped thumbnail images for the current health management examination. In a first embodiment of the grouped thumbnail image mode, the layout generation component 214 generates a display layout that includes grouping thumbnail images based on grouping by the selection component 212 (grouping into sets by the same image position (e.g., CC, LMO) and side of the body (e.g., left, right)). In such an example, the thumbnail images displayed in a user interface element (e.g., a thumbnail bar element) may include right craniocaudal (CC) views grouped together by RCC thumbnails (e.g., first and second RCC views), right endolateral oblique (MLO) views grouped together by RMLO thumbnails (e.g., first and second RMLO views), right endolateral oblique (MLO) composite views grouped together by RMLO composite view thumbnails (e.g., first and second RMLO composite views), and so on. In a second embodiment of the grouped thumbnail image mode, the display layout can further group side views (e.g., left and right) to group by imaging position. For example, left and right head-to-tail (CC) views (e.g., first and second LCC and RCC views) may be grouped together by LCC / RCC thumbnails, left and right medio-exo-oblique (MLO) views (e.g., first and second LMLO and RMLO views) may be grouped together by LMLO / RMLO thumbnails, left and right medio-exo-oblique (MLO) composite views (e.g., first and second LMLO and RMLO composite views) may be grouped together by LMLO and RMLO composite view thumbnails, and so on.

[0042] The layout generation component 214 further generates a display layout for the ungrouped thumbnail image mode. In the ungrouped thumbnail image mode, the display layout includes the display of ungrouped thumbnail images for the current health management examination. For example, in the ungrouped thumbnail image mode, a first RCC thumbnail for the first RCC image, a second RCC thumbnail for the second RCC image, a first RMLO thumbnail for the first RMLO image, a second RMLO thumbnail for the second RMLO image, etc., can be presented in the GUI. In the ungrouped thumbnail image mode, images from the tomosynthesis series may remain grouped together in a set-grouped tomosynthesis image based, for example, on the same acquisition position and side.

[0043] The display layout generated by the layout generation component 214 may include user interface elements configured for displaying thumbnail images, hereinafter referred to as thumbnail bar elements. In several embodiments, the thumbnail bar elements may be one or more of the following: image sliders, image carousels, carousel sliders, slider bars, slide panels, galleries, slideshows, etc. The thumbnail bar elements may be configured to move automatically for navigation (e.g., slide, rotate), or to be manually navigated by the user (e.g., from left to right) without navigating away from an inspection view such as a GUI. The user can interact with the thumbnail bar elements to navigate the thumbnail images (e.g., by swiping on a touchscreen display, pressing arrow keys on a keyboard, using a mouse, etc.).

[0044] The display layout can display one or more images from the current examination for clinician review. The display layout can compare one or more images from the current examination with one or more images from at least one past examination. The display layout can compare one or more images from the current examination with one or more images (e.g., annotated image data) generated by the layout generation component 214, which include automated image analysis findings for the current examination. In one embodiment, the layout generation component 214 generates a side-by-side layout within the display component, rendering the currently and previously generated examination images side by side. The display layout can define a configuration including parts of the screen layout, display context (e.g., image data, layout, image placement, image size), etc., to facilitate a structured review process.

[0045] The display manager 216 (e.g., a rendering component) receives the display layout and generates a graphical user interface (GUI) on the display device of the display component 218. The GUI can be implemented within an image viewer or an image viewer application of the display device. The GUI can be configured to display the contents of the current health checkup, including any images and findings contained therein. The display component 218 includes a display device (e.g., a monitor, computer screen, projector, or other hardware device) for displaying the display layout, which includes images and other data from the health checkup, on the GUI. For example, the remote computer 140 mentioned above with reference to Figure 1 may include a display component having a display device. The display component 218 displays the display layout generated by the display manager 216 on the GUI of the display device, for example, on the GUI 252 of the display device 250 of the remote computer 140 shown in Figure 2.

[0046] The display layout generated by the layout generation component 214 may further include user interface elements that enable user interaction with the GUI using the input component 220 (e.g., a user interface input device). The input component 220 can receive user input from a user (e.g., a clinician) and modify the user interface (e.g., the display layout). For example, the input component 220 can receive user input from a user via a grouping selection user interface element and switch (e.g., toggle) the GUI (via the display manager 216) between grouped and ungrouped thumbnail image modes (e.g., from grouped thumbnail image mode to ungrouped thumbnail image mode, and from ungrouped thumbnail image mode to grouped thumbnail image mode). User input can be received from a user interface input device (e.g., a keyboard, keypad, mouse, etc.). In one example, the input device is a keyboard 254 on a remote computer 140. User input received by the input component 220 may include commands invoked by the clinician to modify the user interface (e.g., the display layout). Examples of commands invoked by clinicians include button presses, keyboard keystrokes, mouse clicks, and voice input. In one example, the command is a mouse click on a user interface element.

[0047] If the display layout is in grouped thumbnail image mode, the display manager 216 can switch the graphical user interface from grouped thumbnail image mode to ungrouped thumbnail image mode in response to receiving user input to change the user interface (e.g., display layout). If the display layout is in ungrouped thumbnail image mode, the display manager 216 can switch the graphical user interface from ungrouped thumbnail image mode to grouped thumbnail image mode in response to receiving user input to change the user interface (e.g., display layout).

[0048] Figure 3 shows an example of a graphical user interface (GUI 300) that may be used for grouped medical image display for review in the systems of Figures 1 and 2, in several embodiments. In part of the following discussion, the exemplary system environment 100 of Figure 1 and / or entities or processes detailed in Figures 1 and 2 may be referenced; however, these references are for illustrative purposes only. As discussed with respect to the computer system 200 of Figure 2, a test display module (e.g., test display module 202) receives selected health management test information about health management tests from a data source. The health management test information is selected by a selection component (e.g., selection component 212). Using the selected health management test information, a layout generation component (e.g., layout generation component 214) generates at least one display layout for displaying one or more medical images (e.g., mammography images) of the current health management test on the GUI (e.g., GUI 300) of a display device (e.g., display device 250 of remote computer 140). The display manager (for example, display manager 216) receives the display layout and generates a GUI on the display device. This GUI is then displayed to the clinician for review.

[0049] In Figure 3, the exemplary GUI 300 includes four viewports in a 2x2 grid for displaying health management examination information (e.g., mammography images). In such a configuration, the 2x2 grid includes the upper-left viewport 302, the lower-left viewport 304, the upper-right viewport 306, and the lower-right viewport 308. Depending on the embodiment, there may be more or fewer viewports for medical images of health management examinations. In the exemplary configuration of Figure 3, images are stacked horizontally for each acquisition position (view) and vertically for each side (laterality). In the exemplary GUI 300, the upper-left viewport 302 displays the right craniocaudal (CC) view 312 from the examination, the lower-left viewport 304 displays the right mediolateral oblique (MLO) view 314, the upper-right viewport 306 displays the left CC view 316, and the lower-right viewport 308 displays the left MLO view 318. These are merely examples of projections that may exist in the display layout for examinations shown in the exemplary GUI.

[0050] The GUI 300 includes the display of at least one thumbnail image in the thumbnail bar element 330. The presence of thumbnail images enables clinicians to navigate to the content of health management examinations. Figure 3 shows the grouped thumbnail image mode, where one or more medical images of an examination are grouped into sets (e.g., by the selection component 212), and each set is represented by a thumbnail image displayed in the thumbnail bar element 330. For example, if there are multiple medical images of a body part (e.g., breast), they can be grouped into sets by the same imaging location (e.g., CC, LMO) and side of the body (e.g., left, right). In this example, the right esolateral oblique (RMLO) view is grouped together by the RMLO thumbnail 332, the left esolateral oblique (LMLO) view is grouped together by the LMLO thumbnail 334, the right craniocaudal (RCC) view is grouped together by the RCC thumbnail 336, the left craniocaudal (LCC) view is grouped together by the LCC thumbnail 338, the RMLO composite view is grouped together by the RMLO composite view thumbnail 340, the LMLO composite view is grouped together by the LMLO composite view thumbnail 342, the RCC composite view is grouped together by the RCC composite view thumbnail 344, the LCC composite view is grouped together by the LMLO composite view thumbnail 346, and so on. Other thumbnail groups may exist in the thumbnail bar element 330, but they are not visible in the GUI 300 shown in Figure 3. Navigation elements (e.g., elements 320 and 322) may be presented for navigation of the content of thumbnail bar element 330 (e.g., for accessing other thumbnail images). Images grouped together (e.g., views) may represent different image series (e.g., 2D image series, tomosynthesis image series, technical iteration series).

[0051] When displayed in GUI300, thumbnail images may include a numerical index representing the total number of images and / or series grouped into the set represented by the thumbnail. For example, RMLO thumbnail 332 includes the numerical index "2," indicating that this group includes a first RMLO image and a second RMLO image (e.g., a 2D image and a technical iteration). Similarly, LMLO thumbnail 334, RCC thumbnail 336, and LCC thumbnail 338 also include the numerical index "2." In contrast, RMLO composite view thumbnail 340, LMLO composite view thumbnail 342, RCC composite view thumbnail 344, and LMLO composite view thumbnail 346 each include the numerical index "9," indicating that each thumbnail represents nine composite tomosynthesis images.

[0052] The selection of one or more thumbnail images (e.g., by a clinician) can result in a change in the display layout. When one or more thumbnails are selected, one or more images are displayed in the GUI (e.g., the GUI's viewports). For example, in a GUI with four viewports in a 2x2 grid (e.g., GUI300 in Figure 3), if four thumbnails representing the first set (e.g., RCC), the second set (e.g., LCC), the third set (e.g., RMLO), and the fourth set (e.g., LMLO) are selected, the images of the first set will be displayed in the top-left viewport, the second set in the top-right viewport, the third set in the bottom-left viewport, and the fourth set in the bottom-right viewport. If a set contains two or more images, a UI element (e.g., a next page selector) may be presented to allow the clinician to scroll between images in the set.

[0053] While reviewing medical images displayed on GUI300, the clinician can provide user input to modify the GUI (e.g., via input component 220). For example, this could involve providing input to a group selection user interface element 350 (e.g., a button in the GUI) to switch the GUI between grouped thumbnail image mode and ungrouped thumbnail image mode (e.g., from grouped thumbnail image mode to ungrouped thumbnail image mode, and from ungrouped thumbnail image mode to grouped thumbnail image mode). When the display layout is in grouped thumbnail image mode, the display manager (e.g., display manager 216) can switch the GUI from grouped thumbnail image mode (shown in Figure 3) to ungrouped thumbnail image mode (shown in Figure 4) in response to receiving user input to modify the user interface.

[0054] Figure 4 shows an example of a graphical user interface (GUI 400) that may be used for grouped medical image display for review in the systems of Figures 1 and 2, in several embodiments. In some parts of the following discussion, the exemplary system environment 100 of Figure 1, and / or entities or processes detailed in Figures 1 and 2 may be referenced; however, these references are for illustrative purposes only. As discussed with respect to the computer system 200 of Figure 2, the examination display module (e.g., examination display module 202) receives selected health management examination information from a data source. The health management examination information is selected by a selection component (e.g., selection component 212).

[0055] Using the selected health management examination information, a layout generation component (e.g., layout generation component 214) generates at least one display layout for displaying one or more medical images (e.g., mammography images) of the current health management examination on the GUI of a display device (e.g., display device 250 of remote computer 140). A display manager (e.g., display manager 216) receives the display layout and generates a GUI on the display device. This displays the GUI for review to the clinician. GUI 400 is similar to GUI 300 shown in Figure 3 and described above, except for the points detailed below. Thus, GUI 400 includes an upper-left viewport 402, a lower-left viewport 404, an upper-right viewport 406, a lower-right viewport 408, navigation elements 420 and 422, a thumbnail bar element 430, and a grouping selection user interface element 450. In the illustrative GUI 400, the upper left viewport 402 displays the right craniocaudal (CC) view 412 from the examination, the lower left viewport 404 displays the right mediolateral oblique (MLO) view 414, the upper right viewport 406 displays the left CC view 416, and the lower right viewport 408 displays the left MLO view 418.

[0056] Figure 4 shows the ungrouped thumbnail image mode, where the thumbnail images displayed in the thumbnail bar element 430 do not reflect the medical images of this examination that have been grouped into sets (e.g., by the selection component 212). In such a mode, if there are multiple medical images of a body part (e.g., breast), they are not grouped into sets by the same imaging location (e.g., CC, LMO) and side of the body (e.g., left, right). In this example, the right esolateral oblique (RMLO) view is not grouped and is represented by the first RMLO thumbnail 432 and the second RMLO thumbnail 434; the left esolateral oblique (LMLO) view is not grouped and is represented by the first LMLO thumbnail 436 and the second LMLO thumbnail 438; the right craniocaudal (RCC) view is not grouped and is represented by the first RCC thumbnail 440 and the second RCC thumbnail 442; and the left craniocaudal (LCC) view is not grouped and is represented by the first LCC thumbnail 444 and the second LCC thumbnail 446. Further thumbnails and / or thumbnail groups may exist in the thumbnail bar element 430, but they are not visible in the GUI 400 shown in Figure 4.

[0057] When displayed in GUI400, thumbnail images may include a numerical index representing the total number of images and / or series grouped into the set represented by the thumbnail. For example, the first RMLO thumbnail 432, the second RMLO thumbnail 434, the first LMLO thumbnail 436, the second LMLO thumbnail 438, the first RCC thumbnail 440, the second RCC thumbnail 442, the first LCC thumbnail 444, and the second LCC thumbnail 446 each have a numerical index of "1". This indicates that the group (image) represented by the thumbnail contains one image.

[0058] When reviewing medical images displayed on GUI400, clinicians can provide user input to modify the GUI (e.g., via input component 220). For example, clinicians can switch the GUI between ungrouped thumbnail image mode and grouped thumbnail image mode (e.g., from grouped thumbnail image mode to ungrouped thumbnail image mode, and from ungrouped thumbnail image mode to grouped thumbnail image mode) by inputting into the grouping selection user interface element 450 (e.g., a button on the GUI). When the display layout is in ungrouped thumbnail image mode, the display manager 216 can switch the GUI from ungrouped thumbnail image mode (shown in Figure 4) to grouped thumbnail image mode (shown in Figure 3) in response to receiving user input to modify the user interface (e.g., display layout). Depending on the embodiment, a set of composite tomosynthesis images (e.g., RMLO composite view, LMLO composite view, RCC composite view, LCC composite view) may not be ungrouped by selection of the grouping selection user interface element 450. Process example

[0059] Figure 5 is a flowchart of one embodiment of a process 500 for displaying grouped medical images for review, which is performed by a medical image management system (e.g., the medical image management system environment 100 and the medical image management system 600 in Figure 1). Process 500 is performed by processing logic that may include hardware (e.g., circuits, dedicated logic), software (e.g., software running on a general-purpose computer system, software running on a dedicated machine), firmware, or a combination of two or more of these. The medical image management system may include a network communication interface configured to receive images from health management examinations, an image cache memory for temporarily storing the received images, one or more processors coupled to the network connection interface and memory and configured to display health management examination information, and a display component (e.g., a display screen) coupled to one or more processors and displaying images on a graphical user interface (GUI) of a display device.

[0060] Process 500 is presented as a set of blocks specifying the operations to be performed, but is not necessarily limited to the order or combination of operations specified by each block. Furthermore, any one or more operations can be repeated, combined, reconfigured, or concatenated to provide a wide range of additional and / or alternative methods. In some parts of the following discussion, the exemplary system environment 100 in Figure 1 and / or entities or processes detailed in Figures 1 to 4 may be referenced; however, these references are for illustrative purposes only. This technology is not limited to execution by one or more entities operating on a single device.

[0061] Referring to Figure 5, process 500 begins with the processing logic receiving an image dataset (e.g., medical images of a health checkup) from a data source (processing block 502). The image dataset may include projected X-ray images for a health checkup (e.g., projected X-ray mammography images). In one embodiment, the image dataset is transmitted to a medical image management system by the modality creating the examination. In another embodiment, the image dataset is transmitted from a medical image archive (e.g., a picture archiving and communication system (PACS) or other remote storage facility). In another embodiment, the image dataset is received via a network interface and stored in the memory of the medical image management system. The processing logic determines an ungrouped thumbnail image for each image in the image dataset (e.g., projected X-ray images, projected X-ray mammography images) (processing block 504). In another embodiment, the ungrouped thumbnail image is determined by receiving from the data source. The ungrouped thumbnail image is intended for display on the graphical user interface of a display device.

[0062] The processing logic groups the images in the image dataset into multiple sets (processing block 506). The processing logic determines a set grouping thumbnail image for each set of grouped images (processing block 508). The set grouping thumbnail images are configured to be displayed in the graphical user interface. The processing logic generates the graphical user interface and includes displaying at least one of the set grouping thumbnail images or ungrouped thumbnail images in the graphical user interface (processing block 510). The processing logic receives user input to the user interface elements (processing block 512). A grouping selection user interface element may be displayed in the graphical user interface to receive user input. The grouping selection user interface element may be configured to switch the graphical user interface from grouped thumbnail image mode to ungrouped thumbnail image mode. In response to receiving user input to a user interface element, the processing logic either (1) switches the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images (processing block 514), or (2) switches the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images (processing block 516). Examples of medical image management systems

[0063] Figure 6 shows an example of a logical representation of the medical image management system 600 for the grouped medical image display for review described above. The medical image management system 600 can be implemented by one or more of the control server 110, remote computers (e.g., remote computer 140), and / or database clusters 120 of the medical image management system environment described above with respect to Figure 1. The medical image management system 600 includes one or more processors 602 coupled to a communication interface logic 604 via a first transmission medium 606. The communication interface logic 604 enables communication with other electronic devices, specifically with remote users such as physicians, nurses, and / or medical technicians, remote databases (e.g., PACS) that store health management tests, and health management modalities that generate and transmit tests. According to one aspect of this disclosure, the communication interface logic 604 may be implemented as a physical interface including one or more ports for wired connections. Furthermore, or alternatively, the communication interface logic 604 may also be implemented as one or more wireless units that support wireless communication with other electronic devices.

[0064] The medical image management system 600 performs some or all of the processing steps of a system and method for displaying grouped medical images for review in response to the execution of one or more sequences of one or more instructions contained in memory, such as a persistent storage device 610, by a processor 602. Such instructions can be read into the persistent storage device from another computer-readable medium, such as a storage device. It is also possible to use one or more processors in a multiprocessing configuration to execute the sequence of instructions contained in the persistent storage device 610. In some embodiments, wired circuits can be used instead of or in combination with software instructions. Therefore, the embodiments are not limited to any particular combination of hardware circuits and software.

[0065] As stated above, the medical image management system 600 includes at least one computer-readable medium or memory programmed in accordance with the teachings of the System and Method of the Disclosure for displaying grouped medical images for review and for including data structures, tables, records, and other data described herein. Examples of computer-readable storage media include compact disks, hard disks, floppy disks, tapes, magneto-optical disks, PROMs (erasable programmable read-only memory (EPROM), EEPROM, flash EPROM), dynamic random access memory, static random access memory, synchronous DRAM, etc. The System and Method of the Disclosure for displaying grouped medical images for review, stored in any one or a combination thereof, includes software for controlling the medical image management system 600, driving one or more devices to implement the System and Method of the Disclosure, and enabling the Medical Image Management System 600 to interact with a human user. Such software may include, but is not limited to, device drivers, operating systems, development tools, and application software. Such computer-readable storage media further include computer program products of the disclosed system and method for performing all or (if the processing is distributed) some of the processing performed in the implementation of the disclosed system and method for displaying grouped medical images for review. The computer code device of the disclosed system and method for displaying grouped medical images for review may include, but is not limited to, any interpreted or executable code mechanism including scripts, interpreters, dynamic link libraries, Java® classes, and complete executable programs. Furthermore, some of the processing of the disclosed system and method for displaying grouped medical images for review may be distributed for better performance, reliability, and / or cost. As used herein, the term “computer-readable medium” refers to any medium involved in giving instructions for execution to the processor 602.Computer-readable media can take many forms, including but not limited to non-volatile media, volatile media, and transmission media.

[0066] The processor 602 is further coupled to a persistent storage device 610 via a transmission medium 608. The persistent storage device 610 is capable of storing information and instructions executed by the processor 602. Furthermore, the persistent storage device 610 can be used to store temporary variables or other intermediate information during the execution of instructions executed by the processor 602. According to one aspect of the present disclosure, the persistent storage device 610 may include (a) image analysis logic 612, (b) selection logic 614, (c) rendering logic 616, (d) display control logic 618, (e) image database 620, and (f) findings database 622.

[0067] Image analysis logic 612 includes logic for analyzing images from health management examinations (e.g., medical images). Image analysis may include activating one or more automated image analysis algorithms running on one or more artificial intelligence (AI) engines and / or servers to generate findings (e.g., results, outputs, annotated image data) that show the results of the algorithms. Findings may include images from the analyzed health management examination, or parts thereof, related to the patient's diagnosis or condition. Image analysis logic can sense and mark latent features in medical image data (e.g., examination images) and generate annotated image data. Image analysis logic may use one or more markers (e.g., tags, icons, arrows, pointers) to mark latent features in medical image data. Annotated image data may include examination images annotated with markers to generate annotated image data, overlays containing markers displayed on top of examination images, etc. Annotated image data can be stored in a data source.

[0068] The selection logic 614 may include logic for selecting health management tests (e.g., image datasets of medical images, thumbnail images) and accessing a data source (e.g., a database) to retrieve the selected health management tests (e.g., reading health management test information from storage for display in a graphical user interface). Health management test information may include, but is not limited to, (i) medical images including X-rays, mammograms, thumbnail images, CT scans, MRI, PET scans, and / or ultrasound images; (ii) computer-aided detection results; (iii) clinician annotations for one or more medical images; and / or (iv) medical records corresponding to one or more subjects for one or more medical images. Medical records may include other test data, such as parameter values ​​related to the health management tests (e.g., measurements, findings, impressions, patient demographic information, medical history / risk factors). For example, health management examination information may include a first image dataset containing projected X-ray mammography images and thumbnail images for health management examinations, and a second image dataset containing tomosynthesis projection images related to the projected X-ray mammography images of the examination. The first image dataset may be received from a first image data source, and the second image dataset may be received from a second image data source. The first and second data sources may be the same or different. The selection logic 614 may include logic for determining ungrouped thumbnail images for each image in the image dataset (e.g., projected X-ray images). The selection logic 614 may include logic for grouping the images in the first and / or second image datasets into multiple sets. The selection logic 614 may include logic for thumbnail image sets of the grouped images.

[0069] The rendering logic 616 may include logic for generating data for a graphical user interface (e.g., as described above). In one embodiment, the rendering logic 616 may include logic for generating a graphical user interface, which includes displaying thumbnail images in a graphical user interface, such as a thumbnail bar element configured to display thumbnail images.

[0070] The display control logic 618 receives data generated for the graphical user interface and renders the graphical user interface on the display. The display control logic 618 includes logic for displaying health management examination information on the graphical user interface. The display control logic 618 includes logic for receiving user input to user interface elements. In some embodiments, the display control logic 618 includes logic for switching the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images in response to receiving user input to user interface elements. In some embodiments, the display control logic 618 includes logic for switching (e.g., modifying) the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images in response to receiving user input to user interface elements.

[0071] The image database 620 and the findings database 622 may include a single non-temporary computer-readable media storage device, or they may each be separate non-temporary computer-readable media storage devices. The image database 620 stores health management examination information (e.g., medical images) for display in the display area of ​​an image viewer or other GUI. The findings database 622 stores automated image analysis findings (e.g., images) for display in the display area of ​​an image viewer or other GUI. Additional Examples

[0072] Some additional examples of systems and methods for displaying grouped medical images for review include the following:

[0073] Example 1. Steps include receiving an image dataset from a data source, wherein the image dataset includes projected X-ray mammography images for health management examinations; determining an ungrouped thumbnail image for each projected X-ray mammography image in the image dataset, wherein the ungrouped thumbnail image is for display on the graphical user interface of a display device; grouping the images in the image dataset into sets; determining a set-grouped thumbnail image for each set of grouped images, wherein the set-grouped thumbnail image is for display on the graphical user interface; and determining a set-grouped thumbnail image or an ungrouped thumbnail image. A method comprising the steps of: generating a graphical user interface, which includes displaying at least one thumbnail image in the graphical user interface; receiving user input to a user interface element; and, in response to receiving user input to a user interface element, switching the graphical user interface from displaying a set-grouped thumbnail image to displaying an ungrouped thumbnail image, or from displaying an ungrouped thumbnail image to displaying a set-grouped thumbnail image in the graphical user interface.

[0074] Example 2. The method of Example 1, further comprising the steps of selecting projected X-ray mammography images from an image dataset for display in a graphical user interface, and displaying the selected projected X-ray mammography images in a graphical user interface.

[0075] Example 3. The method of Example 1, wherein the step of generating a graphical user interface, which includes displaying at least one set-grouped thumbnail image or an ungrouped thumbnail image in the graphical user interface, further includes the step of generating a thumbnail bar element configured to display at least one ungrouped thumbnail image or a set-grouped thumbnail image.

[0076] Example 4. The method of Example 3, wherein the step of switching the graphical user interface from displaying set grouped thumbnail images to displaying ungrouped thumbnail images includes the steps of modifying the generated graphical user interface to display ungrouped thumbnail images within the thumbnail bar element of the graphical user interface, and displaying at least one ungrouped thumbnail image in the thumbnail bar element.

[0077] Example 5. The method of Example 3, wherein the step of switching the graphical user interface from displaying ungrouped thumbnail images in the graphical user interface to displaying set-grouped thumbnail images in the graphical user interface includes the steps of modifying the generated graphical user interface to display set-grouped thumbnail images in the thumbnail bar element of the graphical user interface, and displaying at least one set-grouped thumbnail image in the thumbnail bar element.

[0078] Example 6. The method of Example 3, wherein the image dataset is a first image dataset, and the thumbnail bar element is further configured to display tomosynthesis thumbnail images, and the method further includes the steps of receiving a second image dataset from a data source, wherein the second image dataset includes tomosynthesis projection images relating to projection X-ray mammography images of the first images of the first image dataset, grouping the images of the second image dataset into at least one series of tomosynthesis projection images, and determining a tomosynthesis thumbnail image for each series of tomosynthesis projection images to be displayed in a graphical user interface, and the step of generating a graphical user interface further includes displaying at least one tomography thumbnail image in the thumbnail bar element of the graphical user interface.

[0079] Example 7. The step of switching the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images in the graphical user interface is the method of Example 6, in which the ungrouped tomosynthesis projection image series is not displayed in the thumbnail bar element of the graphical user interface.

[0080] Example 8. The method of Example 6, wherein the image dataset is the first image dataset, and the data source for the first image dataset and the data source for the second image dataset are the same data source.

[0081] Example 9. The method of Example 1, wherein the step of grouping images of an image dataset into multiple sets further includes grouping images of the image dataset based on at least one of acquisition location and side, or compression and side; the step of determining a thumbnail image for each set of grouped images further includes generating thumbnail images that indicate grouping based on acquisition location and side; and the step of generating a graphical user interface, which includes displaying set grouped thumbnail images in a graphical user interface, further includes displaying set grouped thumbnail images that indicate grouping based on laterality and view in a graphical user interface.

[0082] Example 10. A medical image management system comprising: a network communication interface for receiving health management examination results; a memory connected to the network communication interface for storing the received health management examination results; a display screen connected to the memory for displaying the received health management examination results; and one or more processors connected to the network communication interface, memory, and display screen, wherein the one or more processors receive an image dataset containing projected X-ray mammography images for health management examinations from a data source, determine an ungrouped thumbnail image for each projected X-ray mammography image in the image dataset to be displayed on the graphical user interface of the display device, group the images in the image dataset into multiple sets, and for each set of grouped images, A medical image management system configured to determine a set grouped thumbnail image to display, generate a graphical user interface that includes displaying at least one of the set grouped thumbnail image or an ungrouped thumbnail image, receive user input to a user interface element, and in response to the receipt of user input to the user interface element, switch the graphical user interface from displaying the set grouped thumbnail image to displaying the ungrouped thumbnail image, or from displaying the ungrouped thumbnail image to displaying the set grouped thumbnail image.

[0083] The medical image management system according to Example 10, wherein the processor of Example 11.1 or higher is further configured to select projected X-ray mammography images from an image dataset for display in a graphical user interface, and to display the selected projected X-ray mammography images in the graphical user interface.

[0084] Example 12. A medical image management system according to Example 10, wherein one or more processors configured to generate a graphical user interface including displaying at least one set-grouped thumbnail image or an ungrouped thumbnail image are further configured to generate a thumbnail bar element configured to display at least one ungrouped thumbnail image or a set-grouped thumbnail image.

[0085] Example 13. A medical image management system according to Example 12, wherein one or more processors configured to switch the graphical user interface from displaying set grouped thumbnail images to displaying ungrouped thumbnail images, modify the generated graphical user interface to display ungrouped thumbnail images in the thumbnail bar elements of the graphical user interface, and further configured to display at least one ungrouped thumbnail image in the thumbnail bar elements.

[0086] Example 14. A medical image management system according to Example 12, wherein one or more processors configured to switch the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images in the graphical user interface, further configured to modify the generated graphical user interface to display set-grouped thumbnail images in the thumbnail bar elements of the graphical user interface, and to display at least one of the set-grouped thumbnail images in the thumbnail bar elements.

[0087] Example 15. A non-temporary computer-readable storage medium storing instructions, wherein when an instruction is executed by a system having at least one processor, memory, and display screen, the instructions include: receiving an image dataset from a data source, the image dataset including projected X-ray mammography images for health management examinations; determining an ungrouped thumbnail image for each projected X-ray mammography image in the image dataset, the ungrouped thumbnail image being for display on a graphical user interface of a display device; grouping the images in the image dataset into sets; and determining a set-grouped thumbnail image for each set of grouped images, the set-grouped thumbnail image being for display on a graphical user interface. A non-temporary computer-readable storage medium that causes the system to perform a method including: generating a graphical user interface, which includes displaying at least one set-grouped thumbnail image or an ungrouped thumbnail image in the graphical user interface; receiving user input to a user interface element; and, in response to receiving user input to a user interface element, switching the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images, or from displaying ungrouped thumbnail images to display set-grouped thumbnail images in the graphical user interface.

[0088] Example 16. The computer-readable storage medium described in Example 15, wherein the instruction causes the system to further perform the steps of selecting a projected X-ray mammography image from an image dataset for display in a graphical user interface, and displaying the selected projected X-ray mammography image in the graphical user interface.

[0089] Example 17. A computer-readable storage medium according to Example 15, wherein an instruction causing the system to perform a method for generating a graphical user interface, which includes displaying at least one set-grouped thumbnail image or an ungrouped thumbnail image in the graphical user interface, further includes the step of generating a thumbnail bar element configured to display at least one ungrouped thumbnail image or a set-grouped thumbnail image.

[0090] Example 18. A computer-readable storage medium according to Example 17, wherein a command causing the system to perform a method including switching a graphical user interface from displaying set-grouped thumbnail images in the graphical user interface to displaying ungrouped thumbnail images in the graphical user interface further includes causing the system to perform the steps of: modifying the generated graphical user interface to display ungrouped thumbnail images in the thumbnail bar element of the graphical user interface; and displaying at least one ungrouped thumbnail image in the thumbnail bar element.

[0091] Example 19. A computer-readable storage medium according to Example 17, wherein a command causing the system to perform a method including switching a graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images is a command including the steps of modifying a generated graphical user interface to display set-grouped thumbnail images in the thumbnail bar elements of the graphical user interface, and displaying at least one set-grouped thumbnail image in the thumbnail bar elements.

[0092] Example 20. A computer-readable storage medium according to Example 17, wherein the image dataset is a first image dataset, and the thumbnail bar element is further configured to display tomosynthesis thumbnail images, and the instruction causes the system to perform the steps of: receiving a second image dataset from a data source, wherein the second image dataset includes tomosynthesis projection images relating to projection X-ray mammography images of the first images of the first image dataset; grouping the images of the second image dataset into at least one series of tomosynthesis projection images; and determining a tomosynthesis thumbnail image for each series of tomosynthesis projection images to be displayed in a graphical user interface, and the step of generating a graphical user interface further includes displaying at least one tomography thumbnail image in the thumbnail bar element of the graphical user interface. conclusion

[0093] The disclosed embodiments of a system and method for displaying grouped medical images for review enable clinicians to quickly find the medical image data (e.g., mammography images) necessary to complete a review, thereby reducing the time required for the review, improving the clinician's user experience, enabling clinicians to work more efficiently, and improving the timeliness of patient care.

Claims

1. At least one processor, A step of receiving an image dataset from a data source, wherein the image dataset includes projected X-ray mammography images for health management examinations. A step of determining an ungrouped thumbnail image for each projected X-ray mammography image in an image dataset, wherein the ungrouped thumbnail image is intended to be displayed on the graphical user interface of a display device. The steps include: grouping the images in the aforementioned image dataset into multiple sets; A step of determining a set grouping thumbnail image for each set of grouped images, wherein the set grouping thumbnail image is to be displayed in the graphical user interface. The steps include generating a graphical user interface, which includes displaying at least one of the set grouped thumbnail images or the ungrouped thumbnail images in the graphical user interface; A step of receiving user input to a user interface element, In response to receiving user input to the aforementioned user interface element, Switch the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images, or The steps include switching the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images, To execute A method that includes this.

2. The aforementioned at least one processor, The steps include selecting projected X-ray mammography images from the image dataset for display in the graphical user interface, The steps include: displaying the selected projected X-ray mammography image on the graphical user interface; To execute The method according to claim 1, further comprising:

3. The method according to claim 1, wherein the step of generating a graphical user interface, which includes displaying at least one of the set-grouped thumbnail images or the ungrouped thumbnail images in the graphical user interface, further includes the step of generating a thumbnail bar element configured to display at least one of the ungrouped thumbnail images or the set-grouped thumbnail images in the graphical user interface.

4. The step of switching the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images is as follows: The aforementioned graphical user interface The steps include modifying the generated graphical user interface to display the ungrouped thumbnail images within the thumbnail bar element of the graphical user interface, The steps include displaying at least one of the ungrouped thumbnail images in the thumbnail bar element, To execute The method according to claim 3, including the method described in claim 3.

5. The step of switching the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images in the graphical user interface is: The aforementioned graphical user interface The steps include modifying the generated graphical user interface to display the set-grouped thumbnail images in the thumbnail bar element of the graphical user interface, The steps include displaying at least one of the set-grouped thumbnail images in the thumbnail bar element, To execute The method according to claim 3, including the method described in claim 3.

6. The aforementioned image dataset is the first image dataset, The aforementioned thumbnail bar element is further configured to display a tomosynthesis thumbnail image. The aforementioned method, The aforementioned at least one processor, A step of receiving a second image dataset from a data source, wherein the second image dataset includes tomosynthesis projection images relating to the projection X-ray mammography images of the first image dataset, The steps include: grouping the images from the second image dataset into at least one tomosynthesis projection image series; The steps include determining a tomosynthesis thumbnail image for each tomosynthesis projection image series to be displayed in the graphical user interface, To execute It further includes, The step of generating the graphical user interface involves at least one processor processing the thumbnail bar elements of the graphical user interface. The method according to claim 3, further comprising displaying at least one tomographic thumbnail image.

7. The method according to claim 6, wherein the step of switching the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images in the graphical user interface is to prevent the display of the ungrouped tomosynthesis projection image series in the thumbnail bar element of the graphical user interface.

8. The method according to claim 6, wherein the image dataset is a first image dataset, and the data source for the first image dataset and the data source for the second image dataset are the same data source.

9. The step of grouping the images in the aforementioned image dataset into multiple sets is: The aforementioned at least one processor, Imaging position and side, or Compression and side, The further includes grouping the images of the image dataset based on at least one of the following: The step of determining a thumbnail image for each set of grouped images further includes the at least one processor generating a thumbnail image that indicates grouping based on the imaging position and side, The method according to claim 1, wherein the step of generating the graphical user interface, which includes displaying the set-grouped thumbnail images on the graphical user interface, further includes the at least one processor displaying the set-grouped thumbnail images on the graphical user interface indicating grouping based on imaging position and side.

10. A medical image management system, A network communication interface for receiving health management examination results, including an image dataset containing projected X-ray mammography images, A memory connected to the network communication interface for storing the received health management test results, A display screen connected to memory is used to display the received health management test results, One or more processors connected to a network communication interface, memory, and a display screen, Equipped with, The one or more processors mentioned above are: The image dataset included in the health management test results is received from the data source via the network communication interface. For each projected X-ray mammography image in the aforementioned image dataset, an ungrouped thumbnail image is determined for display on the graphical user interface of the display device. The images in the aforementioned image dataset are grouped into multiple sets. For each set of grouped images, a set grouping thumbnail image to be displayed in the graphical user interface is determined. A graphical user interface is generated, which includes displaying at least one of the set grouped thumbnail images or the ungrouped thumbnail images. Receive user input to user interface elements, In response to receiving user input to the aforementioned user interface element, Display set-grouped thumbnail images in the graphical user interface. Therefore, the graphical user interface is switched to display ungrouped thumbnail images, or The graphical user interface is switched from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images. A medical image management system configured as follows.

11. The one or more processors mentioned above are: To display in the aforementioned graphical user interface, a projected X-ray mammography image is selected from the image dataset. The selected projected X-ray mammography image is displayed on the graphical user interface. A medical image management system according to claim 10, further configured as follows.

12. The medical image management system according to claim 10, wherein the one or more processors configured to generate a graphical user interface including displaying at least one of the set-grouped thumbnail images or the ungrouped thumbnail images are further configured to generate a thumbnail bar element configured to display at least one of the ungrouped thumbnail images or the set-grouped thumbnail images.

13. The one or more processors configured to switch the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images are, The generated graphical user interface is modified to display the ungrouped thumbnail images in the thumbnail bar element of the graphical user interface. Display at least one of the ungrouped thumbnail images in the thumbnail bar element. A medical image management system according to claim 12, further configured as follows.

14. The one or more processors configured to switch the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images are: To display the set grouped thumbnail images in the thumbnail bar element of the graphical user interface, the generated graphical user interface is modified. Display at least one of the set grouped thumbnail images in the thumbnail bar element. A medical image management system according to claim 12, further configured as follows.

15. A non-temporary computer-readable storage medium in which instructions are stored, wherein the instructions are executed by a system having at least one processor, memory, and display screen. A step of receiving an image dataset from a data source, wherein the image dataset includes projected X-ray mammography images for health management examinations. A step of determining an ungrouped thumbnail image for each projected X-ray mammography image in an image dataset, wherein the ungrouped thumbnail image is intended to be displayed on the graphical user interface of a display device. The steps include: grouping the images in the aforementioned image dataset into multiple sets; A step of determining a set grouping thumbnail image for each set of grouped images, wherein the set grouping thumbnail image is to be displayed in the graphical user interface. The steps include generating a graphical user interface, which includes displaying at least one of the set grouped thumbnail images or the ungrouped thumbnail images in the graphical user interface; A step of receiving user input to a user interface element, In response to receiving user input to the aforementioned user interface element, Switch the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images, or The steps include: switching the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images; A non-temporary, computer-readable storage medium that allows a system to perform a method including [specific actions].

16. The aforementioned instruction is, The steps include selecting projected X-ray mammography images from the image dataset for display in the graphical user interface, The steps include: displaying the selected projected X-ray mammography image on the graphical user interface; A computer-readable storage medium according to claim 15, further comprising causing the system to perform the above.

17. The computer-readable storage medium according to claim 15, wherein the instruction causing the system to perform a method for generating a graphical user interface, which includes displaying at least one of the set-grouped thumbnail images or the ungrouped thumbnail images in the graphical user interface, further includes the step of generating a thumbnail bar element configured to display at least one of the ungrouped thumbnail images or the set-grouped thumbnail images.

18. The instruction causing the system to execute a method that includes switching the graphical user interface from displaying set-grouped thumbnail images to displaying ungrouped thumbnail images is, The steps include modifying the generated graphical user interface to display the ungrouped thumbnail images within the thumbnail bar element of the graphical user interface, The steps include displaying at least one of the ungrouped thumbnail images in the thumbnail bar element, The computer-readable storage medium according to claim 17, further comprising causing the system to perform the following.

19. The instruction causing the system to execute a method that includes switching the graphical user interface from displaying ungrouped thumbnail images to displaying set-grouped thumbnail images is, The generated graphical user interface displays the set grouped thumbnail images in the thumbnail bar element of the graphical user interface. Steps to correct this, The steps include displaying at least one set-grouped thumbnail image in the thumbnail bar element, The computer-readable storage medium according to claim 17, further comprising causing the system to perform the following.

20. The aforementioned image dataset is the first image dataset, The aforementioned thumbnail bar element is further configured to display a tomosynthesis thumbnail image. The aforementioned instruction is, A step of receiving a second image dataset from a data source, wherein the second image dataset includes tomosynthesis projection images relating to the projection X-ray mammography images of the first image dataset, The steps include: grouping the images from the second image dataset into at least one tomosynthesis projection image series; The steps include determining a tomosynthesis thumbnail image for each tomosynthesis projection image series to be displayed in the graphical user interface, The system is then made to perform the following: The computer-readable storage medium according to claim 17, wherein the step of generating the graphical user interface further includes displaying at least one tomographic thumbnail image in the thumbnail bar element of the graphical user interface.

Images