Variable viewport display configurations

Variable viewport configurations in medical imaging systems address the inflexibility of existing digital hanging protocols, enabling efficient review of multiple imaging modalities and improving diagnostic accuracy.

WO2025059309A1PCT designated stage expired Publication Date: 2025-03-20HOLOGIC INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
PCT/US2024/046398
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-12
Filing Date
2024-09-12
Publication Date
2025-03-20

AI Technical Summary

Technical Problem

Existing digital hanging protocols for medical images are inflexible, making it difficult for medical specialists to efficiently review images from multiple imaging modalities simultaneously, which leads to less efficient and accurate diagnoses.

Method used

The implementation of variable viewport configurations allows medical specialists to easily customize the layout of viewports on a display screen, enabling simultaneous viewing of images from multiple modalities and adjusting the number of visible images within a viewport.

Benefits of technology

This approach enhances the efficiency of medical image review by allowing specialists to quickly make accurate diagnoses, while also reducing network traffic and computing power required to load medical images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US2024046398_20032025_PF_FP_ABST
    Figure US2024046398_20032025_PF_FP_ABST
Patent Text Reader

Abstract

A method for the display of medical images in a plurality of viewport configurations includes displaying a workspace on a computer display. A first viewport configuration of a looped series of viewport configurations is displayed in the workspace. A button is displayed with the first viewport configuration, where the button includes an icon representative of a next-in-series viewport configuration. At the button, an advance-to-next viewport selection is received. Based at least in part on receiving the advance-to-next viewport selection, the next-in-series viewport configuration of the looped series of viewport configurations is displayed in the workspace, where the next-in-series viewport configuration is different than the first viewport configuration. The button is displayed with the next-in-series viewport configuration, the button now including an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.
Need to check novelty before this filing date? Find Prior Art

Description

VARIABLE VIEWPORT DISPLAY CONFIGURATIONSCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of U.S. Provisional Patent Application No. 63 / 582,190, filed September 12, 2023, which is incorporated by reference herein in its entirety.BACKGROUND

[0002] Medical imaging procedures are often used to screen, detect, or diagnose abnormalities within the human body. Images may be captured via a variety of different imaging techniques or modalities, including sonography / ultrasound, computed tomography (CT / CAT), magnetic resonance imaging (MRI), vascular interventional radiology, nuclear medicine imaging, positron-emission tomography (PET), x-ray (including 2D mammography and tomosynthesis), or other medical imaging modality. Once the images are acquired through via the appropriate medical imaging device, they must be analyzed by a medical professional to determine if there are any notable features (e.g., abnormalities, tumors, foreign objects, breaks / trauma, or others). That analysis is commonly performed by doctor or other medical specialist specially trained for evaluation of the medical images (e.g., a sonographer or radiologist). Each medical specialist may have a particular procedure for which he or she requires or prefers to perform the analysis of the images. In the past, with film-based images, the medical specialist would physically “hang” each of the physical films in a light box to perform the analysis. The manner in which the physical films were hung was referred to as a “hanging protocol.”

[0003] With the advent of digital medical imaging, a medical specialist can now review digital medical images on a display screen. While some digital hanging protocols do exist, the creation and use of those hanging protocols is difficult, unsatisfactory, or impossible for some medical specialists who work with digital images that are grouped into studies, or who wish to review medical images of different modalities on the same display (for example, x-ray and ultrasound). Existing hanging protocol workspaces may be based on predefined viewport configurations, may only include one image per viewport, and may not be easily customizable by the medical specialist. The existing hanging protocols are stagnant and require a number of steps to be reconfigured. Medical specialists often wish to view images from multiple imagingmodalities to evaluate a same region of interest and confirm an analysis or finding. For example, sonography (ultrasound) images may be hung next to mammography (x-ray) images and viewed by the medical specialist. Ultrasound images are generally obtained in a group or series, and it is not always clear to the medical specialist which of the images is going to be relevant until the sonography image(s) is also reviewed. Even if multiple viewports are available on a display, the number of sonography images generally outnumbers the number of viewports, so most images cannot be viewed quickly or simultaneously. These rigid structures of such tools leads to less efficient and effective review of medical images, and add time and inaccuracy to the review process. In addition, the digital images may be stored in one or more databases, and the inability to effectively view groups of potentially large images may require additional computing power and increased network traffic.

[0004] It is with respect to these and other general considerations that the aspects disclosed herein have been made. Also, although relatively specific problems may be discussed, it should be understood that the examples should not be limited to solving the specific problems identified in the background or elsewhere in this disclosure.SUMMARY

[0005] Examples of the present disclosure describe systems and methods for providing variable viewport configurations, so that a medical specialist may easily determine a layout of various viewports on a display screen workspace, may simultaneously view images from multiple imaging modalities, and may easily change the number of images of an image study that are visible within a viewport. This allows a medical specialist to efficiently review multiple images of an image study in a single viewport, rather than having to hang each image of the study in each viewport individually, so that they can more quickly make an accurate diagnosis. These features not only provide customizable options to the medical specialist for efficient review of the images, but also minimize network traffic and computing power required to load various medical images.

[0006] In accordance with aspects of the disclosure, a computer-implemented method for the display of medical images in a plurality of viewport configurations comprises: displaying, on a display of a computer, a workspace; displaying, in the workspace, a first viewport configuration of a looped series of viewport configurations; displaying, with the first viewport configuration, a button, wherein the buttoncomprises an icon representative of a next-in-series viewport configuration; receiving, at the button, an advance-to-next viewport selection; based at least in part on receiving the advance-to-next viewport selection: displaying, in the workspace, the next-in-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and displaying, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

[0007] In some examples, the method further comprises displaying at least one medical image in at least one of the first viewport configuration, the next-in-series viewport configuration, and the subsequent viewport configuration.

[0008] In some examples, the method further comprises receiving a selection of a portion of the workspace; and automatically selecting a viewport theme based at least in part on an orientation and a dimension of the selected portion of the workspace.

[0009] In some examples, the workspace theme is selected from at least one of a horizontal theme, a full theme, a vertical theme, and a quarter theme.

[0010] In some examples, the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises a second plurality of tiles different than the first plurality of tiles.

[0011] In some examples, the selected viewport theme comprises the horizontal theme, the plurality of tiles in each of the next-in-series viewport configuration and the subsequent viewport configuration are arranged along both a horizontal axis and a vertical axis.

[0012] In some examples, the selected viewport theme comprises the full theme, the plurality of tiles in each of the next-in-series viewport configuration and the subsequent viewport configuration are arranged along both a horizontal axis and a vertical axis.

[0013] In some examples, the selected viewport theme comprises at least one of the vertical theme and the quarter theme, the plurality of tiles in the next-in-series viewport configuration are arranged along a vertical axis.

[0014] In some examples, the first viewport configuration comprises one tile, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises the first viewport configuration.

[0015] In some examples, the first viewport configuration comprises one tile, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises a second plurality of tiles different than the first plurality of tiles.

[0016] In some examples, the method further comprises, when the next-in-series viewport configuration is displayed: displaying one of a plurality of medical images in at least an equal number of the plurality of tiles; receiving at least one of an image single-shift signal and an image block-shift signal; and shifting the plurality of medical images displayed in the plurality of tiles, based on the received signal.

[0017] In some examples, the method further comprises: receiving an expand signal associated with at least one of the plurality of medical images; and displaying, in the workspace, an enlarged version of the associated at least one of the plurality of medical images.

[0018] In accordance with aspects of the disclosure, a medical image review station comprises: a display; and a computing system coupled to the display, the computing system comprising at least one processor and at least one memory, the at least one memory storing computer-executable instructions that, when executed by the at least one processor, cause the computing system to: display a workspace on the display; display, in the workspace, a first viewport configuration of a looped series of viewport configurations; display, with the first viewport configuration, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration; receive, at the button, an advance-to-next viewport selection; based at least in part on receiving the advance-to-next viewport selection: display, in the workspace, the nextin-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and display, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

[0019] In some examples, the medical image review station further comprises instructions to: receive, from a first medical image database, a first set of images, wherein the first set of images comprises at least one image of a first modality type; display, in a first portion of the workspace on the display, the first viewport configuration; display, in the first viewport configuration, the at least one image of the first modality type; receive, from a second medical image database, a second set ofimages, wherein the second set of images comprises at least one image of a second modality type; and display, in a second portion of the workspace on the display and contemporaneously with the display in the first portion of the workspace, the at least one image of the second modality type.

[0020] In some examples, the first medical image database comprises the second medical image database.

[0021] In some examples, the medical image review station further comprises instructions to: receive a selection of the first portion of the workspace; and automatically select a viewport theme based at least in part on an orientation and a dimension of the selected first portion of the workspace, wherein the looped series of viewport configurations is associated with the selected viewport theme.

[0022] In some examples, the next-in-series viewport configuration comprises a first plurality of tiles, and the medical image review station further comprises instructions to, when the next-in-series viewport configuration is displayed: display one image of the first set of medical images in at least an equal number of the first plurality of tiles; receive at least one of an image single-shift signal and an image block-shift signal; and shift the first set of medical images displayed in the first plurality of tiles, based on the received signal.

[0023] In some examples, the medical image review station further comprises instructions to: receive an expand signal associated with at least one image of the first set of medical images; and display, in the workspace, an enlarged version of the at least one image.

[0024] In some examples, the enlarged version of the at least one image obstructs at least a portion of the first portion of the workspace.

[0025] In some examples, the enlarged version of the at least one image obstructs at least a portion of the second portion of the workspace.

[0026] In accordance with aspects of a disclosure, a computing system comprises at least one processor and at least one memory, and the at least one memory stores computer-executable instructions that, when executed by the at least one processor, cause the computing system to: display a workspace on a display of a computer; display, in the workspace, a first viewport configuration of a looped series of viewport configurations; display, with the first viewport configuration, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration; receive, at the button, an advance-to-next viewport selection; based at least in part onreceiving the advance-to-next viewport selection: display, in the workspace, the nextin-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and display, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

[0027] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Additional aspects, features, and / or advantages of examples will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the disclosure.BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Non-limiting and non-exhaustive examples are described with reference to the following figures.

[0029] FIG. 1 depicts an example system for collecting and reviewing medical images.

[0030] FIG. 2A depicts an example user interface including a full viewport configuration, displaying a single tile.

[0031] FIG. 2B depicts an example user interface including a full viewport configuration, displaying four tiles.

[0032] FIG. 2C depicts an example user interface including a full viewport configuration, displaying twelve tiles.

[0033] FIG. 2D depicts an example user interface including a full viewport configuration, displaying a first four tiles of a set of tiles.

[0034] FIG. 2E depicts an example user interface including a full viewport configuration, displaying a second tile through a fifth tile of a set of tiles.

[0035] FIG. 2F depicts an example user interface including a full viewport configuration, displaying a next four tiles of a set of tiles.

[0036] FIG. 3 depicts an example method for displaying medical images in a plurality of viewport configurations.

[0037] FIG. 4A depicts an example user interface including a horizontal viewport configuration, displaying a single tile.

[0038] FIG. 4B depicts an example user interface including a horizontal viewport configuration, displaying two tiles.

[0039] FIG. 4C depicts an example user interface including a horizontal viewport configuration, displaying six tiles.

[0040] FIG. 5A depicts an example user interface including a vertical viewport configuration, displaying a single tile.

[0041] FIG. 5B depicts an example user interface including a vertical viewport configuration, displaying two tiles.

[0042] FIG. 5C depicts an example user interface including a vertical viewport configuration, displaying four tiles.

[0043] FIG. 6A depicts an example user interface including a quarter viewport configuration, displaying a single tile.

[0044] FIG. 6B depicts an example user interface including a quarter viewport configuration, displaying two tiles.

[0045] FIG. 7A depicts an example user interface including a first full viewport configuration including an image of a first modality.

[0046] FIG. 7B depicts an example user interface including a first full viewport configuration including an image of a first modality, and a second horizontal viewport configuration, displaying a single image of a second modality.

[0047] FIG. 7C depicts an example user interface including a first full viewport configuration including an image of a first modality, and a second horizontal viewport configuration, displaying two images of a second modality.

[0048] FIG. 7D depicts an example user interface including a first full viewport configuration including an image of a first modality, and a second horizontal viewport configuration, displaying six images of a second modality.

[0049] FIG. 8 depicts an example user interface including a full viewport configuration, displaying an enlarged image.

[0050] FIG. 9 depicts an example of a suitable operating environment for performing the methods and for incorporation into the systems disclosed herein.DETAILED DESCRIPTION

[0051] In the following detailed description, references are made to the accompanying drawings that form a part hereof, and in which are shown by way of illustrations specific embodiments or examples. These aspects may be combined, other aspects may be utilized, and structural changes may be made without departing from the present disclosure. Examples may be practiced as methods, systems, or devices. Accordingly, examples may take the form of a hardware implementation, an entirely software implementation, or an implementation combining software and hardware aspects. The following detailed description is therefore not to be taken in a limiting sense, and the scope of the present disclosure is defined by the appended claims and their equivalents.

[0052] Examples of the present disclosure describe systems and methods for providing variable viewport configurations, so that a medical specialist may easily determine a layout of various viewports on a display screen workspace, may simultaneously view images from multiple imaging modalities, and may easily change the number of images of an image study that are visible within a viewport.

[0053] In an example, the term “workspace” is defined to mean a space on a display (such as a computer display) wherein a user can view and interact with one or more medical images. The workspace may be a common display feature such as a program “window” in which a program is run. The workspace may substantially, partially, or completely fill a program window or the display area of the display. The workspace may include a single viewport or may be divided into multiple viewports.

[0054] In an example, the term “viewport” is defined to mean a sub-area of a workspace. The viewport may be configured to display one or more images, which can be arranged according to various assigned viewport configurations as described herein.

[0055] In an example, the term “tile” is defined to mean a sub-area of a viewport, in which may be displayed an image. A viewport configuration may include one or more tiles, and each viewport configuration may include tiles of different sizes and orientations that may be based on factors related to the size and orientation of the viewport or other factors.

[0056] In an example, the term “image” is defined to mean a still image file, video frame still file, video file (for example, a sonography cine), or other type of file generated by a medical imaging device. Each image also may include associated metadata (for example, date, time, size, location, patient, or other information).

[0057] A workspace on a display may include a grid that guides the presentation of the workspace, as well as the various viewports therein. The workspace may be populated by dragging and dropping images or groups of images thereon. When a user, such as a radiologist, selects a section or portion of the workspace grid, a viewport may be created having a specific size and shape in that section or portion of the workspace. Once a first viewport is populated, a subsequent viewport may be populated in an unassigned section or portion remaining on the workspace. In some examples, the workspace may include one viewport; that is, a single viewport may occupy the entire area of the workspace. In some examples, the workspace may include two or more viewports that together occupy the entire area of the workspace. A customized viewport layout / hanging protocol may be saved or stored and may be associated with a particular user. A user may save / store more than one viewport layout that they may select from. A user may set a viewport layout that serves as a default layout when a display is activated or when the user logs into a review station that includes the display. In some examples, tools for enhancing displayed images, such as measurement and magnification tools, may also be customized.

[0058] A theme is assigned to each viewport, based on the size and shape of the viewport. Each theme includes one or more viewport configurations that each include a predefined number and orientation of tiles. Each tile represents a space where an image may be displayed. The various themes described herein include “full”, “horizontal”, “vertical”, and quarter”, and those terms are used primarily for differentiation between the various themes and should not be considered limiting. In examples where more than one viewport is defined in a single workspace, each viewport may have a different theme, based on its size and orientation.

[0059] As will be described in more detail below, a full viewport theme may be assigned to a viewport occupying at least enough of the workspace area to display at least 12 tiles of a predetermined minimum size simultaneously in a grid layout (for example, three-by-four or four-by-three). A horizontal viewport theme may be assigned to a viewport occupying at least enough of the workspace area to display six tiles of a predetermined minimum size simultaneously in a grid layout (for example, three by two). A vertical viewport theme may be assigned to a viewport occupying at least enough of the workspace area to display four tiles of a predetermined minimum size simultaneously (for example, arranged vertically). A quarter viewport theme may be assigned to a viewport occupying at least enough of the workspace area to displaytwo tiles of a predetermined minimum size simultaneously. Any viewport theme may display, as different viewport configurations, a lesser selected number of tiles that may be larger in size than the predetermined minimum size. On a workspace, a vertical or horizontal theme viewport may cover half as much workspace area as a full theme viewport. A quarter theme viewport may cover one-fourth as much workspace as a full themed viewport (and half as much space as a horizontal or vertical themed viewport).

[0060] Each viewport may include a button or toggle that allows a user to advance the configuration or layout of tiles of the viewport. These viewport configurations or layouts are arranged in a predefined series, with first viewport configuration being followed by a predetermined second viewport configuration, which may be followed by a predetermined third viewport configuration, and so on, until the “last” viewport configuration is reached and the series returns to the first configuration. In examples where only two viewport configurations are used for a theme, a first viewport configuration is followed by a second viewport configuration, which is then followed by the first viewport configuration. Each time the button is interacted with (e.g., selected by a user), the viewport configuration is changed to the next viewport configuration, which may be referred to as a “next-in-series” or “subsequent” viewport. A set number and type of viewport configurations may be automatically assigned to a particular viewport based on the size and shape of the viewport. Repeated interaction with the button causes the viewport to loop through the subsequent viewport configurations of the assigned viewport theme. The button may include an icon that graphically depicts or represents the subsequent or next-in-series viewport configuration of the assigned viewport theme (for example, the icon may show the orientation, layout, and / or size ratio of the tiles that will be displayed with the next-in- series viewport configuration). In examples where more than one viewport is defined in a single workspace, a user interaction with the button of a viewport causes that viewport to advance to its next-in-series viewport configuration, while the other defined viewports will remain at their currently-displayed viewport configurations.

[0061] For example, as will be described in more detail below, a full viewport theme may display a single tile and a button icon that indicates that the next-in-series viewport configuration will display four tiles. Interaction with the button will change the viewport configuration to the next-in-series, which displays four tiles, while the button icon indicates that a next-in-series viewport configuration will display 12 tiles.Interaction with the button will change the viewport configuration to the next-in-series,which displays twelve tiles, while the button icon indicates that a next-in-series viewport configuration will display a single tile.

[0062] In an example, a horizontal viewport theme may display a single tile and a button icon that indicates that the next-in-series viewport configuration will display two tiles. Interaction with the button will change the viewport configuration to the next-inseries, which displays two tiles, while the button icon indicates that a next-in-series viewport configuration will display six tiles. Interaction with the button will change the viewport configuration to the next-in-series, which displays six tiles, while the button icon indicates that a next-in-series viewport configuration will display a single tile.

[0063] In an example, a vertical viewport theme may display a single tile and a button icon that indicates that the next-in-series viewport configuration will display two tiles. Interaction with the button will change the viewport configuration to the next-inseries, which displays two tiles, while the button icon indicates that a next-in-series viewport configuration will display four tiles. Interaction with the button will change the viewport configuration to the next-in-series, which displays four tiles, while the button icon indicates that a next-in-series viewport configuration will display a single tile.

[0064] In an example, a quarter viewport theme may display a single tile and a button icon that indicates that the next-in-series viewport configuration will display two tiles. Interaction with the button will change the viewport configuration to the next-inseries, which displays two tiles, while the button icon indicates that a next-in-series viewport configuration will display a single tile.

[0065] The above viewport themes and viewport configurations are described herein by way of example, however, different viewport themes and viewport configurations are possible, that may include different sizes and orientations of viewports, and / or different numbers, sizes, and orientation of tiles. Differently-named themes are contemplated, as required or desired for a particular application, and fall within the scope of the technologies described herein.

[0066] Different viewports on the same display or workspace may include images from different imaging modalities. Different viewports on the same display or workspace may include images from the same study (e.g., a group of images taken of a same patient in a same timeframe), or from different studies.

[0067] These features as described in more detail below provide customizable options to the medical specialist for efficient review of medical images, especially when those images are part of a study or group of images. The medical specialist can easily compare images side-by-side, view more than one image at once, quickly identify an image requiring closer examination, quickly scroll or page through multiple images of a study, and view images from multiple modalities simultaneously.

[0068] The digital images may be stored in one or more databases, and the computing system that displays the images may receive / retrieve / obtain the images from the database(s). The files of the medical images are of high quality so that adequate detail can be viewed in order to make appropriate diagnoses. Thus, image files can be very large. Image files that include video (for example, sonogram cine images) and images with additional metadata (for example, annotations and measurements) may be even larger. The database(s) and computing system communicate over a wired or wireless network. If a user is able to see multiple images simultaneously, the computer system needs to receive the images of the study once; it does not need to continue retrieving images as it would have to if the user was able to only see one image of a study at a time. This reduces network traffic, which is advantageous because networks, especially wireless networks, have limited bandwidths. By reducing the necessary network traffic, more bandwidth is available for other users on the network, and network speeds may be faster overall. Additionally, the ability to load multiple images and view them at once frees computing power, because the computing system needs to only load those images of the study for display simultaneously and does not necessarily need to sequentially re-load each individual image (as it would need to if a user could only view one image at a time). This may reduce the amount of computing power (for example, RAM) required by the computer throughout the time that the user is evaluating the images.

[0069] FIG. 1 depicts an example system 100 for collecting and reviewing medical images. Medical imaging device (e.g. medical image review station) 108 is configured to generate medical images of at least some portions of a patient. Medical imaging device 108 may be a device suitable for performing a particular imaging modality, such as sonography / ultrasound, computed tomography (CT / CAT), magnetic resonance imaging (MRI), vascular interventional radiology, nuclear medicine imaging, positronemission tomography (PET), x-ray (including 2D mammography and tomosynthesis), or other medical imaging modality. Medical imaging device 108 receives input fromuser 106, such as parameters for the medical imaging procedures. The input received from user 106 may be put directly from user 106 to the medical imaging device 108 or may be entered into a computing device 102 and then communicated to the medical imaging device 108.

[0070] The output of the medical imaging device 108 is generally a plurality of medical images, although it may be a single medical image. The images may be saved in one or more databases 112. In some examples, medical images of a first modality 114 and medical images of a second modality 116 may be stored in a single database 112. In other examples, medical images of each modality may be stored in separate databases represented by database 112. Database 112 described herein may be of any appropriate database type, including distributed, centralized, relational / SQL, object- oriented, column-oriented, NoSQL, cloud-based, on-premises, operational, analytical, flat-file, network, graphical, time series, multi-model, and / or other database types. Although the database(s) described / shown herein is described as a standalone database for the purpose of illustrating the particular examples described, the database may be wholly or partially combined with other databases.

[0071] After the medical images are generated, they may be viewed on a user interface 104. In an example, user interface 104 is a device application. In other examples, user interface 104 is a web application. As described, user interface 104 is a graphical user interface (GUI). User interface 104 is displayed on a display 103. Display 103 is a digital display, and may be a display integrated into a computing device 102, such as a monitor or other viewing screen. In some examples, display 103 may be a separate monitor, television, smart television, or other display that is communicatively connected to a computing device 102. In some examples, the same computing device 102 may communicate with display 103 and medical imaging device 108. In other examples, these may be separate computing devices communicatively connected within system 100. Computing device 102 may be a desktop computer, a laptop computer, a tablet, a smart TV, or other appropriate electronic device.

[0072] The devices, applications, and systems of system 100 may be configured to send and receive data via network 110. As described herein, network 110 may include a computer network, an enterprise intranet, the Internet, a LAN, a Wide Area Network (WAN), wireless transmission mediums, wired transmission mediums, other networks, and combinations thereof. Although network 110 is shown as a single network in FIG.1, this is shown as an example and the various communications described herein may occur over the same network or a number of different networks.

[0073] EXAMPLE 1

[0074] FIG. 2A depicts an example user interface including a full viewport configuration, displaying a single tile 216a. The user interface 204 may be generated at the system 100, for example using user interface services 104 of FIG. 1. Display 203 displays user interface 204. The display 203 may be accessible to and viewed by user 206 (for example, a user such as user 106 as described with reference to FIG. 1). User 206 may view information displayed on user interface 204 and may interact with user interface 204 utilizing a keyboard, mouse touchpad, touchscreen, remote, voice command, joystick, or other interactive methods. Display 203 may be an example of display 103. User interface 204 includes a workspace 208 capable of defining a plurality of viewports.

[0075] Workspace 208 includes a viewport 214 that has been assigned a full viewport theme. Viewport 214 is shown in a viewport configuration that displays a single tile 216a, that includes a single image. The single tile viewport configuration is part of a looped series of viewport configurations. The single tile 216a is scaled to fit the viewport 214 at a smallest dimension (for example, the width of tile 216a is scaled to the width of viewport 214, which is smaller than a height of the viewport 214). The image displayed in the single tile 216a may be an individual image, or may be one image of a set (e.g. a study) of images. In the case of the latter, the tile 216a of viewport 214 may also include an image reference number 218 that indicates which image in the set of images is displayed in the tile (for example, image 1 out of 11 total images of the study as depicted).

[0076] Viewport 214 includes a button or toggle 210 that the user 206 may interact with (for example, press, click, or otherwise select) to change or advance the viewport configuration of viewport 214 to a next-in-series viewport configuration. When an advance-to-next viewport configuration selection is received at the button 210, the viewport configuration of viewport 214 is advanced to the next-in-series viewport configuration. Button 210 (shown in an expanded view) includes an icon 212a that indicates the orientation and number of tiles that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 212a indicates that for this example, a next-in-series viewport configuration of viewport 214will display four tiles in a grid configuration. In some examples, icon 212a is displayed in a comer of the viewport 214 so as to be unobtrusive to the study of images being displayed.

[0077] In some examples, for any assigned viewport theme, a single tile configuration may be the first viewport configuration to be displayed in viewport 214. The user 206 can then interact with button 210 to move to a next-in-series viewport configuration. In some examples, the first image to be displayed in the single tile is the first image of a set of images. The first viewport configuration to be displayed may be selected / set by the user 206 to be a different viewport configuration (for example, a user 206 may customize via a hanging protocol or other available settings that a viewport configuration that displays more than one tile 216 should be the default configuration).

[0078] Workspace 208 includes additional unassigned space 220. Area of unassigned space 220 may be selected by the user 206 for configuration of one or more additional viewports. Workspace 208 may also include a navigator toolbox 222. Navigator toolbox 222 may include various interactive features by which user 206 can interact with workspace 208 and viewport 214. For example, user 206 may utilize navigator toolbox 222 to move images / sets of images from image storage to be displayed in the viewports, to define the size and orientation of viewports, and to make other alterations to workspace 208.

[0079] FIG. 2B depicts an example user interface including a full viewport configuration, displaying four tiles 216. User interface 204, display 203, user 206, unassigned space 220, and navigator toolbox 222 may have features as described above with respect to FIG. 2A. User interface 204 includes workspace 208, including viewport 214.

[0080] Viewport 214 is shown in a viewport configuration that displays four tiles 216b, 216c, 216d, 216e that each include an image. The four tiles 216 are arranged in a grid configuration along (e.g. parallel with) both a horizontal axis H and a vertical axis V. The four-tile viewport configuration is part of a looped series of viewport configurations. The four tiles 216b through 216e are scaled to fit the viewport 214 at a smallest dimension. The images displayed in each of the four tiles 216b through 216e may be images of a set (e.g. a study) of images. If a set of images includes fewer images than the number of tiles displayed, one or more tiles will remain blank. Each of the tiles 216b through 216e of viewport 214 may also include image reference number218 that indicates which image in the set of images is displayed in the tile (for example, reference number 218 indicates that image 1 out of 11 total images of the study is depicted in tile 216b).

[0081] Button 210 (shown in an expanded view) includes an icon 212b that indicates the orientation and number of tiles that are included in the next-in-series (e.g. subsequent) viewport configuration of the looped series of viewport configurations. Icon 212b indicates that for this example, a next-in-series viewport configuration of viewport 214 will display twelve tiles in a grid configuration.

[0082] FIG. 2C depicts an example user interface including a full viewport configuration, displaying twelve tiles 216. User interface 204, display 203, user 206, unassigned space 220, and navigator toolbox 222 may have features as described above with respect to FIG. 2A. User interface 204 includes workspace 208, including viewport 214.

[0083] Viewport 214 is shown in a viewport configuration that displays twelve tiles 216f, 216g, 216h, 216i, 216j, 216k, 2161, 216m, 216n, 216o, 216p, 216q, that each include an image. The twelve tiles 216 are arranged in a grid configuration along (e.g. parallel with) both a horizontal axis H and a vertical axis V. The twelve-tile viewport configuration is part of a looped series of viewport configurations. The twelve tiles 216f through 216q are scaled to fit the viewport 214 (at a smallest dimension). The images displayed in each of the four tiles 216f through 216q may be images of a set (e.g. a study) of images. If a set of images includes fewer images than the number of tiles displayed, one or more tiles will remain blank as depicted by tile 216q. Each of the tiles 216f through 216q of viewport 214 may also include image reference number 218 that indicates which image in the set of images is displayed in the tile (for example, reference number 218 indicates that image 1 out of 11 total images of the study is depicted in tile 216f).

[0084] Button 210 (shown in an expanded view) includes an icon 212c that indicates the orientation and number of tiles 216 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 212c indicates that for this example, a next-in-series viewport configuration of viewport 214 will display the single tile configuration.

[0085] FIG. 2D depicts an example user interface including a full viewport configuration, displaying a first four tiles of a set of tiles. User interface 204, display 203, user 206, unassigned space 220, and navigator toolbox 222 may have features asdescribed above with respect to FIG. 2A. User interface 204 includes workspace 208, including viewport 214. Viewport 214 is shown in a viewport configuration that displays four tiles 216b, 216c, 216d, 216e (having features as described above with respect to FIG. 2B, including reference number(s) 218), that each include an image 224a, 224d, 224c, 224d, respectively.

[0086] In an example where displayed images 224a, 224d, 224c, 224d represent images of a set of images that includes more than four images, user 206 may desire to interact with the user interface 204 to view one or more currently not-displayed images of the study. As shown, tile 216b displays image 224a, and the associated image reference number 218 reads “Image 1 / 15.” In example, user 206 may indicate (for example, by keyboard, mouse, touchscreen, voice commands, joystick, rollerball, or other interactive interface) that viewport 214 should scroll or page through the images of the set of images, as described below in FIGS. 6 and 7. This advances or shifts the images displayed within the tiles of a particular viewport. The scrolling (also referred to as image “single-shifting”) and paging (also referred to as image “block-shifting”) features of FIGS. 2E and 2F, although described with respect to a viewport with a full theme and four-tile viewport configuration by way of example, are applicable to other viewport themes and other viewport configurations.

[0087] FIG. 2E depicts an example user interface including a full viewport configuration, displaying a second tile through a fifth tile of a set of tiles after at least one scrolling (e.g., image single-shift) action has occurred. In FIG. 2D, image 224a is displayed in tile 216b, with the following tiles 216 displaying sequential images 224 in the set of images. Upon scrolling, tile 216b now displays image 224b, and the image reference number 218 reads “Image 2 / 15.” The rest of the images of the set of images (in this example of 15 images, the remaining images 224c through 224o) sequentially advance through the other tiles 216c through 216e, and the image reference number 218 of each tile 216 changes to indicate the displayed image. The user 206 may continue to scroll through the images of the set of images one at a time and may eventually loop back to image 224a (image 1 of 15) being displayed again (in tile 216e).

[0088] FIG. 2F depicts an example user interface including a full viewport configuration, displaying a next four tiles of a set of tile after at least one paging (i.e. image block-shift) action has occurred. In FIG. 2D, image 224a is displayed in tile 216b, with the following tiles 216 displaying sequential images 224 in the set ofimages. Instead, tiles 216b through 216e now display, respectively, images 224e through 224h. The associated reference number 218 of each tile 216 is also updated (for example, the reference number for tile 216b now reads “Image 5 / 15”). The user 206 may continue to page through the images of the set of images one page (where each page includes a number of images equal to the number of tiles 216 displayed) at a time. The images may eventually loop back so that previously displayed images are being displayed again (although they may be displayed in different tiles 216 / groupings of tiles 216 if the number of images is not divisible by the number of tiles 216 displayed in the viewport configuration).

[0089] FIG. 3 depicts an example method 300 for displaying medical images in a plurality of viewport configurations. The method may be implemented by a computer / computing system (for example, a system such as operating environment 900, described below with reference to FIG. 9). The computing system may include at least one processor and at least one memory, and the at least one memory stores computer-executable instructions that, when executed by the at least one processor, cause the computing system to perform the operations of the method. The computing system is coupled to (for example, communicatively connected to or integrated with) or includes a display (for example, as computing device 102 and display 103 as described above with reference to FIG. 1). In some examples, a medical image review station includes the display and / or computing system.

[0090] At operation 302, a workspace is displayed on the display of the computer / computing system. In some examples, a selection (for example, selection by a user) of a portion of the workspace is received, and a viewport theme is automatically selected based at least in part on an orientation and a dimension of the selected portion of the workspace. The workspace theme may be automatically selected from at least one of a horizontal theme, a full theme, a vertical theme, and a quarter theme.

[0091] At operation 304, a first viewport configuration of a looped series of viewport configurations is displayed in the workspace. The looped series of viewport configurations may be associated with a selected viewport theme. Displaying the first viewport configuration may include displaying at least one medical image. In some examples, the at least one medical image is part of a plurality of images of a medical image study. The first viewport configuration may include a plurality of tiles, and each tile may or may not include an image to be displayed. Each viewport configuration ofthe looped series of viewport configurations may include a different number and / or orientation of tiles, such that a next-in-series viewport configuration has a different number of tiles than the first viewport configuration, and a further subsequent viewport configuration has a different number of tiles than the next-in-series viewport configuration, etc. In some examples where the looped series of viewport configurations only includes two viewport configurations, the first viewport configuration includes one tile, where a next-in-series viewport configuration includes a first plurality of tiles, and where a subsequent viewport configuration includes the first viewport configuration. In another example where the first viewport configuration includes one tile, the next-in-series viewport configuration includes a first plurality of tiles (for example, four), and wherein the subsequent viewport configuration comprises a second plurality of tiles different than the first plurality of tiles (for example, 12).

[0092] In some examples, a first set of images is received from a first medical image database, where the first set of images includes at least one image of a first modality type (for example, sonogram images). The first viewport configuration is displayed in a first portion of the workspace on the display, and the at least one image of the first modality type is displayed in the first viewport configuration. A second set of images is received from a second medical image database, where the second set of images includes at least one image of a second modality type (for example, x-ray images). The at least one image of the second modality type is displayed (contemporaneously with the display in the first portion of the workspace) in a second portion of the workspace on the display. In some examples, the first and second medical image databases may be separate databases, may be the same database, or one of the first and second medical image databases may include the other.

[0093] At operation 306, a button is displayed with the first viewport configuration, where the button includes an icon that is representative of a next-in-series viewport configuration selection. At operation 308, an advance-to-next viewport configuration selection is received at the button.

[0094] At operation 310, based at least on receiving the advance-to-next viewport selection, the next-in-series viewport configuration of the looped series of viewport configurations is displayed in the workspace, where the next-in-series viewport configuration is different than the first viewport configuration. Displaying the next-in- series viewport configuration may include displaying at least one medical image. When the next-in-series viewport configuration is displayed, a plurality of medicalimages may be displayed in at least an equal number a plurality of tiles included in the next-in series viewport configuration. At least one of an image single-shift signal and an image block-shift signal may be received, and the plurality of medical images displayed in the plurality of tiles may be shifted (based on the received signal). Further, the button is displayed with the next-in-series viewport configuration, where the button includes an icon that is representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

[0095] Displaying the subsequent viewport configuration may include displaying at least one medical image. In some examples, method 300 further includes receiving an expand signal associated with at least one medical images of the plurality of medical images and displaying, in the workspace, an enlarged version of the associated at least one medical image of the plurality of medical images. The enlarged version of the at least one image may obstruct at least a portion of the first portion of the workspace. The enlarged version of the at least one image may obstruct at least a portion of the second portion of the workspace.

[0096] EXAMPLE 2

[0097] FIG. 4A depicts an example user interface including a horizontal viewport configuration, displaying a single tile 416. User interface 204, display 203, user 206, and navigator toolbox 222 may have features as described above with respect to FIG. 2A. Workspace 208 includes additional unassigned space 420. Area of unassigned space 420 may be selected by the user 206 for configuration of one or more viewports.

[0098] Workspace 208 includes a viewport 414 that has been assigned a horizontal viewport theme. Viewport 414 is shown in a viewport configuration that displays a single tile 416a, that includes a single image. The single tile viewport configuration is part of a looped series of viewport configurations. The single tile 416a is scaled to fit the viewport 414 at a smallest dimension. The image displayed in the single tile 416a may be an individual image, or may be one image of a set (e.g. a study) of images. In the case of the latter, the tile 416a of viewport 414 may also include an image reference number 418 that indicates which image in the set of images is displayed in the tile (for example, image 1 out of 15 total images of the study as depicted).

[0099] Viewport 414 includes a button or toggle 410 that the user 206 may interact with (for example, press, click, or otherwise select) to change the viewport configuration of viewport 414 to a next-in-series viewport configuration. Button 410(shown in an expanded view) includes an icon 412a that indicates the orientation and number of tiles 416 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 412a indicates that for this example, a next-in-series viewport configuration of viewport 414 will display two tiles oriented horizontally adjacent one another.

[0100] FIG. 4B depicts an example user interface including a horizontal viewport configuration, displaying two tiles 416. User interface 204, display 203, user 206, navigator toolbox 222, and unassigned space 420 may have features as described above with respect to FIG. 4A.

[0101] Viewport 414 is shown in a viewport configuration that displays two tiles 416b, 416c, that each include an image. The two tiles 416 are arranged along (e.g. parallel with) a horizontal axis H. The two-tile viewport configuration is part of a looped series of viewport configurations. The tiles 416b, 416c are scaled to fit the viewport 414. The images displayed in each of the two tiles 416b, 416c may be images of a set (e.g. a study) of images. If a set of images includes fewer images than the number of tiles displayed, one or more tiles will remain blank. Each of the tiles 416b, 416c of viewport 414 may also include image reference number 418 that indicates which image in the set of images is displayed in the tile (for example, reference number 418 indicates that image 1 out of 15 total images of the study is depicted in tile 416b).

[0102] Button 410 (shown in an expanded view) includes an icon 412b that indicates the orientation and number of tiles 416 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 412b indicates that for this example, a next-in-series viewport configuration of viewport 414 will display six tiles oriented in a grid configuration.

[0103] FIG. 4C depicts an example user interface including a horizontal viewport configuration, displaying six tiles 416. User interface 204, display 203, user 206, navigator toolbox 222, and unassigned space 420 may have features as described above with respect to FIG. 4A.

[0104] Viewport 414 is shown in a viewport configuration that displays six tiles 416d, 416e, 416f, 416g, 416h, 416i, that each include an image. The six tiles 416 are arranged in a grid configuration along (e.g. parallel with) both a horizontal axis H and a vertical axis V. The six-tile viewport configuration is part of a looped series of viewport configurations. The tiles 416d through 416i are scaled to fit the viewport 414. The images displayed in each of the tiles 416d through 416i may be images of a set(e.g. a study) of images. If a set of images includes fewer images than the number of tiles displayed, one or more tiles will remain blank. Each of the tiles 416d through 416i of viewport 414 may also include image reference number 418 that indicates which image in the set of images is displayed in the tile (for example, reference number 418 indicates that image 1 out of 15 total images of the study is depicted in tile 416d).

[0105] Button 410 (shown in an expanded view) includes an icon 412c that indicates the orientation and number of tiles 416 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 412c indicates that for this example, a next-in-series viewport configuration of viewport 414 will display the single tile configuration.

[0106] EXAMPLE S

[0107] FIG. 5A depicts an example user interface including a vertical viewport configuration, displaying a single tile 516. User interface 204, display 203, user 206, and navigator toolbox 222 may have features as described above with respect to FIG. 2A. Workspace 208 includes additional unassigned space 520. Area of unassigned space 520 may be selected by the user 206 for configuration of one or more viewports.

[0108] Workspace 208 includes a viewport 514 that has been assigned a vertical viewport theme. Viewport 514 is shown in a viewport configuration that displays a single tile 516a, that includes a single image. The single tile viewport configuration is part of a looped series of viewport configurations. The single tile 516a is scaled to fit the viewport 514 at a smallest dimension. The image displayed in the single tile 516a may be an individual image, or may be one image of a set (e.g. a study) of images. In the case of the latter, the tile 516a of viewport 514 may also include an image reference number 518 that indicates which image in the set of images is displayed in the tile (for example, image 1 out of 21 total images of the study as depicted).

[0109] Viewport 514 includes a button or toggle 510 that the user 206 may interact with (for example, press, click, or otherwise select) to change the viewport configuration of viewport 514 to a next-in-series viewport configuration. Button 510 (shown in an expanded view) includes an icon 512a that indicates the orientation and number of tiles 516 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 512a indicates that for this example, a next-in-series viewport configuration of viewport 414 will display two tiles oriented vertically adjacent one another.

[0110] FIG. 5B depicts an example user interface including a vertical viewport configuration, displaying two tiles 516. User interface 204, display 203, user 206, navigator toolbox 222, and unassigned space 520 may have features as described above with respect to FIG. 5A.

[0111] Viewport 514 is shown in a viewport configuration that displays two tiles 516b, 516c, that each include an image. The two tiles 516 are arranged along (e.g. parallel with) a vertical axis V. The two-tile viewport configuration is part of a looped series of viewport configurations. The tiles 516b, 516c are scaled to fit the viewport 514. The images displayed in each of the two tiles 516b, 516c may be images of a set (e.g. a study) of images. If a set of images includes fewer images than the number of tiles displayed, one or more tiles will remain blank. Each of the tiles 516b, 516c of viewport 514 may also include image reference number 518 that indicates which image in the set of images is displayed in the tile (for example, reference number 518 indicates that image 1 out of 21 total images of the study is depicted in tile 516b).

[0112] Button 510 (shown in an expanded view) includes an icon 512b that indicates the orientation and number of tiles 516 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 512b indicates that for this example, a next-in-series viewport configuration of viewport 514 will display four tiles oriented vertically along a vertical axis.

[0113] FIG. 5C depicts an example user interface including a vertical viewport configuration, displaying four tiles 516. User interface 204, display 203, user 206, navigator toolbox 222, and unassigned space 520 may have features as described above with respect to FIG. 5A.

[0114] Viewport 514 is shown in a viewport configuration that displays four tiles 516d, 416e, 416f, 416g, that each include an image. The four tiles 516 are arranged along (e.g. parallel with) a vertical axis V. The four-tile viewport configuration is part of a looped series of viewport configurations. The tiles 516d through 516g are scaled to fit the viewport 514. The images displayed in each of the tiles 516d through 516g may be images of a set (e.g. a study) of images. If a set of images includes fewer images than the number of tiles displayed, one or more tiles will remain blank. Each of the tiles 516d through 516g of viewport 514 may also include image reference number 518 that indicates which image in the set of images is displayed in the tile (for example, reference number 518 indicates that image 1 out of 21 total images of the study is depicted in tile 516d).

[0115] Button 510 (shown in an expanded view) includes an icon 512c that indicates the orientation and number of tiles 516 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 512c indicates that for this example, a next-in-series viewport configuration of viewport 514 will display the single tile configuration.

[0116] In some examples, as shown in tile 516g, a displayed image may be a multiframe image (the image may include two or more sub-images that make up the displayed image).

[0117] EXAMPLE 4

[0118] FIG. 6A depicts an example user interface including a quarter viewport configuration, displaying a single tile 616. User interface 204, display 203, user 206, and navigator toolbox 222 may have features as described above with respect to FIG. 2A. Workspace 208 includes additional unassigned space 620. Area of unassigned space 620 may be selected by the user 206 for configuration of one or more viewports.

[0119] Workspace 208 includes a viewport 614 that has been assigned a vertical viewport theme. Viewport 614 is shown in a viewport configuration that displays a single tile 616a, that includes a single image. The single tile viewport configuration is part of a looped series of viewport configurations. The single tile 616a is scaled to fit the viewport 614 at a smallest dimension. The image displayed in the single tile 616a may be an individual image, or may be one image of a set (e.g. a study) of images. In the case of the latter, the tile 616a of viewport 614 may also include an image reference number 618 that indicates which image in the set of images is displayed in the tile (for example, image 1 out of 21 total images of the study as depicted).

[0120] Viewport 614 includes a button or toggle 610 that the user 206 may interact with (for example, press, click, or otherwise select) to change the viewport configuration of viewport 614 to a next-in-series viewport configuration. Button 610 (shown in an expanded view) includes an icon 612a that indicates the orientation and number of tiles 616 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 612a indicates that for this example, a next-in-series viewport configuration of viewport 614 will display two tiles oriented vertically adjacent one another.

[0121] FIG. 6B depicts an example user interface including a quarter viewport configuration, displaying two tiles 616. User interface 204, display 203, user 206,navigator toolbox 222, and unassigned space 520 may have features as described above with respect to FIG. 6A.

[0122] Viewport 614 is shown in a viewport configuration that displays two tiles 616b, 616c, that each include an image. The two tiles 616 are arranged along (e.g. parallel with) a vertical axis V. The two-tile viewport configuration is part of a looped series of viewport configurations. The tiles 616b, 616c are scaled to fit the viewport 614. The images displayed in each of the two tiles 616b, 616c may be images of a set (e.g. a study) of images. If a set of images includes fewer images than the number of tiles displayed, one or more tiles will remain blank. Each of the tiles 616b, 616c of viewport 614 may also include image reference number 618 that indicates which image in the set of images is displayed in the tile (for example, reference number 618 indicates that image 1 out of 21 total images of the study is depicted in tile 616b).

[0123] Button 610 (shown in an expanded view) includes an icon 612b that indicates the orientation and number of tiles 616 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 612b indicates that for this example, a next-in-series viewport configuration of viewport 614 will display the single tile configuration.

[0124] FURTHER EXAMPLES

[0125] FIG. 7A depicts an example user interface including a first full viewport configuration including an image of a first modality. User interface 204, display 203, user 206, and navigator toolbox 222 may have features as described above with respect to FIG. 2A. User interface 204 includes workspace 208. Workspace 208 includes additional unassigned space 720. Area of unassigned space 720 may be selected by the user 206 for configuration of one or more additional viewports.

[0126] Workspace 208 includes a viewport 715 that has been assigned a full viewport theme. Viewport 715 is shown in a viewport configuration that displays a single tile 717, that includes a single image of a first modality type. As shown in the example, the image displayed in tile 717 is a mammography image.

[0127] FIG. 7B depicts an example user interface including a first full viewport configuration including an image of a first modality, and a second horizontal viewport configuration, displaying a single image of a second modality. User interface 204, display 203, user 206, navigator toolbox 222, viewport 715, and tile 717 may have features as described above with respect to FIG. 7A.

[0128] Workspace 208 includes a viewport 714 that has been assigned a horizontal viewport theme. Workspace 208 includes additional unassigned space 721 that represents a remaining area of unassigned space 720 (see FIG. 7A) after viewport 714 has been defined. The remaining unassigned space 721 may be selected by the user 206 for configuration of one or more viewports. Viewport 714 is shown in a viewport configuration that displays a single tile 716a, that includes a single image. The horizontal viewport theme and viewport 714 in the single tile configuration (which includes single tile 716a) have features as described above with respect to FIG. 4 A.

[0129] Viewport 714 includes a button or toggle 710 that the user 206 may interact with (for example, press, click, or otherwise select) to change the viewport configuration of viewport 714 to a next-in-series viewport configuration. Button 710 (shown in an expanded view) includes an icon 712a that indicates the orientation and number of tiles 716 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 712a and button 710 have features as described above with respect to FIG. 4A. In such an example, where there are multiple defined viewports 715, 714, an advance-to-next viewport configuration signal received at one viewport will not change the viewport configuration of the other viewport. For example, if a user 206 interacts with button 710, viewport 714 will advance to its nextin-series viewport configuration, while viewport 715 will remain in its current viewport configuration.

[0130] In this example, viewport 714 includes at least one image of a second modality type. As shown in the example, the image displayed in tile 716a is a sonography / ultrasound image. Displaying images of multiple modality types on a single workspace 208 allows the user 206 to view images relating to the same patient that otherwise would have to be viewed separately. This provides user 206 an efficient way to identify features of interest to better diagnose and treat the patient (the subject of the medical images displayed).

[0131] FIG. 7C depicts an example user interface including a first full viewport configuration including an image of a first modality, and a second horizontal viewport configuration, displaying two images of a second modality. User interface 204, display 203, user 206, navigator toolbox 222, viewport 715, and tile 717 may have features as described above with respect to FIG. 7A. Workspace 208 includes additional unassigned space 721 as described above with respect to FIG. 7B. Viewport 714 is shown in a viewport configuration that displays two tiles 716b, 716c, that each includean image. The horizontal viewport theme and viewport 714 in the two-tile configuration (which includes tiles 716b, 716c) have features as described above with respect to FIG. 4B.

[0132] Button 710 (shown in an expanded view) includes an icon 712b that indicates the orientation and number of tiles 716 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 712b and button 710 have features as described above with respect to FIG. 4B.

[0133] FIG. 7D depicts an example user interface including a first full viewport configuration including an image of a first modality, and a second horizontal viewport configuration, displaying six images of a second modality. User interface 204, display 203, user 206, navigator toolbox 222, viewport 715, and tile 717 may have features as described above with respect to FIG. 7A. Workspace 208 includes additional unassigned space 721 as described above with respect to FIG. 7B. Viewport 714 is shown in a viewport configuration that displays six tiles 716d, 716e, 716f, 716g, 716h, 716i, that each include an image. The horizontal viewport theme and viewport 714 in the six-tile configuration (which includes tiles 716d through 716i) have features as described above with respect to FIG. 4C.

[0134] Button 710 (shown in an expanded view) includes an icon 712c that indicates the orientation and number of tiles 716 that are included in the next-in-series viewport configuration of the looped series of viewport configurations. Icon 712c and button 710 have features as described above with respect to FIG. 4C.

[0135] FIG. 8 depicts an example user interface including a full viewport configuration, displaying an enlarged image 819. User interface 204, display 203, user 206, unassigned space 220, and navigator toolbox 222 may have features as described above with respect to FIG. 2A. User interface 204 includes workspace 208, including viewport 814.

[0136] In the example shown, viewport 814 is assigned a full viewport theme. In any one of the associated viewport configurations (one-tile, four-tile, or twelve-tile), a user 206 may desire to view one of the images displayed in one of the tiles (for example, one of a tile 216) in an enlarged / expanded format on the workspace 208. By interacting with the user interface 204 (for example, by pressing or clicking on an appropriate button / interaction feature on user interface 204, by voice command, by shortcut key, by clicking / double-clicking on the image 819 or tile itself, or by anothermethod of interaction), user 204 may indicate that a particular image should be enlarged.

[0137] In the example shown, image 819 is enlarged. Reference number 818 indicates that image 819 is image 4 of a set of 15 images. As shown, image 819 is enlarged to fit in viewport 814 at a smallest dimension of the viewport 814. In other examples, image 819 may be enlarged larger than the smallest dimension of viewport 814, so that it overlaps / obscures at least part of unassigned space 220 and / or other viewports that are included on workspace 208.

[0138] Viewport 814 in the example shown has been assigned a full viewport theme for the purposes of explanation, but the enlargement features described with reference to FIG. 8 apply to any viewport theme and associated viewport configurations. These features allow user 206 to better view a selected image 819 in more detail (after a more cursory review of multiple, smaller images in displayed tiles to identify the image the user 206 wishes to enlarge, in some examples) to better identify features of the image, without having to view and load every image in the set of images one after the other in an enlarged format. This provides efficiency for the user 206, and also may prevent the computer system from having to load completely all data and metadata associated with each image of the set of images.

[0139] FIG. 9 depicts an example of a suitable operating environment 900 for performing the methods and for incorporation into the systems disclosed herein. In its most basic configuration, operating environment 900 typically includes at least one processing unit 902 and memory 904. Operating environment may be included within a medical image review station, and / or be included within system 100. Depending on the exact configuration and type of computing device, memory 904 (storing, instructions to perform the techniques, methods, and operations disclosed herein, including displaying images in a plurality of viewport configurations) may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. This most basic configuration is illustrated in Figure 9 by dashed line 906. Further, environment 900 may also include storage devices (removable, 908, and / or non-removable, 910) including, but not limited to, magnetic or optical disks or tape. Similarly, environment 900 may also have input device(s) 914 such as keyboard, mouse, pen, voice input, etc. and / or output device(s) 916 such as a display, speakers, printer, etc. Also included in the environment may be one or more communication connections 912, such as LAN, WAN, point to point, etc. In embodiments, theconnections may be operable to facility point-to-point communications, connection- oriented communications, connectionless communications, etc.

[0140] Operating environment 900 typically includes at least some form of computer readable media. Computer readable media can be any available media that can be accessed by processing unit 902 or other devices comprising the operating environment. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, RAM, ROM, EEPROM, flash memory or other memory technology, CD- ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transitory medium which can be used to store the desired information. Computer storage media does not include communication media.

[0141] Communication media embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, microwave, and other wireless media. Combinations of the any of the above should also be included within the scope of computer readable media.

[0142] The operating environment 900 may be a single computer operating in a networked environment using logical connections to one or more remote computers. The remote computer may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above as well as others not so mentioned. The logical connections may include any method supported by available communications media. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.

[0143] As should be appreciated, while the above methods have been described in particular orders, no such order is inherently necessary for each operation identified inthe methods. For instance, the operations identified in the methods may be performed concurrently with other operations or in different orders. In addition, the methods described above may be performed by the systems described herein. For example, a system may have at least one processor and memory storing instructions that, when executed by the at least one processor, cause the system to perform the methods described herein.

[0144] The embodiments described herein may be employed using software, hardware, or a combination of software and hardware to implement and perform the systems and methods disclosed herein. Although specific devices have been recited throughout the disclosure as performing specific functions, one of skill in the art will appreciate that these devices are provided for illustrative purposes, and other devices may be employed to perform the functionality disclosed herein without departing from the scope of the disclosure.

[0145] This disclosure describes some embodiments of the present technology with reference to the accompanying drawings, in which only some of the possible embodiments were shown. Other aspects may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments were provided so that this disclosure was thorough and complete and fully conveyed the scope of the possible embodiments to those skilled in the art. Further, as used herein and in the claims, the phrase “at least one of element A, element B, or element C” is intended to convey any of: element A, element B, element C, elements A and B, elements A and C, elements B and C, and elements A, B, and C.

[0146] Although specific embodiments are described herein, the scope of the technology is not limited to those specific embodiments. One skilled in the art will recognize other embodiments or improvements that are within the scope and spirit of the present technology. Therefore, the specific structure, acts, or media are disclosed only as illustrative embodiments. The scope of the technology is defined by the following claims and any equivalents therein.EXAMPLES

[0147] Illustrative examples of the systems and methods described herein are provided below. An embodiment of the system or method described herein may include any one or more, and any combination of, the clauses described below:Clause 1. A computer-implemented method for the display of medical images in a plurality of viewport configurations, the method comprising: displaying, on a display of a computer, a workspace; displaying, in the workspace, a first viewport configuration of a looped series of viewport configurations; displaying, with the first viewport configmation, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration; receiving, at the button, an advance-to-next viewport configuration selection; based at least in part on receiving the advance-to-next viewport configuration selection: displaying, in the workspace, the next-in-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and displaying, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.Clause 2. The method of clause 1, further comprising displaying at least one medical image in at least one of the first viewport configuration, the next-in-series viewport configuration, and the subsequent viewport configuration.Clause 3. The method of any of clauses 1-2, further comprising: receiving a selection of a portion of the workspace; and automatically selecting a viewport theme based at least in part on an orientation and a dimension of the selected portion of the workspace.Clause 4. The method of clause 3, wherein the viewport theme is selected from at least one of a horizontal theme, a full theme, a vertical theme, and a quarter theme.Clause 5. The method of clause 4, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises a second plurality of tiles different than the first plurality of tiles.Clause 6. The method of clause 5, wherein the selected viewport theme comprises the horizontal theme, the plurality of tiles in each of the next-in-series viewport configuration and the subsequent viewport configuration are arranged along both a horizontal axis and a vertical axis.Clause 7. The method of clause 5, wherein the selected viewport theme comprises the full theme, the plurality of tiles in each of the next-in-series viewport configuration and the subsequent viewport configuration are arranged along both a horizontal axis and a vertical axis.Clause 8. The method of clause 5, wherein the selected viewport theme comprises at least one of the vertical theme and the quarter theme, the plurality of tiles in the next- in-series viewport configuration are arranged along a vertical axis.Clause 9. The method of any of clauses 1-8, wherein the first viewport configuration comprises one tile, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises the first viewport configuration.Clause 10. The method of any of clauses 1 -9, wherein the first viewport configuration comprises one tile, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises a second plurality of tiles different than the first plurality of tiles.Clause 11. The method of any of clauses 9-10, further comprising, when the nextin-series viewport configuration is displayed: displaying one of a plurality of medical images in at least an equal number of the plurality of tiles; receiving at least one of an image single-shift signal and an image block-shift signal; and shifting the plurality of medical images displayed in the plurality of tiles, based on the received signal.Clause 12. The method of clause 11, further comprising: receiving an expand signal associated with at least one of the plurality of medical images; and displaying, in the workspace, an enlarged version of the associated at least one of the plurality of medical images.Clause 1 . A medical image review station comprising: a display; and a computing system coupled to the display, the computing system comprising at least one processor and at least one memory, the at least one memory storing computerexecutable instructions that, when executed by the at least one processor, cause the computing system to:display a workspace on the display; display, in the workspace, a first viewport configuration of a looped series of viewport configurations; display, with the first viewport configuration, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration; receive, at the button, an advance-to-next viewport configuration selection; based at least in part on receiving the advance-to-next viewport configuration selection: display, in the workspace, the next-in-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and display, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.Clause 14. The medical image review station of clause 13, further comprising instructions to: receive, from a first medical image database, a first set of images, wherein the first set of images comprises at least one image of a first modality type; display, in a first portion of the workspace on the display, the first viewport configuration; display, in the first viewport configuration, the at least one image of the first modality type; receive, from a second medical image database, a second set of images, wherein the second set of images comprises at least one image of a second modality type; and display, in a second portion of the workspace on the display and contemporaneously with the display in the first portion of the workspace, the at least one image of the second modality type.Clause 15. The medical image review station of clause 14, wherein the first medical image database comprises the second medical image database.Clause 16. The medical image review station of clause 14, further comprising instructions to: receive a selection of the first portion of the workspace; and automatically select a viewport theme based at least in part on an orientation and a dimension of the selected first portion of the workspace, wherein the looped series of viewport configurations is associated with the selected viewport theme. Clause 17. The medical image review station of clause 14, wherein the next-in- series viewport configuration comprises a first plurality of tiles, and further comprising instructions to, when the next-in-series viewport configuration is displayed: display one image of the first set of medical images in at least an equal number of the first plurality of tiles; receive at least one of an image single-shift signal and an image block-shift signal; and shift the first set of medical images displayed in the first plurality of tiles, based on the received signal.Clause 18. The medical image review station of clause 14, further comprising instructions to: receive an expand signal associated with at least one image of the first set of medical images; and display, in the workspace, am enlarged version of the at least one image.Clause 19. The medical image review station of clause 18, wherein the enlarged version of the at least one image obstructs at least a portion of the first portion of the workspace.Clause 20. The medical image review station of any of clauses 18-19, wherein the enlarged version of the at least one image obstructs at least a portion of the second portion of the workspace.Clause 21. A computing system, the computing system comprising at least one processor and at least one memory, the at least one memory storing computerexecutable instructions that, when executed by the at least one processor, cause the computing system to: display a workspace on a display of a computer; display, in the workspace, a first viewport configuration of a looped series of viewport configurations; display, with the first viewport configuration, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration;receive, at the button, an advance-to-next viewport configuration selection; based at least in part on receiving the advance-to-next viewport configuration selection: display, in the workspace, the next-in-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and display, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

Claims

CLAIMSWhat is claimed is:

1. A computer-implemented method for the display of medical images in a plurality of viewport configurations, the method comprising: displaying, on a display of a computer, a workspace; displaying, in the workspace, a first viewport configuration of a looped series of viewport configurations; displaying, with the first viewport configuration, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration; receiving, at the button, an advance-to-next viewport configuration selection; based at least in part on receiving the advance-to-next viewport configuration selection: displaying, in the workspace, the next-in-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and displaying, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

2. The method of claim 1 , further comprising displaying at least one medical image in at least one of the first viewport configuration, the next-in-series viewport configuration, and the subsequent viewport configuration.

3. The method of any of claims 1-2, further comprising: receiving a selection of a portion of the workspace; and automatically selecting a viewport theme based at least in part on an orientation and a dimension of the selected portion of the workspace.

4. The method of claim 3, wherein the viewport theme is selected from at least one of a horizontal theme, a full theme, a vertical theme, and a quarter theme.

5. The method of claim 4, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises a second plurality of tiles different than the first plurality of tiles.

6. The method of claim 5, wherein the selected viewport theme comprises the horizontal theme, the plurality of tiles in each of the next-in-series viewport configuration and the subsequent viewport configuration are arranged along both a horizontal axis and a vertical axis.

7. The method of claim 5, wherein the selected viewport theme comprises the full theme, the plurality of tiles in each of the next-in-series viewport configuration and the subsequent viewport configuration are arranged along both a horizontal axis and a vertical axis.

8. The method of claim 5, wherein the selected viewport theme comprises at least one of the vertical theme and the quarter theme, the plurality of tiles in the next-in- series viewport configuration are arranged along a vertical axis.

9. The method of any of claims 1-8, wherein the first viewport configuration comprises one tile, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises the first viewport configuration.

10. The method of any of claims 1-9, wherein the first viewport configuration comprises one tile, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and wherein the subsequent viewport configuration comprises a second plurality of tiles different than the first plurality of tiles.

11. The method of any of claims 9- 10, further comprising, when the next-in-series viewport configuration is displayed: displaying one of a plurality of medical images in at least an equal number of the plurality of tiles; receiving at least one of an image single-shift signal and an image block-shift signal; andshifting the plurality of medical images displayed in the plurality of tiles, based on the received signal.

12. The method of claim 11, further comprising: receiving an expand signal associated with at least one of the plurality of medical images; and displaying, in the workspace, an enlarged version of the associated at least one of the plurality of medical images.

13. A medical image review station comprising: a display; and a computing system coupled to the display, the computing system comprising at least one processor and at least one memory, the at least one memory storing computerexecutable instructions that, when executed by the at least one processor, cause the computing system to: display a workspace on the display; display, in the workspace, a first viewport configuration of a looped series of viewport configurations; display, with the first viewport configuration, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration; receive, at the button, an advance-to-next viewport configuration selection; based at least in part on receiving the advance-to-next viewport configuration selection: display, in the workspace, the next-in-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and display, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

14. The medical image review station of claim 13, further comprising instructions to: receive, from a first medical image database, a first set of images, wherein the first set of images comprises at least one image of a first modality type; display, in a first portion of the workspace on the display, the first viewport configuration; display, in the first viewport configuration, the at least one image of the first modality type; receive, from a second medical image database, a second set of images, wherein the second set of images comprises at least one image of a second modality type; and display, in a second portion of the workspace on the display and contemporaneously with the display in the first portion of the workspace, the at least one image of the second modality type.

15. The medical image review station of claim 14, wherein the first medical image database comprises the second medical image database.

16. The medical image review station of claim 14, further comprising instructions to: receive a selection of the first portion of the workspace; and automatically select a viewport theme based at least in part on an orientation and a dimension of the selected first portion of the workspace, wherein the looped series of viewport configurations is associated with the selected viewport theme.

17. The medical image review station of claim 14, wherein the next-in-series viewport configuration comprises a first plurality of tiles, and further comprising instructions to, when the next-in-series viewport configuration is displayed: display one image of the first set of medical images in at least an equal number of the first plurality of tiles; receive at least one of an image single-shift signal and an image block-shift signal; and shift the first set of medical images displayed in the first plurality of tiles, based on the received signal.

18. The medical image review station of claim 14, further comprising instructions to: receive an expand signal associated with at least one image of the first set of medical images; and display, in the workspace, an enlarged version of the at least one image.

19. The medical image review station of claim 18, wherein the enlarged version of the at least one image obstructs at least a portion of the first portion of the workspace.

20. The medical image review station of any of claims 18-19, wherein the enlarged version of the at least one image obstructs at least a portion of the second portion of the workspace.

21. A computing system, the computing system comprising at least one processor and at least one memory, the at least one memory storing computer-executable instructions that, when executed by the at least one processor, cause the computing system to: display a workspace on a display of a computer; display, in the workspace, a first viewport configuration of a looped series of viewport configurations; display, with the first viewport configuration, a button, wherein the button comprises an icon representative of a next-in-series viewport configuration; receive, at the button, an advance-to-next viewport configuration selection; based at least in part on receiving the advance-to-next viewport configuration selection: display, in the workspace, the next-in-series viewport configuration of the looped series of viewport configurations, wherein the next-in-series viewport configuration is different than the first viewport configuration, and display, with the next-in-series viewport configuration, the button, wherein the button comprises an icon representative of a subsequent viewport configuration different than the next-in-series viewport configuration.

Citation Information

Patent Citations

  • Comparative image review system and method

    US20060238546A1