Method and system for multi-range slider-based user interface control of medical images
The multi-range slider with linked and disjointed modes addresses inefficiencies in medical image processing by allowing simultaneous adjustment of slider knobs, enhancing speed and accuracy in image analysis.
Patent Information
- Application Number
- JP2025504417
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-07-29
- Filing Date
- 2023-07-27
- Publication Date
- 2025-08-13
- Estimated Expiration
- 2043-07-27
AI Technical Summary
Existing medical image processing systems require time-consuming and error-prone manual adjustments of multiple slider ranges to define image analysis parameters, leading to inefficiencies and inaccuracies.
Implementing a multi-range slider with linked and disjointed operational modes allows simultaneous adjustment of slider knobs, reducing the need for repetitive user inputs and minimizing errors.
Facilitates faster, more accurate, and efficient adjustment of medical image analysis parameters by enabling coordinated movement of slider knobs, thereby reducing user input and execution time.
Smart Images

Figure 2025526410000001_ABST
Abstract
Description
[Technical Field]
[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. patent application Ser. No. 17 / 816,335, entitled "Method and System for Multi-Range Slider-Based User Interface Control of Medical Imaging," filed July 29, 2022, which application is incorporated herein by reference.
[0002] FIELD OF THE INVENTION Embodiments of the subject matter disclosed herein relate to medical imaging, and more particularly to imaging user interfaces. [Background technology]
[0003] When processing medical images, a user can define multiple ranges for adjusting display and analysis parameters of the medical image through widgets in a graphic user interface (GUI). One such widget is a slider (or slider bar). In some examples, multiple ranges can be controlled by the slider. The slider can include a finite track, which can be a horizontal or vertical area that defines a range of possible values for each of the multiple ranges. Each of the multiple ranges can be defined by a minimum and a maximum value, and a thumb representing a single point on the finite track can graphically define the minimum and maximum values on the slider. A user can adjust a first position of a first thumb on the finite track to adjust the minimum value of one of the multiple ranges, and can adjust a second position of a second thumb on the finite track to adjust the maximum value of the same range. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] U.S. Patent Application Publication No. 2010 / 0185976 Summary of the Invention
[0005] This Summary introduces concepts that are more fully described in the Detailed Description. This Summary is not intended to identify essential features of the claimed subject matter or to limit the scope of the claimed subject matter.
[0006] In one aspect, a method may include displaying a slider bar including grooves having fixed ranges of values, a first slider knob in the groove defining a maximum value of a first adjustable range, and a second slider knob in the groove defining a minimum value of a second adjustable range, operating the first slider knob and the second slider knob in one of a linked mode and a disjointed mode, and adjusting, in response to receiving a single user input, one or both of the maximum value of the first adjustable range and the minimum value of the second adjustable range based on whether the first slider knob and the second slider knob are operating in the linked mode or the disjointed mode. In this manner, the user interface may be more easily and accurately controlled with fewer individual operations.
[0007] It should be understood that the foregoing brief description is provided to introduce various concepts in a simplified form that are more fully described in the detailed description. Such description is not intended to identify key or essential features of the claimed subject matter, the scope of which is defined uniquely by the claims that follow the detailed description. Furthermore, the claimed subject matter is not limited to implementations that solve any of the shortcomings described above or elsewhere in this disclosure. [Brief explanation of the drawings]
[0008] The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
[0009] The present disclosure will be more fully understood from a reading of the following description of non-limiting embodiments with reference to the accompanying drawings, in which:
[0010] [Figure 1] 1 is a diagram illustrating an embodiment of a medical image processing system. [Figure 2] 10A-10C illustrate an embodiment of a slider bar including an adjustable knob in a user interface. [Figure 3] 10A-10C illustrate an embodiment of a handle that can be used to operate the associated knob of a slider bar. [Figure 4] 1 is a flow diagram illustrating a first example method for linking and unlinking slider bar thumbs. [Figure 5] 10 is a flow diagram illustrating a second example method for linking and unlinking slider bar thumbs. [Figure 6] 1 is a flow diagram illustrating an example method for adjusting the analysis output of a medical image via a multi-range slider bar with coordinated range controls. [Figure 7] FIG. 10 illustrates an example of slider knob interaction for two ranges based on input received through the user interface. [Figure 8] FIG. 10 illustrates an example of slider thumb uncoupling behavior for two ranges based on input received through the user interface. [Figure 9] FIG. 10 illustrates an example of slider knob interaction for more than two ranges based on input received through the user interface. [Figure 10] FIG. 10 illustrates an example of slider knob interaction for more than two ranges based on input received through the user interface. [Figure 11] FIG. 1 illustrates a first embodiment of a user interface for an imaging system including a slider bar for adjusting medical imaging output. [Figure 12] FIG. 12 illustrates a first example adjustment to the medical imaging output of FIG. 11 based on input received via a slider bar. [Figure 13] FIG. 12 illustrates a second example adjustment of the medical imaging output of FIG. 11 based on input received via a slider bar. [Figure 14] FIG. 10 illustrates a second embodiment of a user interface for an imaging system including a slider bar for adjusting medical imaging output. [Figure 15] FIG. 15 illustrates a first example adjustment of the medical imaging output of FIG. 14 based on input received via a slider bar. [Figure 16] FIG. 15 illustrates a second example adjustment of the medical imaging output of FIG. 14 based on input received via a slider bar. DETAILED DESCRIPTION OF THE INVENTION
[0011] Embodiments of the present disclosure are described below, by way of example, with reference to FIGS. 1 through 16 , which relate to various embodiments for controlling user interface components to adjust medical images. Specifically, systems and methods are provided for adjusting the operational modes of a slider in a user interface. A slider may be any graphic widget that provides an interaction element with a GUI, such as a button or scroll bar. A slider is also referred to herein as a multi-range slider. The slider may have multiple adjustable knobs, each of which represents a single point on the slider groove and can be used to select a single point on the groove. The knobs may define minimum and maximum values for multiple ranges corresponding to different medical image analysis outputs. Controlling the slider through the operational modes described herein can increase the ease of use of the user interface and reduce user error.
[0012] A multi-range slider can be implemented to perform image analysis operations and display medical image data obtained via multiple medical imaging systems. One example operation is an image segmentation operation, in which a multi-range slider can be used to define thresholds for multiple ranges of image signal values that can correspond to different segmentation outputs. The different segmentation outputs can correspond to different visual indicators that distinguish between tissue types or healthy tissue from diseased tissue. The different visual indicators can include shading, coloring, borders, and / or other forms of visual identification, which can be output to corresponding areas of the output medical image via overlays, etc. As an example, an image segmentation operation can be used to quantify and visually indicate various types of lesions in a patient's lungs. Another example operation is to temporally identify contrast agent updates in cerebral blood vessels in a patient's image.
[0013] Typically, a user can define two adjacent ranges of a multi-range slider. The user can manually set the upper limit of a first of the two adjacent ranges to be equal to the lower limit of a second of the two adjacent ranges, for example, by performing several computer operations including changing the upper limit of the first range via a first slider knob, changing the lower limit of the second range via a second slider, and setting the lower limit of the second range to match the upper limit of the first range via the first and / or second slider knobs. However, this sequence is time consuming and prone to user error.
[0014] Thus, embodiments described herein provide faster and more intuitive slider range control through linking and delinking of slider knobs. An example medical imaging processing system that may be used to evaluate medical imaging data via the user interface controls described herein is shown in FIG. 1. An example multi-range slider that may be used to adjust image analysis output via a user interface is shown in FIG. 2. Graphical user interface components of the slider, referred to herein as handles, may be output by the medical imaging processing system to link adjacent range knobs. An example handle is shown in FIG. 3. For example, the handle may be output in the user interface when adjacent range knobs are linked and not output in the user interface when adjacent range knobs are delinked. User input at various touch zones of the handle, also shown in FIG. 3, may enable specific outputs, such as moving or delinking the knob. According to the methods shown in Figures 4 and 5, knobs in adjacent ranges of a multi-range slider can be linked to allow dependent knob movement or unlinked to allow independent knob movement.
[0015] A multi-range slider can be used to adjust the output of an image analysis operation, such as in the manner of FIG. 6 , with different adjustments to the output resulting from the selected operating mode of the multi-range slider. FIG. 7 illustrates an example of a sequence of operations linking two adjacent ranges and adjusting the ranges in unison via a slider handle, while FIG. 8 illustrates an example of a sequence of operations delinking two adjacent ranges. FIG. 9 illustrates an example of a sequence of operations linking two or more adjacent ranges via a user interface. FIG. 10 illustrates an example of a sequence of operations delinking two or more adjacent ranges via a user interface. An example user interface is shown in FIG. 11 , which includes a multi-range slider that can be used to adjust the image segmentation output of a patient's lung image. Image signal values can be adjusted in the user interface via the slider operating modes described herein to adjust the image segmentation output of a lung image, as shown in FIGS. 12 and 13 . A second example of a user interface is shown in Figure 14, which includes a multi-range slider that can be used to adjust contrast-enhanced phase mapping for a computed tomography angiography (CTA) scan of a patient's brain. Figures 15 and 16 illustrate adjusting the period in the user interface via the slider operation mode described herein to adjust the contrast-enhanced phase mapping.
[0016] An advantage that may be realized upon execution of some embodiments of the described systems and methods is that defining ranges may be less time-intensive and may reduce user error. Coordinating knobs, as described herein, allows the knobs to be moved simultaneously through dependent movement of the coordinated knobs, eliminating the repetitive step of separately adjusting each knob to the same value. Furthermore, the systems and methods described herein reduce the range of user input used to define ranges. By reducing the amount of user input used, the potential for user error is reduced. Overall, more accurate ranges may be defined more quickly, thereby reducing the amount of time it takes a user to evaluate a medical image.
[0017] Other benefits of operating a slider in a coordinated mode may include increased efficiency of a computing device. For example, operating a slider in a coordinated mode may enable a computing device to adjust multiple (e.g., two) slider ranges or other widgets in a user interface based on a single user input. When multiple widgets are adjusted in response to a single user input, the execution time of an algorithm (e.g., an algorithm controlling a user interface) may be reduced compared to adjusting multiple widgets based on multiple user inputs. As such, selectively operating a slider in a coordinated mode may increase algorithmic efficiency of a computing device.
[0018] Referring now to FIG. 1 , an example medical image processing system 100 is shown. In some embodiments, the medical image processing system 100 is incorporated into a medical imaging system such as an ultrasound imaging system, a magnetic resonance imaging (MRI) system, a computed tomography (CT) system, a single photon emission computed tomography (SPECT) system, or the like. In some embodiments, at least a portion of the medical image processing system 100 is disposed in a device (e.g., an end device or server) communicatively coupled to the medical imaging system via a wired and / or wireless connection. In some embodiments, the medical image processing system 100 is disposed in a separate device (e.g., a workstation) that can receive images from the medical imaging system or from a storage device that stores images formed by the medical imaging system. The medical image processing system 100 may include an image processor 110 and a user interface 130. For example, the image processor 110 may be operatively / communicatively coupled to the user interface 130.
[0019] The image processor 110 includes a processor 102 configured to execute machine-readable instructions stored in a non-transitory memory 104. The processor 102 may be single-core or multi-core, and programs executed by the processor 102 may be configured for parallel or distributed processing. In some embodiments, the processor 102 may optionally include individual components distributed across two or more devices, which may be remotely located and / or configured for cooperative processing. In some embodiments, one or more aspects of the processor 102 may be virtualized and executed by remotely accessible, networked computing devices configured as a cloud computing configuration. In some embodiments, the processor 102 may include other electronic components capable of performing processing functions, such as a digital signal processor, FPGA, or graphics board. In some embodiments, the processor 102 may include multiple electronic components capable of performing processing functions. For example, the processor 102 may include two or more electronic components selected from several possible electronic components, including a central processor, a digital signal processor, a field-programmable gate array, and a graphics board. In yet other embodiments, the processor 102 may be configured as a graphics processing unit (GPU) that includes a parallel computing architecture and parallel processing capabilities.
[0020] As shown in FIG. 1 , in some embodiments, the non-transitory memory 104 stores a medical image analysis module 106 and medical image data 108. The medical image analysis module 106 includes one or more algorithms, including machine learning models, for processing input medical images from the medical image data 108. In some examples, the medical image analysis module 106 may provide an artificial intelligence system that identifies different tissue types and / or anatomical features (e.g., lesions or blood vessels) within the medical image data 108. For example, the medical image analysis module 106 may include one or more deep learning networks with multiple weights and biases, activation functions, loss functions, steepest descent algorithms, and instructions for implementing the one or more deep learning networks to process the input medical images. Additionally or alternatively, the medical image analysis module 106 may store instructions for implementing a neural network, such as a convolutional neural network, that identifies different tissue types and / or anatomical features captured in the medical image data 108. The medical image analysis module 106 may include trained and / or pre-trained neural networks, and may further include training routines or parameters (e.g., weights and biases) associated with one or more neural network models stored therein. Additionally or alternatively, the medical image analysis module 106 may include image recognition algorithms, shape or edge detection algorithms, etc., for identifying different tissue types and / or anatomical features.
[0021] The medical image analysis module 106 may include conventionally programmed algorithms in addition to or in place of the machine learning algorithms described above. For example, the medical image analysis module 106 may store instructions embodying one or more pre-programmed transformations, manipulations, and / or adjustments to the input medical image data 108. Furthermore, the medical image analysis module 106 may include instructions to output an analysis image or report based on the conventional and / or machine learning evaluation of the medical image data.
[0022] In some embodiments, the medical image analysis module 106 can evaluate the medical image data 108 in real time as it is being acquired. As used herein, the term "real time" is defined to include procedures that are performed without any intentional delay (e.g., substantially at the time of occurrence). Additionally or alternatively, the medical image analysis module 106 can evaluate the medical image data 108 offline rather than in real time.
[0023] In some embodiments, the medical image analysis module 106 may further include trained and / or untrained neural networks that identify and differentiate anatomical features in the medical image data 108. For example, the anatomical features identified via the trained and / or untrained neural networks may include organs, tissues, blood vessels, and the like. In one embodiment, the neural network may be trained using medical images (e.g., images generated from a CT scan). After training, the neural network may generate transformed medical images directly from the medical images, which may include segmentations that differentiate various tissue types, lesion types, or phases of contrast dye uptake (e.g., for a computed tomography angiography scan).
[0024] In some embodiments, the image processor 110 may be coupled to communicate with a training module 120 that includes instructions for training one or more of the machine learning models stored in the medical image analysis module 106. The training module 120 may include instructions that, when executed by the processor, cause the processor to build a model (e.g., a mathematical model) based on sample data to make predictions or decisions about medical images without the explicit programming of traditional non-machine learning algorithms. In one example, the training module 120 includes instructions for receiving a training dataset from the medical image data 108. The training dataset includes a collection of medical images, associated ground truth labels / images, and associated model outputs used to train one or more of the machine learning models stored in the medical image analysis module 106. The training module 120 may also receive the medical images, associated ground truth labels / images, and associated model outputs used to train one or more machine learning models from sources other than the medical image data 108, such as other image processing systems, the cloud, etc. In some embodiments, one or more aspects of the training module 120 may include a remotely accessible networked storage device configured as a cloud computing arrangement. Further, in some embodiments, the training module 120 is included in the non-transitory memory 104. Additionally or alternatively, in some embodiments, the training module 120 may be used to generate a medical image analysis module 106 that is located offline and remote from the medical image processing system 100. In such an embodiment, the training module 120 may generate data that is stored in the medical image processing system 100 rather than being included in the medical image processing system 100. For example, the medical image analysis module 106 may be pre-trained by the training module 120 at a manufacturing site.
[0025] The medical image processing system 100 may further include a user interface 130. The user interface 130 may include a display device 132 and a user input device 134. The display device 132 may include one or more display devices using any type of display technology. In some embodiments, the display device 132 may include a computer monitor and may display raw images, processed images, parameter maps, and / or examination reports. The display device 132 may be integrated into a common housing with the processor 102, the non-transitory memory 104, and / or the user input device 134, or may be a peripheral display device. The display device 132 may include a monitor, touch screen, projector, or other type of display device and may allow a user to view medical images and interact with various data stored in the non-transitory memory 104. In some embodiments, the display device 132 may be included in a smartphone, tablet, smartwatch, or the like.
[0026] User input device 134 may include one or more of a touchscreen, keyboard, mouse, trackpad, motion-sensitive camera, or other device configured to allow a user to interact with and manipulate data stored within image processor 110. As an example, user input device 134 may allow a user to select images for analysis by medical image analysis module 106. In some embodiments, such as touchscreen embodiments, user input device 134 is integrated with display device 132.
[0027] The non-transitory memory 104 may further include a user interface control module 112. The user interface control module 112 may store instructions for controlling components of the user interface 130, such as the components described herein with respect to Figures 2-3. For example, the user interface control module 112 may include instructions for operating a slider bar knob in one of an associated mode and an unassociated mode, and instructions for transitioning between the associated mode and the unassociated mode, such as in the manner described herein with respect to Figures 4 and 5. As an example, the user interface control module 112 may include instructions for enabling automatic or manual association / unassociation of a slider bar knob in response to receiving a predetermined user input via the user input device 134. Additionally or alternatively, the user interface control module 112 may include instructions for interfacing with the medical image analysis module 106 such that adjustments made to the slider bar knobs are reflected in the output of the medical image analysis module 106 displayed via the display device 132.
[0028] The non-transitory memory 104 further stores medical image data 108. The medical image data 108 may include, for example, functional and / or anatomical images captured by imaging modalities such as ultrasound imaging systems, MRI systems, and CT systems. As an example, the medical image data 108 may include CT images, such as chest CT images. Furthermore, the medical image data 108 may include one or more of 2D images, 3D images, single-frame still images, and multi-frame cine loops (e.g., video).
[0029] In some embodiments, non-transitory memory 104 may include components located on two or more devices that may be remotely located and / or configured for collaborative processing. In some embodiments, one or more aspects of non-transitory memory 104 may include remotely accessible networked storage in a cloud computing configuration. As an example, non-transitory memory 104 may be part of a Picture Archiving and Communication System (PACS) configured to store, for example, patient medical history, imaging data, test results, diagnostic information, administrative information, and / or scheduling information.
[0030] 1 is one non-limiting embodiment of an image processing system, and it will be understood that other image processing systems may include more, fewer, or different components without departing from the scope of this disclosure. Furthermore, in some embodiments, at least a portion of the medical image processing system 100 may be included in a medical imaging system.
[0031] As used herein, the terms "system" and "module" may include a hardware and / or software system that operates to perform one or more functions. For example, a module or system may include or be included in a computer processor, controller, or other logic-based device that performs operations based on instructions stored in a tangible, non-transitory, computer-readable storage medium, such as computer memory. Alternatively, a module or system may include a hardwired device that performs operations based on the device's hardwired logic. The various modules or systems shown in the accompanying drawings may represent hardware that operates based on software or hardwired instructions, software that directs hardware to perform these operations, or a combination thereof.
[0032] A "system" or "module" may include or represent hardware and associated instructions (e.g., software stored on a tangible, non-transitory, computer-readable storage medium such as a computer hard drive, ROM, or RAM) that perform one or more operations described herein. The hardware may include one or more logic-type devices, such as a microprocessor, processor, or controller, and / or electronic circuitry coupled to such devices. These devices may be general-purpose (off-the-shelf) devices that are appropriately programmed or instructed to perform the operations described herein from the instructions. Additionally or alternatively, one or more of these devices may be hardwired with logic circuitry to perform these operations.
[0033] Referring to FIG. 2, a multi-range slider 200 is shown that may be displayed in the user interface 130 depicted in FIG. 1. The multi-range slider 200 includes a groove 206 (represented by a dotted line) having a fixed range of values, a first range 214 (represented by vertical stripes) including a first adjustable portion of the fixed range of values, a second range 216 (represented by a checkerboard pattern) including a second adjustable portion of the fixed range of values, and multiple thumbs that define values in the groove 206, all of which are described in more detail below. The fixed range of values increases from left to right such that the values in the second range 216 are greater than the values in the first range 214. The portion of the groove 206 that does not overlap with either the first range 214 or the second range 216 is a region of values that are not included in either the first range 214 or the second range 216.
[0034] First knob 202 defines the minimum value of first range 214, second knob 204 defines the maximum value of first range 214, third knob 208 defines the minimum value of second range 216, and fourth knob 210 defines the maximum value of second range 216. Values falling within first range 214 and second range 216 may be adjusted via adjustments to the position of the corresponding knob in groove 206. A cursor 212 (or other user interface visual component) may be used to select one of first knob 202, second knob 204, third knob 208, and fourth knob 210 to adjust the position of the selected knob in groove 206. For example, in response to selecting the second knob 204 and receiving via the cursor 212 an adjustment of the second knob 204 to a further right position in the groove 206 (e.g., toward the third knob 208), the maximum value of the first range 214 may be increased. In another example, in response to selecting the second knob 204 and receiving via the cursor 212 an adjustment of the second knob 204 to a further left position in the groove 206 (e.g., toward the first knob 202), the maximum value of the first range 214 may be decreased. As yet another example, in response to selecting the first knob 202 and receiving via the cursor 212 an adjustment of the first knob 202 to a further right position in the groove 206 (e.g., toward the second knob 204), the minimum value of the first range 214 may be increased. As yet another example, the minimum value of first range 214 may be decreased in response to selecting first knob 202 and receiving an adjustment of first knob 202 to a position further left in groove 206 via cursor 212. The minimum and maximum values of second range 216 may similarly be adjusted in response to receiving an adjustment to third knob 208 or fourth knob 210, respectively.
[0035] Other adjustment sequences and modes of operation for similar multi-range sliders are described below with respect to Figures 7-10. Furthermore, it will be understood that other embodiments of the multi-range slider 200 may include alternative display outputs and / or numbers of adjacent ranges. One such alternative example may include a vertical representation of the grooves 206 instead of the horizontal representation of the grooves 206 shown in Figure 2. Another alternative example may include a non-linear shape of the grooves 206 instead of the linear shape of the grooves 206 shown in Figure 2. For example, the grooves 206 may alternatively include an arc shape or a curved shape.
[0036] Turning now to FIG. 3 , an embodiment of a slider handle 302 is shown. The slider handle 302 can be output via a user interface (e.g., user interface 130 of FIG. 1 ) while operating a slider bar in a coordinated mode, as described in more detail below. The slider handle 302 includes an associated knob 304, which further includes a first knob 306 at the maximum of a first range and a second knob 308 at the minimum of a second range as a single unit defining a single position in a slider bar groove (e.g., groove 206 of FIG. 2 ). As such, the first knob 306 and the second knob 308, when included in the coordinated knob 304, share the same position in the groove and the same single corresponding value. The slider handle 302 is an interactive user interface component configured to operationally couple the first knob 306 and the second knob 308 (e.g., as a linked knob 308), such that the positions of both knobs can be simultaneously adjusted via adjustment of the slider handle 302. Specifically, the position of the slider handle 304 can be adjusted, as indicated by the dashed lines, when the user interface receives user input within a first region 310. The first region 310 is also referred to herein as a first touch zone. For example, the user interface can receive input in the first region 310 that adjusts the position of the slider handle 304 along a groove, which can adjust the single position of the linked knob 304 and thus correspondingly adjust both the single values of both the first range maximum and the second range minimum. Operation in the linked mode is described again below with respect to Figures 4 through 6.
[0037] In contrast, when the user interface receives user input in the second region 312 (e.g., the second touch zone or the uncoupled touch zone), in at least some embodiments, the coupled knob 304 can be uncoupled such that the positions of the first knob 306 and the second knob 308, also indicated by dashed lines, can be adjusted independently of one another. For example, the slider handle 302 can be hidden in response to receiving a uncoupled request (e.g., via the second region 312), such that the first knob 306 and the second knob 308 are no longer included in the coupled knob 304. Upon uncoupling, the slider bar operates in a uncoupled mode, in which the first knob 306 and the second knob 308 can be adjusted independently to different positions and thus to different corresponding values for the first range maximum and second range minimum in the groove. Operation in the uncoupled mode is described again below with respect to FIGS. 4 through 6. In this manner, the first region 310 and the second region 312 may define multiple portions of the slider handle 302 that may trigger different actions in response to received user input.
[0038] While FIG. 3 depicts the slider handle 302 as having an elliptical (e.g., oval) shape, it will be understood that the slider handle 302 may appear in the user interface as shapes other than an ellipse, including both geometric and non-geometric shapes. For example, the slider handle 302 may have a rectangular shape. Similarly, other embodiments of the slider handle 302 may include different portions of the first region 310 and the second region 312. In some examples, the first region 310 may include all of the slider handle 302 that is not included in the second region 312, or vice versa. Additionally, more or fewer regions (or touch zones) may be included that provide for triggering similar or different slider bar control responses.
[0039] A first example method 400 for linking and unlinking slider knobs via input received through a user interface is shown in FIG. 4 . In one embodiment, method 400 is performed by medical image processing system 100 of FIG. 1 , and the user interface may be user interface 130 of FIG. 1 . As such, method 400 is described with respect to the systems and components described above with respect to FIGS. 1 through 3 , but may be performed by other systems / components without departing from the scope of this disclosure. Method 400, and the remaining methods contained herein, may be performed by a processor (e.g., processor 102 of FIG. 1 ) according to instructions stored in non-transitory memory (e.g., non-transitory memory 104 of FIG. 1 ). While method 400 is described with respect to linking and unlinking a single pair of adjacent knobs, it will be understood that method 400 may be applied to more than one pair of adjacent knobs. For example, a first pair of adjacent knobs can be linked and unlinked independently from a second pair of adjacent knobs via method 400, and the second pair of adjacent knobs can also be linked and unlinked independently via method 400.
[0040] At block 402, method 400 includes receiving user input via a user interface. For example, the user input may be captured by a user input device, such as user input device 134 of FIG. 1, and displayed to a user via a display device, such as display device 132 of FIG. 1. As described above with respect to FIG. 1, one or both of the user input device and the display device may be integrated into or operatively coupled to the user interface. For example, the user input device may include a computer mouse, keyboard, trackpad, or touchscreen (e.g., a touch-sensitive display). In some examples, the user interface may include a visual component that indicates a current location for user interaction, such as a cursor or pointer controlled by the user via the user input device. For example, the user input may include a user navigating a cursor (e.g., via the user input device) to hover over or select an area of interest in the user interface (e.g., via a click, tap, drag, or other type of predefined gesture). In other examples, such as some touchscreen embodiments, user input may include direct contact with the user interface (e.g., via touching the touchscreen with a finger or stylus) at a location desired for user interaction, and may optionally omit the visual component. In addition to the above examples, other forms of user input may be received via the user interface.
[0041] Additionally, the user interface may include a graphic user interface (GUI) that may be output via a display and that allows a user to interact with graphic icons and widgets via a user input device. The GUI may include a slider and a slider thumb, in addition to other interactive components. As discussed further below, the slider may include at least two adjacent thumbs that may be selectively linked and unlinked in response to received user input. An example of a slider is shown in FIG. 2 and described above (e.g., multi-range slider 200). Furthermore, as a result of this selective linking and unlinking, the slider may operate in one of a linked mode and a unlinked mode, also discussed further below.
[0042] At block 404, method 400 includes determining whether a slider knob control menu is requested (e.g., via user input received at block 402). The slider control menu may enable selective coupling and decoupling of a first knob and a second knob. In some examples, the slider knob control menu may be determined to be requested in response to receiving a predefined interaction at a predefined position on the slider and / or slider knob. For example, the predefined interaction may include moving a cursor (or other user input device) to a predefined position. The predefined position may overlap one of the knobs and / or may be located a predefined non-zero threshold distance from one of the knobs (e.g., a number of millimeters, such as a value ranging between 1 millimeter and 100 millimeters, or a number of pixels, such as a number ranging between 1 pixel and 300 pixels). In some examples, the predefined interaction may further include cursor hovering at the predefined position. In other examples, the predefined interaction may include a click or other pre-programmed gesture at a predetermined location, such as a right-click via a mouse, a two-finger tap via a trackpad or touchscreen, or other form of pre-programmed user input.
[0043] If a slider knob control menu is not desired, method 400 proceeds to block 406 and includes not outputting a slider knob control menu. Determining that a slider knob control menu is not desired may include not receiving a predefined interaction at a predefined position on the slider and / or slider knob. For example, the received user input may not include a cursor hover or click within a predefined threshold distance of one of the knobs. As such, the user interface display may not output a control menu that allows for changing the slider knob control settings.
[0044] At block 410, method 400 includes retaining the current slider control setting. Because the slider knob control menu is not output, no changes can be made to the slider knob control setting. As such, two adjacent knobs can continue to operate in one of the linked mode and the unlinked mode based on which is currently selected. For example, if the linked mode is selected, the slider knob can continue to operate in the linked mode. Alternatively, if the unlinked mode is selected, the slider knob can continue to operate in the unlinked mode. The operation of slider knobs in the linked and unlinked modes is described again below. Method 400 may return. For example, method 400 may be repeated so that the slider control can be adjusted in response to user input.
[0045] Returning to block 404, if a slider knob control menu is requested, method 400 proceeds to block 408, which includes outputting a slider knob control menu. In response to the slider knob control menu being requested, the processor may output a slider control menu via a display device of the user interface to allow the slider knob control setting to be changed. The slider knob control menu may be a drop-down menu offering one or more selectable slider knob control settings. In some examples, one or more options offered by the slider knob control menu may change based on the currently selected setting. For example, if the slider knobs are linked, the slider knob control menu may offer an unlink option. As another example, if the slider knobs are unlinked, the slider knob control menu may offer an link option.
[0046] At block 412, method 400 includes determining whether coordination is requested (e.g., via user input received at block 402). In one example, the processor may output, via a display device of the user interface, a coordination option (or prompt) in a slider knob control menu asking the user or operator whether they want to enable a coordination mode for the slider knob. As such, the processor may determine that coordination is requested in response to the user interface receiving user input selecting the coordination option in the slider knob control menu. For example, the user may select the coordination option via a user input device using a cursor, touch gestures, or other form of pre-programmed input. As another example, the processor may determine that coordination is not requested in response to the user interface receiving user input not selecting the coordination option in the slider knob control menu. In some examples, not receiving a selection of the coordination option may include receiving a different prompt or selection of the option, such as a de-coupling option (or prompt) asking the user or operator if they wish to operate in a de-coupling mode, at block 414. This is described in more detail below. As another example, not receiving a selection of the coordination option may include receiving a user input that closes the slider knob control menu without selecting an option.
[0047] If linkage is requested, method 400 proceeds to block 416 and includes linking the first slider knob of the first range maximum (e.g., the first range maximum) to the second slider knob of the second range minimum (e.g., the second range minimum) via a slider handle such that the first range maximum is equal to the second range minimum. As described above with respect to FIG. 3, the slider handle is a UI component that couples the position of the first slider knob of the first range maximum and the position of the second slider knob of the second range minimum in the slider groove to ensure that the first range maximum is equal in value to the second range minimum. An example sequence illustrating the linkage between the first slider knob and the second slider knob is described below with respect to FIG. 7.
[0048] At block 420, method 400 includes simultaneously adjusting the first range maximum and the second range minimum in response to receiving user adjustment of the slider handle via the user interface. User adjustment of the slider handle coordinately adjusts the displayed positions of the first slider knob and the second slider knob such that the second range minimum value and the first range maximum value share a single numeric value and overlapping position in the groove, as described above. For example, the slider handle can encompass and control the position of a coordinated knob that includes both the first knob and the second knob (e.g., coordinated knob 304 of FIG. 3 ). Simultaneous adjustment of the first range maximum and the second range minimum via the slider handle is also referred to herein as operating the slider knobs in a coordinated mode. An example of operating slider knobs in a coordinated mode may include the processor simultaneously adjusting the display positions and numerical values in the slider grooves of both the first and second knobs in response to the user interface receiving a single user input (e.g., via a user input device). For example, the user interface may receive user input selecting a predetermined touch zone of the slider handle and dragging the slider handle to decrease the first range maximum and second range minimum or increase the first range maximum and second range minimum. Method 400 then returns.
[0049] By operating the slider knobs in a coordinated mode, the output of a medical image processing system can be more easily and accurately adjusted in real time or near real time based on user input received at a user interface. In one such example, a displayed segmented output, which may use colors or fill patterns to distinguish multiple regions of an imaged organ in a graphical user interface, can be updated by a processor, in response to receiving simultaneous adjustment of a first range and a second range via the slider handle, by increasing (or decreasing) the number of pixels of a particular color or fill pattern associated with both the first range and the second range. This is described in more detail below with respect to FIG. 6. Examples of real-time adjustment of output through coordinated slider knob adjustments are shown in FIGS. 12 through 16.
[0050] Returning to block 412, if coordination is not requested, method 400 proceeds to block 414 to determine whether uncoupling is requested (e.g., via user input received in block 402). In one example, the processor may output, via a display device of the user interface, a uncoupling option in a slider knob control menu that asks the user or operator whether they want to enable a uncoupling mode of operation for the slider knob. As such, the processor may determine that uncoupling is requested in response to the user interface receiving user input selecting the uncoupling option in the slider knob control menu. Specifically, the user may select the uncoupling option via a user input device using a cursor, touch gestures, or other form of pre-programmed input. As another example, the processor may determine that uncoupling is not requested in response to the user interface receiving user input not selecting the uncoupling option in the slider knob control menu. In other examples, not receiving a selection of the disconnect option may include receiving a different prompt or selection of an action, such as receiving a selection of the connect option, as described above in block 412. Another example of not receiving a selection of the disconnect option may include receiving a user input that closes the slider knob control menu without selecting an option.
[0051] If disassociation is requested, method 400 proceeds to block 418 and includes disassociating the first slider knob at the first range maximum and the second slider knob at the second range minimum from the slider handle such that the first range maximum is independent of the second range minimum. For example, disassociating the first slider knob and the second slider knob from the slider handle may include no longer displaying the slider handle in the user interface. Further, the associated thumb, including both the first thumb and the second thumb, may no longer be displayed; instead, the first thumb and the second thumb may be displayed as separate graphical components. Once the first thumb at the first range maximum and the second thumb at the second range maximum are disassociated, the slider handle may be made inaccessible to the user. An example sequence illustrating the decoupling of the first and second slider knobs is described below with respect to FIG.
[0052] At block 422, method 400 includes adjusting the first range maximum without adjusting the second range minimum in response to receiving user adjustment of the first slider knob via the user interface. For example, upon receiving user adjustment of the first slider knob, the displayed position of the first slider knob and the corresponding numerical value of the first range maximum can be adjusted (e.g., changed) in real time, while the displayed position of the second slider knob and the corresponding numerical value of the second range minimum can be maintained and unchanged. In this manner, the first slider knob and the second slider knob can be adjusted independently, which is also referred to herein as operating the sliders in a decoupled mode. An example of operating slider knobs in a decoupled mode may include, in response to receiving user input (e.g., via a user input device) selecting a first knob in the groove and adjusting the position of the first knob, the processor adjusting the displayed position and numerical value of the first knob, but not the second knob, to increase or decrease a first range maximum without affecting a second range minimum.
[0053] At block 424, method 400 includes adjusting the second range minimum without adjusting the first range slider maximum in response to receiving user adjustment of the second slider knob via the user interface. By way of example, receiving user adjustment of the second slider knob can adjust (e.g., change) the displayed position of the second slider knob and the corresponding numerical value of the second range minimum in real time, while preserving the displayed position of the first slider knob and the corresponding numerical value of the first range maximum. Thus, an example of operating the slider knobs in a decoupled mode can include, in response to the user interface receiving user input (e.g., via a user input device) selecting the second knob in the groove and adjusting the position of the second knob, the processor adjusting the displayed position and numerical value of the second knob, but not the first knob, to increase or decrease the second range minimum without affecting the first range maximum. Method 400 then returns.
[0054] Operating the slider knobs in a decoupled mode provides increased flexibility in adjusting the output of the medical image processing system in real time or near real time based on user input received at the user interface. For example, the processor may update a segmented output displayed in a graphical user interface in response to receiving an independent adjustment of one of the first range or the second range via the corresponding slider knob, resulting in an increase (or decrease) in the number of pixels of color or fill pattern associated with one of the first range or the second range, but not the other of the first range and the second range. This is described in more detail below with respect to FIG. 6.
[0055] Returning to block 414, if decoupling is not requested, method 400 proceeds to block 410 and includes retaining the current slider control settings as described above. As one example, the current slider settings may include operating in a coordinated mode. As such, the slider handles may be visually output via a display device of the user interface, and the first range maximum and second range minimum values may be simultaneously adjusted as described herein in block 420. As another example, the current slider settings may include that decoupling is already enabled, and the sliders may continue to operate in a decoupling mode such that the first slider knob and the second slider knob are independently adjusted as described above in blocks 422 and 424. Method 400 then returns.
[0056] A second example method 500 for automatically linking and unlinking slider knobs via input received through a user interface is shown in FIG. 5 . In one embodiment, method 500 is performed by medical image processing system 100 of FIG. 1 , and the user interface may be user interface 130 of FIG. 1 . As such, method 500 is described with respect to the systems and components described above with respect to FIGS. 1 through 3 , but may be performed by other systems / components without departing from the scope of this disclosure. As described with respect to method 400, method 500 may be performed by a processor (e.g., processor 102 of FIG. 1 ) according to instructions stored in non-transitory memory (e.g., non-transitory memory 104 of FIG. 1 ). While method 500 is described with respect to link and unlink modes for a single pair of adjacent knobs, it will be understood that method 500 may be applied to more than one pair of adjacent knobs. As described herein with respect to method 400, adjacent pairs of knobs may be linked and delinked via method 500 independently of other adjacent pairs of knobs.
[0057] At block 502, method 500 includes receiving user input via a user interface. As an example, the user input may be obtained by a user input device, such as user input device 134 of FIG. 1, and displayed to a user via a display device, such as display device 132 of FIG. 1. As described above with respect to FIG. 1, one or both of the user input device and the display device may be operatively coupled to the user interface. Further details regarding receiving user input via a user interface are described above in block 402 of FIG. 4.
[0058] At block 504, method 500 includes determining whether the first slider knob is within a threshold distance of the second slider knob. As described above with respect to FIG. 4, the first slider knob defines a first range maximum (e.g., the maximum of the first range) and the second slider knob defines a second range minimum (e.g., the minimum of the second range that includes values greater than the first range). The threshold distance may be calibrated to enable automatic linking and dislinking of the first and second slider knobs without user input, such as the slider knob control menu entry described above with respect to FIG. 4. The threshold distance may be a predetermined non-zero number of pixels or other measurement (e.g., number of millimeters) stored in non-transient memory. As a non-limiting example, the threshold distance may be a value between 1 and 500 pixels. In some examples, the processor may determine that the first slider knob is within the threshold distance from the second slider knob in response to receiving user input (e.g., at block 502) adjusting the first slider knob to a slider position in the groove that is less than or equal to the threshold distance from the second slider knob. As another example, the processor may determine that the first slider knob is within the threshold distance from the second slider knob in response to receiving user input adjusting the second slider knob to a position in the groove that is less than or equal to the threshold distance from the first slider knob. In yet another example, the processor may determine that the first slider knob is within the threshold distance of the second slider knob when the first slider knob and the second slider knob are already operating in a linked mode (e.g., the linked mode described above in block 420 of FIG. 4).
[0059] If the first slider knob is not within the threshold distance of the second slider knob, method 500 proceeds to block 516 and includes adjusting the first range maximum without adjusting the second range minimum in response to receiving user adjustment of the first slider knob via the user interface. Determining that the first slider knob is not within the threshold distance of the second slider knob may include the first slider knob being located in a groove greater than the threshold distance from the second slider knob. As such, the processor may operate the first slider knob and the second slider knob in a disjointed mode via a display device of the user interface and may not output a slider handle used when operating in the linked mode. An example of operating the first slider knob in a decoupled mode may include receiving an adjustment of the first slider knob and updating in real time the displayed position of the first slider knob in the groove and the corresponding numerical value of the first range maximum while simultaneously adjusting (e.g., changing) the first slider knob, while preserving (and not updating) the displayed position of the second slider knob in the groove and the corresponding numerical value of the second range minimum. An example of adjusting a first range maximum without adjusting a second range minimum in response to receiving a user adjustment of a first slider knob via a user interface is described above with reference to block 422 of FIG. 4.
[0060] At block 518, method 500 includes adjusting the second range minimum without adjusting the first range maximum in response to receiving user adjustment of the second slider knob via the user interface. An example of operating the second slider knob in a disjointed mode may include receiving the adjustment of the second slider knob and updating (e.g., changing) in real time the displayed position of the second slider knob in the groove and the corresponding numerical value of the second range minimum while preserving (and not updating or changing) the displayed position of the first slider knob and the corresponding numerical value of the first range maximum. An example of adjusting the second range minimum without adjusting the first range maximum in response to receiving user adjustment of the second slider knob via the user interface is described above with respect to block 424 of FIG. 4 . Method 500 returns.
[0061] Returning to block 504, if the first slider knob is within the threshold distance of the second slider knob, method 500 proceeds to block 506 and includes linking the first slider knob at the first range maximum to the second slider knob at the second range minimum such that the first range maximum is equal to the second range minimum. As described herein, the slider handle couples the position of the first slider knob at the first range maximum with the position of the second slider knob at the second range minimum such that the first range maximum is equal to the second range minimum, as described above with respect to block 416 of FIG. 4.
[0062] At block 508, method 500 includes simultaneously adjusting the first range maximum and the second range minimum in response to receiving user adjustment of the slider handle via the user interface. Receiving user adjustment of the slider handle may include receiving user adjustment in a predetermined touch zone configured to adjust the display positions of the first slider knob and the second slider knob in unison such that the second range minimum value and the first range maximum value share a single numeric value and overlapping position in the groove, as described above. An example of simultaneously adjusting the first range maximum and the second range minimum in response to receiving user adjustment of the slider handle via the user interface is described above with reference to block 420 of FIG. 4.
[0063] At block 510, method 500 includes determining whether a predetermined disengagement gesture is received. In response to receiving the predetermined disengagement gesture, the processor may enable automatic disengagement of the first knob and the second knob without additional user input. The predetermined disengagement gesture may include a predefined interaction at a predefined location in the user interface stored in non-transitory memory. The predefined location may overlap one of the knobs and / or the slider handle. In one example, the predefined location may be a disengagement touch zone of the slider handle, as described with respect to FIG. 3 . In another example, the predefined location may be a distance of 1 mm from the disengagement touch zone. The predefined interaction may include a click or other preprogrammed gesture at the predefined location. For example, a click action or other pre-programmed gesture may include a left click via a mouse, a single finger tap via a trackpad or touchscreen, or other form of pre-programmed user input. As an illustrative example, a predetermined uncoupling gesture may include a user selecting a uncoupling touch zone of slider handles and dragging one of the slider thumbs greater than a threshold distance from the other slider thumb.
[0064] If the predetermined disassociation gesture is received, method 500 proceeds to block 514 and includes disassociating the first slider knob at the first range maximum and the second slider knob at the second range minimum from the slider handles such that the first range maximum is independent of the second range minimum. For example, in response to the processor enabling the disassociation mode, the display device may no longer display the slider handles in the user interface. Once the disassociation mode is enabled, the slider handles may be made inaccessible to the user. Each slider knob may then be operated in the disassociation mode, as described above in blocks 516 and 518.
[0065] Returning to block 510, if a predetermined disengagement gesture is not received, method 500 proceeds to block 512 and includes maintaining display and control of the linked slider knob. As such, the slider handle may continue to be visually output via the display device of the user interface, and the processor may continue to operate the slider knob in a linked mode to simultaneously adjust the first range maximum and the second range minimum, as described herein in block 420 of FIG. 4 . Method 500 returns. In this manner, the processor may control the operation of the slider knob and the corresponding adjustments to the first range minimum and the second range maximum with reduced input from the user.
[0066] FIG. 6 illustrates an example method 600 for adjusting a medical image via a multi-range slider with coordinated and uncoordinated modes of operation. In one embodiment, method 600 is performed by medical image processing system 100 of FIG. 1 , and the user interface may be user interface 130 of FIG. 1 . As such, method 600 is described with respect to the systems and components described above with respect to FIGS. 1 through 3 , but may also be performed by other systems / components without departing from the scope of this disclosure. As described with respect to method 400, method 600 may be performed by a processor according to instructions stored in non-transitory memory (e.g., processor 102 and non-transitory memory 104 of FIG. 1 ). While method 600 is described with respect to a single medical image, it will be understood that method 600 may be applied to more than one medical image. For example, a first medical image may be analyzed independently of or in conjunction with a second medical image. In one embodiment, a single multi-range slider may adjust ranges for multiple parameters of interest. In another embodiment, multiple multi-range sliders may adjust ranges for multiple parameters of interest.
[0067] At block 602, method 600 includes obtaining a medical image to be analyzed. In some embodiments, the medical image may be generated by an imaging system such as an ultrasound imaging system, a magnetic resonance imaging (MRI) system, a computed tomography (CT) system, a single photon emission computed tomography (SPECT) system, or the like. The medical image generated by the imaging system may determine anatomical features of the patient of interest to aid in the diagnosis of a patient's disease or other physical condition. For example, a patient's lungs may be characterized in a chest CT image to detect and quantify various types of lung lesions. In another example, a patient's brain may be characterized in a computed tomography angiography (CTA) image to differentiate cerebral blood vessels for the study of ischemic stroke. It will be understood that the above examples are illustrative and do not limit the scope of the present disclosure. As such, method 600 may be applied to other anatomical features and medical image types in addition to those described above.
[0068] At block 604, method 600 includes receiving initial settings for the output ranges. In some examples, the initial settings may be stored in a non-transitory memory (e.g., the medical image analysis module of FIG. 1 ) and retrieved in response to receiving a selection of an analysis to be performed on the medical image. In other examples, the initial settings may be received via user input. For example, a user may manually define the initial settings by entering text or selecting values (e.g., from a drop-down menu) that define each of the output ranges. The output ranges may include multiple different ranges of pixel values corresponding to features of the medical image, such as tissue type or lesion type. In one embodiment, the output ranges may include pixel value ranges used to segment multiple anatomical features in the medical image to differentiate between tissue types, lesion types, etc. As another example, the output ranges may include multiple different temporal ranges. For example, the temporal ranges may be used for composite medical images formed from a time-based medical image sequence. As a non-limiting example, the temporal ranges may be used to indicate the location of contrast dye in the blood vessels of a patient's brain with respect to time. Other embodiments may use other parameter ranges to visualize the parameters of interest in the medical images displayed in the user interface to aid in medical diagnosis.
[0069] Additionally, each output range includes an associated visual indicator. Each visual indicator may include a color, fill pattern, line style, or the like that visually distinguishes each visual indicator from the others. For example, a first visual indicator may be calibrated to distinguish blood vessels, a second visual indicator may be calibrated to distinguish lesions, and a third visual indicator may be calibrated to distinguish healthy tissue. As such, the initial setting of the output ranges may define the pixel values or temporal values of the medical image to be represented by each visual indicator in the analysis of the medical image. Furthermore, the output ranges may be adjusted via a multi-range slider, such that each output range may include a range of the multi-range slider, as described in more detail below. For example, a first range of the multi-range slider may be functionally associated with a first visual indicator, a second range of the multi-range slider may be functionally associated with a second visual indicator, and so on.
[0070] At block 606, method 600 includes determining whether an output range adjustment has been received. The processor can determine whether an output range adjustment has been received using user input received via a user input device. The user input can include adjustments to the position of a slider handle or slider knob. As described above with respect to FIGS. 2 through 5, each slider knob can include an interactive element that defines one minimum or maximum value of the output range. Furthermore, as described above with respect to FIGS. 3 through 5, a slider handle can couple the position and adjustment of two adjacent slider knobs from two adjacent ranges (e.g., the maximum value of a first lower range and the minimum value of a second higher range).
[0071] If no output range adjustments have been received, method 600 proceeds to block 608 and includes analyzing the medical image using the default settings for the output ranges. For example, the processor may not receive any adjustments of the slider knobs or slider handles, if present, via the user interface. As such, the processor may use the default settings for the output ranges in determining where to place each visual indicator in the analyzed medical image.
[0072] At block 618, the method 600 includes outputting the analyzed medical image to a display. The analyzed medical image may be a transformation of the medical image, with each portion (or region) of the medical image distinguished via a visual indicator, each portion (or region) distinguished according to pixel values or temporal data in each portion and a corresponding output range of the associated visual indicator. For example, the analyzed medical image may include a color overlay display with different colors for different tissue types. The method 600 returns.
[0073] Returning to block 606, if a split output range adjustment is received, method 600 proceeds to block 610 and includes determining whether the adjustment is for an associated slider knob. As an example, receiving the output range adjustment may include receiving a selection of a slider knob (e.g., in an unlinked mode of operation) or a slider handle (e.g., in an associated mode of operation) and a position adjustment of the slider knob or slider handle (e.g., to the left or right in the groove). As such, an adjustment is received for the output range associated with the adjusted slider knob or slider handle.
[0074] If the adjustment is for an associated slider knob, method 600 proceeds to block 612 and includes simultaneously adjusting adjacent slider ranges via the associated slider knob. Information regarding the operational settings of the multi-range slider may be stored in a user interface control module of the medical image processing system. In this manner, the processor can determine whether an adjustment was made to an associated slider knob by accessing the operational settings of the multi-range slider. Furthermore, a slider handle may only be output for an associated slider knob. As such, the processor can determine that an adjustment is for an associated knob in response to receiving a slider handle adjustment via the user interface. As described herein, associated slider knobs (e.g., those linked via slider handles) can simultaneously adjust adjacent ranges. For example, an adjustment to the position of a slider handle can increase the maximum value of a first range while also increasing the minimum value of a second range. Without any adjustment to the minimum value of the first range and the maximum value of the second range, the first range can be increased to encompass a larger range of values while the second range is decreased to encompass a smaller range of values. Examples of adjusting the associated slider knobs to adjust the medical image output range are described below in Figures 11-16, and illustrative examples of range output adjustments with the associated knobs are described below in Figures 7-10.
[0075] However, if it is determined in block 610 that the adjustment is not linked to the slider knob, method 600 proceeds to block 614 and includes adjusting the slider range independently of the adjacent slider range. As an example, if the multi-range slider's operational settings are accessed to indicate that the slider knob is operating in a unlinked mode, the processor may determine that the adjustment was made to the unlinked slider knob. As another example, the processor may determine that the adjustment is not linked to the slider knob in response to receiving an adjustment to one of the slider knobs but not to the slider handle. As described herein, the unlinked slider knob may adjust the corresponding slider range independently of the adjacent ranges. In one example, an adjustment to the unlinked knob position of a first range may decrease the maximum value of the first range while leaving the minimum value of the second range unchanged. Without any adjustment to the minimum value of the first range and the maximum value of the second range, the first range can be decreased to encompass a smaller range of values while the second range remains unchanged. An example of adjusting the decoupled adjustable slider knob to adjust the medical image output range is described below in Figure 11, and illustrative examples of range output adjustment with the decoupled knobs are described below in Figures 7 through 10.
[0076] At block 616, the method 600 includes analyzing the medical image using the adjusted settings for the output ranges. The processor analyzes the medical image using the output ranges defined by user input (e.g., adjustments to each range) received via the multi-range slider to determine where each visual indicator should be located in the analyzed medical image. In instances where the adjusted settings are received via linked slider knobs, a first region (e.g., a first group of pixels) corresponding to a first range and the first visual indicator is analyzed and adjusted simultaneously with a second region (e.g., a second group of pixels) corresponding to a second range and the second visual indicator. In instances where the adjusted settings are received via unlinked slider knobs, the first region is analyzed and adjusted independently of the second region, and vice versa.
[0077] At block 618, the method 600 includes outputting the analyzed medical image to a display device, as described above. The analyzed medical image reflects adjustments made to the output ranges via the multi-range sliders in real time or near real time. In one example where adjustments to linked slider knobs are received, the placement of a first visual indicator in the analyzed medical image may be adjusted simultaneously with a second visual indicator. For example, the size of a first region distinguished by a first visual indicator in the analyzed medical image may increase (or decrease) in real time or near real time simultaneously with the size of a second region distinguished by a second visual indicator in the analyzed medical image decreasing (or increasing). In another example where adjustments to unlinked slider knobs are received, the placement of a first visual indicator in the analyzed medical image may be adjusted in real time or near real time on the display device independently of the second visual indicator, or vice versa. For example, the size of a first region distinguished by a first visual indicator in the analyzed medical image may increase (or decrease) in real-time or near-real-time in response to adjustments to the first slider knob, while leaving the size and location of the second region unchanged. The method 600 returns so that the output analyzed medical image may continue to be adjusted in real-time in response to adjustments to the output range received via the multi-range slider.
[0078] Referring to FIG. 7 , a sequence 700 illustrating the linking of two adjacent ranges of the slider 200 depicted in FIG. 2 is shown. As such, components previously depicted in FIGS. 2 and 3 are numbered the same and will not be described again. The sequence 700 describes, with respect to time, example display output in a user interface (e.g., displayed by the display device 132 of the user interface 130 of FIG. 1 ) during the linking of two adjacent ranges. Furthermore, it will be understood that other embodiments may include alternative display output, number of adjacent ranges, and / or position adjustment of the unlinked and linked ranges. For example, the slider 200 may be formed as an arc instead of the linear slider depicted in FIG. 7 . As another example, the slider 200 may be oriented vertically rather than horizontally.
[0079] As illustrated in FIG. 2 , slider 200 includes a first range 214 (represented by vertical stripes) and a second range 216 (represented by a checkerboard pattern) and a plurality of thumbs. First thumb 202 defines a minimum value of first range 214, second thumb 204 defines a maximum value of first range 214, third thumb 208 defines a minimum value of second range 216, and fourth thumb 210 defines a maximum value of second range 216. Slider 200 further includes grooves 206, over which first range 214 and second range 216 can be adjusted. Grooves 206 include fixed ranges of values for the slider bar. The portion of groove 206 not included in either first range 214 or second range 216 is referred to herein as a range gap, and includes a range of values between first range 214 and second range 216 that are not included in either first range 214 or second range 216. The slider 200 can receive input via a cursor 212 that can be controlled by a user.
[0080] A first display output 702 of the sequence 700 occurs at time t1. In the first display output 702, the cursor 212 does not interact with the knob of the slider 200, and therefore no adjustment is made to either the first range 214 or the second range 216, nor to the movement of the slider knob. At time t2, the slider 200 receives user input via the cursor 212 selecting the third knob 208, as shown in a second display output 704 of the sequence 700. The user input further includes receiving via the cursor 212 an adjustment of the third knob 208 toward the second knob 204, as shown by a third display output 706 of the sequence 700 occurring at time t3. The third knob 208 is adjusted toward the second knob 204, decreasing the minimum value of the second range 216. Subsequently, the range gap between the first range 214 and the second range 216 decreases, with the second range 216 correspondingly increasing.
[0081] A fourth display output 708 occurs at time t4. The fourth display output 708 shows the slider handle 302 presented in FIG. 3 being output to the user interface. The slider handle 302 links the second knob 204 and the third knob 208 such that these knobs are operatively coupled and share the same position in the groove 206. As such, the slider handle 302 links the maximum value of the first range 214 and the minimum value of the second range 216. Furthermore, the second knob 204 and the third knob 208 can be adjusted simultaneously in response to receiving user input to the slider handle 302. The linkage mode of the slider 200 is enabled for the remainder of the sequence 700. Furthermore, since the second knob 204 is linked to the third knob 208 via the slider handle 302, there is no longer a range gap between the first range 214 and the second range 216.
[0082] At time t5, the user interface receives user input in a first touch zone of the slider handle 302 (e.g., first region 310 in FIG. 3 ) dragging the slider handle 302 toward the fourth knob 210, as indicated by the direction of the arrow in the fifth display output 710 of the sequence 700. In response to receiving the user input in the first touch zone of the slider handle 302, the shared position of the second knob 204 and the third knob 208 is adjusted toward the fourth knob 210, as indicated by the sixth display output 712 at time t6. As a result, the maximum value of the first range 214 and the minimum value of the second range 216 both increase. Furthermore, the width of the first range 214 increases while the width of the second range 216 decreases.
[0083] 8, there is shown a sequence 800 illustrating the decoupling of two adjacent ranges of the slider 200. As such, components previously presented in FIGS. 2 and 3 are given the same reference numerals and will not be described again. The sequence 800 describes the display output of the user interface (e.g., as displayed by the display device 132 of FIG. 1) with respect to time during the decoupling of the two adjacent ranges.
[0084] A first display output 802 of the sequence 800 occurs at time t1. In the first display output 802, the second slider knob 204 and the third slider knob 208 are operating in linked mode. The cursor 212 is not receiving user input, and therefore no adjustment is made to either the first range 214 or the second range 216, or to the movement of the slider knobs.
[0085] At time t2, the user interface receives user input in a second touch zone (e.g., second region 312 described above with respect to FIG. 3 ) of slider handle 302 via cursor 212, as shown in second display output 804 of sequence 800. As a result of receiving user input in the second touch zone, second knob 204 and third knob 208 are decoupled, allowing the knobs to be adjusted independently, and slider handle 302 is no longer output, as shown by third display output 806 of sequence 800 occurring at time t3.
[0086] A fourth display output 808 occurs at time t4. The fourth display output 808 shows that the second knob 204 is adjusted toward the first knob 202 based on user input received via the cursor 212, as indicated by the direction of the arrow. As a result, the maximum value of the first range 214 decreases, while the second range 216 remains unchanged, as indicated by a fifth display output 810 at time t5. Furthermore, the second knob 204 continues to be adjusted toward the first knob 202 based on user input received via the cursor 212, causing the range gap between the first range 214 and the second range 216 to increase, as indicated by a sixth display output 812 output at time t6 of the sequence 800. As a result of the adjustment of the position of the second knob 204 in the unlinked mode, the width of the first range 214 decreases, while the width of the second range 216 remains unchanged.
[0087] Turning now to FIG. 9, a sequence of actions 900 illustrating the coordination of three adjacent ranges of a slider 901 of a user interface is shown. The sequence of actions 900 describes, with respect to time, an example display output in a user interface (e.g., as displayed by display device 132 of FIG. 1) for control of the three adjacent ranges. Slider 901 is similar to slider 200 illustrated in FIG. 2. As such, components previously illustrated in FIGS. 2 and 3 are numbered the same and will not be described again. For example, slider 901, like slider 200 of FIGS. 2 and 6-7, includes first range 214 and second range 216, and further includes a third range 922 (indicated, for example, by a cross-hatched pattern). A fifth knob 934 defines a minimum value of the third range, and a sixth knob 936 defines a maximum value of the third range.
[0088] A first display output 902 of the continuous operation 900 occurs at time t1. In the first display output 902, the cursor 212 does not interact with the knob of the slider 901, and therefore no adjustment is made to any of the first range 214, second range 216, third range 922, or movement of the slider knob. At time t2, the slider 901 receives user input via the cursor 212 selecting the third knob 208, as shown in a second display output 904 of the continuous operation 900. The user input further includes receiving via the cursor 212 an adjustment of the third knob 208 toward the second knob 204, as indicated by the direction of the arrow in the second display output 904. As a result, the minimum value of the second range 214 decreases, and the range gap between the first range 214 and the second range 216 decreases, as shown by a third display output 906 of the continuous operation 900 occurring at time t3.
[0089] User input continues to adjust the third knob 208 toward the second knob 204, as indicated by the direction of the arrow in the third display output 906. A fourth display output 908 occurs at time t4. The fourth display output 908 indicates that the second knob 204 and the third knob 208 are operated in a linked mode. The fourth display output 908 indicates that the first slider handle 302a operatively couples (e.g., links) the second knob 204 and the third knob 208 such that the second knob 204 and the third knob 208 may be adjusted simultaneously. The first slider handle 302a links the maximum value of the first range 214 with the minimum value of the second range 216. In fourth display output 908, first slider handle 302a is not selected via cursor 212, and therefore, no adjustment is made to first slider handle 302a. Instead, the user interface receives user input via cursor 212 selecting fifth knob 934 at time t4. Further, the user input includes adjusting fifth knob 934 toward fourth knob 210, as shown by the direction of the arrow in fourth display output 908. As a result of adjusting the position of fifth knob 934 toward fourth knob 210, the minimum value of third range 922 decreases and the range gap between second range 216 and third range 922 decreases, as shown in fifth display output 910 at time t5 of continuous operation 900.
[0090] User input continues to adjust the fifth knob 934 toward the fourth knob 210, as indicated by the direction of the arrow in the fifth display output 910. A sixth display output 912 occurs at time t6. The sixth display output 912 indicates that the fourth knob 210 and the fifth knob 934 are operating in a linked mode. The sixth display output 912 indicates that the second slider handle 302b links the fourth knob 210 and the fifth knob 934 such that the fourth knob 210 and the fifth knob 934 may be adjusted simultaneously. The second slider handle 302b links the maximum value of the second range 216 with the minimum value of the third range 922. As such, there is no longer a range gap between the second range 216 and the third range 922.
[0091] Additionally, at time t6, the user interface receives user input via cursor 212 in the first touch zone of second slider handle 302b adjusting the position of second slider handle 302b toward first slider handle 302a so that the maximum of the second range and the minimum of the third range are both decreased, as shown by seventh display output 914 at time t7.
[0092] 10, a sequence of actions 1000 is shown illustrating the decoupling of three adjacent ranges of slider 901 of FIG. 9. As such, components previously presented in FIGS. 2 and 3 are numbered the same and will not be described again. Sequence of actions 1000 describes, with respect to time, an example display output of a user interface (e.g., as displayed by display device 132 of FIG. 1) during the decoupling of three adjacent ranges.
[0093] A first display output 1002 of the sequence 1000 occurs at time t1. The first display output 1002 shows the slider 901 having the second knob 204 and the third knob 208 operating in a coordinated mode, as indicated by the first slider handle 302a. Additionally, the first display output 1002 shows the fourth knob 210 and the fifth knob 934 also operating in a coordinated mode, as indicated by the second slider handle 302b.
[0094] At time t2, the user interface receives user input at the second touch zone (described above with respect to FIG. 3) of slider handle 302b via cursor 212, as shown by second display output 1004 of sequence 1000. In response to receiving user input at the second touch zone, which is the decoupling touch zone, the display device no longer outputs second slider handle 302b, thereby decoupling fourth knob 210 and fifth knob 934, as shown by third display output 1006 of sequence 1000 occurring at time t3, so that fourth knob 210 and fifth knob 934 may be adjusted independently.
[0095] A fourth display output 1008 occurs at time t4. The fourth display output 1008 shows the cursor 212 selecting the unlinked fifth knob 934 and adjusting the fifth knob 934 toward the sixth knob 936, as indicated by the direction of the arrow in the fourth display output 1008. As a result, as shown by the fifth display output 1010 at time t5, the minimum value of the third range 922 increases and a range gap occurs between the second range 216 and the third range 922. Furthermore, the second range 216 and the first range 214 remain unchanged. Additionally, the user interface receives user input via the cursor 212 in the second touch zone of the first slider handle 302a at time t5. In response to receiving user input at the second touch zone of first slider handle 302a, the display device no longer outputs first slider handle 302a, as shown by the sixth display output 1012 of sequence 1000 occurring at time t6. As a result, second knob 202 and third knob 204 operate in a decoupled mode, allowing second knob 202 and third knob 204 to be adjusted independently.
[0096] At time t7, the user interface receives user input via cursor 212 to select third knob 208, as shown by seventh display output 1014. Additionally, the user input received at time t7 adjusts third knob 208 toward fourth knob 210, as shown by the direction of the arrow in seventh display output 1014. As a result, third knob 208 is adjusted independently of the second knob, and second range 216 is adjusted independently of first range 214.
[0097] 11-13 show example display outputs of the user interface 1101. For example, each display output may be output to a display device such as the display device 132 of FIG. 1. The user interface 1101 includes a tool box 1104. The tool box 1104 may include, as some examples, visualization tools, selection tools, segmentation tools, measurement tools, and annotation tools. The user interface 1101 further includes an image display area 1102, which shows a medical image 1106 of a patient's lungs and a segmented output 1108 of the medical image 1106. The segmented output 1108 shows a transformed version of the medical image 1106 with a colored overlay 1110 visually distinguishing different portions of the segmented output 1108 according to a segmentation range defined in a table 1112 of the user interface 1101. In the illustrated example, table 1112 includes a first column 1114, a second column 1116, a third column 1118, a fourth column 1120, and a fifth column 1122, although other numbers of columns and rows may be included in table 1112. Additionally, in some embodiments, user interface 1101 may include more than one table or may not show table 1112.
[0098] A first column 1114 defines a range name for at least one row of the table 1112. A second column 1116 defines a plurality of ranges of image values (e.g., Hounsfield Units or HU) and corresponding colors in the color overlay 1110 to be used for image portions (e.g., pixels) that fall within the given range for each row. A third column 1118 defines the percentage of pixels within the right lung that fall within the given range for each row. A fourth column 1120 defines the percentage of pixels within the left lung that fall within the given range for each row. A fifth column 1122 defines the percentage of pixels within the combined left and right lungs and lung volume that fall within the given range for each row.
[0099] User interface 1101 further includes multi-range sliders 1124 that can be used to adjust the range of image values contained in each sub-range of split output 1108 and visually indicated via colored overlay 1110. Multi-range sliders 1124 include adjustable knobs, and each pair of adjacent adjustable knobs can be operated in a coordinated or uncoordinated mode according to embodiments described herein.
[0100] The multi-range slider includes a first range 1128, a second range 1134 that is higher than the first range 1128 (e.g., includes a larger range of values), and a third range 1142 that is higher than the second range 1134. The first range 1128 corresponds to the blue region of the colored overlay 1110 and includes a first knob 1126 that defines a minimum value of the first range 1128 and a second knob 1130 that defines a maximum value of the first range 1128. The second range 1134 corresponds to the green region of the colored overlay 1110 and includes a third knob 1132 that defines a minimum value of the second range 1134 and a fourth knob 1136 that defines a maximum value of the second range 1134. The third range 1142 corresponds to the red area of the colored overlay 1110 and includes a fifth knob 1140 that defines the minimum value of the third range 1142 and a sixth knob 1144 that defines the maximum value of the third range 1142.
[0101] The colored overlay 1110 of the segmented output 1108 can be used to visually distinguish different tissues shown in the medical image 1106 according to the ranges defined by the multi-range slider 1124. As a non-limiting example, the second range 1134 of the multi-range slider 1124 may represent a lesion, and the third range 1142 may represent a blood vessel. Additionally, the multi-range slider 1124 may include a range gap that defines a range of values that are not included in the first range 1128, the second range 1134, or the third range 1142. In some examples, the range gap may include image values that are not expected to represent target tissues for image segmentation. As such, the value of the range gap can be adjusted in response to adjustments to each range of the multi-range slider 1124 (e.g., the first range 1128, the second range 1134, and the third range 1142) to exclude such data from the colored overlay 1110 of the segmented output 1108.
[0102] It will be understood that the user interface 1101 may include more or fewer components than those shown in Figures 11-13 and configurations other than those shown in Figures 11-13, and that Figures 11-13 provide an illustrative example of a user interface 1101 that includes a multi-range slider 1124.
[0103] Referring first to FIG. 11 , an example display output 1100 is shown. In display output 1100, second knob 1130 and third knob 1132 are linked (e.g., operating in a first mode also referred to as a linked mode) as indicated by first slider handle 1138a. First slider handle 1138a may be one embodiment of slider handle 302 shown in FIG. 3 and operates as described above. In contrast, fourth knob 1136 and fifth knob 1140 are unlinked (e.g., operating in a second mode also referred to as a unlinked mode). As an example, in response to receiving an adjustment to first slider handle 1138a, the maximum value of first range 1128 and the minimum value of second range 1134 can both be adjusted, and split output 1108 can be adjusted in real time or near real time correspondingly to reflect the changes made to both first range 1128 and second range 1134. In contrast, the maximum value of second range 1134 and the minimum value of third range 1142 can be adjusted independently. For example, in response to an input to fourth knob 1136, the maximum value of second range 1134 can be adjusted without adjusting the minimum value of third range 1142, and the corresponding green portion indicated via colored overlay 1110 of split output 1108 can be adjusted without adjusting the red portion of colored overlay 1110.
[0104] 12, an example display output 1200 is shown. Display output 1200 illustrates adjustments to multi-range slider 1124 relative to first display output 1100 of FIG. 11. Box 1202 highlights each range adjusted via adjustments to multi-range slider 1124 between display output 1100 and display output 1200, and the corresponding color in color overlay 1110. Additionally, second range 1134 and third range 1142 are operating in a linked mode, as indicated by second slider handle 1138b surrounding fourth knob 1136 and fifth knob 1140. As shown in box 1202, the minimum value of the third range 1142 is adjusted in response to receiving user input via the second slider handle 1138b, so that the minimum value of the third range 1142 is equal to the maximum value of the second range 1134 and a range gap no longer exists.
[0105] Comparing display output 1100 of FIG. 11 with display output 1200 of FIG. 12, first range 1128 and second range 1134 remain unchanged, while third range 1142 encompasses a larger range of values because the minimum value of third range 1142 decreases (e.g., due to adjustment of fifth knob 1140 toward fourth knob 1136). Furthermore, third range 1142 is coupled to second range 1134 via second slider handle 1138b, ensuring simultaneous real-time or near-real-time adjustment of the second and third ranges. Specifically, the minimum value of first range 1128 is maintained at −1024 HU and the maximum value of the first range is maintained at −487 HU, while the minimum value of second range 1134 is maintained at −487 HU and the maximum value of second range 1134 is maintained at −268 HU. The minimum of third range 1142 decreases from −30 HU to −268 HU, and the maximum of third range 1142 remains at 3071 HU, increasing the range of values included in third range 1142 and resulting in additional red content in color overlay 1110 of segmented output 1108. As described above with respect to FIG. 11 , adjusting multi-range slider 1124 results in real-time or near-real-time adjustments to segmented output 1108 and color overlay 1110. For example, in response to receiving user input via second slider handle 1138 b, the minimum of third range 1142 decreases, and a greater percentage of pixels in the right lung (third column 1118), left lung (fourth column 1120), and total lung volume (fifth column 1122) are represented by red in color overlay 1110. As such, the red (eg, blood vessel) areas of the colored overlay 1110 increase between the display output 1100 of FIG. 11 and the display output 1200 of FIG. 12 (eg, from 1.71% to 4.88% for the right lung).
[0106] Turning to FIG. 13, an example display output 1300 is shown. Display output 1300 illustrates adjustments to multi-range slider 1124 for both first display output 1100 of FIG. 11 and second display output 1200 of FIG. 12. Box 1302 highlights each range adjusted via adjustments to multi-range slider 1124 between display output 1200 and display output 1300, and the corresponding color in color overlay 1110. As shown in box 1302, the minimum value of third range 1142 has been adjusted in response to receiving user input via second slider handle 1138b, such that the minimum value of third range 1142 is equal to the maximum value of second range 1134, and a range gap no longer exists.
[0107] 12 with display output 1300 of FIG. 13, first range 1128 remains unchanged, while second range 1134 and third range 1142 have been adjusted. For example, second range 1134 encompasses a larger range of values because the maximum value of second range 1134 has increased, while third range 1142 encompasses a smaller range of values because the minimum value of third range 1142 has increased (e.g., due to adjustment of second slider handle 1138b toward sixth knob 1144). Specifically, the minimum value of first range 1128 remains at -1024 HU, and the maximum value of the first range remains at -487 HU. For the second range 1134, the minimum value of the second range 1134 is kept at -487 HU and the maximum value of the second range 1134 is increased from -268 HU to -56 HU, thus increasing the range of values included in the second range 1134 and resulting in additional green portions in the colored overlay 1110 of the split output 1108. The minimum value of the third range 1142 is increased from -268 HU to -56 HU and the maximum value of the third range 1142 is kept at 3071 HU, thus decreasing the range of values included in the third range 1142 and resulting in less red portions in the colored overlay 1110 of the split output 1108.
[0108] As described above with respect to FIGURE 11 , adjusting multi-range slider 1124 results in real-time or near-real-time adjustments to segmented output 1108 and color overlay 1110. For example, in response to receiving user input via second slider handle 1138b, the maximum value of second range 1134 increases, resulting in a greater percentage of pixels in the right lung (third column 1118), left lung (fourth column 1120), and total lung volume (fifth column 1122) represented by a green color in color overlay 1110. As such, the green (e.g., lesion) area in color overlay 1110 increases between display output 1200 of FIGURE 12 and display output 1300 of FIGURE 13 (e.g., an increase from 7.5% to 10.4% for the right lung). Similarly, in response to receiving user input via second slider handle 1138b, the minimum value of third range 1142 increases, resulting in a smaller percentage of pixels in the right lung (third column 1118), left lung (fourth column 1120), and total lung volume (fifth column 1122) represented by the color red in color overlay 1110. As such, the area of red (e.g., blood vessels) in color overlay 1110 decreases between display output 1200 of FIG. 12 and display output 1300 of FIG. 13 (e.g., from 4.9% to 2.0% for the right lung).
[0109] 14-16 show example display outputs of user interface 1401. For example, each display output may be output to a display device such as display device 132 of FIG. 1. User interface 1401 includes an image display area 1402 showing an axial image output 1406 of a patient's brain, a coronal image output 1408 of a patient's brain, and a sagittal image output 1410 of a patient's brain. Image outputs 1406, 1408, and 1410 each show a composite of multiple contrast-enhanced images acquired over the duration of a CTA scan, with colored overlays 1436, 1438, and 1440 visually distinguishing different portions of the axial, coronal, and sagittal image outputs according to a predetermined contrast uptake phase, as provided in key 1434, which is described in more detail below.
[0110] The user interface 1401 further includes a multi-range slider 1412 that can be used to adjust the range of temporal distribution of contrast enhancement included in the phase ranges of each of the image outputs 1406, 1408, and 1410 and visually indicated by colored overlays 1436, 1438, and 1440. The multi-range slider 1412 includes an adjustable knob that can be operated in a linked mode or a non-linked mode according to embodiments described herein. The value of the multi-range slider 1412 defines a time (e.g., in seconds) from the start of the CTA scan, with time increasing (e.g., in seconds) from left to right.
[0111] Multi-range slider 1412 includes a first range 1416, a second range 1424 that is higher than first range 1416 (e.g., includes later time values), and a third range 1430 that is higher than second range 1424. First range 1416 corresponds to the red region of colored overlays 1436, 1438, and 1440 and includes a first knob 1414 that defines a minimum value of first range 1416 and a second knob 1418 that defines a maximum value of first range 1416. Second range 1424 corresponds to the green region of colored overlays 1436, 1438, and 1440 and includes a third knob 1420 that defines a minimum value of second range 1424 and a fourth knob 1426 that defines a maximum value of second range 1424. The third range 1430 corresponds to the blue area of the colored overlays 1436, 1438, and 1440 and includes a fifth knob 1428 that defines the minimum value of the third range 1430 and a sixth knob 1432 that defines the maximum value of the third range 1430.
[0112] Colored overlays 1436, 1438, and 1440 of the image outputs 1406, 1408, and 1410 can be used to visually distinguish, with respect to time, different contrast-enhanced phases of the cerebral vasculature shown in the medical image according to the temporal range defined by the multi-range slider 1412. As shown in key 1434, a first range 1426 of the multi-range slider 1412 represents the anterior venous phase, a second range 1424 of the multi-range slider 1412 represents the venous phase, and a third range 1430 represents the posterior venous phase.
[0113] It will be understood that user interface 1401 may include more or fewer components than those shown in FIGS. 14-16 and configurations other than those shown in FIGS. 14-16, and that FIGS. 14-16 provide an illustrative example of user interface 1401 including a multi-range slider 1412.
[0114] Referring first to FIG. 14, an example display output 1400 is shown. In display output 1400, second knob 1418 and third knob 1420 are linked together (e.g., operating in a first mode, also referred to as a linked mode), as indicated by first slider handle 1422a. Similarly, fourth knob 1426 and fifth knob 1428 are linked together, as indicated by second slider handle 1422b. First slider handle 1422a and second slider handle 1422b may be an embodiment of slider handle 302 shown in FIG. 3 and operate as described above. As an example, the maximum value of first range 1416 and the minimum value of second range 1424 can both be adjusted in response to receiving an adjustment to first slider handle 1422a, and color overlays 1436, 1438, and 1440 can be adjusted in real time or near real time correspondingly to reflect the changes made to both first range 1416 and second range 1424. For example, the corresponding green and red portions indicated via color overlays 1436, 1438, and 1440 of image outputs 1406, 1408, and 1410 can be adjusted simultaneously. As another example, the maximum value of second range 1424 and the minimum value of third range 1430 can both be adjusted in response to receiving an adjustment to second slider handle 1422b, and color overlays 1436, 1438, and 1440 can be adjusted in real time or near real time in response to reflect the changes made to both second range 1424 and third range 1430. For example, the corresponding green and blue portions indicated via color overlays 1436, 1438, and 1440 of image outputs 1406, 1408, and 1410 can be adjusted simultaneously.
[0115] 15, an example display output 1500 is shown. Display output 1500 illustrates adjustments to multi-range slider 1412 relative to first display output 1400 of FIG. 14. As shown, the minimum value of second range 1424 and the maximum value of first range 1416 have both been adjusted toward first knob 1414 in response to receiving user input via first slider handle 1422a, resulting in the minimum value of second range 1424 and the maximum value of first range 1416 decreasing relative to display output 1400 of FIG. 14. Additionally, both the minimum value of the third range 1430 and the maximum value of the second range 1424 are adjusted in response to receiving user input via the second slider handle 1422b by adjusting the second slider handle 1422b toward the sixth knob 1432, resulting in the minimum value of the third range 1430 and the maximum value of the second range 1424 increasing relative to the display output 1400 of FIG. 14.
[0116] Comparing display output 1400 of Figure 14 with display output 1500 of Figure 15, first range 1416, second range 1424, and third range 1430 have all been changed. More specifically, first range 1416 encompasses a smaller time range because the maximum value of first range 1416 has decreased (e.g., due to adjustment of second knob 1418 toward first knob 1414), resulting in a reduction in the red portion of colored overlays 1436, 1438, and 1440 of image outputs 1406, 1408, and 1410. In contrast, second range 1424 encompasses a larger time range because the minimum value of second range 1424 has decreased and the maximum value of second range 1424 has increased (e.g., due to adjustment of third knob 1420 toward second knob 1418 and fourth knob 1426 toward fifth knob 1428). As a result, the temporal contrast enhancement distribution increases, as indicated by the green portions in the color overlays 1436, 1438, and 1440 of the medical image. Furthermore, the third range 1430 encompasses a smaller temporal range because the minimum value of the third range 1430 increases (e.g., due to adjustment of the fifth knob 1428 toward the sixth knob 1432). As such, the blue portions shrink in the color overlays 1436, 1438, and 1440 due to the smaller amount of contrast enhancement included in the smaller third range 1430.
[0117] Turning to Figure 16, an example display output 1600 is shown. Display output 1600 illustrates adjustments to multi-range slider 1412 relative to both display output 1400 of Figure 14 and display output 1500 of Figure 15. As shown, the minimum value of second range 1424 and the maximum value of first range 1416 have both been adjusted toward fourth knob 1426 in response to receiving user input via first slider handle 1422a, resulting in an increase in the minimum value of second range 1424 and the maximum value of first range 1416 relative to display output 1500 of Figure 15. Additionally, both the minimum value of the third range 1430 and the maximum value of the second range 1424 are adjusted in response to receiving user input via the second slider handle 1422b by adjusting the second slider handle 1422b toward the sixth knob 1432, resulting in the minimum value of the third range 1430 and the maximum value of the second range 1424 increasing relative to the display output 1500 of FIG. 15.
[0118] Comparing display output 1600 of FIG. 16 to display output 1500 of FIG. 15 , first range 1416, second range 1424, and third range 1430 have all been modified. More specifically, first range 1416 encompasses a larger temporal range because the maximum value of first range 1416 has increased (e.g., due to adjustment of second knob 1418 toward third knob 1420), adding red portions to color overlays 1436, 1438, and 1440 of image outputs 1406, 1408, and 1410. Furthermore, second range 1424 encompasses a smaller temporal range because the minimum value of second range 1424 has increased and the maximum value of second range 1424 has decreased. As a result, second range 1424 encompasses a smaller temporal contrast enhancement distribution, as indicated by the reduced green portions of color overlays 1436, 1438, and 1440 of the medical image. Furthermore, third range 1430 encompasses a smaller time range because the minimum value of third range 1430 increases (e.g., due to adjustment of fifth knob 1428 toward sixth knob 1432). As such, the blue portion shrinks further in color overlays 1436, 1438, and 1440 due to the smaller amount of contrast enhancement included in smaller third range 1430.
[0119] In this manner, a multi-range slider-type UI component allows a user to adjust the range endpoints of adjacent ranges via UI components called thumbs. When the thumbs are linked as described herein, the user can adjust the positions of both thumbs simultaneously due to the linked mode, which allows dependent movement of the thumbs via the slider handles. If the user determines that the medical image evaluation could benefit from more precise manual range adjustment, the user can disable the linked mode in the user interface and disengage the thumbs via the slider handles to operate in unlinked mode. Furthermore, in response to receiving a single user input, the processor can update the values contained in one or both of the adjacent ranges and update the resulting image analysis output, depending on whether the adjacent thumbs of the adjacent ranges are operating in linked or unlinked mode. As a result of operating adjacent knobs in one of a coordinated and an uncoordinated mode, more precise adjustments can be made to the multi-range slider with less input and in a reduced amount of time.
[0120] The technical effect of adjusting one or both of the maximum value of a first range and the minimum value of a second range adjacent to the first range on the slider bar in response to a single input on the slider bar based on whether linked or unlinked mode of operation is selected is that faster and more precise control of parameters associated with each of the first and second ranges is achieved.
[0121] The present disclosure also provides support for a method, the method including the steps of: displaying a slider bar including a groove having a fixed range of values, a first slider knob in the groove defining a maximum value of a first adjustable range, and a second slider knob in the groove defining a minimum value of a second adjustable range; operating the first slider knob and the second slider knob in one of a linked mode and a non-linked mode; and adjusting, in response to receiving a single user input, one or both of the maximum value of the first adjustable range and the minimum value of the second adjustable range based on whether the first slider knob and the second slider knob are operating in the linked mode or the non-linked mode. In a first example of the method, the method further includes, in response to operating the first slider knob and the second slider knob in the coordinated mode, setting a maximum value of the first adjustable range equal to a minimum value of the second adjustable range; in response to operating the first slider knob and the second slider knob in the coordinated mode, displaying the first slider knob and the second slider knob in the same position in the groove; and, in response to operating the first slider knob and the second slider knob in the coordinated mode, displaying a slider handle configured to simultaneously adjust both the first slider knob and the second slider knob. In a second example of the method, which optionally includes the first example, the step of adjusting one or both of the maximum value of the first adjustable range and the minimum value of the second adjustable range based on whether the first slider knob and the second slider knob are operating in a linked mode or a non-linked mode in response to receiving a single user input includes operating the first slider knob and the second slider knob in a linked mode at a first time, adjusting both the maximum value of the first adjustable range and the minimum value of the second adjustable range in response to receiving a single user input at the first time, operating the first slider knob and the second slider knob in a non-linked mode at a second time, and adjusting one of the maximum value of the first adjustable range and the minimum value of the second adjustable range, but not the other, in response to receiving a single user input at the second time.In a third example of the method, optionally including one or both of the first and second examples, the step of receiving a single user input at a first time includes receiving an adjustment of a position of a slider handle in the groove. In a fourth example of the method, optionally including one or more or each of the first through third examples, the step of receiving a single user input at a second time includes receiving an adjustment of a position of one of the first slider knob and the second slider knob in the groove, but not the other. In a fifth example of the method optionally including one or more or each of the first through fourth examples, the method further includes, in response to receiving a first predetermined input while operating the first slider knob and the second slider knob in the unlinked mode, transitioning from operating the first slider knob and the second slider knob in the unlinked mode to operating the first slider knob and the second slider knob in the linked mode; in response to receiving a second predetermined input while operating the first slider knob and the second slider knob in the linked mode, transitioning from operating the first slider knob and the second slider knob in the linked mode to operating the first slider knob and the second slider knob in the unlinked mode; and in response to transitioning from the linked mode to the unlinked mode, removing the slider handle. In a sixth example of the method, optionally including one or more or each of the first through fifth examples, receiving the first predetermined input includes selecting a linkage mode option in a slider knob control menu via the user interface, and receiving the second predetermined input includes selecting a linkage mode option in a slider knob control menu via the user interface.In a seventh example of the method, optionally including one or more or each of the first through sixth examples, receiving the first predetermined input includes receiving, via the user interface, an adjustment of one of the first slider knob and the second slider knob that brings the first slider knob within a threshold distance of the second slider knob in the groove, and receiving the second predetermined input includes receiving, via the user interface, a predetermined disengagement gesture at a disengagement touch zone of the slider handle. In an eighth example of the method, optionally including one or more or each of the first through seventh examples, the second adjustable range includes values in a fixed range of values adjacent to the first adjustable range and greater than the first adjustable range, and the method further includes the steps of displaying an overlay display on the medical image including a first visual indicator for pixels of the medical image having values within the first adjustable range and a second visual indicator for pixels of the medical image having values within the second adjustable range, and adjusting the overlay display in response to receiving a single user input, the adjusting step including adjusting one or both of the first visual indicator and the second visual indicator based on whether the first slider knob and the second slider knob are operating in an associated mode or an associated mode in response to receiving the single user input. In a ninth example of the method, optionally including one or more or each of the first through eighth examples, the step of adjusting one or both of the first visual indicator and the second visual indicator based on whether the first slider knob and the second slider knob are operating in an integrated mode or an unintegrated mode in response to receiving a single user input includes adjusting both the first visual indicator and the second visual indicator in response to receiving a single user input while the first slider knob and the second slider knob are operating in an integrated mode, and adjusting one of the first visual indicator and the second visual indicator but not the other in response to receiving a single user input while the first slider knob and the second slider knob are operating in an unintegrated mode.
[0122] The present disclosure also provides support for a method, the method including the steps of: displaying, via a user interface, an analysis output of a medical image, the analysis output including a first visual indicator for a first group of pixels of the medical image having values within a first adjustable range and a second visual indicator for a second group of pixels of the medical image having values within a second adjustable range; displaying, via the user interface, a slider bar including a first adjustable range and a second adjustable range in grooves having a fixed range of values; operating the slider bar in a first mode at a first time; and simultaneously adjusting both the first visual indicator and the second visual indicator in response to receiving, via the user interface, a first adjustment to the slider bar while operating in the first mode; operating the slider bar in a second mode at a second time; and adjusting one of the first visual indicator and the second visual indicator in response to receiving, via the user interface, a second adjustment to the slider bar while operating in the second mode. In a first example of the method, the slider bar further includes a first adjustable knob defining a maximum value of a first adjustable range and a second adjustable knob defining a minimum value of a second adjustable range, and operating the slider bar in the first mode at a first time includes displaying, via a user interface, a slider handle configured to operatively couple and simultaneously adjust the first adjustable knob and the second adjustable knob; setting the maximum value of the first adjustable range equal to the minimum value of the second adjustable range; and simultaneously adjusting both the maximum value of the first adjustable range and the minimum value of the second adjustable range in response to receiving, via the user interface, a first adjustment to the slider bar via the slider handle.In a second example of the method, which optionally includes the first example, the step of operating the slider bar in a second mode at a second time includes not displaying a slider handle via the user interface; adjusting a maximum value of the first adjustable range and not adjusting a minimum value of the second adjustable range in response to receiving a second adjustment to the slider bar via the first adjustable knob via the user interface; and adjusting a minimum value of the second adjustable range and not adjusting a maximum value of the first adjustable range in response to receiving a second adjustment to the slider bar via the second adjustable knob via the user interface. In a third example of the method, optionally including one or both of the first and second examples, the step of simultaneously adjusting both the first visual indicator and the second visual indicator in response to receiving a first adjustment to the slider bar via the user interface while operating in the first mode includes simultaneously adjusting pixels of the medical image included in both the first pixel group and the second pixel group in real time in response to receiving the first adjustment to the slider bar, and updating in real time the analysis output displayed via the user interface based on the adjusted first pixel group and the adjusted second pixel group. In a fourth example of the method, optionally including one or more or each of the first through third examples, the step of adjusting one of the first visual indicator and the second visual indicator in response to receiving a second adjustment to the slider bar via the user interface while operating in the second mode includes adjusting pixels of the medical image included in one of the first pixel group and the second pixel group, and not adjusting the other, in real time in response to receiving the second adjustment to the slider bar, and updating in real time the analysis output displayed via the user interface based on the adjusted one of the first pixel group and the second pixel group.
[0123] The present disclosure also provides support for a system, the system comprising: a user interface; and a processor operatively coupled to the user interface and to executable instructions stored in a non-transitory memory, the instructions, when executed, causing the processor to: display, via the user interface, a slider bar including a first slider knob in a groove defining a maximum value of a first adjustable range; and a second slider knob in a groove defining a minimum value of a second adjustable range adjacent the first adjustable range and including a value greater than the first adjustable range; and, in response to receiving a predetermined associated instruction input via the user interface, displaying a slider bar including a first slider knob in a groove defining a maximum value of a first adjustable range and a second slider knob in a groove defining a minimum value of a second adjustable range adjacent the first adjustable range and including a value greater than the first adjustable range. the first slider knob and the second slider knob in a linked mode; while operating in the linked mode, displaying slider handles around the first slider knob and the second slider knob via the user interface, the slider handles including a first touch zone configured to receive input via the user interface and simultaneously adjust a maximum value of the first adjustable range and a minimum value of the second adjustable range in response to the input; and operating the first slider knob and the second slider knob in a non-linked mode in response to receiving a predetermined non-linked instruction input via the user interface. In a first example of the system, receiving the predetermined link instruction input via the user interface includes receiving a selection of a link mode in a slider knob control menu displayed via the user interface, and receiving the predetermined unlink instruction input via the user interface includes receiving a selection of a unlink mode in the slider knob control menu.In a second example of the system that optionally includes the first example, the step of receiving the predetermined link instruction input via the user interface includes receiving via the user interface an adjustment of one of the first slider knob and the second slider knob that brings the first slider knob within a threshold distance of the second slider knob in the groove, and the step of receiving the predetermined disengage instruction input via the user interface includes receiving via the user interface an input at a second touch zone of the slider handle configured to disengage the first slider knob and the second slider knob and hide the slider handle. In a third example of the system, optionally including one or both of the first and second examples, the processor executes further instructions stored in the non-transitory memory that cause the processor to not display the slider handle while operating in a disjointed mode; adjust a maximum value of the first adjustable range without adjusting a minimum value of the second adjustable range in response to receiving an adjustment to the first slider knob via the user interface while the first slider knob and the second slider knob are operating in a disjointed mode; and adjust a minimum value of the second adjustable range without adjusting a maximum value of the first adjustable range in response to receiving an adjustment to the second slider knob via the user interface while the first slider knob and the second slider knob are operating in a disjointed mode.In a fourth example of the system optionally including one or more or each of the first through third examples, the processor executes further instructions stored in the non-transitory memory, the instructions causing the processor to: display an overlay on the medical image via a user interface, the overlay including a first color for pixels of the medical image having values within a first adjustable range and a second color for pixels of the medical image having values within a second adjustable range; and displaying the first color and the second color in response to receiving input via the user interface at a first touch zone of the slider handle while operating in the linked mode. The control unit performs the steps of: adjusting pixels depicted by both the two colors; adjusting pixels depicted by the first color but not the second color in response to receiving an adjustment to the first slider knob through the user interface while the first and second slider knobs are operating in a disjointed mode; and adjusting pixels depicted by the second color but not the first color in response to receiving an adjustment to the second slider knob through the user interface while the first and second slider knobs are operating in a disjointed mode.
[0124] As used herein, the use of a singular element or step preceded by the indefinite article "a," "an," or "the" should be understood as not excluding a plurality of such elements or steps, unless the exclusion is expressly stated. Furthermore, references to "one embodiment" of the present invention should not be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Also, unless expressly stated to the contrary, embodiments "comprising," "including," or "having" an element or elements having a particular characteristic may include additional elements that do not have that characteristic. The term "including" is used as a standard language equivalent of "comprising," and the term "in which" is used as a standard language equivalent of "wherein." Furthermore, terms such as "first," "second," and "third" are used merely as labels, and do not impose numerical requirements or a particular positional order on the objects of these terms.
[0125] This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are considered to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements that have insubstantial differences from the literal language of the claims. [Explanation of symbols]
[0126] 100 Medical Image Processing System 200 Multi-range slider 202, 204, 208, 210 First to fourth knobs 206 Groove 212 cursor 214 First Range 216 Second Range 302 Slider Handle 302a First slider handle 302b Second Slider Handle 304 Interlocking knob 306 First Knob 308 Second knob 310 First Realm 312 Second Realm 400 First method for linking and unlinking slider thumbs 500 Second method for automatically linking and unlinking slider thumbs 600 Method for adjusting medical images via a multi-range slider 700 A series of links between two adjacent range knobs 702, 704, 706, 708, 710, 712 First to sixth display outputs 800 Series that unlinks two adjacent range knobs 802, 804, 806, 808, 810, 812 First to sixth display outputs 900 A series of three adjacent range knobs 901 Slider 902, 904, 906, 908, 910, 912, 914 First to seventh display outputs 922 Third Range 934 Fifth knob 936 Sixth Knob 1000 A series of three adjacent range knobs that are unlinked 1002, 1004, 1006, 1008, 1010, 1012, 1014 First to seventh display outputs 1100 display output 1101 User Interface 1102 Image display area 1104 Tool Box 1106 Medical Imaging 1108 Split Output 1110 Colored Overlay Display 1112 Table 1114, 1116, 1118, 1120, 1122 1st to 5th columns 1124 Multi-range slider 1126, 1130, 1132, 1136, 1140, 1144 First to sixth knobs 1128, 1134, 1142 First to third range 1138a First slider handle 1138b Second slider handle 1200, 1300, 1400, 1500, 1600 display output 1202 Box 1302 Box 1401 User Interface 1402 Image display area 1404 1406 Axial image output 1408 Coronal image output 1410 Sagittal image output 1412 Multi-range slider 1414, 1418, 1420, 1426, 1428, 1432 First to sixth knobs 1416, 1424, 1430 First to third range 1422a First slider handle 1422b Second Slider Handle 1434 keys 1436, 1438, 1440 Colored overlay display
Claims
1. displaying a slider bar including a groove having a fixed range of values, a first slider knob in the groove defining a maximum value of a first adjustable range, and a second slider knob in the groove defining a minimum value of a second adjustable range; operating the first slider knob and the second slider knob in one of a linked mode and a non-linked mode; adjusting, in response to receiving a single user input, one or both of the maximum value of the first adjustable range and the minimum value of the second adjustable range based on whether the first slider knob and the second slider knob are operating in the linked mode or the unlinked mode; A method comprising:
2. setting the maximum value of the first adjustable range equal to the minimum value of the second adjustable range in response to operating the first slider knob and the second slider knob in the linked mode; displaying the first slider knob and the second slider knob at the same position in the groove in response to operating the first slider knob and the second slider knob in the linked mode; displaying a slider handle configured to simultaneously adjust both the first slider knob and the second slider knob in response to operating the first slider knob and the second slider knob in the coordinated mode; 10. The method of claim 1 further comprising:
3. adjusting, in response to receiving the single user input, one or both of the maximum value of the first adjustable range and the minimum value of the second adjustable range based on whether the first slider knob and the second slider knob are operating in the linked mode or the unlinked mode, operating the first slider knob and the second slider knob in the linked mode at a first time; adjusting both the maximum value of the first adjustable range and the minimum value of the second adjustable range in response to receiving the single user input at the first time; operating the first slider knob and the second slider knob in the unlinked mode at a second time; adjusting one of the maximum value of the first adjustable range and the minimum value of the second adjustable range, and not adjusting the other, in response to receiving the single user input at the second time. The method of claim 2, comprising:
4. 4. The method of claim 3, wherein the step of receiving the single user input at the first time comprises receiving an adjustment of the position of the slider handle in the groove.
5. 4. The method of claim 3, wherein the step of receiving the single user input at the second time includes receiving an adjustment of the position of one of the first slider knob and the second slider knob in the groove, but not the other.
6. transitioning from operating the first slider knob and the second slider knob in the unlinked mode to operating the first slider knob and the second slider knob in the linked mode in response to receiving a first predetermined input while operating the first slider knob and the second slider knob in the unlinked mode; in response to receiving a second predetermined input while operating the first slider knob and the second slider knob in the linked mode, transitioning from operating the first slider knob and the second slider knob in the linked mode to operating the first slider knob and the second slider knob in the unlinked mode; removing the slider handle in response to transitioning from the linked mode to the unlinked mode.
3. The method of claim 2 further comprising:
7. 7. The method of claim 6, wherein the step of receiving the first predetermined input comprises selecting a linkage mode option in a slider knob control menu via a user interface, and the step of receiving the second predetermined input comprises selecting a dislinkage mode option in the slider knob control menu via the user interface.
8. 7. The method of claim 6, wherein receiving the first predetermined input comprises receiving, via a user interface, an adjustment of one of the first slider knob and the second slider knob that brings the first slider knob within a threshold distance of the second slider knob in the groove, and receiving the second predetermined input comprises receiving, via the user interface, a predetermined disengagement gesture at a disengagement touch zone of the slider handle.
9. The second adjustable range is adjacent to the first adjustable range and includes values in the fixed value range greater than the first adjustable range, and the method includes: displaying an overlay on the medical image including a first visual indicator for pixels of the medical image having values within the first adjustable range and a second visual indicator for pixels of the medical image having values within the second adjustable range; adjusting the overlay display in response to receiving the single user input, the adjusting step including adjusting one or both of the first visual indicator and the second visual indicator in response to receiving the single user input based on whether the first slider knob and the second slider knob are operating in the linked mode or the unlinked mode; 10. The method of claim 1 further comprising:
10. adjusting one or both of the first visual indicator and the second visual indicator in response to receiving the single user input based on whether the first slider knob and the second slider knob are operating in the linked mode or the unlinked mode, adjusting both the first visual indicator and the second visual indicator in response to receiving the single user input while operating the first slider knob and the second slider knob in the coordinated mode; adjusting one of the first visual indicator and the second visual indicator and not adjusting the other in response to receiving the single user input while operating the first slider knob and the second slider knob in the unlinked mode.
10. The method of claim 9, comprising:
11. displaying, via a user interface, an analysis output of the medical image, the analysis output including a first visual indicator for a first group of pixels of the medical image having values within a first adjustable range and a second visual indicator for a second group of pixels of the medical image having values within a second adjustable range; displaying, via the user interface, a slider bar including the first adjustable range and the second adjustable range in grooves having fixed ranges of values; operating the slider bar in a first mode at a first time; simultaneously adjusting both the first visual indicator and the second visual indicator in response to receiving a first adjustment to the slider bar via the user interface while operating in the first mode; operating the slider bar in a second mode at a second time; adjusting one of the first visual indicator and the second visual indicator in response to receiving a second adjustment to the slider bar via the user interface while operating in the second mode; A method comprising:
12. the slider bar further includes a first adjustable knob defining a maximum value of the first adjustable range and a second adjustable knob defining a minimum value of the second adjustable range, and the step of operating the slider bar in the first mode at the first time includes: displaying, via the user interface, a slider handle configured to operatively couple and simultaneously adjust the first adjustable knob and the second adjustable knob; setting the maximum value of the first adjustable range equal to the minimum value of the second adjustable range; simultaneously adjusting both the maximum value of the first adjustable range and the minimum value of the second adjustable range in response to receiving, via the user interface, the first adjustment to the slider bar via the slider handle; and The method of claim 11 , comprising:
13. The step of operating the slider bar in the second mode at the second time includes: not displaying the slider handle via the user interface; adjusting the maximum value of the first adjustable range and not adjusting the minimum value of the second adjustable range in response to receiving, via the user interface, the second adjustment to the slider bar via the first adjustable knob; adjusting the minimum value of the second adjustable range and not adjusting the maximum value of the first adjustable range in response to receiving via the user interface the second adjustment to the slider bar via the second adjustable knob; The method of claim 12, comprising:
14. and simultaneously adjusting both the first visual indicator and the second visual indicator in response to receiving the first adjustment to the slider bar via the user interface while operating in the first mode, the step of: simultaneously adjusting pixels of the medical image included in both the first group of pixels and the second group of pixels in real time responsive to receiving the first adjustment to the slider bar; updating the analysis output displayed via the user interface in real time based on the adjusted first group of pixels and the adjusted second group of pixels; The method of claim 11 , comprising:
15. adjusting one of the first visual indicator and the second visual indicator in response to receiving the second adjustment to the slider bar via the user interface while operating in the second mode, adjusting pixels of the medical image included in one of the first group of pixels and the second group of pixels, but not adjusting the other group of pixels, in real time responsive to receiving the second adjustment to the slider bar; updating the analysis output displayed via the user interface in real time based on the adjusted one of the first group of pixels and the second group of pixels; The method of claim 11 , comprising:
16. a user interface; a processor operatively coupled to the user interface and to executable instructions stored in non-transitory memory; wherein the instructions, when executed, cause the processor to: displaying, via the user interface, a slider bar including a first slider knob in a groove defining a maximum value of a first adjustable range, and a second slider knob in said groove defining a minimum value of a second adjustable range adjacent to the first adjustable range and including a value greater than the first adjustable range; operating the first slider knob and the second slider knob in a coordinated mode in response to receiving a predetermined coordinated instruction input via the user interface; displaying, via the user interface, slider handles around the first slider knob and the second slider knob while operating in the linked mode, the slider handles including a first touch zone configured to receive input via the user interface and simultaneously adjust the maximum value of the first adjustable range and the minimum value of the second adjustable range in response to the input; operating the first slider knob and the second slider knob in a disjoint mode in response to receiving a predetermined disjoint instruction input via the user interface; A system that allows the following to be performed.
17. 17. The system of claim 16, wherein the step of receiving a predetermined link instruction input via the user interface includes receiving a selection of the link mode in a slider knob control menu displayed via the user interface, and the step of receiving a predetermined unlink instruction input via the user interface includes receiving the selection of the unlink mode in the slider knob control menu.
18. 17. The system of claim 16, wherein receiving a predetermined link instruction input through the user interface comprises receiving an adjustment of one of the first slider knob and the second slider knob through the user interface that brings the first slider knob within a threshold distance of the second slider knob in the groove, and receiving a predetermined disengage instruction input through the user interface comprises receiving an input through the user interface at a second touch zone of the slider handle configured to disengage the first slider knob and the second slider knob and hide the slider handle.
19. The processor executes further instructions stored in the non-transitory memory, the instructions causing the processor to: not displaying the slider handle while operating in the unlinked mode; adjusting the maximum value of the first adjustable range without adjusting the minimum value of the second adjustable range in response to receiving an adjustment to the first slider knob via the user interface while operating the first slider knob and the second slider knob in the unlinked mode; adjusting the minimum value of the second adjustable range without adjusting the maximum value of the first adjustable range in response to receiving the adjustment to the second slider knob via the user interface while operating the first slider knob and the second slider knob in the unlinked mode; The system of claim 16 , wherein the system:
20. The processor executes further instructions stored in the non-transitory memory, the instructions causing the processor to: displaying an overlay on the medical image via the user interface, the overlay including a first color for pixels of the medical image having values within the first adjustable range and a second color for pixels of the medical image having values within the second adjustable range; adjusting pixels depicted with both the first color and the second color in response to receiving the input at the first touch zone of the slider handle through the user interface while operating in the linked mode; adjusting pixels depicted with the first color and not the second color in response to receiving an adjustment to the first slider knob through the user interface while operating the first slider knob and the second slider knob in the unlinked mode; adjusting pixels depicted with the second color and not adjusting the first color in response to receiving the adjustment to the second slider knob via the user interface while operating the first slider knob and the second slider knob in the unlinked mode; The system of claim 16 , wherein the system:
Citation Information
Patent Citations
Data setting device
JP1997160601A
Image processing apparatus, image processing method, and program
JP2017080158A
Graphic user interface and a method thereof
US20100185976A1