User interface transition apparatus and method

Abstract

The present invention relates to a UI transition apparatus (2) for transitioning between a first user interface, UI, and a second UI of a medical imaging device (1), where the second UI is different from the first UI. The device (2) comprises a first communication interface (6), a second communication interface (7) and a computing unit (8). The first communication interface (6) is adapted to receive a first UI output (19) from the medical imaging device (1) and to send a first UI input (22) to the medical imaging device (1), where the first UI output (19) and the first UI input (22) correspond to the first UI. The second communication interface (7) is adapted to send a second UI output (21) to a UI arrangement (3) of the second UI and to receive a second UI input (20) from the UI arrangement (3), where the second UI output (21) and the second UI input (20) correspond to the second UI. The computing unit (8) is configured to translate the first UI output (19) into the second UI output (21) and translate the second UI input (20) into the first UI input (22) such that the medical imaging device (1) is operable using the second UI. The invention also relates to an associated method (18) for transitioning between the first UI and the second UI.

Description

Technical Field

[0001] This invention relates to medical imaging devices, and more particularly to a UI transition device for transitioning between a first user interface (UI) and a second UI of a medical imaging device, wherein the second UI is different from the first UI. The invention also relates to a method for transitioning between a first UI and a second UI of a medical imaging device, wherein the second UI is different from the first UI. Background Technology

[0002] User interfaces (UIs) in medical imaging are complex and diverse, particularly varying by vendor, due to the lack of standardization. Even though basic medical imaging devices may be very similar in technology, the naming and / or abbreviations of imaging protocols, the protocol parameters of sequences, and the technical sub-units of medical imaging devices differ from one another.

[0003] Staff using these UIs often need to switch between different vendors, leaving little time for training and practice with each UI type. Furthermore, all vendors frequently update their scanning technologies with software releases, new hardware, and related UI updates, increasing the learning curve significantly.

[0004] The proper operation of medical imaging equipment by staff is crucial for patient health. Furthermore, ensuring the imaging instruments are functioning correctly can be time-consuming and requires specialized knowledge.

[0005] Furthermore, the user interface (UI) of medical imaging equipment is complex: the planning and actual operation of medical imaging scans are performed via user input through multi-level menus, buttons, controls, and settings on the UI. This can lead to difficulties in executing imaging procedures quickly and easily, resulting in errors and reduced patient throughput, especially for inexperienced operators.

[0006] Furthermore, the flexibility to switch from one medical imaging device to another (e.g., when staff must work temporarily in different hospitals) is challenging due to the different UIs.

[0007] In their article "Remote Control of Magnetic Resonance Imaging Scans" (Proc. Intl. Soc. Mag.Reson. Med. 14 (2006)), JP Finn et al. described how to provide professional scanning support via remote control from a central hub.

[0008] International patent application WO2021 / 228541A1 describes a system and method for extracting and processing information from an imaging system in a multi-vendor environment.

[0009] US Patent Application US2021 / 0406673A1 describes apparatus, systems, and techniques for generating one or more interfaces, such as using one or more neural networks. Summary of the Invention

[0010] Therefore, the object of the present invention is to provide an apparatus and a corresponding method for solving the above-mentioned problems. In particular, the object of the present invention is to provide an apparatus and a corresponding method for switching between one user interface and another different user interface.

[0011] The object of the invention is achieved by the subject matter of the independent claims, wherein further embodiments are included in the dependent claims.

[0012] In one aspect of the invention, a user interface (UI) switching device is provided. The UI switching device is adapted to switch between a first UI and a second UI of a medical imaging device, wherein the second UI is different from the first UI.

[0013] In this context, "user interface" refers to both UI hardware and UI information. UI hardware can be a UI setup, such as a screen, keyboard, and mouse. UI information includes information exchanged between the medical imaging device and the user, particularly UI output (information exchanged from the medical imaging device to the user) and UI input (information entered by the user and sent to the medical imaging device).

[0014] The term "transformation" between the first and second UIs of a medical imaging device means that the UI transformation device simulates the second UI for use on the medical imaging device.

[0015] Although the second UI is different from the first UI, the second UI is also equivalent to the first UI, that is, the second UI can provide at least some of the functions of the first UI, and preferably can provide most or all of the functions of the first UI.

[0016] The UI transformation device includes a first communication interface, a second communication interface, and a computing unit.

[0017] The first communication interface is adapted to receive a first UI output from the medical imaging device and send a first UI input to the medical imaging device, wherein the first UI output and the first UI input correspond to the first UI. The first UI output and / or the first UI input can be transmitted using wired and / or wireless connections. For example, the first UI output can be transmitted via an HDMI, DVI, or VGA connection. As another example, the first UI input can be transmitted via a USB connection.

[0018] The second communication interface is adapted to send a second UI output to and receive a second UI input from the UI arrangement of the second UI, wherein the second UI output and the second UI input correspond to the second UI. The UI arrangement is UI hardware corresponding to the second UI and includes at least one output device (e.g., a screen and / or a speaker) and at least one input device (e.g., a mouse and / or a keyboard). The UI arrangement may be similar to or the same as the UI arrangement corresponding to the first UI (particularly when the UI arrangement includes standard hardware (e.g., a screen, keyboard, and mouse)), but may also differ from the UI arrangement corresponding to the first UI (particularly when at least one UI arrangement includes dedicated hardware).

[0019] The computing unit is configured to convert the first UI output into the second UI output and the second UI input into the first UI input, enabling the medical imaging device to operate using the second UI. In other words, the second UI output is a UI output equivalent to the first UI output but simulating the second UI. Similarly, the first UI input is a UI input equivalent to the second UI input but simulating the first UI. The first UI input is generated relative to the first UI output; for example, the mouse pointer position is relative to the screen output of the first UI. In effect, the UI conversion device represents a layer between the UI layout operated by the user and the host computer of the medical imaging device. Therefore, the user may only see and operate the second UI, while the medical imaging device functions as if it were controlled using the first UI.

[0020] Therefore, the UI transformation device allows users to operate medical imaging equipment, which is normally operated via a first UI, through a second UI. Thus, the UI of the medical imaging equipment can be transformed into a user-familiar UI. In particular, UIs from different vendors can be transformed into a single UI, enabling users to operate many different medical imaging devices using a single UI. This reduces the learning curve for users and improves the efficiency and reliability of operating medical imaging equipment.

[0021] According to embodiments, the medical imaging equipment is an ultrasound (US) imaging device, a digital X-ray (DXR) imaging device, a computed tomography (CT) imaging device, and / or a magnetic resonance imaging (MRI) device. All of these medical imaging devices operate using rather complex user interfaces (UIs), which are often different between different vendors. Therefore, for users who must operate medical imaging devices from different vendors, a UI switching device improves the operation of the medical imaging devices.

[0022] According to an embodiment, the second UI corresponds to the UI of another medical imaging device, wherein the other medical imaging device is a device of a different type from the stated medical imaging device. Specifically, the other medical imaging device may come from a different supplier than the stated medical imaging device, or from a different series of medical imaging devices, or belong to a different system type (e.g., with a different software version). Therefore, a user accustomed to the other medical imaging device can use its UI to operate the stated medical imaging device. This eliminates the need for additional training on the specific operation of the stated medical imaging device.

[0023] Alternatively, the second UI may not correspond to a specific medical imaging device. For example, the second UI may be optimized to simplify the transition between many different UIs (e.g., by incorporating combined functionality of many different UIs).

[0024] Alternatively, the second UI can correspond to, or even be equivalent to, the UI of another medical imaging device, but with limited functionality (corresponding to the user's training level). In particular, multiple different versions of the second UI can exist, each with a different set of features.

[0025] According to an embodiment, the UI layout is a mobile UI layout. For example, a mobile UI layout may include a tablet or a smartphone.

[0026] According to an embodiment, the UI transition device further includes a third communication interface adapted to output the first UI output to another UI arrangement. For example, the screen output of the first UI (i.e., the raw screen output from a medical imaging device) can be displayed on a second screen. Users can use these displays to confirm that any input performed using the second UI has been correctly transmitted to the first UI. Furthermore, for example, for training purposes, users can see how their actions are presented on the first UI. Moreover, the second screen can be used as an observation station for diagnostic images to achieve high-quality display.

[0027] Alternatively, the third communication interface can be adapted to provide another example of the second UI. This can be used for, for example, training purposes or remote support. For instance, the second communication interface can be connected to a UI setup near a medical imaging device, while the third communication interface can be connected to a remote UI setup.

[0028] Alternatively, the third communication interface can be connected to a mobile UI setup, while the second communication interface can be connected to a fixed UI setup. Therefore, users can operate the medical imaging device using both the mobile and fixed UI setups.

[0029] According to an embodiment, the first UI output and / or the second UI output includes video output and / or audio output. Specifically, the video output may include image output obtained by the medical imaging device, as well as menus, buttons, input forms, etc., for operating the medical imaging device. The video output may be provided, for example, via an HDMI connection, a DVI connection, or a VGA connection, but may also be provided via a machine interface. The audio output may include, for example, alarm sounds, and may be provided via an electronic audio connection or an optical audio connection.

[0030] According to an embodiment, the first UI input and / or the second UI input includes mouse input and / or keyboard input. These UI inputs may be provided, for example, via a USB connection or other accessible interface.

[0031] According to an embodiment, the steps of converting the first UI output into the second UI output and converting the second UI input into the first UI input include: analyzing the first UI output and analyzing the second UI input.

[0032] Analyzing the first UI output specifically refers to analyzing the structure and content of the first UI output. For example, a text recognition system and / or optical character recognition system can be used to detect text and its coordinates in the video output of the first UI output. Furthermore, an image processor can be used to capture images from the video output of the first UI output, particularly the results of a medical imaging process and / or graphics related to medical imaging equipment. The image processor can be a conventional image processor that uses, for example, edge detection to find corner points in the images of the video output. When capturing images, special attention may be needed to grayscale levels and dynamic range to obtain good image quality. This can be achieved, for example, by calibrating the image capturer using test images. Optionally, the images captured from the video output can be further analyzed to extract additional elements or information. For example, graphic elements (such as lines or rectangles) superimposed on medical images shown in the video output of the first UI output can be analyzed; these elements are typically used to define the field of view of a diagnostic scan based on the content of a positioning scan or locator scan. As a second example, markers (such as arrows or special icons) that support image manipulation (such as zooming or window width / level adjustment) can be analyzed. In addition, the audio output of the first UI output can be analyzed (for example, by comparing the received sound (often an alarm sound) with a set of known sounds).

[0033] The second UI input can be analyzed relative to the second UI output. Specifically, the relationship between the mouse cursor's position on the screen and the currently displayed widgets (e.g., menus, buttons, and text input boxes) must be known to determine the mouse click action. If the second UI corresponds to the UI of another medical imaging device, the analysis can be performed using a portion of the original software from that medical imaging device.

[0034] According to an embodiment, two UI state machines (one for a first UI and the other for a second UI) are used to perform the steps of transforming the output of the first UI into the output of the second UI and transforming the input of the second UI into the input of the first UI. Specifically, a first UI state machine is established to model the state of the first UI; and a second UI state machine is established to model the state of the second UI. The state machine may include the complete state of the UI, including currently displayed menus, submenus, buttons, checkmarks, text input boxes and their states (e.g., whether a checkmark is checked), and text in the text input boxes. The state of the UI may also include numbers, values, icons, images, error messages, system warnings, maintenance routines and / or calibration routines, and may include information that is not currently displayed in the UI video but is hidden in other menus.

[0035] The state of the first UI state machine is changed based on the analyzed first UI output. Specifically, when a change in the first UI output is detected, these changes are translated into changes in the first UI state machine. The current state of the first UI state machine can also be used as input for video output used to analyze the first UI output: typically, in a given state, only a limited number of state changes are possible, such as text appearing on the screen, a menu popping up, or a checkmark being checked or unchecked. Therefore, the analysis only requires searching a low-dimensional and finite space, which simplifies the classification process.

[0036] Furthermore, the state of the second UI state machine is changed based on the analyzed second UI input.

[0037] Then, the first UI state machine and the second UI state machine are kept in equivalent and / or associated states by transmitting any changes that occur in one state machine to the other state machine. More specifically, changes in the first UI state machine are transmitted to the second UI state machine, and changes in the second UI state machine are transmitted to the first UI state machine. In this context, an equivalent and / or associated state refers to a state that is closest to the state of the other UI state machine. For example, this includes using equivalent names for parameters such as MR sequences or MR scan protocols. Furthermore, since different types of medical imaging devices may have different hardware specifications, it may be necessary to define modified scans to compensate for such differences. The corresponding logic and / or association of the UI states is part of the steps of transforming the first UI output into the second UI output and the second UI input into the first UI input. For example, in CT, different widths or different table pitches of CT detectors must be compensated for. As another example, in MRI, different RF peak powers and / or different gradient intensities and switching rates must be compensated for, for example, by selecting the correct MR sequence timing. If an equivalent and / or associated first UI state cannot be found for the second UI state, the second UI state can be disabled, preventing the user from selecting it. Conversely, if an equivalent and / or associated second UI state cannot be found for the first UI state, an alert or error message can be issued.

[0038] Then, the second UI output is generated based on the changes made to the second UI state machine. This generation process may include coding the layout and widgets of the second UI. The first UI input is generated based on the changes made to the first UI state machine. Therefore, by using a state machine, an efficient way to transition between the first UI and the second UI is achieved.

[0039] If the second UI corresponds to the UI of another medical imaging device, the second UI output can be generated using the original software or part of the original software of the other medical imaging device, given the state machine of the second UI.

[0040] According to an embodiment, changing the state of the first UI state machine based on the analyzed first UI output includes: mapping text and / or images to changes in the first UI state machine using a conventional classifier. Specifically, the conventional classifier can be provided by a human (particularly a medical imaging expert trained on medical imaging equipment and familiar with the second UI).

[0041] Alternatively or additionally, changing the state of the first UI state machine based on the analyzed first UI output includes: using a neural network to map the audio output or its text and / or image of the first UI to changes in the first UI state machine. Such a neural network can be trained, for example, by operating a medical imaging device in parallel using the first and second UIs, performing an action on the second UI corresponding to an action performed on the first UI. In this way, training data is generated, providing equivalent state changes for the first and second UIs. This training data is then used to train the neural network.

[0042] Optionally, in addition to the first UI input, the first UI output, the second UI input, and the second UI output, the conventional classifier and / or neural network may also use the current state of the first UI state machine as an input parameter to improve the learning and accuracy of the conventional classifier and / or neural network.

[0043] According to another aspect of the invention, a method is provided for switching between a first user interface (UI) and a second UI in a medical imaging device, wherein the second UI is different from the first UI. (steffen.weisshilips.com) In this context, "user interface" refers to both UI hardware and UI information. UI hardware can be a UI setup, such as a screen, keyboard, and mouse. UI information includes information exchanged between the medical imaging device and the user, particularly UI output (information exchanged from the medical imaging device to the user) and UI input (information entered by the user and sent to the medical imaging device).

[0044] The term "transformation" between the first and second UIs of a medical imaging device means that the UI transformation device simulates the second UI for use on the medical imaging device.

[0045] Although the second UI is different from the first UI, the second UI is also equivalent to the first UI, that is, the second UI can provide at least some of the functions of the first UI, and preferably can provide most or all of the functions of the first UI.

[0046] According to the method, a first UI output is received from the medical imaging device, wherein the first UI output corresponds to the first UI. The first UI output can be received using a wired and / or wireless connection. For example, it can be received via an HDMI, DVI, or VGA connection.

[0047] Furthermore, a second UI input is received from the UI arrangement of the second UI, wherein the second UI input corresponds to the second UI, and the UI arrangement includes at least one output device (e.g., a screen and / or a speaker) and at least one input device (e.g., a mouse and / or a keyboard). The UI arrangement may be similar to or the same as the UI arrangement corresponding to the first UI (in particular, when the UI arrangement includes standard hardware (e.g., a screen, a keyboard, and a mouse)), but may also be different from the UI arrangement corresponding to the first UI (in particular, when at least one UI arrangement in the UI arrangement includes dedicated hardware).

[0048] The first UI output is converted into the second UI output, and the second UI input is converted into the first UI input, enabling the medical imaging device to operate using the second UI. Here, the second UI output corresponds to the second UI, and the first UI input corresponds to the first UI. Specifically, the second UI output is a UI output that is equivalent to the first UI output but simulates the second UI. Similarly, the first UI input is a UI input that is equivalent to the second UI input but simulates the first UI. The first UI input is generated relative to the first UI output; for example, the mouse pointer position is relative to the screen output of the first UI. Therefore, the user may only see the second UI, while the medical imaging device operates as if controlled using the first UI.

[0049] The first UI input is then sent to the medical imaging device, and the second UI output is sent to the UI arrangement. Here, the first UI input can be transmitted using a wired and / or wireless connection. For example, the first UI input can be transmitted via a USB connection.

[0050] By switching between a first UI and a second UI, users can operate medical imaging equipment that is typically operated via the first UI through the second UI. Therefore, the UI of the medical imaging equipment can be transformed into a user-friendly interface. In particular, UIs from different vendors can be converted into a single UI, allowing users to operate many different medical imaging devices using a single interface. This reduces the learning curve for users and improves the efficiency and reliability of operating medical imaging equipment.

[0051] According to an embodiment, a setup check is performed. The setup check may be performed at the start of a medical imaging routine and / or periodically. The setup check is performed by sending a first UI input corresponding to an access configuration and / or version page to the medical imaging device, and analyzing the resulting first UI output to obtain the provided setup information.

[0052] According to an embodiment, a first UI input is generated to initiate a calibration run of the medical imaging device, and the generated first UI input is sent to the medical imaging device. Thus, this method step initiates a calibration run of the medical imaging device. This calibration run can be performed, for example, at the start of each medical imaging phase, or before and / or after each medical imaging run. Similarly, calibrations of the UI layout (e.g., calibration of the screen's color space and / or the mouse's range of motion) can be performed.

[0053] According to an embodiment, a training function is provided to the user of the medical imaging device. This training function offers only a set of available functions based on the user's experience. Specifically, for beginners, the training function may only provide the most basic functions, while for experienced users, it may offer all available functions. In other words, the training function can provide a course that first introduces the user to the basic functions of the UI, and then introduces more complex functions. This can be supported by displaying only core functions at the beginning and prompting more complex functions for advanced learners. Furthermore, the training function can record the frequency of use of certain functions and trigger training on rarely used functions.

[0054] According to an embodiment, the efficiency and / or ergonomics of the first UI and the second UI are measured, and a comparison of the efficiency and / or ergonomics of the first UI and the second UI is provided. Specifically, the measurement can be performed based on the transition between the first UI and the second UI, since the first UI and the second UI perform equivalent actions. Metrics of efficiency and / or ergonomics may include the number of mouse clicks and / or drags required to define and / or plan a particular scan, and / or the number of menus and / or tabs that must be navigated.

[0055] It should be understood that preferred embodiments of the present invention can also be any combination of dependent claims and corresponding independent claims. Furthermore, features described only for the apparatus can also be applied to the method, and vice versa.

[0056] These and other aspects of the invention will become apparent and elucidated with reference to the embodiments described below. Attached Figure Description

[0057] In the following description, preferred embodiments of the invention will be illustrated by way of example only with reference to the accompanying drawings, in which: Figure 1 A schematic diagram illustrating an embodiment of a medical imaging device with a user interface (UI) switching mechanism is shown. Figure 2a A schematic screen output of a UI example is shown; Figure 2b This shows a schematic screen output of another UI example; Figure 3 A flowchart illustrating an embodiment of a method for UI transformation is shown; and Figure 4 A flowchart of another embodiment of the method for UI transformation is shown.

[0058] In the accompanying drawings, elements corresponding to those already described may have the same reference numerals. Examples, embodiments, or optional features, whether or not explicitly stated otherwise, should not be construed as limiting the claimed invention.

[0059] List of reference numerals in the attached diagram: 1. Medical imaging equipment 2 UI transformation device 3 UI Layout 4. Medical Imaging Devices 5. Mainframe computer 6 First Communication Interface 7 Second Communication Interface 8 Computing Units 9 screens 10. Mouse 11 Keyboard 12 Screen Output 13 Menu 14 Scan sequence window 15. Scan Parameter Window 16 Control Area 17 Image Window 18 UI Transformation Methods 19 First UI Output 20 Second UI Input 21 Second UI Output 22 First UI Input Detailed Implementation

[0060] Figure 1 A schematic diagram of an embodiment of a medical imaging device 1 having a user interface (UI) switching device 2 and a UI arrangement 3 is shown.

[0061] Medical imaging equipment 1 may be an ultrasound imaging device, a digital X-ray imaging device, a computed tomography imaging device, and / or a magnetic resonance imaging device, and includes a medical imaging unit 4 and a host computer 5. The medical imaging unit 4 and the host computer 5 may be separate entities, such as... Figure 1 As shown, they are connected via wired or wireless connections. Alternatively, the host computer 5 can be integrated into the medical imaging device 4 to form the medical imaging apparatus 1.

[0062] UI transformation device 2 includes a first communication interface 6, a second communication interface 7, and a computing unit 8.

[0063] The first communication interface 6 is adapted to receive a first UI output from the medical imaging device 1 (particularly from the host computer 5 of the medical imaging device 1) and to send a first UI input to the medical imaging device 1. Here, the first UI output and the first UI input correspond to the first UI, wherein the first UI is the UI of the medical imaging device 1.

[0064] The second communication interface 7 is adapted to send a second UI output to the UI arrangement 3 and receive a second UI input from the UI arrangement 3. Here, the second UI output and the second UI input correspond to a second UI, which is different from the first UI. Although the second UI is different from the first UI, the second UI is also equivalent to the first UI, that is, the second UI can provide at least some of the functions of the first UI, and preferably can provide most or all of the functions of the first UI.

[0065] UI arrangement 3 is shown as including a screen 9 as an output device and a mouse 10 and a keyboard 11 as input devices. However, other output devices (e.g., speakers) or other input devices may also be part of UI arrangement 3. Furthermore, UI arrangement 3 may include separate output and input devices, and / or may include integrated output / input devices.

[0066] The computing unit 8 is configured to switch between the first UI and the second UI. Specifically, the computing unit 8 is configured to convert the first UI output into the second UI output and the second UI input into the first UI input, enabling the medical imaging device 1 to operate using the second UI. In other words, the second UI output is a UI output equivalent to the first UI output but simulating the second UI. Similarly, the first UI input is a UI input equivalent to the second UI input but simulating the first UI. The first UI input is generated relative to the first UI output; for example, the mouse pointer position is relative to the screen output of the first UI. In effect, the UI switching device 2 represents a layer between the user-operated UI arrangement 3 and the host computer 5 of the medical imaging device 1. Therefore, the user may only see and operate the second UI, while the medical imaging device 1 operates as if controlled using the first UI.

[0067] Figure 2a A schematic screen output 12 of a UI example is shown (e.g., a screen output corresponding to the first UI). The screen output 12 includes a menu 13, a window 14 containing information about the scan sequence, a window 15 containing information about the scan parameters, an area 16 including widgets for controlling the scan, and a window 17 showing an image obtained by the medical imaging device 1.

[0068] Figure 2b A schematic screen output 12' of another UI example is shown (e.g., a screen output corresponding to the second UI). Similar to screen output 12, screen output 12' includes a menu 13', a scan sequence window 14', a scan parameter window 15', a control area 16', and an image window 17'.

[0069] It is readily apparent that the screen output 12 of the example UI is similar to the screen output 12' of another example UI. However, it must be noted that while the content included in each window may be similar, it is not identical. Therefore, by switching between the first UI and the second UI, the user can operate the medical imaging device 1, which is typically operated via the first UI, through the second UI. In other words, the UI of the medical imaging device 1 can be transformed into a UI that the user is accustomed to. In particular, UIs from different vendors can be transformed into a single UI, allowing the user to operate many different medical imaging devices using a single UI. This reduces the user's learning curve and improves the efficiency and reliability of operating the medical imaging device 1.

[0070] Figure 3 A flowchart illustrating an embodiment of the method 18 for UI transformation is shown. According to the method, a UI transformation device 2 receives a first UI output 19 from a medical imaging device 1. Additionally, it receives a second UI input 20 from a UI arrangement 3. The UI transformation device 2 then transforms the first UI output 19 into a second UI output 21 and the second UI input 20 into a first UI input 22, sending the first UI input 22 to the medical imaging device 1 and the second UI output 21 to the UI arrangement 3. Performing the transformation from the first UI output 19 to the second UI output 21 and from the second UI input 20 to the first UI input 22 enables the medical imaging device 1 to operate using the second UI.

[0071] Figure 4 A flowchart of another embodiment of method 18 for UI transformation is shown. Specifically, with... Figure 3 Compared to method 18, the method provides more details of the transition. More specifically, the UI transition device 2 establishes a first UI state machine 23 and a second UI state machine 24, whereby the first UI state machine 23 models the state of the first UI and the second UI state machine 24 models the state of the second UI. The state machines can include the complete state of the UI, including currently displayed menus, submenus, buttons, checkmarks, text input boxes and their states (e.g., whether a checkmark is checked), and the text in the text input boxes. The UI state can also include numbers, values, icons, images, error messages, system warnings, maintenance routines and / or calibration routines, and may include information not currently displayed in the UI video but hidden in other menus.

[0072] Then, the state of the first UI state machine 23 is changed based on the analyzed first UI output 19, and the state of the second UI state machine 24 is changed based on the analyzed second UI input 20. The first UI state machine 23 and the second UI state machine 24 are kept in equivalent and / or associated states by transmitting any changes occurring in one state machine to the other (as indicated by the double arrows between the state machines). More specifically, changes in the first UI state machine are transmitted to the second UI state machine, and changes in the second UI state machine are transmitted to the first UI state machine. Here, an equivalent and / or associated state refers to a state that is closest to the state of the other UI state machine. For example, this includes using equivalent names for parameters such as MR sequences or MR scan protocols. Furthermore, since different types of medical imaging devices may have different hardware specifications, it may be necessary to define modified scans to compensate for such differences. The corresponding logic and / or association of the UI states is part of the steps of transforming the first UI output 19 into the second UI output 21 and the second UI input 20 into the first UI input 22. For example, in CT, different widths of CT detectors or different table pitches must be compensated for. As another example, in MRI, it is necessary to compensate for different radiofrequency peak powers and / or different gradient intensities and switching rates, for example, by selecting the correct MR sequence timing. If an equivalent and / or associated first UI state cannot be found for the second UI state, the second UI state can be disabled, preventing the user from selecting it. Conversely, if an equivalent and / or associated second UI state cannot be found for the first UI state, an alarm or error message can be issued.

[0073] Furthermore, a second UI output 21 is generated based on changes made to the second UI state machine 24, and a first UI input 22 is generated based on changes made to the first UI state machine 23.

[0074] Although the invention has been described and illustrated in detail in the accompanying drawings and the foregoing description, such description and illustration should be considered illustrative or exemplary, and not restrictive; the invention is not limited to the disclosed embodiments.

[0075] By studying the accompanying drawings, the disclosure, and the appended claims, those skilled in the art can understand and implement other variations of the disclosed embodiments in the practice of the claimed invention. In the claims, the word "comprising" does not exclude other elements or steps, and the words "a" or "an" do not exclude multiple. The fact that certain measures are only described in mutually different dependent claims does not indicate that combinations of these measures cannot be advantageously used. No reference numerals in the claims should be construed as limiting the scope.

Claims

1. A UI transition device (2) for transitioning between a first user interface (UI) and a second UI of a medical imaging device (1), wherein, The second UI differs from the first UI, and the device (2) includes: A first communication interface (6) is adapted to receive a first UI output (19) from the medical imaging device (1) and send a first UI input (22) to the medical imaging device (1), wherein the first UI output (19) and the first UI input (22) correspond to the first UI; A second communication interface (7) is adapted to send a second UI output (21) to the UI arrangement (3) of the second UI and receive a second UI input (20) from the UI arrangement (3), wherein the second UI output (21) and the second UI input (20) correspond to the second UI, and the UI arrangement (3) includes at least one output device (9) and at least one input device (10; 11); and The computing unit (8) is configured to convert the first UI output (19) into the second UI output (21) and convert the second UI input (20) into the first UI input (22), so that the medical imaging device (1) can operate using the second UI.

2. The UI switching device (2) according to claim 1, wherein, The medical imaging device (1) is an ultrasound imaging device, a digital X-ray imaging device, a computed tomography imaging device and / or a magnetic resonance imaging device.

3. The UI conversion device (2) according to claim 1 or 2, wherein, The second UI corresponds to the UI of another medical imaging device, wherein the other medical imaging device is a device of a different type from the medical imaging device (1).

4. The UI switching device (2) according to any one of claims 1 to 3, wherein, The UI layout (3) is a mobile UI layout.

5. The UI transformation device (2) according to any one of claims 1 to 4 further includes a third communication interface adapted to output the first UI output (19) to another UI arrangement.

6. The UI transition device (2) according to any one of claims 1 to 5, wherein, The first UI output (19) and / or the second UI output (21) include video output and / or audio output.

7. The UI switching device (2) according to any one of claims 1 to 6, wherein, The first UI input (22) and / or the second UI input (20) include mouse input and / or keyboard input.

8. The UI switching device (2) according to any one of claims 1 to 7, wherein, Converting the first UI output (19) into the second UI output (21) and converting the second UI input (20) into the first UI input (22) includes: Analyze the first UI output (19), for example, by the following operations: Use a text recognition system to detect text in the video output and the coordinates of the text; and / or Use an image processor to capture and / or analyze images in the video output; and Analyze the second UI input (20).

9. The UI transition device (2) according to claim 8, wherein, Converting the first UI output (19) into the second UI output (21) and converting the second UI input (20) into the first UI input (22) includes: Establish a first UI state machine, which models the state of the first UI; Establish a second UI state machine, which models the state of the second UI; The state of the first UI state machine is changed based on the analyzed first UI output (19); The state of the second UI state machine is changed based on the analyzed second UI input (20); The first UI state machine and the second UI state machine are kept in an equivalent and / or associated state by transmitting any changes that occur in one state machine to the other state machine in the state machine. The second UI output (21) is generated based on the changes made to the second UI state machine; and The first UI input (22) is generated based on the changes made to the first UI state machine.

10. The UI switching device (2) according to claim 9, wherein, Changing the state of the first UI state machine based on the analyzed first UI output (19) includes: mapping text and / or images to changes in the first UI state machine using a conventional classifier and / or neural network, wherein, more specifically, the conventional classifier and / or neural network uses the current state of the first UI state machine as input parameters.

11. A method (18) for switching between a first user interface (UI) and a second UI of a medical imaging device (1), wherein, The second UI is different from the first UI, and the method (18) includes: Receive a first UI output (19) from the medical imaging device (1), wherein the first UI output (19) corresponds to the first UI; Receive a second UI input (20) from the UI arrangement (3) of the second UI, wherein the second UI input (20) corresponds to the second UI, and the UI arrangement (3) includes at least one output device (9) and at least one input device (10; 11). The first UI output (19) is converted into the second UI output (21) and the second UI input (20) is converted into the first UI input (22), wherein the second UI output (21) corresponds to the second UI and the first UI input (22) corresponds to the first UI, so that the medical imaging device (1) can be operated using the second UI; Send the first UI input (22) to the medical imaging device (1); and The second UI output (21) is sent to the UI layout (3).

12. The method (18) according to claim 11, further comprising: A setup check is performed by sending a first UI input (22) corresponding to the access configuration and / or version page to the medical imaging device (1) and analyzing the resulting first UI output (19).

13. The method (18) according to claim 11 or 12, further comprising: Generate the first UI input (22) to start the calibration run of the medical imaging device (1); as well as The generated first UI input (22) is sent to the medical imaging device (1).

14. The method (18) according to any one of claims 11 to 13, further comprising: Provide training functions to users of the medical imaging device (1).

15. The method (18) according to any one of claims 11 to 14, further comprising: Measure the efficiency and / or ergonomics of the first UI and the second UI; as well as Provides a comparison of the efficiency and / or ergonomics of the first UI and the second UI.

Images