Control system and method for controlling equipment

Abstract

A control system is used to control a device, which receives user input control commands from one or more human interface devices. The control system receives the captured user input control commands and identifies the control actions to be applied to the device to execute the user input control commands. The control actions are converted into human interface device HID input commands that are compatible with one or more human interface devices appropriate for controlling the device. The HID input commands are then sent to the device and emulate the user input applied to one or more human interface devices. In this way, a control system can be applied to different types of devices by converting input control commands (e.g., voice commands or gesture commands) into appropriate HID input commands (usually entered manually by the user) for a particular device.

Description

Technical Field

[0001] The present invention relates to the control of devices, particularly to the control of devices distributed in multiple locations. A specific example is a medical system where a part of the device interacts with a patient and another part is related to the control of the medical system, but may be away from the patient. Medical imaging is a specific example.

Background Art

[0002] Medical imaging is typically performed in an examination room (e.g., a magnetic resonance imaging (MRI) or computed tomography (CT) room) where a patient and an imaging system are located. However, the control console for the imaging system is typically located in a separate control room. Therefore, the control of the imaging procedure is performed remotely from the patient.

[0003] There is a growing need for improved efficiency in the workflow of the radiology department, which often conflicts with the intention of the surgical staff to spend as much time as possible with the patient. Furthermore, the overall shortage of radiology staff means that fewer personnel are available to operate the imaging system, which means that more actions that could have been performed in parallel must be performed sequentially.

[0004] However, many functions of medical imaging systems can only be controlled from a console in the control room. Local operators must be away from the examination room and the patient to perform these actions. Systems are being considered that allow local staff to be supported by remote experts or to control the equipment remotely. If remote experts are expected to monitor many different types of imaging systems from different vendors, they need to know how to perform the necessary actions with many different and inconsistent user interfaces. Therefore, the workload of remote operating staff can still be high, especially if multiple very different systems need to be controlled simultaneously. This approach also leads to the overhead of task switching, which takes additional time.

[0005] US2010131280A1 describes a system (i.e., a decryption system) that sends voice commands configured to recognize user authentication.

[0006] US2019 / 0038236 discloses a system for controlling medical devices in which voice commands are received, converted into instructions that can be provided to the medical device, and the medical device takes action according to the converted instructions. [Overview of the project] [Problems that the invention aims to solve]

[0007] Therefore, there is a need for a simplified approach to controlling devices such as medical systems. [Means for solving the problem]

[0008] The present invention is defined by the independent claims. The dependent claims represent beneficial embodiments.

[0009] According to an example of one aspect of the present invention, a control system for controlling a device is provided, the device is configured to receive user input control commands from one or more human interface devices, the control system has a processor for receiving and processing user input control commands, the processor is Identify the control actions applied to the device in order to execute user input control commands. The control action is converted into an input command, which is compatible with one or more human interface devices, HIDs, and is suitable for controlling the device. Sending an HID input command to the device to emulate user input applied to one or more of the aforementioned human interface devices, It is configured in this way.

[0010] This control system allows the equipment operator to use input control commands independent of HID commands (such as user input control commands in the form of voice or gesture commands). These control commands are interpreted by the control system and converted into appropriate HID commands for the equipment, i.e., compatible with the equipment's human interface device. Thus, the user does not use HID, but the control system generates HID signals as if the user had used HID. This is what is meant by "emulating user input." Therefore, the control system acts as an intermediary between the user (e.g., a user who can use voice commands) and the human interface device of the controlled equipment.

[0011] For example, the equipment may have different parts distributed in different locations; for instance, the human interface device may be in one location (the control room), while the main functional parts of the equipment may be in another location (the patient to the medical system, or the workpiece to a non-medical system). The control system allows the user to be positioned away from the human interface device, but still provides the equipment with commands that emulate the use of the human interface device.

[0012] One specific example is a medical system comprising a patient unit and a control unit. In the example of a medical scanner, the operator of the control system is located, for example, in the examination room with the patient, while one or more HIDs of the medical system are typically located on a console in a separate control room. The HIDs are typically USB input devices such as a keyboard or mouse that are compatible with the USB HID protocol. Thus, a medical scanner typically has a USB port that communicates with the HID host of the medical scanner. This allows the local operator to operate the imaging system console from the examination room or any other location. The present invention is of interest, for example, to CT imaging.

[0013] The processor may be configured, for example, to extract voice commands from user input control commands using speech recognition, or to extract gesture commands from user input control commands using gesture recognition.

[0014] The use of voice commands allows local operators to keep both hands free while operating the system. In preferred embodiments, the medical system is a medical imaging system such as computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), angiography systems, and other imaging systems.

[0015] In general, the present invention can be applied to any type of distributed device, such as medical systems, medical or non-medical imaging systems, or other non-medical examples such as cargo control equipment.

[0016] The conversion of control actions to HID input commands allows operators to easily control imaging systems in a consistent manner, independent of specific system types and user interfaces. In particular, user-provided commands (which can be independent of HID commands, e.g., voice or gesture commands) are converted into user interface commands appropriate for the specific medical system, and therefore specific to the modality type and vendor. Thus, the control system is vendor-independent and can be retrofitted to any existing imaging system installation.

[0017] In remote assistance scenarios, as mentioned earlier, remote experts do not need to be fully familiar with all the different user interfaces of equipment from different vendors (such as medical scanners). In this situation, an automated system that operates the user interface using emulated keyboard or mouse (or other HID) signals can be beneficial. The remote expert can use consistent commands (such as voice commands) to make the system perform similar tasks across different user interfaces.

[0018] When the control system enables the use of voice commands, the voice is first captured by a microphone, which may be a dedicated microphone in, for example, a medical scanner examination room, an existing intercom solution, or a headset worn by the operator. The captured voice is speech-recognized, interpreted, and keywords and semantic structures are identified. The processor is configured to transmit, for example, HID input commands over a USB cable.

[0019] Audio collection and processing are performed locally, for example, in the laboratory, and this results in control of a console in the control room via HID commands.

[0020] The result is that the control system generates HID commands as if they were originating from a local user interface such as a local keyboard or mouse. In this way, user actions are emulated by the control system.

[0021] For example, an HID input command may include one or more of the following: mouse commands, trackpad commands, touchpad commands, keyboard commands, or gesture commands. Therefore, the control system emulates the use of a keyboard or mouse, or other HID device.

[0022] For example, the device has a display screen, and the processor is configured to receive the display output from the display screen and determine the current state of the device from the display output, and the HID input command takes the current state of the device into account.

[0023] The HID input commands required to perform a desired control action (such as a keystroke or icon selection on the display) depend, in some cases, on the current state of the device. For example, in the case of a medical scanner, the display mode may need to be changed or a modal dialog window may need to be closed before the action can be performed. In some cases, UI elements required for the action to be performed (such as display icons that need to be selected) may be positioned in a variable location on the screen, depending on the current state of the medical scanner. By receiving the displayed output, the control system can identify the state of the device, for example, the presence and display position of the UI elements.

[0024] The processor may be configured to receive the display output of the display screen as a captured video signal or as data from screen-grabbing software. The feedback of the device display may be achieved using hardware and / or software. In the example of a medical scanner, the processor is, for example, to change the details of the patient in the patient record, to move the patient table and position the patient, to start or stop a scan event, to perform a calibration measurement, to change the lighting or fan settings, configured to select a control action from a predetermined list of control actions including one or more of the above.

[0025] Thus, the user of the control system has a set of control actions that can be applied to any medical scanner. The control system converts those actions into appropriate HID input commands. Thereby, the user does not need to have complete knowledge of the different commands of the device's HID.

[0026] The control system may further have a database that stores the HID information of multiple different types of devices.

[0027] Thereby, a single user can control different types of devices with reduced overhead when learning the different user interfaces of the system. The data of the device is retrieved from this database to perform the mapping to the HID input commands.

[0028] The processor is further configured to obtain user feedback, for example, before sending the corresponding HID input command. This user feedback enables, for example, the user to provide approval for the identified control action before the control system sends the corresponding HID input command.

[0029] Approval for a proposed action may be achieved, for example, by voice communication using a speaker and microphone, or by visual / haptic communication via a display, button, touchscreen, or gesture recognition device. Approval may be requested by the same operator who initially issued the voice command, or by another local or remote operator with the necessary expertise.

[0030] The processor is further configured to perform masking, for example, for anonymizing audio and video data.

[0031] The present invention also, A device capable of receiving user input control commands from one or more human interface devices, A control system defined for controlling equipment, We provide a system that has the following features.

[0032] The present invention also provides a method for controlling a device that can receive user input control commands from one or more human interface devices, and this method is A step of identifying the control action applied to the device in order to execute a user input control command, The steps include: converting a control action into a human interface device HID input command that is compatible with one or more human interface devices and is suitable for controlling the device; The steps include sending an HID input command to the device to emulate user input applied to one or more of the aforementioned human interface devices (14), It has.

[0033] This method allows operators to easily control equipment in a consistent manner, independent of specific system types and user interfaces.

[0034] The device, for example, has a display screen, and the method further includes the steps of receiving the display output of the display screen and determining the current state of the device from the display output, and the generation of the HID input command takes the current state of the device into consideration.

[0035] A HID input command may include, for example, one or more of the following: a specific mouse command, trackpad command, touchpad command, keyboard command, or gesture command.

[0036] The device, for example, has a medical scanner, and the method is, Modifying patient details in patient records, Moving the patient table and positioning the patient, Starting or stopping scan events, Performing calibration measurements, By changing the lighting or fan settings, The process includes the step of selecting a control action from a predetermined list of control actions that include one or more of the following:

[0037] This method involves, for example, accessing a database to convert control actions into HID input commands, which store user input control commands supported by multiple different types of devices.

[0038] The present invention also provides a computer program having computer program code configured to perform the methods defined above when the computer program is executed on a computer.

[0039] These and other aspects of the present invention will become apparent from and be explained with reference to the embodiments described below.

[0040] For a better understanding of the present invention and to more clearly illustrate how the present invention is carried out, the accompanying drawings are referenced merely as examples. [Brief explanation of the drawing]

[0041] [Figure 1] This describes medical systems, particularly devices in the form of radiation systems, that include a control system for generating HID commands. [Figure 2] The function of the first example of a control system is shown. [Figure 3] The function of a second example of a control system is shown. [Figure 4] This shows how to control the equipment. [Modes for carrying out the invention]

[0042] The present invention will be described with reference to the drawings.

[0043] The detailed descriptions and specific examples illustrate exemplary embodiments of the apparatus, systems, and methods, but should be understood to be for illustrative purposes only and not intended to limit the scope of the invention. These and other features, aspects, and advantages of the apparatus, systems, and methods of the invention will be better understood from the following description, the appended claims, and the appended drawings. The drawings are for illustrative purposes only and are not drawn to a specific scale. Also, the same reference numerals are used throughout the drawings to indicate the same or similar parts.

[0044] The present invention provides a control system used to control a device, which is configured to receive user input control commands from one or more human interface devices. The control system receives the captured user input control commands and identifies the control actions to be applied to the device to execute the user input control commands. The control actions are converted into human interface device HID input commands that are compatible with one or more human interface devices and are appropriate for controlling the device. The HID input commands are then transmitted to the device and emulate the user input applied to one or more human interface devices. In this way, the control system can be applied to different types of devices by converting input control commands (e.g., voice commands or gesture commands) into appropriate HID input commands (usually entered manually by the user) for a particular device.

[0045] As described above, the present invention can be applied to any device that uses a human interface device for inputting control commands. This allows the user to provide commands in different ways, and the control system generates HID commands that are emulated to execute the user commands.

[0046] The present invention will be described with reference to medical devices, particularly medical scanners.

[0047] Figure 1 shows a medical system, particularly in the form of a radiological system, having a control console 10 and a scanner 20 such as a CT scanner. Other systems, such as MRI systems, angiography systems, PET systems, or other medical or non-medical systems, can also be envisioned within the context of the present invention. Therefore, the following description of medical systems can generally be applied to other types of controlled equipment.

[0048] The control console 10 is located, for example, in the control room, and the scanner 20 is located, for example, in the examination room. The medical systems 10 and 20 can receive user input control commands from one or more human interface devices (HIDs), such as the keyboard 11a and mouse 11b shown in the figure. Other examples include trackpads, touchpads, or gesture interfaces. HID commands are received via a USB port by an HID host 14 that implements the USB HID protocol. The HID host is part of the system controller 12 of the control console 10.

[0049] The control console 10 also has a display 16. The display presents information regarding the scanning procedure and can also function as an input device, for example, based on touchscreen input to the display. Thus, touchscreen input is one of several input modalities defined in the HID-USB standard.

[0050] The present invention relates to a control system 30 for controlling equipment in general, for example, a medical system as shown in the figure. In particular, the control system 30 generates an HID input signal.

[0051] The control system 30 receives user input control commands, which are received independently of HID. For example, user input control commands may be voiced. In such cases, the control system uses speech recognition to identify the voice commands and converts them into appropriate HID input commands for controlling the medical system. These HID input commands are typically entered manually by the user using the keyboard 11a and mouse 11b (and other HIDs not shown) and are specific to a particular medical system. Thus, the control system emulates manual control input. This means that the user providing input to the control console 10 may be away from the control console, for example, with a patient in the examination room. More generally, the control system can receive commands from any local operator who is not currently working directly on the console, or from a remote assistant monitoring the examination (and possibly several other examinations). These various options enable improved efficiency in the radiology workflow.

[0052] Figure 2 shows the function of a first example of the control system 30.

[0053] The control system 30 receives sound picked up by the microphone. The microphone may be a dedicated microphone in the examination room, an existing intercom solution, or a headset worn by the operator. The control system may be considered to have a set of modules, as described below, implemented by software running on a processor.

[0054] Speech recognition is applied by module 13 to extract voice commands from captured sounds. Speech recognition identifies keywords and semantic structures.

[0055] These voice commands are used to instruct control actions that will be applied to the medical system.

[0056] The control action has any available user interface functionality that can be used to control the operation of the medical system. An example is: Modifying patient details in patient records. Moving the patient table and positioning the patient, To start or stop a scan event, Perform calibration measurements. Change the lighting or fan settings. That is the case.

[0057] These control actions are typically available for many different types of medical systems where control systems may be used. However, different medical systems with different user interfaces will require different manual user inputs to perform the control actions. Of course, these control actions are merely examples. Any other functions accessible through the user interface of a medical system can be considered.

[0058] In actual implementations, there is a finite list of actions supported by the control system, because for each action, a predetermined set of UI interaction steps must be provided.

[0059] In module 34, control actions are identified using a database so that an action type corresponding to a voice command from the user can be selected. Thus, the user verbally provides voice commands to the control system, and these are translated into control actions applicable to the medical system in order to execute the voice commands.

[0060] In module 36, control actions are translated into appropriate HID input actions (such as specific mouse clicks and keyboard commands) that are part of the user interface of the specific medical system being used to perform the control actions. Mouse positioning and clicking are used, for example, to select icons displayed on display 16.

[0061] For this purpose, database 38 is accessed (which may be remote from the control system or part of the control system). The database provides definitions of user interface functions for a particular medical system, namely a set of HID inputs that may be provided to the console, and the corresponding control actions performed by these HID inputs. Thus, user interface commands and their corresponding HID inputs are modality type and vendor specific.

[0062] The required HID commands are generated by module 42 and then sent to the USB port of the medical system controller 12, which is then connected to the HID host 14. This is done, for example, over a USB cable. The HID commands then emulate user input to the HID system.

[0063] Converting voice commands corresponding to desired control actions into HID input commands allows operators to easily control the imaging system in a consistent manner, independent of specific system types and user interfaces. Therefore, the control system is vendor-independent and can be retrofitted to any existing imaging system installation. Instead of processing voice commands, the control system may process gesture commands.

[0064] The control actions available at any given time may depend on the information displayed on display 16. For example, different icons may be presented at different times depending on the current state of the imaging system. For example, the display mode may need to be changed before a particular action can be instructed, or a modal dialog window may need to be closed before an action can be performed. The display icons that need to be selected to perform a particular action may also be positioned in variable locations on the screen depending on the current state of the medical system.

[0065] The current state of a medical system depends, for example, on the progress of its functional execution, such as the progress of a medical scan. The current state controls, for example, the information displayed to the user and the control options available to the user at that particular time.

[0066] For example, the state of a medical system might be that a task is being performed to open a new patient case. In a given user interface, this might be achieved by sending the keyboard command Alt-P to open the patient tab from the main menu, and then sending N to create a new patient case. However, if a modal window is currently open (for example, to display a message), this window must be closed before the menu becomes accessible. Thus, the HID command depends on the system state. In the latter case, the system must first send a simulated mouse click of "OK" or a keyboard command to close the modal window. Similarly, other system states may require other adapted UI interactions to achieve the same result.

[0067] In a preferred example, the control system receives the display output of the display screen and then determines the current state of the medical system from the display output, thereby determining the available control actions and required HID commands. For this purpose, a screen grabbing module 40 is provided, which can identify the state of the UI (e.g., which user interface icons are displayed and where they are located on the screen). The generated HID input commands can take into account the configuration and current state of the medical system. In some cases, the screen grabber according to the present invention may be screen capture software.

[0068] One simple way to implement screen grab functionality is to use a video splitter device to split the video signal from the console monitor and connect the second output to a video capture device (a standard USB device that converts video inputs (HDMI, DVI, etc.) into a video stream via the USB protocol). The image displayed on the console screen can then be processed by the control system to which the USB screen grabber is connected.

[0069] The system state can be inferred by analyzing a portion of the captured screen to detect the current UI state, active UI elements, overlay windows, or scan progress information.

[0070] Instead of screen grab software, a video signal captured (by hardware) may be used, or may be used as data from screen grab software.

[0071] Figure 3 shows an example of a modification used by the confirmation module 35 to obtain approval for an identified control action before sending a corresponding HID input command. In the example shown, confirmation is requested before the HID command is generated. Obtaining approval for the proposed action may be achieved, for example, by voice communication using a speaker and microphone, or by visual / haptic communication via a display, button, or touchscreen. Approval may be requested from the same operator who initially gave the voice command, or from another local or remote operator with the necessary expertise.

[0072] Another optional module is for implementing masking methods for anonymizing audio and video data (removing personal data). This relates to cases where information is processed in the cloud rather than locally, or where data is stored for training purposes.

[0073] The above example uses a microphone to capture sound so that voice commands are recognized. A camera may be used additionally or alternatively as an input device, for example, for the gesture control described above.

[0074] Another optional module is for enabling and disabling audio capture (or video capture, if video is used) to prevent the acquisition of confidential or personal communications, for example. This allows for the analysis and recording of all information as needed. The activation of analysis and recording may be combined with an adjustable timer, so that the system remains active for a predetermined time after activation, and then turns itself off again.

[0075] Visual elements, such as LEDs, can indicate whether the system is active or not.

[0076] Another optional module is to recognize a trigger word and initiate audio (or video) analysis.

[0077] In another variation, mapping actions to device-specific USB HID commands can be used to implement a device-independent control interface for common actions such as adding a new patient, interacting with a picture archiving and communications system (PACS) or radiology information system (RIS), or changing the default protocol (examination card). This helps automate management tasks for an entire set of scanners. In this case, operator voice input is replaced, for example, by input from the hospital reception desk or ROCC.

[0078] Figure 4 shows a method for controlling a device that can receive user input control commands via an emulated human interface device (HID).

[0079] The example of the method shown is based on voice recognition for controlling medical systems.

[0080] The method is, In step 50, the captured sound is received, In step 52, speech recognition is applied to extract voice commands from the captured sound, It has.

[0081] More generally, these two steps may differ if other types of user input, such as gestures, are interpreted by the control system. Therefore, more generally, these steps enable the understanding of user input control commands.

[0082] In step 54, the method identifies the control action to be applied to the medical system in order to execute a voice command.

[0083] This delicious, In step 56, the control action is converted into an appropriate HID input command for controlling the device, In step 58, the HID input command is sent to the device, for example, via a USB port. It has.

[0084] The above example is based on the HID-USB standard. However, the concept of the present invention, which includes emulating manual user input via a human interface device, may also be applied to other standards, and therefore other protocols that define a communication interface between a human interface device and a control system of a medical system.

[0085] The disclosed information may be provided as a computer program, which may be used to program a computer system (or other electronic device) to perform the processes described herein, or as software which may include a computer-readable storage medium on which instructions are stored. The computer-readable storage medium includes any mechanism for storing information in a format readable by a computer (e.g., software, processing applications). In various implementations, the processor may be associated with one or more storage media, such as volatile and non-volatile computer memory. The computer-readable storage medium may include, but is not limited to, optical storage media (e.g., CD-ROM), magneto-optical storage media, read-only memory (ROM), random access memory (RAM), erasable programmable memory (e.g., EPROM and EEPROM), flash memory, or other types of media suitable for storing electronic instructions. RAM, PROM, EPROM, and EEPROM. The storage medium may be encoded with one or more programs that perform the required functions when executed on one or more processors and / or controllers. Various storage media may be installed within the processor or controller, or they may be transportable so that one or more programs stored on the storage media can be loaded into the processor.

[0086] Modifications of the disclosed embodiments can be understood and implemented by those skilled in the art in carrying out the claimed invention, based on a review of the drawings, disclosures, and appended claims. In the claims, the words “comprising” do not exclude other components or steps, and the indefinite articles “a” or “an” do not exclude plurality.

[0087] The functions implemented by the processor may be implemented by a single processor or by multiple separate processing units that may be considered to constitute a “processor” together. Such processing units may be remote from one another and may communicate with each other by wire or wireless means.

[0088] The mere fact that certain means are described in mutually different dependent claims does not indicate that combinations of these means cannot be used advantageously.

[0089] Computer programs can be stored / distributed on suitable media such as optical or solid-state media supplied together with or as part of other hardware, but they can also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.

[0090] "Computer memory" or "memory" is an example of a computer-readable storage medium. Computer memory is memory that can be directly accessed by a computing system. "Computer storage" or "storage" is a further example of a computer-readable storage medium. A computer storage device is any non-volatile computer-readable storage medium. In some embodiments, the computer storage device may be computer memory, or vice versa.

[0091] Machine-executable instructions or computer-executable code may include instructions or programs that cause a processor or other computing system to perform an aspect of the present invention. Computer-executable code for performing an operation for an aspect of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the C programming language or similar programming languages, and compiled into machine-executable instructions. In some examples, the computer-executable code may be in the form of a high-level language or in a pre-compiled form and may be used with an interpreter that generates machine-executable instructions on the fly. In other examples, machine-executable instructions or computer-executable code may be in the form of programming to a programmable logic gate array.

[0092] Computer executable code may run entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or wide area network (WAN), or the connection may be made to an external computer (for example, via the Internet using an Internet service provider).

[0093] Note that when the term "conforms" is used in the claims or description, it is intended to be equivalent to the term "conforms." When the term "apparatus" is used in the claims or description, it is intended to be equivalent to the term "system," and vice versa.

[0094] No reference numeral in a claim should be construed as limiting the scope.

Claims

1. In a control system for controlling a device, the device is configured to receive user input control commands from one or more human interface devices, the control system has a processor for receiving and processing user input control commands, and the processor is Identify the control action applied to the device in order to execute the user input control command, The control action is converted into a human interface device HID input command that is compatible with one or more human interface devices and is suitable for controlling the device. The HID input command is transmitted to the device in order to emulate the user input applied to the one or more of the aforementioned human interface devices. A control system configured in such a way.

2. The control system according to claim 1, wherein the processor is configured to extract voice commands from the user input control commands using speech recognition, or to extract gesture commands from the user input control commands using gesture recognition.

3. The control system according to claim 1 or 2, wherein the HID input command includes one or more of the following: mouse commands, trackpad commands, touchpad commands, keyboard commands, and gesture commands.

4. The control system according to claim 1 or 2, wherein the device has a display screen, the processor is further configured to receive the display output of the display screen and determine the current state of the device from the display output, and the HID input command takes the current state of the device into consideration.

5. The control system according to claim 4, wherein the processor is configured to receive the display output of the display screen as a captured video signal or as data from screen grabbing software.

6. The aforementioned device has a medical scanner, and the processor is, Modifying patient details in patient records. Move the patient table and place the patient in it. Starting or stopping scan events, Perform calibration measurements. Change the lighting or fan settings. The control system according to any one of claims 1 to 5, configured to select a control action from a predetermined list of control actions that include one or more of the following:

7. The control system according to any one of claims 1 to 6, comprising a database for storing user input control commands supported by multiple different types of devices.

8. The control system according to any one of claims 1 to 7, wherein the processor is further configured to obtain user feedback before transmitting the corresponding HID input command.

9. A device capable of receiving user input control commands from one or more human interface devices, A control system according to any one of claims 1 to 8 for controlling the aforementioned device, A system that has

10. A method for controlling a device that can receive user input control commands from one or more human interface devices, The steps include identifying a control action applied to the device in order to execute the user input control command, The steps include: converting the control action into a human interface device HID input command that is compatible with one or more human interface devices and is suitable for controlling the device; The steps include sending the HID input command to the device in order to emulate the user input applied to one or more of the aforementioned human interface devices, A method having

11. The method according to claim 10, wherein the device has a display screen, the method further comprises the steps of receiving a display output from the display screen and determining the current state of the device from the display output, and the generation of the HID input command takes into account the current state of the device.

12. The method according to claim 10 or 11, wherein the HID input command includes one or more of the following: a mouse command, a trackpad command, a touchpad command, a keyboard command, or a gesture command.

13. The aforementioned device has a medical scanner, and the method is Modifying patient details in patient records. Moving the patient table and positioning the patient, To start or stop a scan event, Perform calibration measurements. Change the lighting or fan settings. The method according to any one of claims 10 to 12, comprising the step of selecting the control action from a predetermined list of control actions, which includes one or more of the following.

14. The method according to any one of claims 10 to 13, further comprising the step of accessing a database to convert the control action into an HID input command, wherein the database stores user input control commands supported by a plurality of different types of devices.

15. A computer program having computer program code that, when executed on a computer, causes the computer to perform the method described in any one of claims 10 to 14.

Images