Gesture control of medical imaging device
By installing vibration sensors on the surface of medical imaging equipment to detect patient posture, the problems of fixed position and sensor interference in traditional control panels are solved, enabling patients to control the operation of imaging equipment autonomously, thus improving user experience and process efficiency.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-21
- Publication Date
- 2026-03-27
AI Technical Summary
Existing medical imaging equipment control panels are usually fixed in one location, which restricts the operator's mobility, and the sensor units are fixed to the patient, which may interfere with the imaging process or cause inconvenience to the operator, especially in emergency situations.
Vibration sensors are used to detect the postures performed by the patient on the surface of the medical imaging device. The sensor signals are analyzed by the processor system to derive control commands. The patient can freely perform postures on the surface of the device to control its operation, avoiding interference from sensors fixed to the patient or around the device.
It provides a flexible control method, allowing patients to control the imaging process themselves in emergency situations, improving user-friendliness and time efficiency, reducing interference with the imaging process, and enhancing patient autonomy and comfort.
Smart Images

Figure CN121752978A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The presently disclosed subject matter relates to a system for gesture control of a medical imaging device, a method for controlling a medical imaging device using gestures, and a computer readable medium. BACKGROUND
[0002] Medical imaging devices are ubiquitous in daily clinical practice. For example, various medical treatments rely on scanning devices such as magnetic resonance imaging (MRI), computed tomography (CT), single photon emission computed tomography (SPECT), computed radiography (CR) systems, X-ray apparatuses, and positron emission tomography (PET) scanners to identify and characterize medical abnormalities, plan interventions, place stents, etc.
[0003] It is known to control medical imaging devices using control panels, e.g. physical control panels or control panels displayed on a graphical user interface. Using such control panels, it is possible to control the medical imaging device, e.g. to start an imaging procedure, to pause an imaging procedure, to adjust imaging parameters, etc. Another example of such control of a medical imaging device is to terminate an imaging procedure, e.g. in case of an emergency, e.g. when a medical condition of a patient deteriorates during an imaging procedure.
[0004] Previously, efforts have been made to improve the ease of use and efficiency of users operating such control panels, e.g. by making the control panels more ergonomic.
[0005] However, one drawback of control panels is that they are typically provided at a fixed location, e.g. on a workstation connected to the medical imaging device, and even if the control panels can be adjustable in terms of position and / or orientation, the adjustability is typically limited. This can have a disadvantageous effect, for example, because in many procedures, the operator can want to be able to move freely, e.g. to check on a patient, but can be limited by the fixed location of the aforementioned control panels.
[0006] US 2022 / 0113809 A1 describes a command communication facility comprising a sensor unit for detecting movements of an operator, a fixation unit for fixing the sensor unit to the operator, an evaluation unit for evaluating the detected movements of the operator and identifying a command from the detected movements, and a command communication unit for sending a control command to a medical facility which will operate based on the identified command.
[0007] Thus, in US 2022 / 0113809 A1, the operator can not be bound to a control panel arranged at a fixed location.
[0008] Medical imaging procedures have emerged that do not rely on the presence of an operator. In such procedures, it can be desirable to give the patient at least some control over the medical imaging procedure, for example, the ability to terminate the procedure in case of an emergency. Disadvantageously, the method of US2022 / 0113809A1 is not well suited for this scenario, as the sensor unit, when fixed to the patient, can interfere with the medical imaging procedure. Furthermore, even if the operator uses the command communication facility of US2022 / 0113809A1, it is inconvenient for the operator, as the sensor unit needs to be fixed to the operator. SUMMARY
[0009] It would be desirable to obtain a system and method for controlling a medical imaging device that addresses one or more of the above-mentioned disadvantages.
[0010] In a first aspect of the invention, a system for gesture control of a medical imaging device is provided, the system comprising a medical imaging device, the medical imaging device comprising a vibration sensor positioned to detect a gesture performed by a patient on a surface of the medical imaging device by detecting vibrations propagating from the gesture via the surface to the vibration sensor, the system further comprising a processor system configured to receive a sensor signal from the vibration sensor, and to derive a command signal from the sensor signal to control the medical imaging device.
[0011] According to the system of the first aspect of the invention, the medical imaging device is arranged to receive a patient, the sensor is arranged to detect a gesture of the patient, and the surface is arranged within reach of the patient. The medical imaging device can receive a patient, for example using a receiving area, such as a bed or table on which the patient can lie, or using a bore into which the patient is at least partially inserted. Thus, the patient can be located in the vicinity of at least part of the medical imaging device, and thus in the vicinity of one or more surfaces of the medical imaging device. This can enable the patient to perform gestures on the surface(s) and thereby at least to some extent control the operation of the medical imaging device. In manufacturing the system, the vibration sensor can be positioned within, on or relative to the medical imaging device so as to be able to receive vibrations from gestures performed on the surface(s) within reach of the patient when the patient is received by the device.
[0012] A further aspect of the invention provides a method of controlling a medical imaging device using gestures of a patient on a surface of the medical imaging device, the method comprising: detecting a gesture of a patient by a vibration sensor comprised in the medical imaging device by detecting vibrations propagating from the gesture via the surface to the vibration sensor; receiving a sensor signal from the vibration sensor by a processor system; and deriving a command signal from the sensor signal by the processor system.
[0013] In another aspect of the invention, a transient or non-transient computer-readable medium is provided, comprising data representing instructions, wherein the data, when executed by a processor system, causes the processor system to perform one or more steps of the method, such as any of the computer-implementable steps.
[0014] The aforementioned measures include sensing vibrations propagating through the surface of the medical imaging device. More specifically, sensing vibrations caused by a patient performing a posture on the surface of the medical imaging device. A posture can be a characteristic movement of a body part to convey an intention. Performing the posture on the surface can include a patient using a body part (e.g., fingers) to contact the surface of the medical imaging device and moving the body part relative to the surface in the aforementioned characteristic manner to convey an intention. Different postures can be conveyed through different movements, for example, differing in their characteristics. Characteristics of movement may include the type of movement (e.g., tapping, scraping, sliding, sweeping, etc.), spatial characteristics of movement (e.g., direction), temporal characteristics of movement (e.g., speed, time pattern represented by the movement), and / or intensity of movement (e.g., force or pressure applied to the surface).
[0015] To detect vibrations, vibration sensors (such as piezoelectric sensors, strain sensors, and / or mechanical sensors) can be positioned on or near a surface to detect vibrations propagating through the surface. The size of the neighborhood may depend on factors such as the surface material, the sensitivity of the vibration sensor, and the intensity of the posture. A suitable location can be determined during system manufacturing.
[0016] A processor system is provided, configurable by hardware and / or software, to receive sensor signals and derive command signals based on those signals. This typically includes the processor system analyzing the sensor signals to determine the characteristics of vibrations and assigning these characteristics to specific types of command signals. Generally, different types of postures, such as postures with different movement characteristics, produce different types of vibrations because each posture causes vibrations with different vibration characteristics. These vibration characteristics can then be detected by the processor system and assigned to corresponding command signals. After determining the specific command signal for the sensor signals, the command signal can then be used to control the medical imaging device. For example, the processor system can transmit the command signal to a control unit of the medical imaging device; or, if the processor system also implements a control unit, the processor system can internally use the command signal to control the medical imaging device.
[0017] In one embodiment, a classifier including a deep learning neural network (e.g., a convolutional neural network) is used to classify different vibration features in the sensor signal.
[0018] The proposed system and method offer several advantages. First, it may not be necessary to provide the patient with access to control panels or sensor units, which could otherwise interfere with the medical imaging process. Instead, existing surfaces of the medical imaging device can be used as input. Since such surfaces are within the patient's reach during the imaging process, the patient can control the operation of the medical imaging device to some extent. For example, in some embodiments, the patient can command a limited set of device operations (such as "start," "pause," or "stop"), which can be beneficial for medical imaging processes that do not rely on the operator's presence. Furthermore, since vibrations propagate from the surface to the vibration sensor, the exact location of the gesture on the surface is less critical. In other words, the patient may not need to provide a gesture at a precisely defined location, providing flexibility in the imaging process. Additionally, there is no need to attach the sensor unit to the patient, which would otherwise require the operator to remember to attach the sensor unit to the patient, and if the sensor unit is attached, it could interfere with the imaging process. Wearable sensors, in particular, are prone to emitting radio frequency signals, which can interfere with the imaging process and consequently negatively impact the quality of the resulting images. Furthermore, the presence of metallic components in many types of sensors can also be a problem. In contrast, vibration sensors are not worn, and their locations are known, which avoids or greatly reduces any interference.
[0019] In an embodiment, a system is provided in which command signals initiate, stop, and / or alter the intensity of medical imaging device operation. Thus, the command signals can be associated with specific commands to control the device. Therefore, different aspects of medical imaging device operation can be controlled through different postures, as one posture can initiate an operation and another can stop it. For example, an entire imaging procedure can be started and stopped by different postures. This can be particularly beneficial for medical imaging procedures where no operator is present, as it allows the patient to decide when to begin the imaging procedure and allows the patient to stop the procedure in an emergency. Specifically, in procedures where the patient must adopt a specific posture or perform a specific action (e.g., holding their breath after a full inhalation), being able to start the procedure solely by posture provides the patient with greater autonomy and convenience, thereby improving the user-friendliness, effectiveness, and time efficiency of the entire procedure. Another posture can cause a change in the intensity of the operation. This may include altering one or more imaging parameters. For example, the imaging sequence of an MRI scanner or the dose of a CT scanner can be adjusted.
[0020] In an embodiment, a system is provided in which the operation of the medical imaging device includes one or more of the following: medical scanning operation, ventilation operation, audio playback operation, emergency stop, and pause operation. Therefore, different postures may trigger a variety of possible operations and procedures at the medical imaging device. While some operations may be related to the imaging procedure itself, others that can be controlled by posture may be related to assistive aspects, such as the patient's comfort level. Ensuring adequate patient comfort is desirable, as the level of comfort can affect the outcome of the imaging procedure, since the patient may need to be comfortable enough to hold their breath and / or remain still. For example, comfort can be improved by adjusting ventilation inside the device, playing music, or playing reverse noise to counteract the noise generated by the medical imaging device. Another example of audio playback operation is playing instructions to the patient. Furthermore, the ability to pause the imaging procedure allows the patient to change position, take a short breath, or sneeze, etc.
[0021] In one embodiment, a system is provided in which the processor system is configured to detect multiple different postures corresponding to multiple different operations of a medical imaging device. For example, the multiple different postures may exhibit different vibrational characteristics, corresponding to multiple different sensor signals, and the processor system can be configured to detect the multiple different sensor signals and derive different command signals from them, corresponding to multiple corresponding operations of the medical imaging device. The multiple different postures may include different physical interactions between the patient and the surface of the medical imaging device. For example, such different physical interactions may include different types of movement relative to the surface, such as tapping the surface, scratching the surface, sliding, stroking, brushing the surface, etc. Another example is that different body parts can be used to provide different postures, such as fingertips, nails, feet, etc. Yet another example is that different postures can be generated by changing the intensity, rhythm, pattern, etc., of the physical interaction. In some cases, several of the above variations can be combined to generate different postures. Generally, different postures may differ in the vibrations they produce, for example, in the frequency domain and / or time domain. The processor system can detect these different vibrational characteristics, for example, using techniques similar to audio classification, and attribute them to the corresponding command signals of the medical imaging device. For example, filtering techniques, such as frequency analysis (e.g., using Fourier analysis), or time series analysis, source localization techniques, or adaptive noise cancellation can be used to distinguish different vibration characteristics and corresponding signals from one another. Vibrations in sensor signals can be classified using deep learning-based techniques, such as recurrent neural networks (e.g., using long short-term memory units), or by using an image classifier containing convolutional neural networks to classify the spectrograms of vibrations.
[0022] In one embodiment, a system is provided in which a medical imaging device is configured for breath-hold scanning, and operation of the medical imaging device includes initiating a medical scan. Breath-hold scanning can be an inconvenient procedure for patients because they may not be able to hold their breath for extended periods, and therefore the procedure needs to be well-timed to prevent the patient from running out of air or starting to breathe prematurely. By enabling patients to initiate breath-hold scanning themselves, they can decide to begin the procedure once they are ready and comfortable. In particular, because patients can assume the posture just before beginning to hold their breath, they may be able to issue the start command "in time," which can minimize the time the patient must hold their breath.
[0023] In one embodiment, a system is provided in which a processor system is configured to monitor the power consumption of a motor in a medical imaging device and derive vibration sensor data from it. Therefore, the sensor monitoring the power consumption of the motor in the medical imaging device can be used as a vibration sensor. This avoids the need for a separate vibration sensor, or it allows such a power consumption sensor to be used as an additional sensor. That is, it has been found that the power consumption of the motor can be affected by postures performed with respect to the surface of the medical imaging device. By monitoring the power consumption, these postures can be detected, or can be used as an additional input source for detecting postures.
[0024] In one embodiment, a system is provided in which a processor system is configured to separate environmental signals, such as those caused by the operation of a medical imaging device, from sensor signals. Vibrations present in or caused by the environment can interfere with the sensing of posture-induced vibrations. However, the influence of such environmental vibrations can be reduced, for example, by signal processing, such as by separating environmental signals from sensor signals, by cleverly placing vibration sensors, for example, near the intended location providing the posture, by providing multiple sensors and distributing them relative to the medical imaging device, or by placing one or more sensors in locations where environmental vibrations are expected to be less or more isolated from them. Furthermore, filtering techniques employing frequency analysis, Fourier analysis, or time series analysis, source localization techniques, or adaptive noise cancellation techniques can be used for the purpose of separating different vibrations and their corresponding signals. This can establish a higher signal-to-noise ratio, which may in turn improve the sensitivity and / or reliability of detecting posture vibrations.
[0025] In one embodiment, a system is provided in which a medical imaging device includes multiple sensors, and a processor system is configured to use triangulation to locate a pose, such as locating the source of the pose and / or distinguishing different poses. By being able to locate the pose, the spatial position and / or orientation of the pose relative to a surface can be used as an additional distinguishing characteristic of the pose. Additionally or alternatively, this localization can allow for improved reliability of pose detection. For example, if a pose is detected in an unexpected location, or if the location cannot be clearly detected, this can indicate that the pose was detected incorrectly, for example, as a false alarm.
[0026] In one embodiment, a system is provided in which the medical imaging device includes a processor system, or the processor system is included in an external signal processing device. Therefore, the processor system can be an internal component of the medical imaging device, such as part of an internal control unit. Alternatively, the processor system can be provided as an external device capable of communicating with the medical imaging device or its control unit.
[0027] Another aspect of the present invention is to provide a medical imaging device that includes the vibration sensor and processor system described in this specification.
[0028] Those skilled in the art will understand that the system and method described herein can be applied to medical imaging devices that acquire multidimensional image data, such as two-dimensional (2D), three-dimensional (3D), or four-dimensional (4D) images, using various acquisition modalities, such as, but not limited to, standard X-ray imaging, CT, MRI, ultrasound (US), PET, SPECT, and nuclear medicine (NM).
[0029] The above embodiments are described in the claims. Furthermore, specific embodiments are set forth in the dependent claims. Attached Figure Description
[0030] Further details, aspects, and embodiments will be described by way of example only with reference to the accompanying drawings. Elements in the drawings are shown for simplicity and clarity and are not necessarily drawn to scale. In the drawings, elements corresponding to those already described may have the same reference numerals. In the drawings:
[0031] Figure 1 An embodiment of a system for posture control of a medical imaging device is schematically illustrated.
[0032] Figure 2 An embodiment of an MRI imaging device with posture control is schematically illustrated.
[0033] Figure 3A processor system is schematically illustrated, configured to receive sensor signals from a vibration sensor and derive command signals from the sensor signals to control a medical imaging device.
[0034] Figure 4 An example flowchart illustrating a method for controlling a medical imaging device using posture is shown schematically.
[0035] Figure 5a A computer-readable medium having a writable portion according to an embodiment is illustrated schematically, the writable portion including a computer program.
[0036] Figure 5b A representation of a processor system according to an embodiment is shown schematically. List of reference numerals The following list of reference numerals and abbreviations is provided to facilitate the interpretation of the drawings and should not be construed as limiting the claims. 100 Systems for attitude control of medical imaging equipment 110 Medical Imaging Equipment 111 Command signal 112 motor 113 Motor Sensor 114 Auxiliary System 120 processor system 121-122 Vibration Sensor 123 Environmental Sensors 200 MRI imaging devices 210 Scanning Component 211-231 Vibration Sensor 240 patient stations 250 patient table base 300 processor system 310 processor 320 storage devices 330 Communication Interface 400 Methods for using posture to control medical imaging equipment 410 Performing a posture on the surface of a medical imaging device 420 Uses vibration sensors to detect posture 430 Receives sensor signals from the vibration sensor. 440 Derive command signals based on sensor signals 1000, 1001 Computer-readable media Data stored in 1010 and 1011 1110 Processor System 1120 Processing Unit 1122 Memory 1124 Application-Specific Integrated Circuit 1126 Communication Components 1130 Interconnection Detailed Implementation
[0037] While the subject matter currently disclosed allows for many different forms of implementation, one or more specific embodiments are shown in the accompanying drawings and will be described in detail herein. It should be understood that this disclosure should be considered as illustrative of the principles of the subject matter and is not intended to limit it to the specific embodiments shown and described.
[0038] In the following text, for ease of understanding, the units of the embodiment in the operational state are described in operation. However, it is clear that the various units are arranged to perform the functions described as being performed by them.
[0039] Furthermore, the subject matter disclosed herein is not limited to the embodiments, but also includes all other combinations of features described herein or recited in mutually different dependent claims.
[0040] Figure 1 An embodiment of a system 100 for attitude control of a medical imaging device 110 is illustrated schematically. The system 100 may include the medical imaging device 110 and a processor system 120. Figure 1 A separate processor system 120 and medical imaging device 110 are shown. For example, the processor system 120 may be included in an external signal processing device, such as an external control unit for the medical imaging device 110. However, this is not a limitation, as the processor system 120 may also be part of the medical imaging device 110, for example, as an internal component of the medical imaging device.
[0041] System 100 enables the sensing of vibrations propagating through one or more surfaces of medical imaging device 110. Specifically, vibrations caused by a patient performing a posture on one or more surfaces of medical imaging device 110 can be sensed. To sense vibrations, medical imaging device 110 may include one or more vibration sensors 121, 122. While shown separately from medical imaging device 110, the one or more vibration sensors 121, 122 may be internal components of medical imaging device 110. Alternatively, the one or more vibration sensors 121, 122 may be external components, for example, fixed to a surface of medical imaging device 110. The one or more vibration sensors 121, 122 may be configured to detect postures performed by a patient on one or more surfaces of medical imaging device 110 by sensing vibrations propagating through one or more surfaces caused by the corresponding posture. Specifically, to be able to detect vibrations, one or more vibration sensors 121, 122 may be positioned in the neighborhood of one or more surfaces to be able to detect vibrations propagating through one or more surfaces. The size of the neighborhood, and therefore the maximum distance between one or more surfaces and one or more vibration sensors, may depend on factors such as the material of the one or more surfaces, the sensitivity of the one or more vibration sensors, the intensity of the posture, etc.
[0042] The appropriate locations of one or more vibration sensors 121, 122 can be determined during the manufacture of system 100, for example, by performing a posture on one or more surfaces and determining in which locations the one or more vibration sensors 121, 122 can still sense vibrations, for example, with a sufficient signal-to-noise ratio.
[0043] Non-limiting examples of suitable vibration sensors 121, 122 include piezoelectric-based vibration sensors, strain sensors (e.g., strain gauges), mechanical vibration sensors, etc. It is worth noting that, although... Figure 1 While not explicitly shown, one or more vibration sensors 121, 122 may typically be integrated into or placed on the surface of the medical imaging device 110, for example, in direct or indirect contact with one or more surfaces where the patient is expected to make one or more gestures. However, this is not a limitation, as in some examples, vibration sensors 121, 122 arranged externally to the medical imaging device 110 may still be able to sense vibrations propagating through one or more surfaces of the imaging device 110.
[0044] For example, the processor system 120 can be configured, via hardware and / or software, to receive sensor signals from one or more vibration sensors 121, 122, and to derive a command signal 111 based on those sensor signals. This typically involves the processor system 120 analyzing the sensor signals to determine the characteristics of the vibration and assigning those characteristics to a specific type of command signal 111. Notably, if multiple sensor signals are received, such as signals from different vibration sensors 121, 122, these sensor signals can be jointly analyzed to determine the characteristics of the vibration and jointly assigned to a specific type of command signal 111.
[0045] Typically, different types of postures, such as postures with different movement characteristics, produce unique types of vibrations because each posture may cause vibrations with different vibrational characteristics. The processor system 120 can then detect these different vibrational characteristics and assign them to different control signals 111 based on the characteristics of the vibrations in the sensor signal. For example, the processor system 120 can use heuristic or machine learning-based techniques to classify the vibrations based on the characteristics of the vibrations contained in the sensor signal, thereby detecting different postures. For example, techniques similar to those used in the field of audio classification can be used, where different audio categories can be distinguished using techniques based on the frequency domain and / or time domain, such as distinguishing between dog sounds and cat sounds. In a specific example, vibrations in the sensor signal can be classified using deep learning-based techniques (e.g., recurrent neural networks (e.g., using long short-term memory units) or convolutional neural network-based image classifiers applied to the spectrogram of the vibration).
[0046] After a specific command signal 111 is determined from the sensor signal, the command signal 111 can then be used to control the medical imaging device 110. For example, the processor system 120 can send the command signal 111 to the control unit of the medical imaging device 110; or, if the processor system 120 also implements a control unit, the processor system 120 can internally use the command signal 111 to control the medical imaging device 110. For example, different command signals 111 can start, stop, and / or change the intensity of the operation of the medical imaging device 110. Examples of such operations include, but are not limited to, medical scanning operations, emergency stop operations, and pause operations. Furthermore, the movement of the patient receiving component of the medical imaging device 110 (e.g., the patient table of an MRI imaging device) can be posture-controlled.
[0047] Continuing with reference to a posture on the surface of the medical imaging device 110, note that this posture may be a body part moving in a characteristic manner to convey intent. Performing this posture on one or more surfaces may involve a patient using a body part (e.g., fingers) to contact one or more surfaces of the medical imaging device 110 and moving the body part relative to the one or more surfaces in the characteristic manner described above, thereby conveying intent. Different postures can be conveyed through different movements, for example, differing in their characteristics. Characteristics of movement may include the type of movement (e.g., tapping, scraping, sliding, sweeping, etc.), spatial characteristics of movement (e.g., direction), temporal characteristics of movement (e.g., speed, time pattern represented by the movement), and / or intensity of movement (e.g., force or pressure applied to one or more surfaces). Examples of different types of postures include: tapping the surface, scraping the surface, sliding on the surface, stroking the surface, or sweeping the surface. In certain examples, tapping can be performed using fingertips, scraping can be performed using fingernails, and sweeping, stroking, and sliding can be performed using any part of the fingers. In addition to using the hand or alternatively using the hand to perform the posture, other body parts, such as feet, knees, upper arms, or elbows, can also be used. The processor system 120 can be configured to detect vibration characteristics of such different types of postures in order to attribute vibrations in the sensor signals to a specific type of command signal 111.
[0048] In some embodiments, the medical imaging device 110 may include at least three vibration sensors 121, 122, and the processor system 120 may be configured to use triangulation to locate the posture. Such triangulation methods are known in themselves. For example, triangulation can be used to detect the location of an earthquake based on vibrations (seismic waves). By being able to locate the posture, the spatial position and / or orientation of the posture relative to one or more surfaces can be used as additional distinguishing features of the posture. Additionally or alternatively, this localization can allow for improved reliability of posture detection. For example, if a posture is detected in an unexpected location, or if the position cannot be clearly detected, this can indicate that the posture has been detected incorrectly, for example, as a false alarm.
[0049] Motor sensor 113 can monitor the power consumption of motor 112 of medical imaging device 110. In some embodiments, such motor sensor 113 can be used as a vibration sensor. For example, motor 112 can drive moving parts of medical imaging device 110, such as a patient table. Posture may cause vibrations to propagate through the moving parts. These vibrations can then be recorded by motor sensor 113, for example, as deviations from the rated current. By using such motor sensor 113, separate vibration sensors 121, 122 may not be necessary, or such motor sensor 113 can be used as an additional sensor in conjunction with one or more other vibration sensors.
[0050] In some embodiments, an auxiliary system 114 may be provided to adjust conditions or characteristics, such as ventilation or audio, of the medical imaging device 110 or its interior, and the operation of the auxiliary system 114 may be controlled by various postures. For example, the processor system 120 may be configured to control ventilation and / or audio playback via the auxiliary system 114. In a particular example, ventilation inside the medical imaging device 110 may be adjusted by posture, for example, by controlling a fan blowing air inside the medical imaging device, or music may be played, or reverse noise may be played to counteract noise generated by the medical imaging device 110, or instructions for the patient may be played, etc.
[0051] In some embodiments, system 100 may include an environmental sensor 123. This may relate to the following: Processor system 120 may be configured to separate environmental signals from sensor signals. Environmental signals may represent vibrations present in or caused by the environment and may interfere with the sensing of posture-induced vibrations. For example, the effect of such environmental vibrations can be reduced by signal processing (e.g., separating environmental signals from sensor signals). For example, such signal separation can be performed using frequency analysis (such as Fourier analysis), or time series analysis, source localization techniques, or adaptive noise cancellation techniques. Furthermore, or as an alternative to such signal processing, vibrations in the environment may also be detected by the aforementioned environmental sensor 123. The sensor 123 may be specifically configured to be insensitive to posture-induced vibrations, for example, by placing it in a location where posture vibrations are not easily reached by the environmental sensor. In a particular example, environmental sensor 123 may be a microphone for recording machine vibrations not caused by postures performed by a patient. In another example, one of a plurality of vibration sensors 121, 122 may operate as environmental sensor 123, for example, by placing the vibration sensor near a location where the influence of environmental vibrations is greater or greatest.
[0052] It is worth noting that the use of environmental sensor 123 can also be avoided, for example, by appropriately placing vibration sensors 121, 122, such as near the expected position of the posture, and / or placing (one or more) sensors 121, 122 in locations where environmental vibration is expected to be less. In yet another example, the signal processing techniques described above can be used to separate the environmental signal from the sensor signal. For example, the sensor signal can pick up not only vibrations from the posture but also motor noise. Filtering techniques such as Fourier or frequency analysis (e.g., using a bandpass filter) or time series analysis (e.g., by removing the average vibration characteristics of the motor) can be used to separate the posture-corresponding signal from the motor noise. Since the vibration characteristics of the motor noise may be known, the motor noise can be filtered out or at least reduced, thereby improving the signal-to-noise ratio of the vibration signal. Another option is adaptive noise cancellation, in which the aforementioned environmental sensors can be arranged and configured to receive vibrations originating from the motor but not vibrations corresponding to the performed posture.
[0053] Figure 2 An MRI imaging apparatus 200 is shown. The MRI imaging apparatus 200 may include a scanning component 210, a patient table 240, a patient table base 250, and vibration sensors 211-231. The MRI imaging apparatus 200 can be controlled by posture, such as... Figure 1 As shown in the example, posture can be detected by a vibration sensor and identified by the processor system from the sensor signal. Figure 2 (The processor system is not shown). The scanning unit 210 may include a chamber for receiving a patient. The patient table 240, also known as a patient bed, may include a movable platform that slides into and out of the chamber 210. The patient can lie on the table 240 and can be moved into the chamber 210 for scanning. Typically, the height of the table 240 can be adjusted and it can be moved horizontally to properly position the patient within the MRI imaging device 200.
[0054] One or more vibration sensors 211-231 can be placed at various locations on the surface and inside the MRI imaging device 200. For example, one or more vibration sensors 211, 212 can be placed inside the chamber 210 to sense vibrations caused by postures performed inside the chamber of the scanning component 210. Additionally, or alternatively, vibration sensors can be disposed within or on the patient table 240, or within or on the base 250 of the patient table, to enable the pickup of vibrations caused by postures performed on the surface of the patient table 240 and / or the base 250. It is worth noting that... Figure 2The positions of vibration sensors 211-231 shown are merely exemplary and may depend on which surfaces the patient uses as input for posture. For example, the positions of vibration sensors 211-231 may depend on whether the patient, operator, or both are expected to provide posture as input.
[0055] Figure 3 A processor system 300 is schematically illustrated. The processor system 300 is configured to receive sensor signals from a vibration sensor and derive command signals based on the sensor signals to control a medical imaging device. The processor system 300 may include a processor 310, a storage device 320, and a communication interface 330. In short, the processor 310 can be used by the processor system 300 to perform any processing tasks related to the processor system described herein; the storage device 320 can be used for temporary storage; and the communication interface 330 can be used to communicate with external entities such as sensors, other processor systems, etc.
[0056] For example, processor 310 can be a known type of processor circuit, such as a microprocessor, CPU, GPU, etc. Processor system 300 may also include multiple processors. The processor circuitry can be implemented in a distributed manner, for example, as multiple sub-processor circuits. For example, processor system 300 can utilize cloud computing. The processor can be configured to execute appropriate software stored in processor system 300; for example, the software may have been downloaded and / or stored in a suitable memory, such as volatile memory like RAM or non-volatile memory like flash memory. Instead of using software to implement functionality, processor 310 can also be implemented entirely or partially as programmable logic (e.g., field-programmable gate array (FPGA)). Processor 310 can be implemented entirely or partially as a so-called application-specific integrated circuit (ASIC), such as an integrated circuit (IC) customized for its specific purpose. For example, the circuitry can be implemented using CMOS, for example, using hardware description languages such as Verilog, VHDL, etc. In hybrid embodiments, functional units are partially implemented in hardware and partially implemented in software stored on and executed on processor system 300.
[0057] Embodiments of the communication interface 330 may include one or more of the following: The communication interface may include a network interface connected to a local area network or wide area network (e.g., the Internet), a storage interface connected to internal or external data storage devices (e.g., internal hospital storage devices where hospital or patient-specific data is stored and shared), or an application programming interface (API), etc. The communication interface 330 may also include a sensor interface and / or a control interface. Therefore, the processor system 300 can receive sensor signals and send command signals to the medical imaging equipment via the communication interface 330.
[0058] Storage device 320 can be, for example, an electronic storage device, a magnetic storage device, etc. Storage device 320 can include local storage devices, such as local hard drives or electronic storage devices. Storage device 320 can also include non-local storage devices, such as cloud storage devices. In the latter case, storage device 320 can include a storage interface to the non-local storage device. Storage device 320 can include multiple separate sub-storage devices that together constitute storage device 320.
[0059] Storage device 320 can be a non-transient storage device. For example, storage device 320 can store data when powered on, such as a volatile storage device, like random access memory (RAM). Storage device 320 can also store data when powered on and when not powered, such as a non-volatile storage device (e.g., flash memory). Memory 320 may include volatile writable portions (e.g., RAM) and non-volatile writable portions (e.g., flash memory). Storage device may include non-volatile non-writable portions, such as ROM, for example, a portion of stored software.
[0060] In some examples, when the processor system 300 is part of a medical imaging apparatus, the aforementioned processor 310, memory 320, and communication interface 330 may be components of the medical imaging apparatus. Continuing to refer to the medical imaging apparatus, it is worth noting that, although in Figure 3 Not shown, but medical imaging devices may also have a user interface, which may include well-known elements such as one or more buttons, a keyboard, a display, a touchscreen, etc.
[0061] Figure 4An example of an embodiment of a method for controlling a medical imaging device using posture is illustrated schematically. Step 410 may include a patient performing a posture on a surface of the medical imaging device. Step 420 may include detecting the patient's posture by means of a vibration sensor included in the medical imaging device, in order to detect vibrations propagating from the posture across the surface to the vibration sensor. Step 430 may include a processor system receiving a sensor signal from the vibration sensor. Step 440 may include the processor system deriving a command signal from the sensor signal. Many different ways of performing this method are possible, as will be apparent to those skilled in the art. For example, the steps may be performed in the order shown, but the order of the steps may be changed or certain steps may be performed in parallel. Furthermore, other method steps may be inserted between the steps. The inserted steps may represent improvements to the method as described herein, or may be unrelated to the method. For example, some steps may be performed at least partially in parallel. Furthermore, a given step may not be fully completed before the next step begins. Embodiments of the method may be performed using software comprising instructions for causing the processor system to perform steps 420, 430, 430 of method 400. The software may include only the steps taken by a specific sub-entity of the system. The software can be stored on suitable storage media, such as hard drives, memory, optical discs, etc. The software can be transmitted as a signal via wired, wireless, or data networks (such as the Internet). The software is available for download and / or remote use on a server.
[0062] It should be understood that the currently disclosed object also extends to computer programs, particularly computer programs on or within a carrier, suitable for putting the currently disclosed object into practice. The program may be source code, object code, code between source code and object code (e.g., in a partially compiled form), or any other form suitable for implementing embodiments of the method. Embodiments relating to the computer program product include computer-executable instructions corresponding to each processing step of at least one of the illustrated methods. These instructions may be subdivided into subroutines and / or stored in one or more files that may be statically or dynamically linked. Another embodiment relating to the computer program product includes computer-executable instructions corresponding to each device, unit, and / or portion of at least one of the illustrated systems and / or products.
[0063] Figure 5aA computer-readable medium 1000 storing data 1010 thereon is shown, as well as a computer-readable medium 1001 storing data 1011 thereon. The computer-readable medium 1000 is shown in the form of an optically readable medium. The computer-readable medium 1001 is shown in the form of an electronic memory, in this example, a memory card. The stored data 1010 and 1011 can represent computer programs, which may include instructions that, when executed by a processor system, cause the processor system to perform actions according to the appendix. Figure 4 Examples of the methods described herein. Computer programs 1010 and 1011 may be embodied on the computer-readable medium 1000 as physical markings or by magnetization of the computer-readable medium 1000. However, any other suitable embodiments are conceivable. Furthermore, it should be understood that although the computer-readable medium 1000 is shown herein as an optical disc, the computer-readable medium 1000 may be any suitable computer-readable medium, such as a hard disk, solid-state storage, flash memory, etc., and may be non-recordable or recordable. Computer programs 1010 and 1011 include instructions for causing a processor system to execute embodiments of the methods using a posture-controlled medical imaging device.
[0064] Figure 5b A schematic diagram of a processor system 1110 according to an embodiment is shown. The processor system 1110 includes a processing unit 1120, such as a CPU, for running computer program components to perform methods according to the embodiment and / or implement modules or units thereof. The processor system 1110 includes a memory 1122 for storing program code, data, etc. A portion of the memory 1122 may be read-only. The processor system 1110 may include a communication element 1126, such as an antenna, a connector, or both, etc. The processor system 1110 may include an application-specific integrated circuit 1124 for performing some or all of the processing defined in the method. The processor 1120, memory 1122, application-specific IC 1124, and communication element 1126 may be interconnected via an interconnect 1130 (e.g., a bus). The processor system 1110 may be arranged for contact and / or contactless communication using an antenna and / or a connector, respectively.
[0065] Although system 1110 is shown as including one of each described component, in various embodiments there may be multiple components. For example, processing unit 1120 may include multiple microprocessors configured to independently execute the methods described herein, or configured to execute steps or subroutines of the methods described herein, such that the multiple processors cooperate to achieve the functionality described herein. Furthermore, in the case of implementing system 1110 in a cloud computing system, the various hardware components may belong to different physical systems. For example, processing unit 1120 may include a first processor in a first server and a second processor in a second server.
[0066] It should be noted that the above embodiments are illustrative and not limiting of the subject matter disclosed herein, and those skilled in the art will be able to devise many alternative embodiments.
[0067] In the claims, any reference numerals placed in parentheses shall not constitute a limitation on the claims. In the claims, the verb "comprising" and its variations do not exclude the presence of elements or steps other than those stated in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. Expressions such as "at least one" preceding a list of elements indicate a selection from all or any subset of the elements in the list. For example, the expression "at least one of A, B, and C" should be understood to include only A, only B, only C, both A and B, both A and C, both B and C, or all of A, B, and C. The subject matter currently disclosed can be implemented by hardware comprising several discrete elements and by means of a suitably programmed computer. In device-type claims that enumerate several parts, several of these parts can be implemented by the same item of hardware. Although specific measures are recited in mutually distinct dependent claims, this does not indicate that combinations of these measures cannot be advantageously used.
[0068] In the claims, the reference numerals enclosed in parentheses refer to reference numerals in the drawings of exemplary embodiments or formulas of embodiments, thus increasing the comprehensibility of the claims. These reference numerals should not be construed as limiting the claims.
Claims
1. A system (100) for posture control of a medical imaging device (110) arranged to receive a patient, the system comprising: The medical imaging devices (110, 200) include vibration sensors (121, 122, 211-231). The vibration sensors (121, 122, 211-231) are positioned to detect the posture by detecting vibrations transmitted through the surface of the patient on the surface of the medical imaging device (110, 200) to the vibration sensors (121, 122, 211-231). The surface is arranged within the area accessible to the patient; and The processor system (120, 300) is configured to receive sensor signals from the vibration sensors (121, 122, 211-231) and derive a command signal (111) from the sensor signals to control the medical imaging device (110, 200).
2. The system (100) according to any one of the preceding claims, wherein, The command signal (111) starts, stops, and / or changes the intensity of the operation of the medical imaging device (110, 200).
3. The system (100) according to claim 2, wherein, The operation of the medical imaging equipment (110, 200) includes one or more of the following: medical scanning operation, ventilation operation, audio playback operation, emergency stop, and pause operation.
4. The system (100) according to claim 2, wherein, The medical imaging devices (110, 200) are configured for breath-hold scanning, and the operation of the medical imaging devices (110, 200) includes initiating the medical scanning operation.
5. The system (100) according to any one of the preceding claims, wherein, The processor systems (120, 300) are configured to detect multiple different postures corresponding to multiple corresponding operations of the medical imaging devices (110, 200).
6. The system (100) according to claim 5, wherein, The processor system (120, 300) is configured to detect the plurality of different postures by detecting different vibration features in the sensor signals, and to assign each of the different vibration features to a different command signal (111) corresponding to a plurality of corresponding operations of the medical imaging device (110, 200).
7. The system (100) according to any one of the preceding claims, wherein, The vibration sensors (121, 122, 211-231) are connected to the processor system (120, 300) via wires.
8. The system (100) according to any one of the preceding claims, wherein, The vibration sensors (121, 122, 211-231) include piezoelectric sensors, strain sensors and / or mechanical sensors.
9. The system (100) according to any one of claims 1-7, wherein, The processor system (120, 300) is configured to monitor the power consumption of the motor (112) of the medical imaging device (110) and derive vibration sensor data from the power consumption.
10. The system (100) according to any one of the preceding claims, wherein, The patient's posture includes one or more of the following: tapping command, stroking command, sliding command, and swiping command.
11. The system (100) according to any one of the preceding claims, wherein, The vibration sensors (121, 122, 211-231) are positioned to detect the posture of the patient's hands and / or feet.
12. The system (100) according to any one of the preceding claims, wherein, The medical imaging devices (110, 200) are one of the following: MRI scanner, CT scanner, SPECT scanner, and PET scanner.
13. The system (100) according to any one of the preceding claims, wherein, The processor system (120, 300) is configured to separate environmental signals from the sensor signals, such as environmental signals caused by the operation of the medical imaging device (110, 200).
14. The system (100) according to any one of the preceding claims, wherein, The medical imaging devices (110, 200) include multiple sensors (121, 122, 211-231), and the processor system (120, 300) is configured to use triangulation to locate the posture.
15. The system (100) according to any one of the preceding claims, wherein, The medical imaging equipment (110, 200) includes the processor system (120, 300); or The processor systems (120, 300) are included in an external signal processing device.
16. A method (400) for controlling a medical imaging device (110, 200) using the posture of a patient on a surface arranged to receive the patient. The method (400) includes: The patient's posture is detected (420) by vibration sensors (121, 122, 211-231) included in the medical imaging device (110, 200) by detecting vibrations propagating from the posture through the surface to the vibration sensors (121, 122, 211-231); The processor system (120, 300) receives (430) sensor signals from the vibration sensors (121, 122, 211-231); and The processor system (120, 300) derives (440) a command signal (111) from the sensor signal.
17. A transient or non-transient computer-readable medium (1000) comprising data (1020) representing instructions that, when executed by a processor system, cause the processor system to perform one or more steps of the method according to claim 16.
Citation Information
Patent Citations
Simultaneous gesture-based actuation of a medical facility
US20220113809A1