Intercom panel interface

Through the intercom panel interface and voice detection module, two-way audio communication between the remote operator and the medical imaging system object is realized, which solves the problem of remote control in the existing system and improves communication efficiency and security.

CN123076845APending Publication Date: 2026-11-10KONINKLIJKE PHILIPS NV
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202580024259.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-03-25
Filing Date
2025-03-18
Publication Date
2026-11-10

AI Technical Summary

Technical Problem

Existing medical imaging systems use one-way communication, making it difficult for remote experts to communicate bidirectionally with the imaging subject. Furthermore, existing software controls may be unavailable or outdated, preventing remote control.

Method used

It adopts an intercom panel interface, including a robot button actuator and a voice detection module, and realizes remote operator audio stream detection and control through a network interface. It automatically actuates the instant call button and provides two-way audio communication and complex audio information stream control by combining audio stream processing and delay mechanism.

Benefits of technology

It enables seamless remote control of the intercom panel of the medical imaging system, provides two-way audio communication, improves communication efficiency and security, and is suitable for remote operation of various medical imaging systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123076845A_ABST
    Figure CN123076845A_ABST
Patent Text Reader

Abstract

This document discloses an intercom panel interface (108) for mounting an intercom panel (100) to a medical imaging system (302). The intercom panel includes: a push-to-talk (PPT) button (102), an intercom panel microphone (104), and an intercom panel speaker (106). The intercom panel interface includes: a panel hardware interface (110) for communicating with a local computing system (362). The panel hardware interface is used to receive control commands and remote operator audio streams (384). The panel hardware interface is configured to transmit object audio streams (390). The intercom panel interface includes: a robot button actuator (112) for actuating the push-to-talk button; an interface microphone (116) configured to receive object audio from the intercom panel speaker; an interface speaker (118) configured to provide remote operator audio to the intercom panel microphone; and an audio interface (114) configured to digitize the object and present the remote operator audio stream.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to medical imaging, and more particularly to communication between an object and a remote operator. Background Technology

[0002] In medical imaging modalities such as magnetic resonance imaging (MRI), positron emission tomography (PET), single-photon emission computed tomography (SPECT), and computed tomography (CT), the operator of the medical imaging system can communicate with the object being imaged using an intercom system. A common arrangement is that the operator has an intercom panel for controlling the intercom system. The intercom panel typically has a speaker for listening to audio signals from the object, a microphone for picking up the operator's voice, and a push-to-talk button. When the push-to-talk button is not engaged, the operator can hear audio from the object. When the push-to-talk button is engaged, the object can hear audio from the operator. Communication using such an intercom system is unidirectional.

[0003] U.S. Patent Application Publication US 2023 / 0185524 A1 discloses a communication system between an imaging chamber containing medical imaging equipment and a control room containing a controller for controlling the medical imaging equipment. The communication system includes an intercom having a chamber audio speaker and a chamber microphone in the imaging chamber, and a communication path through which chamber audio from the chamber microphone is transmitted to the control room, and instructions are transmitted from the control room to the chamber audio speaker via the communication path. An electronic processing device operatively connected to the communication path is programmed to perform at least one of the following operations: (i) generating instructions; (ii) modifying the chamber audio and outputting the modified chamber audio in the control room; and / or (iii) analyzing the chamber audio to determine operability information, determining modifications or additions to a medical workflow based on the operability information, and automatically implementing the modifications or additions to the medical workflow. Summary of the Invention

[0004] The present invention provides an intercom panel, a medical system, a method, and a computer program in the independent claims. Embodiments are given in the dependent claims.

[0005] In one aspect, an intercom panel interface is disclosed. The intercom panel interface is configured for mounting to an intercom panel of a medical imaging system. The intercom panel includes a push-to-talk button, an intercom panel microphone, and an intercom panel speaker. The intercom panel interface also includes a panel hardware interface configured for communicating with a local computing system. The panel hardware interface is configured to receive control commands from the local computing system. The panel hardware interface is configured to receive a remote operator audio stream from the local computing system. The panel hardware interface is also configured to transmit an object audio stream to the local computing system. The intercom panel interface also includes a robotic button actuator configured to actuate the push-to-talk button in response to receiving a control command. The intercom panel interface also includes an interface microphone configured to receive object audio from the intercom panel speaker. The intercom panel interface also includes an interface speaker configured to provide remote operator audio to the intercom panel microphone. The intercom panel interface also includes an audio interface configured to digitize the object audio into an object audio stream. The audio interface is also configured to present the remote operator audio stream to the interface speaker.

[0006] In another aspect, a medical system is disclosed. The medical system includes an example of an intercom panel interface. The medical system also includes a local memory storing local machine-executable instructions and a speech detection module configured to detect human speech in an input digital audio stream. The medical system also includes a local network interface configured to form a network connection with a remote operator station. The medical system also includes a local computing system. Execution of the local machine-executable instructions causes the local computing system to continuously receive a remote operator audio stream, for example, via the network interface. Execution of the local machine-executable instructions also causes the local computing system to continuously detect human speech within the remote operator audio stream by inputting the remote operator stream as an input digital audio stream to the speech detection module. Execution of the local machine-executable instructions further causes the local computing system to continuously provide control signals and the remote operator audio stream to the panel hardware interface when human speech is detected. Execution of the local machine-executable instructions further causes the local computing system to continuously transmit the target audio stream to the remote operator station.

[0007] This could be beneficial because it provides a means of remotely and seamlessly controlling the intercom panel of a medical imaging system. The intercom panel interface provides both connection to and from the intercom panel interface and means of mechanically controlling the push-to-talk button.

[0008] In another aspect, a method for operating a medical system is disclosed. The method includes receiving a remote operator audio stream via a network interface. The method further includes detecting human speech within the remote operator audio stream by inputting the remote operator audio stream as an input digital audio stream to a speech detection module. The method also includes providing control signals and the remote operator audio stream to a panel hardware interface when human speech is detected. The method further includes transmitting the target audio stream to a remote operator station.

[0009] This example could be beneficial because it allows for more sophisticated means of controlling the flow of audio information to and from the intercom panel. For instance, if a local operator is seated in front of the intercom panel interface and then presses the push-to-talk button on the intercom panel, this would disable audio from objects in the medical imaging system. More complex logic could be used to determine when control signals can be used to actuate the push-to-talk button using a robotic button actuator.

[0010] In another aspect, an example of a computer program is disclosed, which includes machine-executable instructions and is configured to control a local computing system to perform the method. Attached Figure Description

[0011] In the following preferred embodiments, the invention will be described by way of example only and with reference to the accompanying drawings, in which:

[0012] Figure 1 The diagram illustrates an example of an intercom panel and its interface.

[0013] Figure 2 The diagram shows a portion of the intercom panel interface, where manual activation of the instant call button is prevented.

[0014] Figure 3 An example of a medical system is illustrated.

[0015] Figure 4 The illustration shows the use of Figure 1 A flowchart of the methods used in medical systems.

[0016] Figure 5 The illustration shows a functional diagram depicting another example of a medical system. List of reference numerals in the attached diagram: 100 Intercom Panel 102 Instant Call Button 104 Intercom Panel Microphone 106 Intercom Panel Speakers 108 Intercom Panel Interface 110 Panel Hardware Interface 112 Robot Button Pusher 114 Audio Interface 116 Interface Microphone 118-interface speaker 120 Data Connection 200 Manual call button 300 Medical System 302 Magnetic Resonance Imaging System 304 magnet 306 Magnet Chamber 308 Imaging Area 309 Field of view 310 Magnetic Gradient Coil 312 Magnetic Gradient Coil Power Supply 314 RF coil 316 transceiver 318 Objects 320 Object Support 330 Control Room Computer 332 Control Room Computing System 334 Control Room Hardware Interface 336 Control Room User Interface 338 Control Room Memory 340 Control room machine executable instructions 342 Pulse Sequence Command 344 k spatial data 346 Magnetic Resonance Imaging Images 350 Intercom System 352 Object Interface 354 Object Microphone 356 Object Headphones 358 Remote User Interface 360 Local Computer 362 Local Computing System 364 Local Hardware Interface 366 Network Interface 368 Local Memory 372 Network Connection 374 Remote Operator Station 380 Local Machine Executable Instructions 382 Voice Detection Module 384 Remote Operator Audio Stream Detection of human speech in the audio stream of a remote operator (386) 388 control signals 390 Object Audio Stream 392 Audio Noise Filtering Module 394 Alarm Recognition Module 396 Buffered Remote Operator Audio Stream 398 Audio-Time Compression Algorithms 400 receives the remote operator's audio stream via the network interface. 402 Detecting human speech within the remote operator audio stream by inputting the remote operator stream as the input digital audio stream into the speech detection module. 404 When the human voice is detected, the control signal and the remote operator audio stream are provided to the panel hardware interface. 406 Transmit the object audio stream to the remote operator station. 500 Medical System 501 Voice and Alarm Signal Detection Module 502 Audio and Button Control Module 504 Delay Configuration Settings 506 Remote Workstation 508 Speakers and microphones or headphones Detailed Implementation

[0017] Elements with similar numbers in these figures are either equivalent elements or perform the same function. If the functions are equivalent, elements that have already been discussed need not be discussed in the following figures.

[0018] Examples may provide a means of establishing direct patient communication from a remote operator supporting a local operator. Some examples may provide a medical system that implements a remotely initiated two-way audio communication system with an object. In some examples, the system is also configured to automatically correct for signal delay and is built upon an existing patient intercom using a robotic push-button actuator (for initiating communication). Some examples may provide a set of modified speakers and microphones, and a mechanical push-button actuator for connecting to an intercom device on a technician's desk to allow remotely initiated two-way audio communication with the patient. Examples may also provide a medical system and method to automatically switch the audio direction at the local intercom based on detected remote audio signals, and to buffer the remote expert's speech in such a way that the delay caused by the mechanical push-button actuator does not cut off the audio signal received from the remote expert.

[0019] Due to a shortage of radiology staff and a growing need for improved efficiency and cost-effectiveness in radiology workflows, remote expert support systems for radiological imaging, such as Radiology Operations Control Centers (ROCCs), are becoming increasingly important in clinical practice. Communication between local operators and patients in the imaging room is typically achieved via intercom systems, allowing technicians at the control console to hear and speak with patients. In many cases, remote experts supporting imaging procedures would prefer to have a way to communicate directly with patients (e.g., to identify patients, inquire about details of disease or anatomy, give instructions for upcoming MRI scans, etc.). This is a highly requested but unavailable feature of ROCCs.

[0020] In this example, the intercom panel interface is configured for mounting to an intercom panel within a medical imaging system. The intercom panel includes a push-to-talk button, an intercom panel microphone, and an intercom panel speaker. When the push-to-talk button is engaged, the intercom panel microphone picks up speech, sound, signals of interest (e.g., alarms), or other noise or sound, and then plays it back to the object currently being imaged in the medical imaging system. When the push-to-talk button is released, the intercom panel speaker provides an audio channel, allowing the operator to listen to speech or other noise from the object's location within the medical imaging system. In some embodiments, the intercom panel microphone is muted when the intercom panel is released. The use of the push-to-talk button enables audio transmission in the intercom system in one direction, such as from a local operator to a remote operator, from a local patient to a remote operator, from both the local operator and the patient to the remote operator, and vice versa.

[0021] The intercom panel interface also includes a panel hardware interface configured to communicate with a local computing system. In different embodiments and examples, the panel hardware interface can take different forms. In one example, the panel hardware interface may be a hardware interface of the local computing system. In other examples, the panel hardware interface may be a network or data communication component, such as a Bluetooth connection or a USB connection. In at least some embodiments, the panel hardware interface is configured to receive control commands from the local computing system. The panel hardware interface is configured to receive a remote operator audio stream from the local computing system. The panel hardware interface is also configured to transmit an object audio stream to the local computing system. The object audio stream may contain an audio stream containing audio from a patient, person, or other object in or around the imaging chamber or console. The panel hardware interface can be used as a control component for controlling various components of the intercom panel interface.

[0022] The intercom panel interface also includes a robotic button actuator configured to actuate a push-to-talk button in response to a received control command. This enables remote actuation of the push-to-talk button. This can, for example, allow a remote operator located at a site remote from a medical imaging system to control the intercom system. The intercom panel interface also includes an interface microphone configured to receive target audio from the intercom panel speaker. For example, the intercom panel microphone is positioned adjacent to or near the intercom panel speaker. The intercom panel interface also includes an interface speaker configured to provide remote operator audio to the intercom panel microphone. For example, the interface speaker can be configured to focus the remote operator audio onto the intercom panel microphone. The intercom panel interface also includes an audio interface configured to digitize the target audio into a target audio stream. The audio interface is also configured to present the remote operator audio stream to the interface speaker.

[0023] This example could be beneficial because it provides a means of remotely and seamlessly controlling the intercom panel of a medical imaging system.

[0024] In another example, the intercom panel is configured to cover the push-to-talk button on the intercom panel, thus preventing manual actuation of the push-to-talk button. The intercom panel interface also includes a manual talk button. The intercom panel interface is also configured to cause pressing the manual talk button to generate a control command to actuate the push-to-talk button on the intercom panel. This example can be beneficial because it allows for more sophisticated means of controlling the flow of audio information to and from the intercom panel. For example, if a local operator is sitting in front of the intercom panel interface and then presses the push-to-talk button on the intercom panel, this would disable audio from objects in the medical imaging system. More complex logic can be used to determine when a control signal can actuate the push-to-talk button using a robotic button actuator.

[0025] In another example, a medical system is disclosed that includes an example of an intercom panel interface according to any of the embodiments of this application. The medical system also includes a local memory storing machine-executable instructions and a speech detection module configured to detect human speech in an input digital audio stream. The digital audio stream may, for example, be input to the speech detection module, and the speech detection module can identify the presence of human speech in the input digital audio stream. The speech detection module can be implemented in various ways, such as those described below. The medical system also includes a local network interface configured to form a network connection with a remote operator station. For example, the remote operator station may be able to remotely control a medical imaging system. The medical imaging system may be any of the following: PET (positron emission tomography), MRI (magnetic resonance imaging), CT (computed tomography), US (ultrasound), X-ray, PET-CT, SPECT-CT, pathology equipment, fluoroscopy, mammography, CBCT (cone-beam CT), or any other imaging equipment used in the field of diagnosing patients.

[0026] The difficulty in remotely controlling a medical imaging system lies in the possibility that software controls may be unavailable, or the software used to operate the system may be too outdated to warrant modification for remote control. One approach to remotely controlling a medical imaging system is to clone the screen of the computer system controlling the system (e.g., using a screen replicator) and provide interfaces (e.g., keyboard and mouse interfaces that work via the internet or other network connections). The remote operator can then control the system as if they were in the control room. As mentioned above, the use of an intercom panel interface allows the remote operator to operate and control the intercom system remotely. For example, this could allow the remote operator to control the medical imaging system as if they were in the control room.

[0027] The medical system also includes a local computing system. Execution of local machine-executable instructions causes the local computing system to continuously receive remote operator audio streams via a network interface. The execution of these machine-executable instructions also causes the computing system to detect human speech within the remote operator audio stream by inputting the remote operator audio stream as an input digital audio stream to a speech detection module. The execution of these machine-executable instructions further causes the computing system to provide control signals to the panel hardware interface and the remote operator audio stream continuously upon detection of human speech. The execution of these machine-executable instructions also causes the computing system to transmit the target audio stream to the remote operator station. In this example, when human speech is detected in the remote operator audio stream, a robot button actuator is controlled to actuate a press-to-talk button. This means that the operator can remotely use the intercom panel of the medical imaging system without pressing a button. The remote operator can use, for example, a headset or other audio system commonly used for teleconferencing. This allows for the integration of the remote operator into the control of the medical imaging system without requiring dedicated hardware at the remote operator's location.

[0028] In another example, the speech detection module is configured to detect human speech by determining when the average audio signal exceeds a predetermined signal strength for at least a predetermined period of time. For example, if noise or speech exceeds the predetermined signal strength for at least the predetermined period of time, the system will determine that this is speech, noise, or sound that should be transmitted remotely to the recipient.

[0029] For example, a predetermined signal strength can refer to a signal strength higher than the background noise level in the room from which the audio signal is captured (i.e., the remote control room or the local inspection room). In the case of an MR inspection room, there is inherent background noise from the cryogenic cooling system to be considered. In the case of a remote operator control room, there may be background noise from air conditioning or from distant speech. A signal strength significantly greater than the background noise level (e.g., 50% or 100% greater than the background noise level) will be considered speech. If such a large signal is identified, for example, within at least 0.3 seconds, the system can determine that someone is speaking.

[0030] In another example, the speech detection module is configured to detect human speech by comparing the FFT (Fast Fourier Transform) of the digital audio stream with a predetermined FFT distribution. In this example, one approach would be to observe the signal in the frequency domain and use simple pattern matching on the spectrum or monitor signal strength within a predetermined frequency range. In this way, for example, human speech can be distinguished from alarm bells or noise with different frequency components or spectra. In one example, the audio signal is observed in the frequency domain, and simple pattern matching is used on the spectrum or signal strength is monitored within a predefined frequency range. In this way, for example, human speech can be distinguished from alarm bells.

[0031] In another example, the speech detection module is configured to use a trained neural network to detect human speech. In this example, the trained neural network may be able to more specifically distinguish speech from background noise. It can capture anticipated conversations and notify the system to generate control signals. For example, when a remote radiologist speaks into the microphone, the trained neural network classifies it as human speech and triggers a message to activate the control signal. If a vacuum cleaner or other noise is present in the background, the trained neural network classifies it as background noise and therefore will not trigger a control signal.

[0032] The trained neural network (NN) can be, for example, a recurrent neural network (RNN) and is trained using various audio clips, both containing and not containing human speech. This can be trained using standard deep learning algorithms to train the recurrent neural network. Examples of suitable RNNs could be LSTM (Long Short-Term Memory) or B-RNN (Bidirectional RNN) or a combination of both. Each of these architectures is capable of performing speech recognition. Therefore, any of these RNN architectures can be used for speech detection when implemented in various examples.

[0033] In one example, a trained neural network (NN) can distinguish human speech from background noise. More specifically, it can capture anticipated conversations and be used to control an intercom panel interface. For instance, when a remote radiologist speaks into a microphone, the trained NN classifies it as human speech and triggers a message to the audio and button control modules. However, if a vacuum cleaner is operating in the background, the trained NN classifies it as background noise and therefore does not trigger any notification to the audio and button control modules. To achieve this task, a labeled dataset of various samples of human speech and background noise can be fed to the selected NN first. The NN's parameter values ​​are updated during training, and its performance is validated. The validated NN is then saved as a file and loaded into the application. The trained NN can be designed to further update its parameter values ​​after deployment based on real-world conversations and user feedback.

[0034] In another example, the execution of machine-executable instructions also causes the computing system to buffer the remote operator's audio stream. As used herein, the buffer includes memory capable of storing the remote operator's audio stream. This can be used, for example, to delay the remote operator's audio stream.

[0035] In another example, the execution of machine-executable instructions also causes the computing system to use a buffered remote operator audio stream to predetermine the transmission delay of the remote operator audio stream to the robot button pusher delay. As used herein, the predetermined robot button pusher delay may include a delay that takes into account the time lag before the robot button pusher activates the push-to-talk button. This may include the mechanical delay of the robot button pusher as well as additional time allowed for the transmission of control signals via a network connection or over the Internet.

[0036] In another example, the execution of the machine-executable instructions also causes the computing system to (continuously) detect human speech within the object audio stream by inputting the object audio stream as a digital audio stream into the speech detection module. The execution of the machine-executable instructions also causes the computing system to (continuously) delay the transmission of control commands when human speech is detected in the object audio stream. The execution of the machine-executable instructions further causes the computing system to (continuously) delay the transmission of a buffered remote operator audio stream when object speech is detected in the object audio stream.

[0037] This example could be beneficial because the system could automatically prevent the push-to-talk button from being engaged while the subject is speaking. For instance, if an operator presses the push-to-talk button, this would prevent audio from the subject from being heard. If the subject is already speaking, the voice from the remote operator would be delayed. This could provide better communication and improved security, for example, when using medical systems.

[0038] In another example, the execution of machine-executable instructions also enables the computing system to generate a time-compressed remote operator audio stream based on the buffered remote operator audio stream when the buffered remote operator audio stream is delayed relative to the original remote operator audio stream. The time-compressed remote operator audio stream is transmitted as a remote operator audio stream to the panel hardware interface. In this example, when the remote operator audio stream has been delayed, such as when an object is speaking, or when there is a delay due to a predetermined robot button pusher delay, the buffered remote operator audio stream can catch up with the current time by using the compressed remote operator audio stream. Various commercially available time compression algorithms can be used to accelerate the compressed remote operator audio stream without altering the pitch of the speech. Using this feature, the output audio signal can be played at a slightly accelerated speed until the buffer is fully played and there is no longer a time lag between the buffer output and the speech input. Once this is achieved, the original input signal can be directly passed to the output.

[0039] In another example, the execution of machine-executable instructions also enables the computing system to pause the remote operator's audio stream using a buffered remote operator's audio stream when the push-to-talk button is manually pressed, or when the local operator's voice is detected in the object's audio stream. In this example, the remote operator's voice is paused when the local operator is speaking or when the push-to-talk button is manually pressed. This can be advantageous because it reduces the chance of various operators talking to each other and some information loss.

[0040] In another example, local memory also stores an audio noise filtering module configured to remove audio noise. For example, the audio noise filtering module can remove various spectral components of noise that are typically outside the normal spectrum of human speech, for example, using high-pass and low-pass filters. In other examples, a neural network trained to remove noise from a speech signal can be used to remove noise that is not speech. Execution of machine-executable instructions also enables the computing system to use the audio noise filtering module to remove audio noise from either a remote operator's audio stream or an object's audio stream. This can be beneficial because it can help the object and the remote operator communicate more effectively.

[0041] In another example, the local memory also includes an alarm recognition module configured to output an alarm signal in response to the detection of an audible alarm in the object audio stream. Execution of machine-executable instructions further enables the computing system to detect audible alarms by inputting the object audio stream into the alarm recognition module, and then, if an audible alarm is detected, to provide an alarm signal to the medical system. For example, the neural network used can be trained to recognize the alarm signal, or, for example, an FFT can be performed on the object audio stream, and components tailored for specific audible alarms can make it easy to detect them. This example could be beneficial as it could help improve the security of medical systems.

[0042] In another example, the medical system also includes a remote operator station. The remote operator station is configured for remotely controlling the medical imaging system. As mentioned above, this can be beneficial because the use of an intercom panel allows for easier and better remote control of the medical system.

[0043] In another example, the medical system also includes a medical imaging system. This medical imaging system can be, for example, a magnetic resonance imaging system, digital fluorescence imaging, computed tomography (CT), positron emission tomography (PET), single-photon emission tomography (SPECT), or any other medical imaging system.

[0044] In another example, the medical system also includes an intercom system. The intercom system includes an intercom panel.

[0045] Figure 1The diagram illustrates an intercom panel 100 and an intercom panel interface 108. The intercom panel 100 includes a push-to-talk button 102, an intercom panel microphone 104, and an intercom panel speaker 106. When the push-to-talk button 102 is not pressed, the intercom panel speaker 106 allows an operator near the intercom panel 100 to hear what is being said. When the push-to-talk button 102 is pressed, the intercom panel microphone 104 becomes active, and the intercom panel speaker 106 is disabled. The intercom panel microphone 104 can then pick up audio noise and speech in its vicinity and then provide audio to the object in the medical imaging system. The intercom panel 100 is useful when there are operators in the same room. The intercom panel interface 108 enables remote use of the intercom panel 100.

[0046] When working with older or legacy medical imaging systems or medical imaging systems from other vendors, the intercom panel interface 108 enables the use of the intercom panel 100 without modifying the existing system. The intercom panel interface 108 has a panel hardware interface 110 connected to a robot button actuator 112 and an audio interface 114. When the panel hardware interface 110 receives a control signal, it passes it to the robot button actuator 112, causing the robot button actuator 112 to remotely press the push-to-talk button 102. The audio interface 114 is shown connected to an interface microphone 116 and an interface speaker 118. The interface microphone 116 is positioned near the intercom panel speaker 106 and is capable of picking up noise, sound, or speech generated by the intercom panel speaker 106. The interface speaker 118 is located near the intercom panel microphone 104 and is capable of remotely providing audio to the intercom panel microphone 104. The interface microphone 116 is configured to receive target audio from the intercom panel speaker 106. Interface speaker 118 is configured to provide remote operator audio to intercom panel microphone 104. Audio interface 114 is configured to digitize object audio into an object audio stream. Audio interface 114 is also configured to present remote operator audio to interface speaker 118.

[0047] Figure 2A cross-sectional view of an example intercom panel interface 108 mounted to intercom panel 100 is shown. In this example, the intercom panel interface 108 shields the surface of the push-to-talk button 102 so that it cannot be manually pressed. Instead of manual actuation, a manual talk button 200 is present on the surface of the intercom panel interface 108. When the manual talk button 200 is pressed, this causes the panel hardware interface 110 to generate a control signal that causes the robot button actuator 112 to actuate and press the push-to-talk button 102. This can be advantageous because it allows for more sophisticated means of control when the push-to-talk button 102 is pressed. For example, it can prevent a local operator from speaking while the subject is speaking. For example, if speech from the subject is detected or if a large amount of noise is being generated, the robot button actuator 112 can be temporarily disabled, for example, to allow the subject to finish speaking.

[0048] Figure 3 An example of a medical system 300 is illustrated. In this example, a magnetic resonance imaging (MRI) system 302 is present. MRI 302 is exemplary. For example, MRI 302 can be replaced by other types of imaging systems or tomographic imaging systems.

[0049] The magnetic resonance imaging system 302 includes a magnet 304. Magnet 304 is a superconducting cylindrical magnet with a bore 306 passing through it. It is also possible to use different types of magnets; for example, both split cylindrical magnets and so-called open magnets are possible. A split cylindrical magnet is similar to a standard cylindrical magnet, except that the cryostat has been split into two parts to allow access to the equiplanar plane of the magnet; such a magnet can be used, for example, in conjunction with charged particle beam therapy. An open magnet has two magnet sections, one on top of the other, with a space large enough between them to receive the object: the arrangement of the two sections is similar to that of a Helmholtz coil. Open magnets are popular because the object is less restricted. Inside the cryostat of the cylindrical magnet, there is an assembly of superconducting coils.

[0050] An imaging region 308 with a sufficiently strong and uniform magnetic field exists within the bore 306 of the cylindrical magnet 304 to perform magnetic resonance imaging. A field of view 309 is shown within the imaging region 308. Typically, k-space data is acquired with respect to the field of view 309. The region of interest may be the same as the field of view 309, or it may be a sub-volume of the field of view 309. An object 318 is shown supported by an object support 320, such that at least a portion of the object 318 is within both the imaging region 308 and the field of view 309.

[0051] Within the bore 306 of the magnet, a set of magnetic field gradient coils 310 are also present, which are used for spatial encoding of the magnetic spins within the imaging region 308 of the magnet 304. The magnetic field gradient coils 310 are connected to a magnetic field gradient coil power supply 312. The magnetic field gradient coils 310 are intended to be representative. Typically, the magnetic field gradient coils 310 comprise three separate sets of coils for spatial encoding in three orthogonal spatial directions. The magnetic field gradient power supply supplies current to the magnetic field gradient coils. The current supplied to the magnetic field gradient coils 310 is controlled as a function of time and can be ramped or pulsed.

[0052] Adjacent to the imaging region 308 is an RF coil 314, which is used to manipulate the orientation of magnetic spins within the imaging region 308 and to receive radio transmissions from spins also located within the imaging region 308. The RF antenna may comprise multiple coil elements. The RF antenna may also be referred to as a channel or antenna. The RF coil 314 is connected to an RF transceiver 316. The RF coil 314 and the RF transceiver 316 may be replaced by separate transmit and receive coils, as well as separate transmitters and receivers. It should be understood that the RF coil 314 and the RF transceiver 316 are representative. The RF coil 314 is also intended to represent a dedicated transmit antenna and a dedicated receive antenna. Similarly, the transceiver 316 may also represent separate transmitters and receivers. The RF coil 314 may also have multiple receive / transmit elements, and the RF transceiver 316 may have multiple receive / transmit channels. The transceiver 316 and the gradient controller 312 are shown as a hardware interface 106 connected to the computer system 102.

[0053] The magnetic field gradient coil power supply 312 and transceiver 316 are shown as a control room hardware interface 334 connected to a control room computer 330. The control room computer 330 can be a computer used by a local operator to control and operate the magnetic resonance imaging system. The control room computer 330 is shown as a control room computing system 332 communicating with the control room hardware interface 334, as well as a control room user interface 336 and a control room memory 338. The control room memory 338 is intended to represent various types of memory accessible to the control room computing system 332. The control room computing system 332 can represent various types of computing cores or computing systems located in one or more locations. The control room hardware interface 334 can provide a user interface enabling the operator to control and operate the magnetic resonance imaging system 302. This can include, for example, a display and human-machine interface devices such as a mouse, trackball, and keyboard.

[0054] The control room memory 338 is shown to contain control room machine-executable instructions 340. These instructions enable the control room computing system 332 to perform tasks such as image processing and control of components of the magnetic resonance imaging system 302. The memory 338 is also shown to contain pulse sequence commands 342. These commands enable the computing system 332 to control the magnetic resonance imaging system 302 to acquire k-space data 344 according to a magnetic resonance imaging protocol. The memory 338 is shown to contain the k-space data 334 acquired by controlling the magnetic resonance imaging system 302 using the pulse sequence commands 342. The memory 338 is also shown to contain a magnetic resonance image 346 reconstructed from the k-space data 344.

[0055] The medical system 300 is also shown to include an intercom system 350. The intercom system 350 includes an intercom panel 100 and a target interface 352. The target interface 352 is connected to a target microphone 354 and a target headset 356. When the push-to-talk button 102 is not pressed, the target microphone 354 is active and audio is generated by the intercom panel speaker 106. When the push-to-talk button 102 is pressed, the intercom panel microphone 104 is active, and the target 318 can hear the audio through the target headset 356. The push-to-talk button 102 determines which of the microphones 354 is active.

[0056] The medical system 300 is also shown to include a remote user interface 358. The remote user interface 358 can, for example, provide a clone or copy of the display provided by the control room user interface 336, as well as simulations of various human-machine interface devices. For example, it can also be plugged into a USB port and simulate a mouse and keyboard. Therefore, the remote user interface 358 enables remote users to use the control room computer 330 remotely without installing additional software on the control room computer.

[0057] Adjacent to the intercom panel 100 of the intercom system 350 is the intercom panel interface 108. The intercom panel interface 108 and the intercom panel 100 are as follows: Figure 1 The arrangement is as shown in the diagram. Both the intercom panel interface 108 and the remote user interface 358 are shown as local hardware interfaces 364 connected to the local computer system 362. In this example, the remote user interface 358 is shown as being operated and controlled by the local computer 360. However, this is not necessarily the case. In some examples, the remote user interface 358 can operate independently of the local computer 360.

[0058] The local computer 360 is shown as a local computing system 362 that communicates with a local hardware interface 364, a network interface 366, and a local memory 368. The network interface 366 is shown as forming a network connection 372 with a remote operator station 374. The remote operator station 374 is a computer system used by a remote operator to remotely control the magnetic resonance imaging system 302. In this example, the connection to the remote user interface 358 is via the local computer 360. In some examples, the remote user interface 358 has a direct connection to the remote operator station 374 via an additional network.

[0059] Local memory 368 is shown to contain local machine-executable instructions 380, which enable local computing system 362 to perform basic computing tasks and data processing. Local memory 368 is also shown to contain a voice detection module 382 capable of detecting human voice in a digital audio stream. Memory 368 is also shown to contain a remote operator audio stream 384 received from remote operator station 374. Local memory 368 is also shown to contain the detection of human voice 386 determined by inputting the remote operator audio stream 384 into voice detection module 382. This causes the generation of control signal 388, which causes robot button pusher 112 to activate press-to-talk button 102. Local memory 368 is also shown to contain an object audio stream 390 received from intercom panel interface 108.

[0060] In this example, the local computer 360 is shown as a separate component compared to the clone user interface 358 and the intercom panel interface 108. In other examples, two or three of these components may combine their functions. For example, the panel hardware interface 110 may be the same as the local hardware interface 364.

[0061] The memory 368 is also shown to include a pair of optional software components. An optional audio noise filtering module 392 is present, which can be used to remove noise from the digital audio stream. An optional alarm detection module 394 is also present, which can be used to detect alarms in the object audio stream 390. A buffered remote operator audio stream 396 is also present, which can be generated when the remote operator audio stream 384 is temporarily stopped, so that the object 318 can speak. The memory 368 is also shown to include an optional audio time compression algorithm 398, which can be used to compress the buffered remote operator audio stream 396 to accelerate its playback, enabling it to catch up with the current time frame.

[0062] Figure 4 The illustrated operation is shown in the diagram. Figure 3A flowchart of a method for a medical system 300. In step 400, a remote operator audio stream 384 is received via a network interface 366. In step 402, human speech 386 is detected within the remote operator audio stream 384 by inputting it as an input digital audio stream to a speech detection module 382. In step 404, when human speech 386 is detected, a control signal 388 and the remote operator audio stream 384 are provided to a panel hardware interface 110. In step 406, the target audio stream 390 is transmitted to a remote operator station 374.

[0063] Figure 5 Another example of a medical system 500 is illustrated. The medical system is shown as including a remote operator station 374 and a panel hardware interface 110. In this example, the panel hardware interface 110 is used instead of the local computing system 362 to implement all functions. The functions of these components can be combined. The remote operator station 374 includes a remote workstation 506, which enables a remote operator to provide and receive audio using speakers and a microphone or a headset 508. The remote workstation 506 is connected to the network interface 366 of the panel hardware interface 110 via a network connection 372. Similarly, the components and functions of the local computer system 360 and the panel hardware interface 110 have been combined.

[0064] Network interface 366 is capable of sending and receiving remote operator audio streams and object audio streams 390. Remote operator audio stream 384 is fed to voice detection module 382. Voice detection module 382 can detect speech in the audio signal received from the microphone at the remote workstation, improve the signal by removing background noise, and notify the "Audio and Button Control Module" 502 of the reception of an upcoming conversation from the remote workstation. The Audio and Button Control Module determines the time when the "Talk to Patient" function 502 becomes active (or the time delay between the initiation of the final activation of the call function) by receiving a corresponding acknowledgment from the robot button pusher 112, or by being provided with predefined delay configuration settings specific to the type of button pusher and the model of the intercom device.

[0065] Upon receiving a message from the voice detection module 382 that “the voice of a remote technician has been detected,” the audio and button control module 502 sends a command to the robot button pusher 112 to enable the “talk to patient” function on the intercom device 100.

[0066] Once the "Talk to Patient" function is activated, the audio and button control module 502 instructs the receiving audio buffer module 510 to begin playing the recorded audio buffer with a negative time offset corresponding to the time taken to activate the "Talk to Patient" function. It may also optionally instruct the receiving audio buffer module 510 to accelerate the output audio (without changing the pitch) until the delay between the input and output audio has been reduced to (almost) zero.

[0067] The audio and button control module 510 also receives information from the voice and alarm signal detection module (501) (for patient audio) described below. When patient voice is detected while the system is already in the process of initiating the "talk to patient" function, there is a risk that the remainder of the sentence spoken by the patient may be lost once the button is fully pressed. In this case, the audio and button control module can temporarily pause the initiation of the "talk to patient" function until the patient has finished speaking, and then continue pressing the button and transmitting the voice of the remote expert (although with a greater initial lag / delay in this case).

[0068] Once the audio and button control module 510 receives a signal from the voice detection module that the voice has ended, it instructs the button pusher to release the "Press to Talk" button and instructs the audio receiving buffer module (510) to stop playing or transmitting audio signals. After detecting speech, the robot button pusher 112 is triggered. The time taken from the start of speech to the initiation of the intercom connection is the time it takes for playback to return promptly from the buffer when audio output begins.

[0069] Playback speeds can be selected such that they (a) are sufficient to achieve real-time synchronization over the typical duration of the speech (a few seconds) and (b) are not sped up too much, so that the listener still understands the words and the speech does not sound unnatural. Assuming the delay to be bridged by the buffer is 0.5 seconds and the total speaking time is >5 seconds, a typical speed increase could be approximately 10%.

[0070] One method to accelerate speech is to transform the digital audio into Fourier space, shift it to a lower frequency, reverse the transformation, and then play it back at a higher speed.

[0071] Two playback parameters (the time returned in time and the playback acceleration factor) can also be adjusted based on user feedback.

[0072] The local operator can hear the playback from a speaker placed near the intercom equipment. For example, the local operator can provide immediate feedback on whether the playback speed is normal or too fast by pressing a button on the user interface of the remote broadcast system.

[0073] The system can provide feedback after inspection regarding whether the remote operator's voice was clipped (correctly assumed buffer playback start time?) and whether the operator's voice sounded unnatural (playback too fast).

[0074] The system can then adjust (increase / decrease) the time it takes to return to the buffer at the start of playback and the playback speed based on (accumulated) feedback.

[0075] Speech signal detection can be achieved either by applying a simple threshold to the amplitude of the received audio signal, or by AI-based detection of human speech in the received signal in the time or frequency domain. These two methods for speech signal detection can be described as follows:

[0076] Method A: The average audio signal strength (or power) over a short time period (~100ms) can be compared to a threshold. If the signal strength is higher than the threshold, it is assumed that the operator has started speaking.

[0077] Method B: Compare the audio signal pattern in Fourier space with the typical frequency pattern of human speech by pattern matching (simple overlap integral and thresholding in the frequency domain). Again, if the patterns match, it is assumed that the operator has begun speaking.

[0078] The remote operator audio stream 384 can be fed into an optional buffer 510 to provide a buffered remote operator audio stream 396 to the interface speaker 118. The receive audio buffer module 510 can be configured to retain the voice of the telemetry technology during the time lag between voice detection at the voice detection module and the robot button pusher switch on the intercom device; this module temporarily records the ongoing voice. The receive audio buffer is preferably implemented as a ring buffer, allowing for continuous data recording. One advantage of this approach is that constant buffering allows the remote operator audio to be buffered without preparation.

[0079] The receiving audio buffer 510 receives control commands from the audio and button control module, instructing it to play the recorded audio signal with a specified time delay. The receiving audio buffer may also include a function to change the speed of the output audio signal without changing its pitch. In at least some embodiments, this can be achieved by transforming the time-compressed audio signal to the frequency domain via a Fast Fourier Transform (FFT), and then shifting the signal in the frequency domain such that the original pitch is reproduced after an inverse transformation to the time domain. Other transform techniques such as the Discrete Fourier Transform (DFT) can be used, and FFT is merely an example. It can also be achieved by omitting the supplementary silence intervals from the output audio stream. Using this function, the output audio signal can be played at a slightly accelerated speed until the buffer is fully played and there is no longer a time lag between the buffer output and the voice input. Once this is achieved, the original input signal can be directly passed to the output.

[0080] The target audio stream 390 is received from the interface microphone 116 and fed into the voice and alarm detection module 501. This module is capable of detecting patient voice and alarm signals from the scanning room. Voice detection can be based on audio level detection and AI-based speech recognition, similar to the voice detection module described above for incoming remote audio. The voice and alarm signal detection module is also capable of detecting patient alarm / emergency rings or any other sounds of interest that may unintentionally affect clinical workflow. Alarm signal detection can be achieved through pattern recognition in the frequency space or through AI-based temporal signal detection.

[0081] If one or more alarms are detected by the voice and alarm detection module 501, this is transferred to the audio and button control module 502. For example, this might enable the provision of control signal 388 to activate the robot button pusher 112. The audio and button control module 502 determines the time when the "talk to patient" function becomes active (or the time delay between the initiation of the final activation of the talk function) by receiving a corresponding acknowledgment from the robot button pusher 112, or by being provided with predefined delay configuration settings specific to the type of button pusher and the model of the intercom device.

[0082] When the alarm signal is transmitted to the audio and button control module 502, it can further forward the information to the network interface, so that the workstation audio or video equipment can notify the remote operator of the alarm event in an acoustic or optical manner.

[0083] Once the "Talk to Patient" function is activated, the audio and button control module instructs the receiving audio buffer module 510 to begin playing the recorded audio buffer with a negative time offset corresponding to the time taken to activate the "Talk to Patient" function. It can also optionally instruct the receiving audio buffer module to accelerate the output audio (without changing the pitch) until the delay between the input and output audio has been reduced to (almost) zero. Once the buffer's read pointer has reached the write pointer (due to the increased playback speed), the playback speed is set to real-time, simply passing the buffer input to the buffer output until the remote operator's voice is no longer detected.

[0084] Once the audio and button control module 502 receives a signal from the voice detection module that the voice has ended, it instructs the button pusher to release the "Press to Talk" button and instructs the receiving audio buffer module to stop playing or transmitting audio signals.

[0085] In one example, the robot button pusher 112 is configured to work with a touchscreen button instead of a physical button by attaching a soft, touchscreen-activating material to the top of the robotic arm. The voice detection module 382 also enables the audio and button control module 502 to generate control signals 388. A delay configuration setting 504 is also present, which can be used to delay the operation of the audio and button control module 502 and the control buffer 510.

[0086] Delay configuration setting 504 is a module containing predefined delay times that specify the expected delay between a voice detection event and the fully established "talk to patient" mode following mechanical interaction with the "Press and Talk" button. The delay time can vary depending on the imaging system type and manufacturer, the intercom type and manufacturer, and the technical settings of the robotic button actuator. Multiple delay times can be preconfigured, but only the delay time valid for the currently configured delay time will be used.

[0087] In the example, when the remote operator begins to speak, the speech is received by microphone 508 and then transmitted to speech detection module 382 via network interface 372. This module is capable of detecting the improved speech signal (with filtered background noise). Once it is determined that the operator is speaking (in this example, 0.5 seconds after the start of speech), audio and button control module 502 initiates a mechanical press of "Talk to Patient" (i.e., press to talk) button 102, a specific operation that takes an additional 1.1 seconds to complete. The receiving audio buffer begins playing the recorded speech of the remote operator, starting with a total offset of -1.6 seconds. The operator speaks for 10 seconds. During the first 5 seconds, the receiving audio buffer plays the recorded audio at a slightly increased speed so that after 5 seconds, there is no longer a significant delay between the input and output audio. When the remote operator stops speaking, the audio detection module identifies the silence period, and the audio and button control module instructs the button pusher to release the button.

[0088] In one example, the intercom call function is turned on and off via a software interface instead of a hardware button. In this case, the robot button pusher is replaced by a software API connection. The delay configuration settings can be adjusted accordingly to account for delays caused by changes in audio direction due to software operation.

[0089] In at least some examples, a bidirectional communication system is disclosed, comprising a remote communication node having a first audio detection device. The system uses a remote communication node (e.g., a microphone or receiving device of a remote expert) and a local communication node (e.g., a patient or a possible local expert) having a second audio detection device, wherein the first and second audio detection devices are configured to detect ambient sounds (e.g., speech). Based on the detected sound transmissions, the sound is switched, prioritized, or otherwise emphasized, wherein the detected sound is further amplified to prevent unwanted noise signals or audio clippings.

[0090] In some examples, a robot button pusher is used to switch or prioritize detected sound transmissions, wherein the robot button pusher is configured to receive and acknowledge incoming signals from a first audio detection device and / or a second audio detection device or audio control module, and to determine bidirectional communication parameters.

[0091] In some examples, the system also includes a speech pattern determination medium, in which ambient sounds or speech from a second audio detection device are analyzed, and if the speech deviates from a predetermined pattern, a notification such as an alarm is transmitted to a remote communication node.

[0092] In some examples, the detected ambient sounds or voices are further improved in the algorithm to improve the quality of the detected sounds.

[0093] In some embodiments, the system can also be configured via delayed communication settings, which, for example, have a time lag from the device.

[0094] In some examples, control messages can be utilized. For instance, when human speech is detected, the module notifies the "Audio and Button Control Module." In addition to signaling the detection, the control message also includes a timestamp of when the speech began. In some cases, there may be a delay (e.g., one second) before the speech recognition system determines that a spoken sentence is in progress. The timestamp of when the speech began will then point to the previous second.

[0095] It should be understood that one or more of the foregoing examples or embodiments of the present invention may be combined, as long as the combined embodiments are not mutually exclusive.

[0096] As those skilled in the art will recognize, aspects of the present invention can be implemented as apparatus, method, or computer program product. Accordingly, aspects of the present invention can take the form of a completely hardware embodiment, a completely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects (all of which may be referred to herein as “circuit,” “module,” or “system”). Furthermore, aspects of the present invention can take the form of a computer program product implemented in one or more computer-readable media having computer-executable code implemented thereon.

[0097] Any combination of one or more computer-readable media can be used. The computer-readable media can be a computer-readable signal medium or a computer-readable storage medium. As used herein, "computer-readable storage medium" encompasses any tangible storage medium capable of storing instructions executable by a processor or computing system of a computing device. A computer-readable storage medium may be referred to as a computer-readable non-transient storage medium. A computer-readable storage medium may also be referred to as a tangible computer-readable medium. In some embodiments, a computer-readable storage medium may also be capable of storing data accessible by a computing system of a computing device. Examples of computer-readable storage media include, but are not limited to: floppy disks, magnetic hard disk drives, solid-state drives, flash memory, USB thumb drives, random access memory (RAM), read-only memory (ROM), optical discs, magneto-optical discs, and register files of computing systems. Examples of optical discs include compact discs (CDs) and digital universal discs (DVDs), such as CD-ROMs, CD-RWs, CD-Rs, DVD-ROMs, DVD-RWs, or DVD-R discs. The term computer-readable storage medium also refers to various types of recording media accessible by a computer device via a network or communication link. For example, data can be retrieved on a modem, the Internet, or a local area network. Computer-executable code implemented on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic cable, RF, or any suitable combination thereof.

[0098] Computer-readable signal media may include propagated data signals having computer-executable code implemented therein, for example, in baseband or as a carrier wave. Such propagated signals may take any variety of forms, including but not limited to electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium that is not a computer-readable storage medium and is capable of conveying, propagating, or transmitting a program used by or in conjunction with an instruction execution system, apparatus, or device.

[0099] "Computer memory" or "memory" is an example of a computer-readable storage medium. Computer memory is any memory that can be directly accessed by a computing system. "Computer storage device" or "storage device" is another example of a computer-readable storage medium. A computer storage device is any non-volatile computer-readable storage medium. In some embodiments, a computer storage device may also be computer memory, or vice versa.

[0100] As used herein, "computing system" encompasses electronic components capable of running programs or machine-executable instructions or computer-executable code. References to computing systems, including examples of "computing systems," should be interpreted as potentially including more than one computing system or processing core. A computing system can, for example, be a multi-core processor. A computing system can also refer to a collection of computing systems within a single computer system or distributed across multiple computer systems. The term computing system should also be interpreted as potentially referring to a collection or network of computing devices, each comprising a processor or computing system. Machine-executable code or instructions can be run by multiple computing systems or processors that may be located within the same computing device or distributed even across multiple computing devices.

[0101] Machine-executable instructions or computer-executable code may include instructions or programs that cause a processor or other computing system to perform aspects of the invention. Computer-executable code for performing operations related to aspects of the invention may be written in any combination of one or more programming languages ​​and compiled into machine-executable instructions, including object-oriented programming languages ​​such as Java, Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages. In some instances, the computer-executable code may be in the form of a high-level language or in a pre-compiled form and used in conjunction with an interpreter that generates machine-executable instructions at runtime. In other instances, the machine-executable instructions or computer-executable code may be in the form of programming for programmable gate arrays.

[0102] The computer executable code may run entirely on the user's computer, partially on the user's computer (as a standalone software package), partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may connect to an external computer (e.g., via the Internet provided by an Internet service provider).

[0103] Aspects of the invention are described with reference to flowchart illustrations, diagrams, and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that, where applicable, each block or portion of a flowchart illustration, diagram, and / or block diagram can be implemented by computer program instructions in the form of computer-executable code. It should also be understood that combinations of blocks from different flowchart illustrations, diagrams, and / or block diagrams can be combined when not mutually exclusive. These computer program instructions can be provided to a computing system of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus that produces the machine, such that the instructions, which run via the computer or other programmable data processing apparatus, create units for implementing the functions / actions specified in the flowchart and / or one or more block diagram blocks.

[0104] These machine-executable instructions or computer program instructions may also be stored in a computer-readable medium that can instruct a computer, other programmable data processing apparatus or other device to operate in a particular manner, such that the instructions stored in the computer-readable medium produce an article of writing that includes instructions that implement the functions / actions specified in flowcharts and / or one or more block diagrams.

[0105] The machine-executable instructions or computer program instructions may also be loaded onto a computer, other programmable data processing apparatus or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device, thereby producing a computer-implemented process, such that the instructions running on the computer or other programmable apparatus provide a process for the function / action specified in the flowchart and / or one or more block diagram boxes.

[0106] As used herein, a "user interface" is an interface that allows a user or operator to interact with a computer or computer system. A "user interface" can also be referred to as a "human-machine interface device." A user interface can provide information or data to and / or receive information or data from an operator. A user interface enables input from an operator to be received by the computer and output from the computer to the user. In other words, the user interface allows an operator to control or manipulate the computer, and the interface allows the computer to indicate the effects of the operator's control or manipulation. The display of data or information on a monitor or graphical user interface is an example of providing information to an operator. The reception of data via a keyboard, mouse, trackball, touchpad, pointing stick, graphics tablet, joystick, game controller, webcam, headset, pedal, wired gloves, remote control, and accelerometer are all examples of user interface components that implement the reception of information or data from an operator.

[0107] As used herein, "hardware interface" encompasses the interfaces that enable a computer system to interact with and / or control external computing devices and / or devices. A hardware interface allows the computing system to send control signals or instructions to external computing devices and / or devices. It also enables the computing system to exchange data with external computing devices and / or devices. Examples of hardware interfaces include, but are not limited to: Universal Serial Bus (USB), IEEE 1394 port, parallel port, IEEE 1284 port, serial port, RS-232 port, IEEE-488 port, Bluetooth connectivity, wireless LAN connectivity, TCP / IP connectivity, Ethernet connectivity, control voltage interfaces, MIDI interfaces, analog input interfaces, and digital input interfaces.

[0108] As used herein, "display" or "display device" encompasses an output device or user interface suitable for displaying images or data. A display may output visual, audio, and / or tactile data. Examples of displays include, but are not limited to: computer monitors, television screens, touchscreens, tactile electronic displays, Braille screens, etc.

[0109] Cathode ray tubes (CRTs), storage tubes, bistable displays, electronic paper, vector displays, flat panel displays, vacuum fluorescent displays (VFs), light-emitting diode (LED) displays, electroluminescent displays (ELDs), plasma display panels (PDPs), liquid crystal displays (LCDs), organic light-emitting diode (OLED) displays, projectors, and head-mounted displays.

[0110] Although the invention has been described and illustrated in detail in the accompanying drawings and the foregoing description, such description and illustration are to be regarded as illustrative or exemplary rather than restrictive; the invention is not limited to the disclosed embodiments.

[0111] Those skilled in the art, through studying the accompanying drawings, disclosure, and claims, will be able to understand and implement other variations of the disclosed embodiments when practicing the claimed invention. In the claims, the word "comprising" does not exclude other elements or steps, and the words "a" or "an" do not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. Although specific measures are recited in dissimilar dependent claims, this does not imply that combinations of these measures cannot be advantageously used. Computer programs may be stored and / or distributed on suitable media, such as optical storage media or solid-state media provided with or as part of other hardware, but computer programs may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems. No reference numerals in the claims should be construed as limiting the scope.

Claims

1. An intercom panel interface (108) configured for mounting to an intercom panel (100) of a medical imaging system (302), wherein, The intercom panel includes: a press-to-talk (PPT) button (102), an intercom panel microphone (104), and an intercom panel speaker (106), wherein the intercom panel interface further includes: A panel hardware interface (110) is configured to communicate with a local computing system (362), wherein the panel hardware interface is configured to receive control commands from the local computing system, wherein the panel hardware interface is configured to receive a remote operator audio stream (384) from the local computing system, and wherein the panel hardware interface is further configured to transmit an object audio stream (390) to the local computing system. A robot button actuator (112) is configured to actuate the press-to-talk button in response to receiving the control command; An interface microphone (116) is configured to receive object audio from the intercom panel speaker; An interface speaker (118) configured to provide remote operator audio to the intercom panel microphone; and An audio interface (114) is configured to digitize the object audio into the object audio stream, wherein the audio interface is also configured to present the remote operator audio stream to the interface speaker.

2. The intercom panel interface according to claim 1, wherein, The intercom panel interface is configured to cover the instant call button on the intercom panel, thereby preventing manual actuation of the instant call button. The intercom panel interface also includes a manual call button (200). The intercom panel interface is further configured to generate the control command by pressing the manual call button to actuate the instant call button on the intercom panel using the robot button actuator.

3. A medical system (300, 500), comprising: The intercom panel interface according to claim 1 or 2; Local memory (368) stores local machine-executable instructions (380) and a speech detection module (382) configured to detect human speech in an input digital audio stream; A local network interface (366) is configured to form a network connection with a remote operator station (374); The local computing system, wherein the execution of the local machine-executable instructions causes the local computing system to continuously perform the following operations: Receive the remote operator audio stream (400) via the network interface; The human speech within the remote operator audio stream is detected (402) by inputting the remote operator audio stream as the input digital audio stream into the speech detection module; When the human voice is detected, the control signal (404) and the remote operator audio stream are provided to the panel hardware interface; and The object audio stream is transmitted (406) to the remote operator station.

4. The medical system according to claim 3, wherein, The speech detection module is configured to detect the human speech using any of the following operations: By determining when the average audio signal is above a predetermined signal strength for at least a predetermined time; The FFT of the digital audio stream is compared with a predetermined FFT distribution; Use a trained neural network.

5. The medical system according to claim 3 or 4, wherein, The execution of the machine-executable instructions also causes the computing system to buffer the remote operator's audio stream (510).

6. The medical system according to claim 5, wherein, The execution of the machine-executable instructions also causes the computing system to use a buffered remote operator audio stream (396) to predetermine the transmission delay of the remote operator audio stream to the robot button pusher.

7. The medical system according to claim 5 or 6, wherein, The execution of the machine-executable instructions also causes the computing system to continuously perform the following operations: The human speech within the object audio stream is detected by inputting the object audio stream as the digital audio stream into the speech detection module. The transmission of control commands is delayed when the human speech is detected in the object's audio stream; and When the object speech is detected in the object audio stream, a buffered remote operator audio stream is used to delay the transmission of the remote operator audio stream.

8. The medical system according to claim 6 or 7, wherein, The execution of the machine-executable instructions also causes the computing system to perform the following operations: when the buffered remote operator audio stream is delayed relative to the remote operator audio stream, generating a time-compressed remote operator audio stream based on the buffered remote operator audio stream, wherein the time-compressed remote operator audio stream is transmitted as the remote operator audio stream to the panel hardware interface.

9. The medical system according to claim 6, 7 or 8, wherein, The execution of the machine-executable instructions also enables the computing system to pause the remote operator audio stream using the buffered remote operator audio stream when the instant call button is manually pressed or when a local operator's voice is detected in the target audio stream.

10. The medical system according to any one of claims 3 to 9, wherein, The local memory also stores an audio noise filtering module (392) configured to remove audio noise, wherein execution of the machine-executable instructions causes the computing system to use the audio noise filtering module to remove audio noise from either the remote operator audio stream or the object audio stream.

11. The medical system according to any one of claims 3 to 10, wherein, The local memory also includes an alarm recognition module (394) configured to output an alarm signal in response to the detection of an auditory alarm in the object audio stream, wherein the execution of the machine-executable instructions further enables the computing system to: The auditory alarm is detected by inputting the object's audio stream into the alarm recognition module; and If the auditory alarm is detected, an alarm signal is provided to the medical system.

12. The medical system according to any one of claims 3 to 11, wherein, The medical system also includes the remote operator station, wherein the remote operator station is configured to remotely control the medical imaging system.

13. The medical system according to any one of claims 3 to 12, wherein, The medical system further includes the medical imaging system, and / or the medical system further includes an intercom system, wherein the intercom system includes the intercom panel.

14. A method of operating a medical system according to any one of claims 3 to 13, wherein, The method includes: Receive the remote operator audio stream (400) via the network interface; The human speech within the remote operator audio stream is detected (402) by inputting the remote operator audio stream as the input digital audio stream into the speech detection module; When the human voice is detected, the control signal (404) and the remote operator audio stream are provided to the panel hardware interface; and The object audio stream is transmitted (406) to the remote operator station.

15. A computer program including machine-executable instructions configured to control a local computing system to perform the method of claim 14.

Citation Information

Patent Citations

  • System and method for leveraging audio communication and guidance to improve medical workflow

    US20230185524A1