Voice Control in Healthcare Facilities

Abstract

The present disclosure relates to systems for voice control of medical devices in a healthcare facility. These systems employ continuous speech processing software, speech recognition software, natural language processing software, and other software to allow for voice control of medical devices. The present disclosure also provides systems for differentiating which of multiple medical devices within a patient room is the particular medical device to be controlled via voice input from a caregiver or patient.

Description

Technical Field

[0001] The present disclosure relates to voice control of devices, and more particularly to voice control of equipment in a medical institution. The present disclosure more particularly relates to voice control of medical devices including hospital beds in a medical institution. Background Art

[0002] In a hospital ward, there are typically several complex medical devices or equipment. Such medical devices typically include hospital beds. Other common medical devices in a ward include patient monitors such as vital sign monitors, intravenous (IV) pumps, and treatment devices such as respiratory therapy devices, ventilators, and compression therapy devices for preventing deep vein thrombosis (DVT), to name a few. Due to usability issues, the feature functions on the hospital bed and other medical devices are sometimes not used correctly or not used at all. That is, a caregiver sometimes does not know how to use a medical device correctly because it may require navigating through a large number of screen levels of complex graphical screens to reach the operation screen required for any specific medical device function. For example, sometimes a caregiver fails to zero (e.g., set the tare weight) the hospital bed and weigh the patient correctly. The fact that a caregiver may need to operate many different medical devices by interacting with various different user interfaces of the medical devices adds to the problem of improper use.

[0003] Recently, voice control of devices including medical devices has become increasingly common. The improvement in computer processing speed and the complexity of voice processing algorithms allow devices to be more successfully controlled by voice input spoken by a user. Voice input for controlling some or all functions of a medical device in a medical environment provides a more intuitive and natural user interface experience for a caregiver, thereby increasing the likelihood that the caregiver will correctly perform medical device functions that were previously incorrectly performed or not performed at all. However, there is still a need for safe and intuitive voice control of medical devices. For example, there are typically multiple medical devices in any given room, so it is desirable that only authorized users (e.g., caregivers and / or patients) are allowed to control medical devices by voice, and it is desirable that only the medical devices that are intended to be controlled by voice are the medical devices that are actually controlled, while other medical devices that are not intended for voice control are not controlled by spoken voice commands. For example, in a semi-private room environment with two hospital beds, two IV pumps, two vital sign monitors, etc., there is still a need to ensure that only the intended medical device is the medical device controlled by each spoken voice command. Accordingly, there is still a need for improvement in the field of voice control of medical devices in a medical institution. Summary of the Invention

[0004] An apparatus, system, or method may include one or more features recited in the appended claims and / or features that may include patentable subject matter, individually or in any combination, as described below.

[0005] According to a first aspect of the present application, a voice control system for a medical institution can be provided. The voice control system can include a hospital bed, which can have a weighing scale for weighing a patient supportable on the hospital bed, and can have a display screen for displaying the patient's weight. The voice control system of the first aspect can further include a voice recorder and a server. The voice recorder can be configured to record digital models of the voices of multiple caregivers, and the digital models can be transmitted to the server to determine the voice biometrics of each of the multiple caregivers. The hospital bed of the first aspect can be configured to receive a voice input from a first caregiver among the multiple caregivers, and the voice input can instruct the hospital bed to weigh the patient. The hospital bed can be configured to communicate with the server to confirm, based on the voice biometrics, that the caregiver can be authorized to control the hospital bed through the voice input. After confirming that the first caregiver can be authorized to control the hospital bed, the patient can be weighed by the weighing scale and the patient's weight can be displayed on the display screen.

[0006] In some embodiments of the first aspect, the voice recorder can be included in a computer. Alternatively or additionally, the voice recorder can be included in a mobile phone. Optionally, the caregiver identification (ID) can be transmitted to the server together with the digital models of each of the multiple caregivers by the voice recorder of the first aspect. If necessary, the hospital bed can be configured to receive a zero-scale voice input from the first caregiver, and the zero-scale voice input can instruct the hospital bed to zero the weighing scale by measuring the tare weight using the weighing scale when the patient is not on the bed. In this regard, the hospital bed can be configured to communicate with the server to confirm, based on the voice biometrics, that the caregiver can be authorized to control the hospital bed through the zero-scale voice input. After confirming that the first caregiver is authorized to control the hospital bed of the first aspect, the hospital bed can zero the weighing scale.

[0007] The present disclosure contemplates that the hospital bed of the first aspect can be configured to display an acceptance button on the display screen for the first caregiver to select to accept the displayed patient weight for storage in one or both of the memory of the hospital bed and the electronic medical record of the patient. If the displayed weight accepted by the first caregiver differs from the previously accepted patient weight by a threshold amount, the hospital bed can display a message on the display screen that instructs the first caregiver to check to determine whether the weighing scale of the hospital bed has been properly zeroed. If the hospital bed of the first aspect does not detect a problem, the hospital bed can display a message on the display screen that can indicate that the patient weight has been successfully stored in one or both of the memory of the hospital bed and the electronic medical record of the patient.

[0008] In some embodiments, the voice control system of the first aspect may further include a Real-Time Location System (RTLS), which can determine the locations of multiple caregivers in a medical institution. In addition to voice biometrics, the server may also use information from the RTLS to confirm that the first caregiver is authorized to control the hospital bed of the first aspect through voice input. Optionally, the hospital bed of the first aspect may be configured to display a Personal Identification Number (PIN) screen on a display for the first caregiver to enter the PIN, and in addition to voice biometrics, the server may also use the PIN to confirm that the first caregiver is authorized to control the hospital bed through voice input. In addition to using voice biometrics, the PIN may also be used to determine that the first caregiver is authorized, and additionally or alternatively, information from the RTLS may also be used. If necessary, the hospital bed of the first aspect may be configured to display a voice input button on the display, which can be selected by the first caregiver to enable the hospital bed to receive voice input.

[0009] According to a second aspect of the present disclosure, a voice control system for a medical institution may include medical devices that can be used to care for patients and a mobile device that may include a voice recorder, which can be configured to record a digital model of the voice of a caregiver. The digital model may be transferred from the mobile device to the medical device. The medical device may be configured to determine the voice biometrics of the caregiver based on the digital model. The medical device may be configured to receive a voice input from the caregiver, and the voice input may instruct the medical device to perform a function. The medical device may be configured to confirm that the caregiver can be authorized to control the medical device through voice input based on the voice biometrics. After confirming that the caregiver can be authorized to control the medical device, the function may be executed by the medical device.

[0010] In some embodiments of the voice control system of the second aspect, the caregiver identification (ID) of the caregiver may be transferred from the mobile device to the medical device together with the digital model of the voice of the caregiver. If necessary, the medical device of the second aspect may be configured to display an acceptance button on the display for the caregiver to select to accept the displayed patient information for storage in one or both of the memory of the medical device and the electronic medical record of the patient. If the medical device does not detect a problem, the medical device may display a message on the display, which may indicate that the patient information has been successfully stored in one or both of the memory of the medical device and the electronic medical record of the patient.

[0011] The present disclosure contemplates that the voice control system of the second aspect may further include a Real-Time Location System (RTLS) that can determine the location of a caregiver within a healthcare facility. In addition to voice biometrics, the medical device may use information from the RTLS to confirm that the caregiver is authorized to control the medical device via voice input. Alternatively or additionally, the medical device may be configured to display a Personal Identification Number (PIN) screen on a display for the caregiver to enter the PIN, and in addition to voice biometrics, the medical device may use the PIN to confirm that the first caregiver is authorized to control the medical device via voice input. In addition to using voice biometrics, the PIN is used to determine that the first caregiver is authorized. Additionally or alternatively, information from the RTLS may also be used. Optionally, the medical device may be configured to display a voice input button on the display, which the caregiver can select to enable the medical device to receive voice input.

[0012] According to a third aspect of the present disclosure, a voice control system for a healthcare facility may include a hospital bed that may have a weighing scale for weighing a patient supported on the hospital bed and may have a display for showing the patient's weight. A Real-Time Location System (RTLS) may be provided to track the locations of multiple caregivers within the healthcare facility. The RTLS of the third aspect may be configured to send a message to the hospital bed that may notify the hospital bed that the first caregiver may have entered the room where the hospital bed is located. The hospital bed of the third aspect may be configured to receive a voice input from the first caregiver that may instruct the hospital bed to weigh the patient. Additionally, the hospital bed may be configured to confirm that the first caregiver is authorized to control the hospital bed via voice input based on the voice biometrics of the first caregiver stored in the memory of the hospital bed. After confirming that the first caregiver is authorized to control the hospital bed, the patient may be weighed by the weighing scale and the patient's weight may be displayed on the display.

[0013] In some embodiments of the third aspect, the hospital bed may be configured to play an audio message that may ask the first caregiver if they want to record the displayed patient weight for storage in the patient's electronic medical record. In response to the first caregiver making an affirmative response to the audio message in an audible manner, the hospital bed may communicate with the RTLS to reconfirm that the first caregiver is authorized to record the patient weight for storage in the patient's electronic medical record. After the RTLS of the third aspect reconfirms that the first caregiver is authorized, the patient weight may be transmitted to the EMR system for storage in the patient's electronic medical record.

[0014] Optionally, the hospital bed of the third aspect can be configured to display a record button on the display screen for the first caregiver to select to record the displayed patient weight for storage in the patient's electronic medical record. In response to the first caregiver's selection of the record button, the hospital bed of the third aspect can communicate with the RTLS to reconfirm that the first caregiver can be authorized to record the patient weight for storage in the patient's electronic medical record. After the RTLS reconfirms that the first caregiver can be authorized, the patient weight can be transmitted to the EMR system for storage in the patient's electronic medical record.

[0015] The present disclosure contemplates that in response to the first caregiver affirmatively responding to the audio message in an audible manner, the hospital bed of the third aspect can display a personal identification number (PIN) screen on the display screen for the first caregiver to enter the PIN, and the hospital bed can use the PIN to reconfirm that the first caregiver can be authorized to record the patient weight for storage in the patient's electronic medical record. After the hospital bed of the third aspect reconfirms that the first caregiver is authorized based on the PIN, the patient weight can be transmitted to the EMR system for storage in the patient's electronic medical record.

[0016] Alternatively, in response to the first caregiver's selection of the record button, the hospital bed of the third aspect displays a personal identification number (PIN) screen on the display screen for the first caregiver to enter the PIN, and the hospital bed can use the PIN to reconfirm that the first caregiver can be authorized to record the patient weight for storage in the patient's electronic medical record. In such an alternative embodiment of the third aspect, after the hospital bed reconfirms that the first caregiver can be authorized based on the PIN, the patient weight can be transmitted to the EMR system for storage in the patient's electronic medical record.

[0017] In a third aspect variant, a voice control system for a medical institution includes a hospital bed that can have a weighing scale for weighing a patient supportable on the hospital bed and can have a display screen for displaying the patient weight. A real-time location system (RTLS) can be provided to track the positions of multiple caregivers in the medical institution. The RTLS can be configured to send a message to the hospital bed, and the message can notify the hospital bed that the first caregiver may have entered the room where the hospital bed is located. The hospital bed can be configured to receive a voice input from the first caregiver, and the voice input can instruct the hospital bed to weigh the patient. The hospital bed can be configured to confirm that the first caregiver can be authorized to control the hospital bed. After confirming that the first caregiver can be authorized to control the hospital bed, the patient can be weighed by the weighing scale.

[0018] In some embodiments of the third aspect variant, the hospital bed can be configured to confirm that the first caregiver can be authorized to control the hospital bed through voice input based on the voice biometrics of the first caregiver that can be stored in the memory of the hospital bed. Optionally, the hospital bed of the third aspect variant can be configured to display the patient weight on the display screen after weighing the patient.

[0019] According to a fourth aspect of the present disclosure, a hospital bed may include a frame configured to support a patient and a circuit carried by the frame and including a processor, a memory, a speaker, a microphone, and a transmitter. The memory of the fourth aspect may store software configured to receive voice input via the microphone and output voice messages via the speaker. In response to receiving a first voice input detectable by the microphone of the fourth aspect, the first voice input including a fall prevention check statement from a caregiver, the processor and the software may cooperate to determine whether the hospital bed is correctly configured according to a fall prevention protocol. If the hospital bed of the fourth aspect is not correctly configured according to the fall prevention protocol, the circuit may be configured to prompt the caregiver to correct one or more bed settings for configuration according to the fall prevention protocol. If the hospital bed of the fourth aspect is correctly configured according to the fall prevention protocol, the circuit may be configured to play a confirmation message via the speaker to confirm to the caregiver that the hospital bed is correctly configured according to the fall prevention protocol. After playing the confirmation message, the circuit may be configured to convey a record query to the caregiver regarding whether fall prevention protocol compliance information should be recorded in the patient's electronic medical record. In response to receiving an affirmative input from the caregiver in response to the record query of the fourth aspect, the circuit may transmit the fall prevention protocol compliance information via the transmitter for storage in the patient's electronic medical record.

[0020] In some embodiments of the fourth aspect, the circuit may be configured to prompt the caregiver to correct one or more bed settings by playing an audio message via the speaker of the circuit that has information about the bed settings that need to be corrected. Alternatively or additionally, the circuit of the fourth aspect may further include a display screen, and the circuit may prompt the caregiver to correct one or more bed settings by displaying a visual message on the display screen that has information about the bed settings that need to be corrected. For example, the visual message may include text information or picture information.

[0021] The present disclosure contemplates that the hospital bed of the fourth aspect may further include a plurality of side rails coupled to the frame, and each side rail is movable between a raised position that prevents the patient from leaving the bed and a lowered position that releases the prevention of the patient from leaving the bed. The hospital bed of the fourth aspect may include a plurality of casters coupled to the frame and a bed exit system carried by the frame and coupled to the circuit. The frame of the fourth aspect may include a base frame and an upper frame supported above the base frame by a lifting system. In such embodiments, in order for the bed of the fourth aspect to be correctly configured according to the fall prevention protocol, two or more of the side rails of the frame may need to be in their respective raised positions, at least one of the plurality of casters may need to be braked, the bed exit system may need to activate a warning to monitor the patient's bed exit condition, and the upper frame may need to be in a lower position relative to the base frame.

[0022] If desired, the circuitry of the fourth aspect can be configured to communicate a recording message to the caregiver by playing, via a speaker of the circuitry, an audio recording message asking the caregiver if they wish to record fall prevention compliance information into the patient's electronic medical record. In such a scenario, an affirmative input from the caregiver can be an oral statement detected by a microphone. Alternatively or additionally, the circuitry of the fourth aspect can further include a display screen, and the circuitry can be configured to communicate a recording query to the caregiver by displaying the recording query on the display screen. In such a scenario, an affirmative input from the caregiver can be a selection of a button that can be displayed on the display screen.

[0023] In some embodiments of the hospital bed of the fourth aspect, after playing the confirmation message and before making the recording query, the circuitry can be configured to communicate a nurse call pendant availability query to the caregiver as to whether the nurse call pendant is within the patient's reach. For example, the circuitry can be configured to communicate the nurse call pendant availability query to the caregiver by playing, via a speaker of the circuitry, an audio availability message. Alternatively or additionally, the circuitry of the fourth aspect can further have a display screen, and the circuitry can be configured to communicate the nurse call pendant availability query to the caregiver by displaying the nurse call pendant availability query on the display screen.

[0024] Optionally, if the caregiver negatively answers the nurse call pendant availability query, the circuitry can be configured to prompt the caregiver to move the nurse call pendant within the patient's reach and confirm that the nurse call pendant has been moved within the patient's reach. For example, the circuitry of the fourth aspect can be configured to prompt the caregiver to move the nurse call pendant within the patient's reach by playing, via a speaker of the circuitry, an audio message. Alternatively or additionally, the circuitry of the fourth aspect can further include a display screen, and the circuitry can be configured to prompt the caregiver to move the nurse call pendant within the patient's reach by displaying a visual message on the display.

[0025] The present disclosure further contemplates that the circuitry of the fourth aspect can be configured to confirm that the nurse call pendant has been moved within the patient's reach in response to receiving an oral confirmation message from the caregiver that can be detected by a microphone. Alternatively or additionally, the circuitry of the fourth aspect can further include a display screen, and the circuitry can be configured to confirm that the nurse call pendant has been moved within the patient's reach in response to the caregiver selecting a confirmation button displayed on the display screen.

[0026] In some embodiments of the hospital bed of the fourth aspect, after playing the confirmation message and before performing the record query, the circuit may be configured to convey to the caregiver an unobstructed path query asking whether the path around the hospital bed is unobstructed. For example, the circuit of the fourth aspect may be configured to convey the unobstructed path query to the caregiver by playing an audio unobstructed path message via the speaker of the circuit. Alternatively or additionally, the circuit of the fourth aspect further includes a display screen, and the circuit may be configured to convey the unobstructed path query to the caregiver by displaying the unobstructed path query on the display screen.

[0027] Optionally, if the caregiver negatively answers the unobstructed path query, the circuit may be configured to prompt the caregiver to clear the path around the hospital bed and confirm that the path around the hospital bed has been cleared. For example, the circuit of the fourth aspect may be configured to prompt the caregiver to clear the path around the hospital bed by playing an audio message via the speaker of the circuit. Alternatively or additionally, the circuit of the fourth aspect may further include a display screen, and the circuit may be configured to prompt the caregiver to clear the path around the hospital bed by displaying a visual message on the display screen.

[0028] The present disclosure further contemplates that the circuit of the fourth aspect may be configured to confirm that the path around the hospital bed is unobstructed in response to receiving an oral confirmation message from the caregiver that can be detected by the microphone. Alternatively or additionally, the circuit of the fourth aspect may further include a display screen, and the circuit may be configured to confirm that the path around the hospital bed is unobstructed in response to the caregiver selecting a confirmation button displayed on the display screen.

[0029] In a variant of the fourth aspect, a hospital bed may include a frame that may be configured to support a patient and a circuit that may be carried by the frame and may include a processor, a memory, a speaker, a microphone, and a transmitter. The memory may store software that may be configured to receive voice input via the microphone and output voice messages via the speaker. In response to receiving a first voice input that can be detected by the microphone, the first voice input may include a fall prevention check statement from the caregiver, the processor and the software may cooperate to determine whether the hospital bed can be correctly configured according to the fall prevention protocol. If the hospital bed is not correctly configured according to the fall prevention protocol, the circuit may be configured to allow correction of one or more hospital bed settings to be configured according to the fall prevention protocol. If the hospital bed is correctly configured according to the fall prevention protocol, the circuit may be configured to play a confirmation message via the speaker to confirm to the caregiver that the hospital bed can be correctly configured according to the fall prevention protocol.

[0030] In some embodiments of the fourth aspect variant, the circuit may be configured to prompt a caregiver to correct one or more hospital bed settings for configuration according to a fall prevention protocol. After playing a confirmation message, the circuit of the fourth aspect variant may be configured to communicate a recording query to the caregiver regarding whether fall prevention protocol compliance information should be recorded in the patient's electronic medical record. In response to receiving an affirmative input from the caregiver in response to the recording query, the circuit may transmit, via a transmitter, the fall prevention protocol compliance information for storage in the patient's electronic medical record.

[0031] According to a fifth aspect of the present disclosure, a system for reducing risks to a patient in a medical environment may be provided. The system of the fifth aspect may include a medical product that may have at least one function that has the potential to cause harm to a patient during operation. The circuit may be carried by the medical product and may include a processor and a memory storing software. The system of the fifth aspect may also have a microphone array that may be configured to receive voice input from a person who may be near the medical product. The microphone array may communicate with the circuit, and the software may be configured to cooperate with the microphone array to use beamforming techniques to infer the direction in which the person's eyes are pointing based on the voice input. The circuit may be configured to stop at least one function that has the potential to cause harm to a patient in response to the person uttering an audible stop command when it is inferred that the person's eyes are pointing at the medical product.

[0032] In some embodiments, the medical product of the fifth aspect may include a hospital bed, and the microphone array may be mounted to the hospital bed. Optionally, the hospital bed may include at least one side rail that may be movable between a raised position that prevents the patient from leaving the bed and a lowered position that releases the prevention of the patient from leaving the bed. At least one microphone in the microphone array may be mounted to at least one side rail.

[0033] If desired, the medical product may optionally include a hospital bed, and the microphone array may be mounted to one or both of the room walls or ceiling of the ward in which the hospital bed is located. For example, the microphone array may include a first microphone mounted to the medical product and a second microphone mounted to one of the room walls or ceiling of the ward in which the medical product is located. Further optionally, the medical product of the fifth aspect may include a patient lift, and the microphone array may be mounted to one or both of the room walls and ceiling of the ward in which the patient lift is located. If desired, the patient lift may include a mobile patient lift or a ceiling-mounted patient lift.

[0034] Optionally, the medical product of the fifth aspect may include a hospital bed that can support a mattress, and at least one function may include one or more of the following functions: moving the mattress support section of the mattress support laminate of the hospital bed, moving the upper frame of the hospital bed relative to the base frame of the hospital bed, operating the percussion and vibration (P&V) treatment function of the mattress of the hospital bed, operating the assisted turning function of the mattress of the hospital bed, or operating the continuous lateral rotation therapy (CLRT) function of the mattress of the hospital bed. Further optionally, the medical product of the fifth aspect may include an operating table, and at least one function may include moving a first operating table portion relative to a second operating table portion.

[0035] In some embodiments, the microphone array of the fifth aspect may communicate wirelessly with the circuit of the medical product. Alternatively or additionally, the microphone array may communicate wired with the circuit of the medical product. If desired, the system of the fifth aspect may further include a mobile phone that can be carried by a person. The mobile phone may be configured to receive voice commands from the person and transmit a command message corresponding to the voice command to the medical product to initiate the operation of at least one function. Alternatively or additionally, the system of the fifth aspect may further include at least one computer that can be remote from the medical product. The at least one computer may have clinical speech recognition software. The microphone array may communicate the voice commands received from the person to the at least one computer. The at least one computer may be configured to transmit a command message corresponding to the voice command to the medical product to initiate the operation of at least one function.

[0036] The present disclosure contemplates that the circuit of the fifth aspect may be configured to not respond to a spoken stop command by a person to stop at least one function that may cause harm to the patient when the person's eye pointing to the medical product is not inferred. If desired, the circuit of the fifth aspect may be configured to be trained to recognize the voice of the patient, and the circuit may be configured to respond to a spoken stop command originating from the patient by the patient to stop at least one function that may cause harm to the patient without considering the eye directionality of the patient. In such embodiments, the medical product of the fifth aspect may include a hospital bed that supports the patient.

[0037] According to a sixth aspect of the present disclosure, a system for associating a medical device with a location in a medical institution can be provided. The system of the sixth aspect can include a medical device, which can have circuitry that can include a processor, a memory, and a transmitter. The system of the sixth aspect can also have at least one microphone that can be communicatively coupled to the circuitry. The memory can store software configured to receive voice input via the at least one microphone. The system of the sixth aspect can also have a positioning system, which can include at least one positioning computer that can be configured to store an association of a device with a room. The circuitry of the medical device can be configured to receive, via the at least one microphone, voice input from a person indicating a location identifier (ID) where the medical device may be located. The circuitry can be configured to store the location ID in the memory of the medical device and transmit the location ID, together with the medical device ID, to the at least one positioning computer. The at least one positioning computer can be configured to establish an association of a first device with a room based on the medical device ID and the location ID that can be transmitted from the medical device.

[0038] In some embodiments, at least one microphone of the sixth aspect can be carried by the medical device. Optionally, at least one microphone of the sixth aspect can include a microphone array that can be carried by the medical device. Further optionally, at least one microphone of the sixth aspect can be spaced apart from the medical device and installed in place. For example, at least one microphone of the sixth aspect can include a microphone array that can be spaced apart from the medical device and installed in place. If desired, at least one microphone of the sixth aspect can be configured to wirelessly communicate with the circuitry of the medical device.

[0039] The present disclosure contemplates that at least one microphone of the sixth aspect can include a first microphone that can be carried by the medical device and a second microphone that can be spaced apart from the medical device. In such embodiments of the sixth aspect, the second microphone can be configured to wirelessly communicate with the circuitry of the medical device.

[0040] In some embodiments, the circuitry of the medical device of the sixth aspect can further include a display screen, which can display the location ID after the circuitry receives the location ID via the at least one microphone. Optionally, the circuitry of the medical device of the sixth aspect can be configured to wirelessly transmit the location ID and the bed ID for reception by the at least one positioning computer. Further optionally, the at least one positioning computer can store an association of a patient with a location, and after receiving the medical device ID and the location ID, can establish an association of the device with the patient. In such embodiments, the at least one positioning computer can be configured to transmit a patient ID corresponding to the patient related to the association of the device with the patient to the medical device. If desired, the circuitry of the medical device of the sixth aspect can include a display screen, and the circuitry can be configured to display the patient ID on the display screen.

[0041] The present disclosure further contemplates that if the voice input does not include a valid location ID, the circuitry of the medical device of the sixth aspect may be configured to generate a query for additional information to a person. For example, the circuitry of the medical device of the sixth aspect may further include at least one speaker, and the query may include an audible message played through the at least one speaker. Alternatively or additionally, the circuitry of the medical device of the sixth aspect may include a display screen, and the query may include a text message displayed on the display screen.

[0042] In some embodiments of the sixth aspect, the circuitry of the medical device may further include a display screen, and the circuitry may be configured to display a location menu of valid location IDs of medical institutions in response to an audible request from a person. In this regard, the circuitry of the medical device may be configured to display menu levels associated with location options, and the circuitry may be configured to allow the person to navigate through the menu levels audibly to reach the location menu.

[0043] Optionally, the circuitry of the medical device of the sixth aspect may further include at least one speaker, and the circuitry may be configured to play an audible confirmation message through the at least one speaker in response to the location ID included in the voice input being a valid location ID. Further optionally, the circuitry of the medical device of the sixth aspect may be configured to receive, via at least one microphone, a disassociation input from a person indicating that the association of the first device with the room should be cancelled. The circuitry may be configured to transmit the disassociation input together with the medical device ID to at least one location computer. The at least one location computer may be configured to cancel the association of the first device with the room based on the medical device ID and the disassociation input transmitted from the medical device.

[0044] According to a seventh aspect of the present disclosure, a system for voice control of a medical device within a room may include a first medical device and a second medical device. The first medical device may have a first circuitry that may include a first processor, a first memory, and a first microphone. The second medical device may have a second circuitry that may include a second processor, a second memory, and a second microphone. The first medical device and the second medical device of the seventh aspect may be close enough to each other such that a voice input spoken by a person may be received by both the first microphone and the second microphone. The first circuitry of the first medical device may be configured to be enabled for voice control in response to the voice input including a first code phrase, and the second circuitry of the second medical device may be configured to be enabled for voice control in response to the voice input including a second code phrase.

[0045] In some embodiments of the seventh aspect, the first code phrase and the second code phrase may each begin with a common code word. For example, the common code word may include the word "hey". Optionally, the first code phrase may include a first unique name that may correspond to the first medical device and may be spoken immediately after the common code word, and the second code phrase may include a second unique name that may correspond to the second medical device and may be spoken immediately after the common code word. In a case where the first medical device and the second medical device may have the same model name, the first unique name may be in the format of "Model Name A", and the second unique name may be in the format of "Model Name B". Alternatively or additionally, in a case where the first medical device and the second medical device may have the same model name, the first unique name may be in the format of "Model Name 1", and the second unique name may be in the format of "Model Name 2".

[0046] If needed, after each of the first medical device and the second medical device in the seventh aspect is enabled for voice control, the corresponding first circuit and second circuit may be enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold period of time. After the threshold period has passed, in a case where the corresponding first medical device and second medical device do not receive at least one voice command, the corresponding first medical device and second medical device may be disabled for voice control. The present disclosure contemplates that the threshold period may be reset in response to receiving a valid voice command during the threshold period.

[0047] According to an eighth aspect of the present disclosure, a system for enabling voice control of a medical device may include an identifier item that may be carried by a caregiver and may be configured to transmit a wireless identification (ID) signal. The system of the eighth aspect may further include a medical device that may have a circuit including a processor, a memory, a microphone, a transmitter, and a proximity detector, and the proximity detector may be configured to receive the wireless ID signal from the identifier item when the identifier item may be within three feet or less of the medical device. The system of the eighth aspect may further include at least one voice control authorization (VCA) computer that may be remote from the medical device and may be communicatively coupled to the medical device. In response to the proximity detector receiving the wireless ID signal, the circuit may transmit ID data included in the wireless ID signal to the VCA computer via the transmitter. The VCA computer may be configured to verify that the ID data may correspond to a caregiver authorized to control the medical device by voice input. If the caregiver authorization is verified by the VCA computer, the VCA computer may be configured to transmit an authorization message to the medical device. In response to the circuit of the medical device receiving the authorization message, voice control of the medical device may be enabled.

[0048] In some embodiments of the eighth aspect, the identifier article can include a mobile phone. Alternatively or additionally, the identifier article of the eighth aspect can include a radio frequency identification (RFID) badge. Further alternatively or additionally, the identifier article of the eighth aspect can include a near field communication (NFC) transponder that can transmit a wireless ID signal in response to receiving electromagnetic energy transmitted by the circuit of the medical device.

[0049] If desired, after enabling voice control of the medical device, voice input received by the microphone of the circuit can be transmitted to the VCA computer via the transmitter of the circuit. In this regard, the VCA computer can be configured to determine that the voice input can correspond to at least one valid control command among a plurality of valid control commands for the medical device. If the voice input corresponds to a valid control command among the plurality of valid control commands, the VCA computer can be configured to transmit a device control message to the medical device. In response to the circuit of the medical device receiving the device control message, the medical device can perform a function corresponding to the device control message.

[0050] Optionally, after enabling voice control of the medical device in the eighth aspect, the circuit can be enabled to receive voice commands to control the functions of the medical device for a threshold period of time. After the threshold period has passed and the medical device in the eighth aspect has not received at least one voice command, the medical device can be disabled for voice control. The present disclosure contemplates that the threshold period can be reset in response to receiving a valid voice command during the threshold period.

[0051] According to a ninth aspect of the present disclosure, a system for voice control of a medical device in a room can include a first medical device and a second medical device. The first medical device can have a first circuit that can include a first processor, a first memory, and a first microphone. The second medical device can have a second circuit that can include a second processor, a second memory, and a second microphone. The first medical device and the second medical device of the ninth aspect can be close enough to each other such that a voice input spoken by a person can be received by both the first microphone and the second microphone. The first circuit of the first medical device can be configured to be enabled for voice control in response to the voice input received by the first microphone being louder than the voice input received by the second microphone. The second circuit of the second medical device can be configured to be enabled for voice control in response to the voice input received by the second microphone being louder than the voice input received by the first microphone.

[0052] In some embodiments of the ninth aspect, the first circuit may be configured to transmit a first loudness value for reception by the second circuit, and the second circuit may be configured to transmit a second loudness value for reception by the first circuit. The first medical device of the ninth aspect may be configured to enable voice control in response to the first circuit determining that the first loudness value is greater than the second loudness value. The second medical device of the ninth aspect may be configured to enable voice control in response to the second circuit determining that the second loudness value is greater than the first loudness value.

[0053] If desired, the system of the ninth aspect may further include at least one Voice Control Authorization (VCA) computer, which may be remote from the first medical device and the second medical device and may be communicatively coupled to the first medical device and the second medical device. The first circuit may be configured to transmit the first loudness value for reception by the at least one VCA computer, and the second circuit may be configured to transmit the second loudness value for reception by the at least one VCA computer. The VCA computer may be configured to transmit a first message to enable the first medical device for voice control to the first medical device in response to the VCA computer determining that the first loudness value is greater than the second loudness value. The VCA computer may be configured to transmit a second message to enable the second medical device for voice control to the second medical device in response to the VCA computer determining that the second loudness value is greater than the first loudness value.

[0054] Optionally, after each of the first medical device and the second medical device of the ninth aspect is enabled for voice control, the corresponding first circuit and second circuit may be enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold period of time. After the threshold period has elapsed, in the case where the corresponding first medical device and second medical device do not receive at least one voice command in the ninth aspect, the corresponding first medical device and second medical device may be disabled for voice control. The present disclosure contemplates that the threshold period may be reset in response to receiving a valid voice command during the threshold period.

[0055] According to a tenth aspect of the present disclosure, a system for voice control of in-room medical devices includes a first medical device and a second medical device. The first medical device may have a first circuit that may include a first processor and a first memory. The second medical device may have a second circuit that may include a second processor and a second memory. The system of the tenth aspect may also have a microphone array positioned within the room and spaced apart from the first medical device and the second medical device. The microphone array may include a first microphone that is closer to the first medical device than to the second medical device and a second microphone that is closer to the second medical device than to the first medical device. The first medical device and the second medical device of the tenth aspect may be close enough to each other such that a voice input spoken by a person can be received by both the first microphone and the second microphone. The first circuit of the first medical device of the tenth aspect may be configured to enable voice control in response to the voice input received by the first microphone being louder than the voice input received by the second microphone. The second circuit of the second medical device of the tenth aspect may be configured to enable voice control in response to the voice input received by the second microphone being louder than the voice input received by the first microphone.

[0056] In some embodiments, the first microphone of the tenth aspect may be included in a first microphone circuit that may be configured to transmit a first loudness value for receipt by the first circuit of the first medical device and the second circuit of the second medical device. The second microphone of the tenth aspect may be included in a second microphone circuit that may be configured to transmit a second loudness value for receipt by the first circuit of the first medical device and the second circuit of the second medical device. The first medical device of the tenth aspect may be configured to enable voice control in response to the first circuit determining that the first loudness value is greater than the second loudness value. The second medical device of the tenth aspect may be configured to enable voice control in response to the second circuit determining that the second loudness value is greater than the first loudness value.

[0057] If desired, the microphone array of the tenth aspect may include a communication circuit that may be coupled to the first microphone and the second microphone. The communication circuit may be configured to determine a first loudness value based on a first loudness of the voice input received by the first microphone and to determine a second loudness value based on a second loudness of the voice input received by the second microphone. The communication circuit may be configured to transmit the first loudness value and the second loudness value for receipt by the first circuit of the first medical device and the second circuit of the second medical device. The first medical device of the tenth aspect may be configured to enable voice control in response to the first circuit determining that the first loudness value is greater than the second loudness value. The second medical device of the tenth aspect may be configured to enable voice control in response to the second circuit determining that the second loudness value is greater than the first loudness value.

[0058] Optionally, the system of the tenth aspect may further include at least one Voice Control Authorization (VCA) computer, which may be remote from the first medical device and the second medical device and may be communicatively coupled to the first microphone and the second microphone in the microphone array. The VCA computer may receive a first loudness value of a first loudness that may be based on a voice input received by the first microphone and a second loudness value of a second loudness that may be based on a voice input received by the second microphone. The VCA computer may be configured to transmit a first message to enable the first medical device for voice control to the first medical device in response to the VCA computer determining that the first loudness value is greater than the second loudness value. The VCA computer may be configured to transmit a second message to enable the second medical device for voice control to the second medical device in response to the VCA computer determining that the second loudness value is greater than the first loudness value.

[0059] Further optionally, after each of the first medical device and the second medical device of the tenth aspect is enabled for voice control, the corresponding first circuit and second circuit may be enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold period of time. After the threshold period of time has passed, in the case where at least one voice command is not received by the corresponding first medical device and second medical device, the corresponding first medical device and second medical device of the tenth aspect are disabled for voice control. The present disclosure contemplates that the threshold period of time may be reset in response to receiving a valid voice command during the threshold period of time.

[0060] According to the eleventh aspect of the present disclosure, a system for voice control of in-room medical devices may include a first medical device and a second medical device. The first medical device may have a first circuit that may include a first processor, a first memory, a first microphone, and a first camera. The second medical device may have a second circuit that may include a second processor, a second memory, a second microphone, and a second camera. The first circuit of the first medical device of the eleventh aspect may be configured to be enabled for voice control in response to the first processor identifying a first person face image captured by the first camera. The second circuit of the second medical device of the eleventh aspect may be configured to be enabled for voice control in response to the second processor identifying a second person face image captured by the second camera.

[0061] In some embodiments of the eleventh aspect, the first camera may capture a first person image for processing by the processor in response to the first microphone receiving a voice command from a person, and the second camera may capture a second person image for processing by the processor in response to the second microphone receiving a voice command from a person. For example, the voice command may include any valid device control command among a plurality of valid device control commands.

[0062] Optionally, with respect to the eleventh aspect, the first circuit may include a first display screen, and the second circuit may include a second display screen. If the first camera and the second camera both capture a corresponding first person face image and second person face image in response to a voice command, the first medical device and the second medical device may both remain disabled for voice control, and the first display screen and the second display screen may each display a notification message that advises the person to face only the first camera or the second camera of the corresponding first medical device or second medical device that the person wishes to control by voice.

[0063] In some embodiments of the eleventh aspect, the first medical device may include a first hospital bed that may have a first patient departure barrier to which the first camera may be coupled, and the second medical device may include a second hospital bed that may have a second patient departure barrier to which the second camera may be coupled. For example, the first patient departure barrier and the second patient departure barrier may each include a corresponding first headboard and second headboard or a corresponding first footboard and second footboard. Thus, the first patient departure barrier and the second patient departure barrier may each include a corresponding first side rail and second side rail. In such embodiments, the first circuit may further include a first display screen coupled to the first side rail, the second circuit may further include a second display screen coupled to the second side rail, the first camera may be located adjacent to the first display screen, and the second camera may be located adjacent to the second display screen.

[0064] If desired, the system of the eleventh aspect may further include at least one voice control authorization (VCA) computer that may be remote from the first medical device and the second medical device and may be communicatively coupled to the first medical device and the second medical device. The first circuit may be configured to transmit a first image for reception by the at least one VCA computer, and the second circuit may be configured to transmit a second image for reception by the at least one VCA computer. The VCA computer of the eleventh aspect may be configured to transmit a first message that enables the first medical device for voice control to the first medical device in response to the VCA computer determining based on an analysis of the first image that the person is authorized to operate the first medical device by voice control. The VCA computer may be configured to transmit a second message that enables the second medical device for voice control to the second medical device in response to the VCA computer determining based on an analysis of the second image that the person is authorized to operate the second medical device by voice control.

[0065] Optionally, after each of the first medical device and the second medical device is enabled for voice control, the corresponding first circuit and second circuit can be enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold time period. After the threshold time period has elapsed, in the case where the corresponding first medical device and second medical device do not receive at least one voice command in the eleventh aspect, the corresponding first medical device and second medical device can be disabled for voice control. The present disclosure contemplates that the threshold time period can be reset in response to receiving a valid voice command during the threshold time period.

[0066] According to a twelfth aspect of the present disclosure, a system for voice control can include a medical device that can have a first circuit that can include a processor, a memory, a button, and a microphone. The circuit of the medical device in the twelfth aspect can be configured to be enabled for voice control in response to a person selecting the button and then receiving a valid voice input via the microphone within a threshold time period.

[0067] In some embodiments of the twelfth aspect, the valid voice input can include a code word. For example, the code word can include a first unique name that can correspond to the medical device and can be received by the microphone within the threshold time period. Optionally, the unique name can include the model name of the medical device.

[0068] If desired, after the medical device in the twelfth aspect is enabled for voice control, the corresponding circuit can be enabled to receive voice commands to control the function of the medical device for a second threshold time period. After the second threshold time period has elapsed, in the case where the medical device does not receive at least one voice command, the medical device can be disabled for voice control. The present disclosure contemplates that the threshold time period can be reset in response to receiving a valid voice command during the second threshold time period.

[0069] In some embodiments of the twelfth aspect, the valid voice input can include any device control command among a plurality of device control commands. The present disclosure contemplates that if no valid voice input is received within the threshold time period, the medical device can remain disabled for voice control.

[0070] According to a thirteenth aspect of the present disclosure, a system for voice control of in-room medical devices may include a first medical device and a second medical device. The first medical device may have a first circuit that may include a first processor, a first memory, a first microphone, and a first infrared (IR) receiver. The second medical device may have a second circuit that may include a second processor, a second memory, a second microphone, and a second IR receiver. The system of the thirteenth aspect may further include an IR indicator that may have an IR transmitter. The first circuit of the first medical device may be configured to enable voice control in response to the first IR receiver receiving an IR signal from the IR transmitter of the IR indicator. The second circuit of the second medical device may be configured to enable voice control in response to the second IR receiver receiving an IR signal from the IR transmitter of the IR indicator.

[0071] In some embodiments of the thirteenth aspect, the IR indicator may be configured to be worn on a person's finger. Alternatively or additionally, the IR indicator may be mounted to a mobile phone. Further alternatively or additionally, the IR indicator may have the shape of a stylus. Even further alternatively or additionally, the IR indicator may have the shape of a keychain.

[0072] The present disclosure contemplates that the first medical device of the thirteenth aspect may include a first hospital bed that may have a first patient departure barrier to which the first IR receiver may be coupled, and the second medical device of the thirteenth aspect may have a second hospital bed that may have a second patient departure barrier to which the second IR receiver may be coupled. For example, the first patient departure barrier and the second patient departure barrier may each include a corresponding first headboard and second headboard or corresponding first footboard and second footboard. Alternatively or additionally, the first patient departure barrier and the second patient departure barrier may each include a corresponding first side rail and second side rail. In such embodiments, the first circuit may further include a first display coupled to the first side rail, the second circuit may further include a second display coupled to the second side rail, the first IR receiver may be adjacent to the first display, and the second IR receiver may be adjacent to the second display.

[0073] If desired, after each of the first medical device and the second medical device of the thirteenth aspect is enabled for voice control, the corresponding first circuit and second circuit may be enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold period of time, and after the threshold period of time has passed, in the case where at least one voice command is not received by the corresponding first medical device and second medical device, the corresponding first medical device and second medical device may be disabled for voice control. The present disclosure contemplates that in response to receiving a valid voice command during the threshold period of time, the threshold period of time may be reset.

[0074] According to a fourteenth aspect of the present disclosure, a system for voice control of in-room medical devices may include a plurality of medical devices that may be in a room, a far-field microphone array that may be dispersed throughout the room, and at least one computer that may be communicatively coupled to the plurality of medical devices and the far-field microphone array. The at least one computer may be configured to: (i) combine voice inputs that may be received from a person by the far-field microphone array; (ii) use beamforming software to amplify and identify the voice inputs; (iii) use Barge-in software to filter out ambient noise; (iv) execute speech recognition software to determine which of the plurality of medical devices may be the designated medical device to be controlled by the voice input; and (v) transmit a control message to the designated medical device to control a first function of the designated medical device based on the voice input.

[0075] In some embodiments of the fourteenth aspect, each of the plurality of medical devices may carry at least one far-field microphone of the far-field microphone array. Optionally, the plurality of medical devices may include two or more of the following devices: a vital sign monitor, a hospital bed, an end-wall interface, a caregiver badge, a location tag, a patient identification (ID) bracelet, a patient gown, an audio station of a nurse call system, a patient lift, and a seat. The speech recognition software of the fourteenth aspect includes one or more of the following software: speech-to-text conversion software, codeword recognition software, wake-word recognition software, and natural language processing (NLP) software.

[0076] Optionally, the at least one computer of the fourteenth aspect may be further configured with distance processing software that may be executed to determine which of the far-field microphones in the far-field microphone array may be the far-field microphone closest to the person, and to determine which of the plurality of medical devices may be closest to the closest far-field microphone. Further optionally, the Barge-in software may determine the ambient noise to be filtered out based on the characteristics or frequency of the noise for a sustainable threshold time period (e.g., longer than the amount of time taken to speak the voice input).

[0077] If desired, the at least one computer of the fourteenth aspect may be further configured with speaker recognition software to determine the identification (ID) of the person who may provide the voice input. In this regard, the speaker recognition software may include one or more of the following: Markov model software, pattern recognition software, voice biometric software, neural network software, natural language processing (NLP) software, natural language understanding software, and Anaphora resolution software.

[0078] In some embodiments of the fourteenth aspect, at least one computer may be further configured to determine that a voice input may include a composite voice command that may relate to a first specified medical device and a second specified medical device. In such a case, at least one computer may be further configured to transmit a second control message to the second specified medical device to control a second function of the second specified medical device based on a portion of the voice input relating to the second medical device. At least one computer of the fourteenth aspect may be further configured to determine that a voice input may include a composite voice command that may relate to a first function and a second function of a specified medical device. In such a case, the control message transmitted by the at least one computer to the specified medical device may include a first portion for controlling the first function of the specified medical device and a second portion for controlling the second function of the specified medical device.

[0079] According to a fifteenth aspect of the present disclosure, a hospital bed may include a frame configured to support a patient, a far-field microphone array carried by the frame, and circuitry carried by the frame and coupled to the far-field microphone array. The circuitry of the fifteenth aspect may include a processor and a memory. Additionally, the circuitry of the fifteenth aspect may be configured to: (i) combine voice inputs received from a person by the far-field microphone array; (ii) use beamforming software to amplify and identify the voice inputs; (iii) use interrupt software to filter out ambient noise; (iv) execute speech recognition software to determine a first function of the hospital bed to be performed based on the voice inputs; and (v) control the hospital bed to perform the first function.

[0080] In some embodiments of the fifteenth aspect, the hospital bed may include a plurality of barriers coupled to the frame, and each barrier of the plurality of barriers may carry at least one far-field microphone of the far-field microphone array. Optionally, the speech recognition software of the fifteenth aspect includes one or more of the following software: speech-to-text conversion software, codeword recognition software, wake-word recognition software, and natural language processing (NLP) software. Further optionally, the interrupt software of the fifteenth aspect may determine the ambient noise to be filtered out based on the characteristics or frequency of the noise over a sustainable threshold time period (e.g., longer than the amount of time taken to speak the voice input).

[0081] If desired, the circuitry of the fifteenth aspect may be further configured with speaker recognition software to determine the identity (ID) of the person who can provide voice input. In this regard, the speaker recognition software of the fifteenth aspect may include one or more of the following: Markov model software, pattern recognition software, voice biometric software, neural network software, natural language processing (NLP) software, natural language understanding software, and anaphora resolution software. In some embodiments of the fifteenth aspect, the circuitry may be further configured to determine that the voice input may include a composite voice command that may relate to a first function and a second function of the hospital bed. In such a case, the circuitry of the fifteenth aspect may be configured to control the second function of the hospital bed while controlling the first function of the hospital bed. Optionally, the circuitry of the fifteenth aspect may be configured to control the functions of the hospital bed according to one or more rows (excluding the header row) provided in Table 1 below of the present application. If desired, the functions of the hospital bed of any one of the first aspect to the fourteenth aspect may also be controlled by voice input according to one or more rows (excluding the header row) provided in Table 1.

[0082] According to a sixteenth aspect of the present disclosure, a system for voice control of a ward environment may be provided. The system of the sixteenth aspect may include environmental equipment operable to control the ward environment, entertainment equipment operable to provide entertainment to a patient in the ward, and a microphone that may be located in the ward and may be configured to receive voice control commands from the patient for controlling the environmental equipment and the entertainment equipment. The system of the sixteenth aspect may further include a remote computer that may be communicatively coupled to the microphone and may have voice recognition software. The remote computer of the sixteenth aspect may be configured to process the voice control commands and send control messages to control the operation of the environmental equipment and the entertainment equipment.

[0083] In some embodiments of the sixteenth aspect, the environmental equipment may include one or more of the following: motorized blinds, motorized curtains, indoor lights, reading lights, or a thermostat. The entertainment equipment of the sixteenth aspect may include a television. Alternatively or additionally, the entertainment equipment of the sixteenth aspect may include a speaker unit that may be configured to play the audio of audiobooks, voice-based games, and quizzes. Optionally, the microphone of the sixteenth aspect may be included in the speaker unit. Further optionally, the system of the sixteenth aspect may further include a hospital bed that may be configured to support the patient, and the speaker unit may be included in the hospital bed.

[0084] If desired, the entertainment device of the sixteenth aspect may include a second entertainment device, which may be separated from the speaker unit, and control messages for controlling the operation of the environmental device and the second entertainment device may be routed to the environmental device and the second entertainment device through the speaker unit. The present disclosure contemplates that the control messages of the sixteenth aspect may be received by the speaker unit as wireless control messages. Alternatively or additionally, the control messages sent from the speaker unit to the environmental device and the second entertainment device may be wirelessly transmitted.

[0085] According to a seventeenth aspect of the present disclosure, a system for voice control of a ward environment may be provided. The system of the seventeenth aspect may include an environmental device operable to control the ward environment, an entertainment device operable to provide entertainment to a patient in the ward, and a microphone that may be located within the ward and configured to receive voice control commands from the patient for controlling the environmental device and the entertainment device. The system of the seventeenth aspect may further include an Internet of Things (IoT) hub communicatively coupled to the microphone. The microphone of the seventeenth aspect may be configured to transmit the voice control commands to the IoT hub, and the IoT hub may be configured to transmit control messages to control the operation of the environmental device and the entertainment device.

[0086] In some embodiments of the seventeenth aspect, the environmental device may include one or more of the following: motorized blinds, motorized curtains, indoor lights, reading lights, or thermostats. The entertainment device of the seventeenth aspect may include a television. Alternatively or additionally, the entertainment device of the seventeenth aspect may include a speaker unit configured to play the audio of audiobooks, voice-based games, and quizzes. Optionally, the microphone of the seventeenth aspect may be included in the speaker unit. Further optionally, the system of the seventeenth aspect may further include a hospital bed configured to support the patient, and the speaker unit may be included in the hospital bed.

[0087] If desired, the entertainment device of the seventeenth aspect may include a second entertainment device, which may be separated from the speaker unit, and control messages from the IoT hub for controlling the operation of the environmental device and the second entertainment device may be routed to the environmental device and the second entertainment device via the speaker unit. The present disclosure contemplates that at least some of the control messages of the seventeenth aspect may be received by the speaker unit from the IoT hub as wireless control messages. Alternatively or additionally, the control messages sent from the speaker unit to the environmental device and the second entertainment device in the seventeenth aspect may be wirelessly transmitted.

[0088] In some embodiments, the system of the seventeenth aspect may further include a second environmental device, a second entertainment device, and a remote computer communicatively coupled to the microphone and having speech recognition software. The remote computer may be configured to process voice control commands and send second control messages to control the operation of the second environmental device and the second entertainment device. Optionally, the second control messages may be transmitted to the second environmental device and the second entertainment device without involving the IoT hub. Further optionally, the system of the seventeenth aspect may further include a speaker unit, the microphone may be included in the speaker unit, and the second control messages may be transmitted to the second environmental device and the second entertainment device through the speaker unit.

[0089] Additional features, either alone or in combination with any other features such as those listed above and those listed in the claims, may include patentable subject matter, which will be apparent to those skilled in the art after considering the following detailed description of various embodiments to illustrate the currently regarded best mode of implementing these embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] The following will be described in detail with reference to the accompanying drawings, in which:

[0091] Figure 1 is a schematic diagram of a first voice control system, showing a caregiver entering a voice input on a mobile phone to control a hospital bed supporting a patient. The mobile phone communicates wirelessly with a wireless access module (WAM) of the hospital bed. The WAM communicates a bed message corresponding to the voice input to a bed controller of the hospital bed via a wired connection. The hospital bed has a microphone and a speaker on each of a pair of side rails (as shown by the circles on the side rails). A patient mobile phone is shown above the patient's head for the patient to enter a voice input to the WAM of the hospital bed;

[0092] Figure 2 is similar to Figure 1 is a schematic diagram of a second voice control system, showing a room microphone and speaker unit above the footboard of the hospital bed. The room microphone and speaker unit communicate wirelessly with the WAM of the hospital bed. The room microphone and speaker unit are configured to receive voice inputs from the caregiver and the patient. The room microphone and speaker unit communicate with a network having continuous speech processing (CSP) speech recognition services and bed control services provided by software of one or more servers in the network, enabling the one or more servers to process the voice inputs and provide command messages to the WAM of the hospital bed via the room microphone and speaker unit to control the functions of the hospital bed;

[0093] Figure 3 is similar to Figure 1 and Figure 2Schematic diagram of the third voice control system, showing a caregiver providing voice input to a microphone on one of the bed rails. The bed has a software development kit (SDK) that the WAM of the bed docks with. The WAM communicates with a network that provides CSP voice recognition services and bed control services by software of one or more servers in the network, enabling the one or more servers to process the voice input and provide command messages to the bed via the WAM to control the functions of the bed;

[0094] Figure 4 is similar to Figures 1 to 3 Schematic diagram of the fourth voice control system, showing a caregiver providing voice input to a microphone on one of the bed rails. The bed has a circuit embedded with voice recognition (VR) and natural language processing (NLP) software to convert the voice input into command messages and communicate these command messages to the bed controller to control the functions of the bed;

[0095] Figure 5 is similar to Figure 2 Schematic diagram of the fifth voice control system, showing an intelligent speaker unit above the caregiver. The intelligent speaker unit is configured to receive voice inputs from the caregiver and the patient. The speaker unit communicates wirelessly with the room environment and entertainment devices. The intelligent speaker unit communicates with a network that provides CSP voice recognition services by software of one or more servers in the network, enabling the one or more servers to process the voice input and provide command information to the intelligent speaker unit to control the functions of the environment and entertainment devices;

[0096] Figure 6 is similar to Figures 1 to 5 Schematic diagram of the sixth voice control system, showing the intelligent speaker unit configured to receive voice inputs from the caregiver and the patient. The intelligent speaker collaborates with an Internet of Things (IoT) hub and a network that provides CSP voice recognition services by software of one or more servers in the network, enabling the intelligent speaker, the network, and / or the IoT hub to provide command messages based on the voice input to control the functions of the bed, environmental devices, and entertainment devices;

[0097] Figure 7 Flowchart of the voice model algorithm, showing a caregiver creating a voice model using an application on a mobile device. The voice model is pushed to a device such as a bed, and the application on the mobile phone updates the voice model to improve accuracy;

[0098] Figure 8 Flowchart of the caregiver authorization algorithm for confirming that a caregiver providing voice input to a patient is authorized to do so;

[0099] Figure 9It is a schematic diagram of the first method for determining which medical device among multiple medical devices in a room is to be controlled by voice. It shows that a caregiver uses a key phrase including a keyword (e.g., "hey") followed by a unique name (e.g., "bed name A") to indicate that bed A will be controlled by the caregiver's voice, rather than bed B;

[0100] Figure 10 It is a schematic diagram of the second method for determining which medical device among multiple medical devices in a room is to be controlled by voice. It shows that when the caregiver approaches the medical device, the caregiver's caregiver badge emits a near-field communication (NFC) signal that can be detected by the medical device (e.g., a hospital bed), and the medical device is enabled for voice control in response to detecting the NFC signal;

[0101] Figure 11 It is a schematic diagram of the third method for determining which medical device among multiple medical devices in a room is to be controlled by voice. It shows a first microphone on the room wall, a second microphone on the hospital bed, and a third microphone on the medical monitor. The remote server determines which medical device will be controlled by voice based on which microphone among the first microphone, the second microphone, and the third microphone detects the loudest voice input from the caregiver;

[0102] Figure 12 It is a schematic diagram of the fourth method for determining which medical device among multiple medical devices in a room is to be controlled by voice. It shows that the first medical device (e.g., the first hospital bed) has a first camera, the second medical device (e.g., the second hospital bed) has a second camera, and the medical device to be controlled by voice is the one that captures the caregiver's face by the corresponding camera;

[0103] Figure 13 It is a schematic diagram of the fifth method for determining which medical device among multiple medical devices in a room is to be controlled by voice. It shows that the caregiver presses a button on the medical device (e.g., a button on one of the bed rails) to enable the medical device for voice control when the button is pressed or within a threshold time period after the button is pressed;

[0104] Figure 14 It is a schematic diagram of the sixth method for determining which medical device among multiple medical devices in a room is to be controlled by voice. It shows that the caregiver's IR indicator emits an IR signal towards the IR receiver of the medical device to be controlled by voice, and the medical device is enabled for voice control for a threshold time period in response to the IR signal being detected by the corresponding IR receiver; and

[0105] Figure 15is a flowchart of an algorithm for controlling a medical device via voice input, showing an algorithm including the following instructions: (i) combining voice inputs received from a person by a far-field microphone array in a room; (ii) using beamforming software to amplify and identify the voice inputs; (iii) using interrupt software to filter out ambient noise; (iv) executing speech recognition software to determine which of a plurality of medical devices is the designated medical device to be controlled via voice input; and (v) transmitting a control message to the designated medical device to control a first function of the designated medical device based on the voice input. Detailed Description

[0106] of the present disclosure Figures 1 to 6 and Figures 9 to 14 both show a system 20 for voice control of devices in a medical facility. As contemplated by the present disclosure, Figure 7 , Figure 8 and Figure 15 show flowcharts of algorithms for voice control of devices in system 20. With respect to system 20, various embodiments are disclosed, and thus for each Figures 1 to 6 and Figures 9 to 14 system 20, a hyphenated suffix is added to the reference numeral 20. The hyphenated suffix corresponds to the figure number of the embodiment of the particular system 20. For example, Figure 1 system 20 is designed with the reference numeral 20-1, Figure 2 system 20 is designed with the reference numeral 20-2, etc. It should be understood that Figures 1 to 6 and Figures 9 to 14 systems 20 are not mutually exclusive, so that a system having a combination of any two or more of systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6, 20-9, 20-10, 20-11, 20-12, 20-13, 20-14 is within the scope of the present disclosure. In addition, the algorithms corresponding to the flowcharts of Figure 7 , Figure 8 and Figure 15 can be implemented in any one or more of systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6, 20-9, 20-10, 20-11, 20-12, 20-13, 20-14 and combinations thereof.

[0107] Now referring to Figure 1 , a first voice control system 20-1 is configured to allow a caregiver to input voice input on a caregiver mobile phone 22 to control a hospital bed 30 supporting a patient. The caregiver wears or otherwise carries a caregiver identification (ID) badge or tag 25, which provides a wireless signal to the mobile phone 22 (such as Figure 1as schematically indicated by the double arrow 24). The wireless signal 24 from the caregiver badge 25 includes a caregiver ID (e.g., the caregiver's employee number, a randomly assigned number, the caregiver's name, etc.). The mobile phone 22 transmits a query message to the caregiver badge 25, and the badge 25 responds to the query message by transmitting the caregiver ID to the mobile phone 22. In some embodiments, in response to the caregiver providing voice input to the mobile phone 22 regarding controlling the bed 20, a query message is initiated from the phone 22. Thus, in the illustrative embodiment, the wireless link 24 between the mobile phone 22 and the badge 25 is two-way.

[0108] The mobile phone 22 wirelessly communicates with the wireless access module (WAM) 26 of the hospital bed 30 (as Figure 1 schematically indicated by the dashed double arrow 28). In some embodiments, the voice input from the caregiver is converted by the mobile phone 22 into a wireless bed command message 28, which is wirelessly transmitted to the WAM 26 along with the caregiver ID. Wireless messages 28 such as confirmation messages, alert messages, etc. are also appropriately communicated from the WAM 26 to the mobile phone 22. Thus, the wireless link 28 between the mobile phone 22 and the WAM 26 is two-way. In other embodiments, a voice recording is made by the phone 22 and converted into a digital sound file (e.g.,.wav file), which is wirelessly transmitted to the WAM 26 via the wireless link 28. The caregiver ID is also wirelessly transmitted to the WAM 26 along with the digital sound file. In some such embodiments, the WAM 26 converts the digital sound file into one or more bed command messages.

[0109] After receiving one or more bed command messages or one or more digital sound files along with the caregiver ID from the mobile phone 22 via the wireless link 28, the WAM 26 communicates the bed command message corresponding to the voice input from the caregiver along with the caregiver ID to the bed controller 34 via a wired link or connection (as Figure 1 schematically indicated by the double arrow 32). Then, the controller 34 determines whether the caregiver ID matches the ID stored in the memory of the controller 34. If the IDs match, the controller 34 infers that the caregiver is authorized to operate the bed 30 by voice and executes the bed functions related to the bed command message. In other embodiments, as detailed below, the bed controller 34 is configured to determine the authorization of the caregiver for voice control by other methods.

[0110] The bed controller 34 is in Figure 1is schematically shown as a single box, but in some embodiments, the bed controller 34 includes various circuit boards, electronic modules, etc. that are electrically and communicatively interconnected. Thus, the bed controller includes a processor 36, such as one or more microprocessors or microcontrollers, which execute software to perform the various control functions and algorithms described herein. Accordingly, the bed controller 34 also includes a memory 38 for storing software, variables, computed values, etc. that are known in the art. Thus, the bed controller 34 may include or be embodied as any device or circuit configured to operate the bed 30 as described herein (e.g., a processor, microcontroller, field programmable gate array (FPGA), application specific integrated circuit (ASIC), reconfigurable circuit, system on a chip (SoC), programmable system on a chip (PSoC), embedded computer module (CoM), and embedded system module (SoM), etc.) and / or software. In certain embodiments, the bed controller 34 includes a VAR-SOM-MX6 embedded system module (SoM) available from Variscite, Ltd. of Lod, Israel, which serves as or is disposed on the main control board (MCB) of the bed 20.

[0111] In Figures 1 to 6 and Figures 9 to 14 illustrative examples of, each bed 30 is depicted as a Smart+ bed available from Hill-Rom. Other details of the Smart+ bed 30 and its variants can be found in U.S. Patent Application US 10 / 517784, which is incorporated herein by reference in its entirety to the extent not inconsistent with the present disclosure, and in case of any conflict, the present disclosure shall prevail. Although the present disclosure focuses largely on the voice control of an illustrative hospital bed 30, it should be understood that the present disclosure is applicable to the voice control of all types of medical equipment or devices, including: other models of hospital beds (e.g., beds available from Hill-Rom, for example), medical operating tables, air-fluidized therapy beds, bariatric beds, ADVANTA TM Generation 2 medical operating tables, EXCEL CARE bariatric beds, Generation 4 delivery beds, and Beds, as well as beds from other manufacturers; patient monitors (e.g., heart rate monitors, respiratory rate monitors, electrocardiographs (EKGs), electroencephalographs (EEGs), pulse oximeters, blood pressure monitors, and thermometers); drug delivery devices such as drug infusion pumps; intravenous (IV) devices; ventilators; respiratory therapy devices such as those for oscillatory lung expansion (OLE), insufflation / exsufflation, continuous positive expiratory pressure (CPEP), continuous high-frequency oscillation (CHFO), continuous positive airway pressure (CPAP), Bi-PAP, etc.; compression therapy devices for treating deep vein thrombosis (DVT), including sequential compression devices (SCD); and the like.

[0112] Referring again to Figure 1 , the hospital bed 30 has a frame 40 that includes an articulated patient support deck 42 that supports a mattress 44. A head end rail 46 is coupled to each side of the head section of the deck 42 such that the bed 30 has two head end rails 46. As indicated schematically by the circles 48 on the rails 46, each of the rails 46 carries a microphone (mic) and a speaker. The speaker and microphone 48 on each rail 46 may be included in a single unit, which is sometimes referred to as a "speaker unit" even though the microphone is also included in the unit. Alternatively, in some embodiments, the microphone and speaker of each rail 46 are separate components included in the circuitry of the respective rail 46. Further alternatively, in some embodiments, the speaker itself also functions as a microphone capable of receiving voice input. The microphones 48 of the bed 30 are each capable of receiving voice input from a caregiver or a patient supported on the bed 30.

[0113] In Figure 1 , a patient mobile phone 22' is shown schematically above the patient's head. As indicated schematically by the dashed double arrow 28', as a supplement or alternative to the microphone 48, the patient may use the patient mobile phone 22' to input voice input into the WAM 26 of the hospital bed. Under appropriate conditions, confirmation messages, alert messages, etc. are provided to the mobile phone 22' via the wireless link 28'. In Figure 1 the illustrative example of Figure 1As schematically indicated by double arrow 32 in the figure, the patient identification (ID) wristband 50 is worn by the patient and provides a wireless signal 52 to the mobile phone 22'. The wireless signal 52 from the wristband 50 includes the patient ID (e.g., the patient's medical record number (MRN), a randomly assigned number, the patient's name, etc.). The mobile phone 22' includes the patient ID in the wireless transmission 28' to the WAM 26 of the bed 30, and the WAM 26 transmits the patient ID together with the bed command message to the bed controller 34. Then, the controller 34 determines whether the patient ID matches the ID stored in the memory 36. If the IDs match, the controller 34 infers that the patient is authorized to operate the bed 30 by voice and executes the bed function related to the bed command message.

[0114] In Figure 1 the figure, the WAM 26 is schematically shown as being coupled to the footboard 54 of the bed 30, and the bed controller 34 is shown in a box adjacent to the bed 30. Although the WAM 26 can be carried by the footboard 54 of the bed 30 or otherwise included in the footboard 54 of the bed 30, in a typical embodiment of the bed 30 envisioned herein, the WAM 26 and the bed controller 34 are carried by the frame 40 of the bed 30. In fact, if desired, the WAM 26 and the bed controller 34 can be included on the same printed circuit board. Additionally, in some embodiments, the WAM 26 can be implemented as part of the processor 36 and memory 38 (e.g., a microcontroller, SoM, SoC, PSoC, FPGA, or ASIC) of the bed controller 34.

[0115] Based on the above, it should be understood that in Figure 1 the embodiments, the controller 34 of the bed 30 determines whether the caregiver or the patient is authorized to control the functions of the bed 30 by voice, respectively, based on an in-bed analysis of the caregiver ID from the badge 25 or the patient ID from the wristband 50. Thus, before receiving voice input from the caregiver or the patient via the microphones 48 of the mobile phones 22, 22' and / or the bed 20, the IDs of one or more caregivers and / or one or more patients authorized to control the bed 30 by voice are stored in the memory 38 of the bed 30. Such IDs are uploaded to the memory 38 of the bed controller 34 from remote computers such as electronic medical record (EMR) computers, admission discharge transfer (ADT) computers, nurse call computers, workflow computers, etc., which are communicatively coupled to the bed controller 34 via the network of the medical institution.

[0116] After a patient is discharged from a healthcare facility or re-assigned to a different bed, the remote computer sends a purge signal to the bed controller 34, which causes the bed controller 34 to purge the patient ID from the memory 38 or otherwise indicate that the patient ID no longer corresponds to a patient authorized to control the bed 30 via voice. Similar purge messages are sent to the bed controllers associated with caregivers who are no longer authorized to control the bed 30 for any reason, such as the caregiver being re-assigned to a different ward of the healthcare facility, the caregiver no longer being employed by the healthcare facility, the caregiver's shift ending, etc.

[0117] In Figure 1 In an illustrative embodiment of the system 20-1, the telephones 22, 22' are each equipped with a transceiver for communicating with the tag 25 and the wristband 50. In such embodiments, the bed 30 need not be equipped with any kind of reader or transceiver for communicating with the tag 25 and the wristband 50, as this functionality is provided by the mobile telephones 22, 22'. In other embodiments, as a supplement or alternative to the tag / band communication functionality of the mobile telephones 22, 22', the bed 30 includes a transceiver or reader for communicating with the tag 25 and the wristband 50.

[0118] In some embodiments of the system 20-1, one or both of the mobile telephones 22, 22' are equipped with a bed control software application that presents bed control inputs on the touchscreen display of the respective mobile telephone 22, 22'. In such embodiments, depending on the situation, the caregiver or patient selects a button or other user input presented on the display screen of the respective mobile telephone 22, 22' to control the corresponding bed function. In response to the selection of a bed control input on the telephones 22, 22', a bed command message is transmitted from the telephones 22, 22' via the respective wireless links 28, 28' to the WAM 26 and processed by the WAM 26 and the bed controller 34 to control the bed function corresponding to the bed command message. In some embodiments where manual input is provided to the bed 30 via the telephones 22, 22', the bed 30 does not implement a caregiver or patient authorization algorithm. That is, in such embodiments, it is assumed that any bed control message received at the WAM 26 originates from a telephone 22, 22' of a user authorized to control the functions of the bed 30. Optionally, before launching the bed control application for use by the respective caregiver or patient, the bed control application on the telephones 22, 22' may require the entry of a personal identification number (PIN) on the respective telephones 22, 22'. Requiring the entry of a PIN on the telephones 22, 22' provides a degree of assurance that the respective caregiver or patient is authorized to use the respective telephone 22, 22' to control the bed 30.

[0119] Now referring to Figure 2 , there is provided a similar to Figure 1The second voice control system 20-2 of the system 20-1. The system 20-2 includes a bed 30 that has a WAM 26, a bed controller 34, and a microphone and speaker 48 coupled to the side rail 46. The descriptions of these components and other parts of the bed 30 above also apply to the system 20-2, so they will not be repeated here. However, as Figure 2 schematically shown in, instead of the mobile phones 22, 22' of the system 20-1, the system 20-2 has a room microphone (mic) and speaker unit 56 that receives voice input 58 from a caregiver and voice input 59 from a patient. The microphone and speaker unit 56 is sometimes referred to herein as "the speaker unit 56". The speaker unit 56 is schematically shown above the footboard 54 of the hospital bed 30 in Figure 2 , but it should be understood that the speaker unit 56 can be located at any suitable position within the patient's room. For example, the speaker unit 56 can be placed on a nightstand adjacent to the bed 30, mounted to the room wall or ceiling of the room where the bed 30 is located, or even mounted to the bed 30 itself. When the speaker unit 56 or any other component is described herein as being mounted, fixed, or attached to a room wall, it means that the component is directly mounted to the wall within the room, mounted to an end wall unit attached to the room wall adjacent to the head end of the bed 30, or mounted to some other building structure within the room, such as a maintenance area, a bed locator unit, or a beam or column attached to the room wall or otherwise fixed in place relative to the room wall.

[0120] In some embodiments, the speaker unit 56 and the speaker unit 48 cooperate to provide a microphone array for the system 20-2 that receives voice inputs 56, 58 from a caregiver and a patient, respectively. As Figure 2 schematically shown, the speaker unit 56 is communicatively coupled to the network 60 of the medical facility via a bi-directional wireless link 62. The speaker unit 56 also communicates wirelessly with the WAM 26 of the hospital bed 30 via a bi-directional wireless link 64. The network 60 is schematically depicted as Figure 2 the cloud in. However, the schematic cloud is intended to represent all the components typically present in the network of a medical institution, for example, the infrastructure provided in the network 60 of the medical institution (e.g., wireless access points, Ethernet jacks such as RJ-45 connectors, wires, routers, gateways, etc.) and various computer devices coupled to the infrastructure (e.g., personal computers, servers, laptops, patient care equipment, etc.).

[0121] As Figure 2Schematically shown in FIG. 20-2, the network 60 of system 20-2 provides continuous speech processing (CSP) speech recognition services and bed control services to the bed 30. In particular, the CSP speech recognition services and bed control services are provided by software on one or more servers of the network 60. Thus, the voice inputs 58, 59 received by the speaker unit 62 are transmitted via the wireless link 62 to one or more servers having CSP speech recognition services and bed control services, so that the one or more servers can process the voice inputs and provide bed command messages to the WAM 26 of the bed 30 via the room microphone and speaker unit 26 to control the functions of the hospital bed 30.

[0122] In some instances of system 20-2, voice inputs from a caregiver or patient received by one or both of the microphones 48 of the bed 30 are communicated directly via a wired connection or through the bed controller 34 and the wired connection 32 to the WAM 26, and then transmitted via the wireless link 64 to the speaker unit 56. The speaker unit 64 then communicates a message corresponding to the voice input initially received at the microphone 48 via the wireless link 62 to the network 60 for processing by one or more servers having CSP speech recognition services and bed control services. A server having software that provides CSP speech recognition services is sometimes referred to herein as a "voice control authorization (VCA) computer".

[0123] The voice inputs communicated via the wireless links 62, 64 are digital sound files, such as.wav files. In other embodiments, in addition to or instead of the.wav file format, other types of audio file formats may also be used in system 20, including audio formats having the following file specifier types:.3gp,.aa,.aac,.aax,.act,.aiff,.alac,.amr,.ape,.au,.awb,.dct,.dss,.dvf,.flac,.gsm,.iklax,.ivs,.m4a,.m4b,.m4p,.mmf,.mp3,.mpc,.msv,.nmf,.ogg,.oga,.mogg,.opus,.ra,.rm,.raw,.rf64,.sln,.tta,.voc,.vox,.wma,.wv,.webm,.8svx, and.cda. Thus, the WAM 26 and / or the speaker unit 56 may employ various audio file compression techniques in combination with the digital sound files transmitted to the network 60 via one or both of the wireless links 62, 64. In some embodiments, the speaker unit 56 is unit or unit.

[0124] In some embodiments, the VCA computer storage of network 60 stores digital models that are authorized to control the voice of each of the caregiver and the patient for various medical devices (such as the hospital bed 30) located in various wards within a healthcare facility. After receiving a voice input from a caregiver or patient attempting to control the bed 30 as a digital audio file at the VCA computer, the VCA computer compares the digital audio file with the digital models of the voices of authorized users stored in the memory of the VCA computer. If the digital audio file of the voice input matches one of the digital models of the authorized users, the VCA computer sends a bed control message to a server having software that provides bed control services (sometimes referred to herein as the "bed control computer"). The present disclosure contemplates that the VCA computer uses voice biometrics in combination with comparing the audio file of the voice input with the stored digital models.

[0125] The voice biometrics used by the VCA computer can, for example, involve feature extraction (e.g., determining the tone, pitch, and / or frequency of a person's voice); creating a voiceprint (e.g., spectrogram); using any one or more of the following: frequency estimation, hidden Markov models, Gaussian mixture models, pattern matching methods, neural networks, matrix representations, and decision trees; determining speech signal feature vectors, such as by segmenting the speech signal into glottal pulses, calculating the glottal pulse feature vectors for each glottal pulse, and calculating the speech signal feature vector as a function of the glottal pulse feature vectors; and other methods, such as determining linear prediction coefficients from the speech signal, forming an inverse filter based on the extracted linear prediction coefficients, filtering the speech signal using the inverse filter to obtain an inverse filtered signal, and segmenting the inverse filtered signal into glottal pulses. Other details regarding voice biometrics can be found in U.S. Patents US 10 / 614,814, US 9 / 870,776, and US 8 / 620,666, which are hereby incorporated by reference in their entirety to the extent not inconsistent with the present disclosure, and any inconsistencies are subject to the present disclosure.

[0126] In some embodiments of system 20, the bed control messages sent from the VCA computer to the bed control computer include one or more data packets that encode text corresponding to the dictated voice input. For example, the data packets sent from the VCA computer to the bed control computer can include text in.html format or.xml format. The bed control computer then converts the text from the one or more data packets into a digital bed control message and transmits it via network 60 to bed 30, resulting in the activation of the corresponding bed function on bed 30. In some embodiments, the bed control message can be sent from the bed control computer to bed 30 via wireless links 62, 64 and speaker unit 56. In other embodiments, the bed control message from the bed control computer is routed to bed 30 through other infrastructure of network 60 (such as one or more wireless access points) or even through the nurse call system of network 60, which communicates with bed 30 via a wired connection (e.g., a 37-core nurse call cable between bed 30 and a nurse call system interface unit such as a network interface unit (NIU), an audio station bed connector (ASBC), etc. installed on the room wall) or via a wireless connection (e.g., a Bluetooth connection between bed 30 and a general collector or other unit installed on the room wall and having Bluetooth wireless communication capabilities).

[0127] To enable the VCA computer to know which bed 30 the voice input corresponding to the digital audio file is intended to control, the bed ID corresponding to a particular bed 30 and / or the location ID corresponding to the room in which bed 30 is located are included in the digital audio file. The location ID can correspond to or be associated with the speaker unit ID of speaker unit 56. For example, the speaker unit ID can be an assigned unique ID or can correspond to the media access control (MAC) address of speaker unit 56. The association between the bed and the room is stored in the database of network 60 to associate each bed ID of bed 30 with a particular room in the medical institution. The bed-room association database can be included in the VCA computer, the bed control computer, or some other computer, such as the location server of the real-time location system (RTLS) of the medical institution. In some embodiments, the patient ID is also associated with bed 30 and / or the room in which bed 30 is located. Thus, in some embodiments, the association database stores patient-bed association and / or patient-room association and / or patient-bed-room association. In any case, when the bed control computer sends a bed command message, the bed ID and / or the speaker unit ID are included in the bed command message so that network 60 can route the bed command message to the appropriate bed 30 to be controlled.

[0128] Now referring to Figure 3 , there is provided something similar to Figure 1 and Figure 2The third voice control system 20-3 of systems 20-1 and 20-2. System 20-3 includes a bed 30 and a network 60, where the VCA computer has software for implementing CSP voice recognition services, and the bed control computer has software for implementing bed control services. Therefore, the descriptions of the bed 30 and the network 60 in connection with systems 20-1 and 20-2 above also apply to system 20-3 and will not be repeated here. In some embodiments of system 20, the VCA computer and the bed control computer are the same computer. That is, the CSP voice recognition service and the bed control service are provided by the same computer such as the same server.

[0129] The main difference between system 20-3 and system 20-2 is that the voice processing function of the speaker unit 56 of system 20-2 is included in the bed 30 of system 20-3. In this regard, in connection with Figure 3 the illustrative example of, the bed 30 has a software development kit (SDK) 66 docked with the WAM 26 of the hospital bed 30. As Figure 3 schematically shown, the SDK or rather the circuitry of the bed 30 implementing the SDK is coupled via a wired connection 68 to the microphone and speaker unit 48 on the side rail 46. Voice inputs 70 from the caregiver and 72 from the patient are detected by one or both of the microphones 48 and provided to the SDK 66 via the wired link 68. In some embodiments, the microphones of the speaker unit 48 cooperate to provide a microphone array to system 20-3 that separately receives voice inputs 70, 72 from the caregiver and the patient.

[0130] As Figure 3 schematically shown, the SDK 66 processes the voice inputs 70, 72 received from one or more microphones 48 and provides voice messages (e.g., digital audio files) to the WAM via a wired communication link, and the WAM in turn communicates the voice messages received from the SDK 66 to the VCA computer of the network 60 via a wireless communication link 76. The VCA computer of the network 60 processes these digital audio files by comparing the digital audio files corresponding to the voice inputs 70, 72 with the digital models of the voices of the authorized users as described above. If one or more of the voice inputs 70, 72 are from an authorized user, the VCA computer cooperates with the bed control computer, and as a result, the bed control computer sends one or more hospital bed command messages to the hospital bed 30 via the wireless link 76 and the WAM 26 to control the functions of the hospital bed. In this regard, as Figure 3 schematically shown, the bed command messages are routed on the bed 30 from the WAM 26 to the bed controller 34 via a wired communication link or connection 78.

[0131] Now referring to Figure 4 , provided is similar to Figures 1 to 3The fourth voice control system 20-4 of systems 20-1, 20-2, and 20-3. Thus, the part of system 20-4 that is substantially the same as the parts of systems 20-1, 20-2, and 20-3 is labeled with the same reference numerals and will not be described further. Accordingly, the above description of the parts of systems 20-1, 20-2, and 20-3 with the same reference numerals also applies to system 20-4, unless otherwise noted.

[0132] In system 20-4, the WAM 26 does not communicate with the network 60, and thus does not use the VCA computer and the bed command computer of the network 60 to determine whether a caregiver or a patient is authorized to control the bed 30 by voice. Instead, as schematically indicated at block 80, the bed 30 of system 20-4 includes circuitry having embedded voice recognition (VR) and / or natural language processing (NLP) software. As Figure 4 schematically shown, the circuitry 80 having embedded VR / NLP software communicates bidirectionally with the bed controller via a wired link or connection 82. In some embodiments, the circuitry 80 includes its own processor and memory. Referring to the above description of the processor 36 and the memory 38, the same applies to the processor and the memory of the circuitry 80 in such embodiments. In other embodiments, the circuitry 80 is included as part of the bed controller 34. Thus, in some embodiments, the memory 38 stores the VR / NLP software for execution by the processor 36 of the controller 34.

[0133] In system 20-4, the functions of the VCA computer and the bed command computer of the network 60 of system 20-3 are provided on the bed 30. In this regard, the circuitry 80 and the controller 34 operate together or separately as an on-bed computer for processing voice inputs 70, 72 received from a caregiver or a patient by the microphone 48 of the bed 30. As Figure 4 schematically shown, the bed 30 includes a wired link 81 between the microphone and speaker unit 48 and the circuitry 80. The circuitry 80 of the bed 30 stores digital models of the voices of caregivers and patients authorized to control the bed 30 by voice. Thus, the digital models are stored in the memory of the circuitry 80 or the memory 38 of the bed controller 34 before receiving voice inputs 70, 72 from the patient and the caregiver. In some embodiments, the controller 34 and / or the circuitry 80 of the bed 30 receive digital models of voices from a remote computer. In other embodiments, authorized caregivers and patients use the microphone 48 of the bed 30 to record voice samples to create digital models. Thus, the VR / NLP software can implement training routines to create the digital models required for authorized voices.

[0134] Based on the above, it should be understood that the present disclosure contemplates an application that runs on a computer (e.g., the VCA computer of network 60 or the in-bed computer 54 of bed 30, circuit 80) or a mobile device (e.g., mobile phones 22, 22') and records the voice of each caregiver and in some embodiments the voice of one or more patients. The voice model is transmitted to a medical device such as bed 30 or to a server (e.g., the VCA computer) for voice biometrics. In some embodiments, the application runs on mobile devices 22, 22' and updates the voice profile / digital model daily to improve the accuracy of the digital model. In this regard, referring to Figure 7 , the figure shows a flowchart of algorithm 200. Algorithm 200 begins at block 202, where a caregiver uses an application on mobile phone 22 to create a voice model. Thereafter, as indicated at block 204, the application pushes the voice model and the caregiver ID to one or more medical devices (e.g., one or more beds 30). Thereafter, as indicated at block 206, when the caregiver uses mobile device 22, the application on mobile device 22 updates the voice profile daily, thereby improving the accuracy of the voice model.

[0135] The present disclosure further contemplates that a caregiver can use a combination of voice input and touchscreen input to operate the various features of bed 30, thereby making the bed features easier to use while maintaining safe operation. That is, even if a caregiver is authorized to provide voice input for controlling bed 30, the caregiver can still use the manual input of bed 30, including touchscreen display input, to control the various bed functions.

[0136] To give an example of the caregiver voice control of the bed 30 envisioned by the present disclosure, a caregiver can say: "hey Centrella, weigh patient". In this example, Centrella is the model name of the bed, but other bed names or medical device names can also be appropriately used. In response to the stated voice input, the Centrella bed 30 displays the current patient weight and requests that the caregiver accept the weight to be stored in the memory 38 of the bed 30 and, in some embodiments, send it to the patient's electronic medical record stored in the database of the EMR computer. If the bed 30 detects a problem, such as a significantly different patient weight, it gives the caregiver an audible feedback - "patient weight is more than x pounds different than the last stored weight. Please check for items added to the bed and make sure the bed has been properly zeroed". If no problem is detected, the bed plays an audio message through the speaker unit 48 stating "weight successfully stored" or some similar such confirmation message.

[0137] While the above description envisions using voice recognition (e.g., using voice biometrics) to determine whether a caregiver and / or patient is authorized for voice control of a medical device, the present disclosure also envisions other ways to determine voice control authorization as a supplement or alternative to using voice recognition. Thus, the present disclosure envisions the following options, either alone or in any combination, to determine an authorized user for voice control of a medical device: (i) RTLS associates the caregiver with the bed and enables the use of voice commands; (ii) PIN input on a screen (e.g., the touchscreen of the mobile phones 22, 22' or the touchscreen of the bed 30); and (iii) voice biometrics. Regarding the combination of these voice, RTLS, PIN authorization methods, the authorization or access options can vary and are automatically applied based on the risk prediction or risk level of the operation. That is, riskier operations may require meeting two or three authorization methods before use, while less risky operations may only require meeting one authorization method before use.

[0138] Now referring to Figure 8, the figure shows a method 210 that requires different levels of authorization according to the medical device functions to be implemented. As indicated in block 212, method 210 begins in response to a caregiver wearing an RTLS tag 25 entering the ward. At block 214, the RTLS sends a message to the bed 30 to notify the bed 30 that an authorized caregiver is in the room. Then, as indicated in block 216, the caregiver gives a voice command to the bed 30, which, in the illustrative example, states "hey bed name weigh patient". Of course, in this example, "bed name" is replaced with the actual model name of the bed in practice. As indicated in block 218, after determining that the user of the input voice command is a valid user (e.g., an authorized user) by using voice biometrics and after weighing the patient, the software of the bed 30 determines that weighing the patient is a low-risk function and displays the weight of the current patient.

[0139] After weighing the patient and displaying the weight at block 218, method 210 proceeds to block 220, where the bed 30 asks (e.g., plays an audio message through the speaker unit 48) the caregiver whether the caregiver wants to record the patient's weight. If, as indicated in block 222, the caregiver responds "yes", then, as indicated in block 224, the software of the bed 30 determines that recording the weight is a high-risk task that requires further authentication of the caregiver. Thereafter, as indicated in block 226, the bed 30 obtains and checks the data received from the RTLS system to authenticate the caregiver or user. After authenticating the caregiver at block 226, the bed 30 sends the patient's weight to the EMR system for recording. As Figure 8 indicated by the bottom note 229, if the RTLS is unavailable (e.g., omitted from the corresponding system 20 or, although present, offline for any reason), the bed 30 prompts the caregiver or user to enter a PIN.

[0140] In view of the above, the voice control system 20 for a medical institution includes a hospital bed 30 that has a weighing scale for weighing a patient supported on the hospital bed and has a display screen for displaying the patient's weight. The voice control system 20 further includes a voice recorder configured to record the voices of a plurality of caregivers in a digital model and a server to which the digital model is transferred to determine the voice biometrics of each caregiver. The hospital bed 30 is configured to receive a voice input from a first caregiver among the plurality of caregivers, the voice input instructing the hospital bed 30 to weigh the patient. The hospital bed is configured to communicate with the server to confirm that the caregiver is authorized to control the hospital bed 30 based on voice biometrics. After confirming that the first caregiver is authorized to control the hospital bed 30, the patient is weighed by the weighing scale and the patient's weight is displayed on the display screen.

[0141] In some embodiments, the voice recorder is included in a computer. Alternatively or additionally, the voice recorder is included in the mobile phone 22. Optionally, the caregiver identification (ID) along with the digital model of each caregiver among a plurality of caregivers is transmitted to the server by the voice recorder. In some embodiments, the hospital bed 30 is configured to receive a zero-scale voice input from a first caregiver, the voice input instructing the hospital bed 30 to zero the weighing scale by measuring the weight using the weighing scale when the patient is not on the hospital bed 30. In this regard, the hospital bed 30 is configured to communicate with the server to confirm, based on voice biometrics, that the caregiver is authorized to control the hospital bed 30 via the zero-scale voice input. After confirming that the first caregiver is authorized to control the hospital bed 30, the hospital bed 30 zeros the weighing scale.

[0142] In some embodiments, the hospital bed 30 is configured to display an accept button on the display screen for the first caregiver to select to accept the displayed patient weight for storage in one or both of the memory 38 of the hospital bed 30 and the electronic medical record of the patient. If the displayed weight accepted by the first caregiver differs from the previously accepted patient weight by a threshold amount, the hospital bed 30 may display a message on the display screen that instructs the first caregiver to check to determine whether the weighing scale of the hospital bed 30 has been properly zeroed. If the hospital bed 30 does not detect a problem, the hospital bed displays a message on the display screen indicating that the patient weight has been successfully stored in one or both of the memory of the hospital bed and the electronic medical record of the patient.

[0143] In some embodiments, the voice control system 20 further includes a real-time location system (RTLS) that determines the locations of the plurality of caregivers in the medical institution. The server uses the information from the RTLS in addition to voice biometrics to confirm that the first caregiver is authorized to control the hospital bed 30 via voice input. Optionally, the hospital bed 30 is configured to display a personal identification number (PIN) screen on the display screen for the first caregiver to enter the PIN, and the server uses the PIN in addition to voice biometrics to confirm that the first caregiver is authorized to control the hospital bed 30 via voice input. In addition to using voice biometrics and using the PIN to determine that the first caregiver is authorized, information from the RTLS may also be used complementarily or alternatively. In some embodiments, the hospital bed 30 is configured to display a voice input button on the display screen, and the voice input button is available for the first caregiver to select to enable the hospital bed 30 to receive voice input.

[0144] As the present disclosure also contemplates, a voice control system 20 for a medical institution includes medical devices for caring for patients and a mobile device 22 including a voice recorder configured to record a digital model of a caregiver's voice. The digital model is transferred from the mobile device 22 to the medical devices. The medical devices are configured to determine a caregiver's voice biometrics based on the digital model. The medical devices are further configured to receive a voice input from the caregiver, the voice input instructing the medical devices to perform a function. The medical devices are configured to confirm that the caregiver is authorized to control the medical devices via the voice input based on the voice biometrics. After confirming that the caregiver is authorized to control the medical devices, the function is performed by the medical devices.

[0145] In some embodiments, a caregiver identification (ID) of the caregiver is transferred from the mobile device 22 to the medical devices together with the digital model of the caregiver's voice. In some embodiments, the medical devices are configured to display an acceptance button on a display screen for the caregiver to select to accept the displayed patient information for storage in one or both of the memory of the medical devices and the electronic medical record of the patient. If the medical devices do not detect a problem, the medical devices display a message on the display screen indicating that the patient information has been successfully stored in one or both of the memory of the medical devices and the electronic medical record of the patient.

[0146] The present disclosure contemplates that, in some embodiments, the voice control system 20 further includes a real-time location system (RTLS) that determines the location of the caregiver within the medical institution. The medical devices use information from the RTLS in addition to the voice biometrics to confirm that the caregiver is authorized to control the medical devices via the voice input. Alternatively or additionally, the medical devices are configured to display a personal identification number (PIN) screen on the display screen for the caregiver to enter the PIN, and the medical devices use the PIN in addition to the voice biometrics to confirm that a first caregiver is authorized to control the medical devices via the voice input. In addition to using the voice biometrics and the PIN to determine that the first caregiver is authorized, information from the RTLS may be used additionally or alternatively. In some embodiments, the medical devices are configured to display a voice input button on the display screen, the voice input button being available for the caregiver to select to enable the medical devices to receive voice input.

[0147] According to the present disclosure, a voice control system 20 for a healthcare facility includes a hospital bed 30 having a weighing scale for weighing a patient supported on the bed and a display screen for displaying the patient's weight. A Real-Time Location System (RTLS) is provided to track the positions of multiple caregivers within the healthcare facility. The RTLS is configured to send a message to the hospital bed 30 notifying the hospital bed 30 that a first caregiver has entered the room where the hospital bed is located. The hospital bed 30 is configured to receive a voice input from the first caregiver, the voice input instructing the hospital bed 30 to weigh the patient. Additionally, the hospital bed 30 is configured to confirm that the first caregiver is authorized to control the hospital bed 30 via voice input based on the voice biometrics of the first caregiver stored in the memory 38 of the hospital bed 30. After confirming that the first caregiver is authorized to control the hospital bed, the patient is weighed using the weighing scale and the patient's weight is displayed on the display screen.

[0148] In some embodiments, the hospital bed 30 is configured to play an audio message asking the first caregiver if they want to record the displayed patient weight for storage in the patient's electronic medical record. In response to the first caregiver making an affirmative response to the audio message in an audible manner, the hospital bed 30 communicates with the RTLS to re-confirm that the first caregiver is authorized to record the patient weight for storage in the patient's electronic medical record. After the RTLS in the third aspect re-confirms that the first caregiver is authorized, the patient weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0149] Optionally, the hospital bed 30 is configured to display a record button on the display screen for the first caregiver to select to record the displayed patient weight for storage in the patient's electronic medical record. In response to the first caregiver selecting the record button, the hospital bed 30 communicates with the RTLS to re-confirm that the first caregiver is authorized to record the patient weight for storage in the patient's electronic medical record. After the RTLS re-confirms that the first caregiver is authorized, the patient weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0150] In some embodiments, in response to the first caregiver making an affirmative response to the audio message in an audible manner, the hospital bed 30 displays a Personal Identification Number (PIN) screen on the display screen for the first caregiver to enter the PIN, and the hospital bed 30 uses the PIN to re-confirm that the first caregiver is authorized to record the patient weight for storage in the patient's electronic medical record. After the hospital bed in the third aspect re-confirms that the first caregiver is authorized based on the PIN, the patient weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0151] Alternatively, in response to a selection of a record button by a first caregiver, the hospital bed 30 displays a personal identification number (PIN) screen on the display for the first caregiver to enter the PIN, and the hospital bed 30 reconfirms with the PIN that the first caregiver is authorized to record the patient's weight for storage in the patient's electronic medical record. In such an alternative embodiment, after the hospital bed 30 reconfirms with the PIN that the first caregiver is authorized, the patient's weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0152] Reference is now made to Figure 5 for a schematic diagram of a fifth voice control system 20-5 similar to Figure 2 the system 20-2. Figure 5 The system 20-5 uses reference numerals common to aspects of the systems 20-1, 20-2, 20-3, 20-4 in Figures 1 to 4 and their description will not be repeated but is equally applicable. In the system 20-5, the speaker unit 56 receives voice inputs 58, 59 from the caregiver and the patient respectively to control environmental and entertainment devices within the ward. In an illustrative example of the system 20-5, the entertainment devices include the speaker unit 56 itself and a television (TV) 84 together with a TV remote control 86 which, in some embodiments, has a microphone for receiving voice inputs. Figure 5 The environmental devices of the system 20-5 depicted in

[0153] The speaker unit 56 converts voice inputs 58, 59 from the caregiver and the patient for controlling one or more devices 84, 86, 88, 90, 92 and / or similar devices into voice control messages such as audio files and transmits them from the speaker unit 56 to the network 60 via the wireless communication link 62. The VCA computer of the network 60 operates CSP speech recognition software to confirm that the caregiver and / or the patient is authorized to control one or more corresponding devices 84, 86, 88, 90, 92 or similar devices by voice control. If the voice control authorization is confirmed, the VCA computer transmits a command message back to the speaker unit 56 via the wireless communication link 62, either alone or in cooperation with another computer. The speaker unit 56 then wirelessly distributes the command message via the corresponding wireless link 94 to one or more specific devices 84, 86, 88, 90, 92 or similar devices to be controlled. In some embodiments, feedback regarding one or more devices 84, 86, 88, 90, 92 being controlled is communicated to the speaker unit 56 via the corresponding wireless link 94 for forwarding to one or more computers of the network 60.

[0154] The present disclosure also contemplates that the speaker unit 56 serves as one of the entertainment devices within the ward. For example, the speaker unit 56 is configured to generally play audio of logbooks, voice-based games, and quizzes in response to the voice input 59 from the patient, although this does not exclude the possibility that such entertainment functions can be initiated by the caregiver in certain situations. Thus, the speaker unit 56 serves a dual function, as a gateway for voice commands 58, 59 to the network 60, command messages from the network 60 to the devices 84, 86, 88, 90, 92, and feedback messages from the devices 84, 86, 88, 90, 92, and is itself an entertainment device. Additionally, it should be understood that in addition to controlling medical devices, including the hospital bed 30 described above in connection with the systems 20-1, 20-2, 20-3, 20-4 respectively Figures 1 to 4 it is also possible to implement the use of the speaker unit 56 to control entertainment and environmental devices 84, 86, 88, 90, 92 as described in connection with the system 20-5.

[0155] Based on the above, the present disclosure contemplates a voice control system 20-5 for a ward environment. The system 20-5 includes: environmental devices 88, 90, 92 operable to control the ward environment, entertainment devices 56, 84, 86 operable to provide entertainment to patients within the ward, and a microphone (e.g., the microphone of the speaker unit 56) located within the ward and configured to receive voice control commands from the patient for controlling the environmental devices 88, 90, 92 and the entertainment devices 56, 84, 86. The system 20-5 further includes a remote computer (e.g., the VCA computer of the network 60) communicatively coupled to the microphone and having voice recognition software. The remote computer is configured to process the voice control commands and send control messages to control the operation of the environmental devices 88, 90, 92 and the entertainment devices 56, 84, 86.

[0156] In some embodiments, the environmental devices include one or more of the following: motorized blinds 88, motorized curtains (also schematically labeled with the reference numeral 88), room lights 90, reading lights (also schematically labeled with the reference numeral 90), or a thermostat 92. The entertainment devices include a television 84. Alternatively or additionally, the entertainment devices include a speaker unit 56 configured to play the audio of books, voice-based games, and quizzes. Optionally, the microphone of the system 20-5 is included in the speaker unit 56. Further optionally, the system 20-5 further includes a hospital bed 30 configured to support the patient, and the speaker unit 56 is included in the hospital bed 30.

[0157] If desired, the entertainment devices of the system 20-5 include a second entertainment device (e.g., a remote control 86) separated from the speaker unit 56, and control messages for controlling the operation of the environmental device (e.g., the TV 84) and the second entertainment device (e.g., the remote control 86) are routed through the speaker unit 56 to the environmental device 84 and the second entertainment device 86. The present disclosure contemplates that the control messages are received by the speaker unit 56 as wireless control messages. Alternatively or additionally, the control messages sent from the speaker unit 56 to the environmental device 84 and the second entertainment device 86 are wirelessly transmitted.

[0158] Now referring to Figure 6 , schematic diagrams of a sixth voice control system 20-6 are provided that are respectively similar to the systems 20-1, 20-2, 20-3, 20-4, 20-5 of Figures 1 to 5 . Figure 6 The systems 20-1, 20-2, 20-3, 20-4, 20-5 use reference numerals in the aspects of the system 20-6 that are common with Figures 1 to 5 , and their descriptions will not be repeated but are equally applicable. Figure 5 The system 20-5 of Figure 6The main difference between the systems 20-6 is that an Internet of Things (IoT) hub 96 is provided. In some embodiments, the IoT hub 96 is a separate hub that is separated from a medical device such as the bed 30. In other embodiments, the IoT hub 96 is included in a medical device such as the bed 30. In some embodiments, the IoT hub 96 is an Insteon hub available from SmartLabs, Inc. of Irvine, California. In Figure 6 not shown Figure 5 the motorized blinds or curtains 88, but in some embodiments, they belong to the environmental devices of the system 20-6.

[0159] The IoT hub 96 allows for the provision of an agnostic microphone array within the ward by using various different devices (e.g., the bed 30, speaker units 56 such as ECHO devices or HOME devices). The IoT hub 96 also allows the system 20-6 to be agnostic as to which speech recognition (VR) and / or natural language processing (NLP) services will be used and agnostic as to which television brand will be controlled via voice. In one example of the system 20-6, the ECHO device 56 and the AWS cloud stack provide a voice-based nurse call system for VR and machine learning (ML). Thus, the present disclosure contemplates that, depending on the type of device to be controlled, the IoT hub 96 in the bed 30 or in the ward provides, as needed, to direct the processing of voice input to the local network 60 (e.g., local edge computing) or an external network (e.g., an external mesh network). In Figure 6 not shown is the external network that communicates with the IoT hub 96.

[0160] If the voice control inputs 70, 72 cannot be locally processed by the network 60, the IoT hub 96 is used to communicate with the external network to obtain the command messages needed to control the devices 56, 84, 86, 88, 90, 92 within the room. Thus, after the external network responds with the control messages needed to control a particular device 56, 84, 86, 88, 90, 92 based on the voice inputs 70, 72, the IoT hub 96 communicates the wireless command messages 98 to the devices 56, 84, 86, 88, 90, 92 as needed. The architecture of the system 20-6 allows for flexibility for system designers to decide where to complete the processing of voice input for the various medical devices, entertainment devices, and environmental devices within the various wards (i.e., internally within the network 60 or externally via the IoT hub 96).

[0161] Also as Figure 6As shown, the caregiver can provide voice input 100 and touch input 102 to mobile phone 22 to control medical devices in the ward, such as bed 30 and other devices 56, 84, 86, 88, 90, 92. Similarly, the patient can provide voice input 100' and touch input 102' to mobile phone 22' to control medical devices in the ward, such as bed 30 and other devices 56, 84, 86, 88, 90, 92. In Figure 6 In the illustrative example of system 20-6 in, mobile phones 22, 22' communicate with network 60 without involving the WAM 26 of bed 30. For example, in some embodiments, mobile phones 22, 22' communicate with a wireless access point (WAP) of network 60. Then, depending on the device to be controlled by the touch input, the WAP forwards voice input 100, 100' to the VCA computer and forwards touch input 102, 102' to other computers.

[0162] If the IoT hub 96 needs to process any of the inputs 100, 100', 102, 102', the signals corresponding to the inputs 100, 100', 102, 102' are provided by network 60 to speaker unit 56 via wireless communication link 62, and then speaker unit 56 in turn communicates inputs 100, 100', 102, 102' to IoT hub 96 via embedded link 106 or wireless link 108. Command messages for controlling medical devices such as bed 30 are sent from network 60 to the medical device via wireless communication link 76, or routed back from IoT hub 96 to network 60 (e.g., via one of links 106, 108 to speaker unit 56 and then via the wireless communication link 62 between speaker unit 56 and network 60) for delivery to the medical device via wireless communication link 76.

[0163] In embodiments where the IoT hub 96 is included in a medical device such as hospital bed 30, each such medical device with IoT hub 96 acts as a communication and computing node in the healthcare facility's network 60. Thus, the computing required to process voice input as well as video input, sensor input, and / or text input can be localized to the ward or distributed among other network nodes (internal or external or both). If the computing is localized to the ward, edge networks and cloud-based computing infrastructure can be avoided.

[0164] Based on the above, the present disclosure contemplates a voice control system 20-6 for a ward environment. The system 20-6 includes: environmental devices 88, 90, 92 operable to control the ward environment; entertainment devices 56, 84, 86 operable to provide entertainment to a patient within the ward; and a microphone (e.g., the microphone of the speaker unit 56, the microphone 48 of the bed 30, and the microphone of the mobile phone 22') located within the ward and configured to receive voice control commands from the patient for controlling the environmental devices 88, 90, 92 and the entertainment devices 56, 84, 86. The system 20-6 further includes an Internet of Things (IoT) hub 96 communicatively coupled to the microphone. The microphone of the system 20-6 is configured to transmit the voice control commands to the IoT hub 96 (e.g., via other components and equipment of the system 20-6), and the IoT hub 96 is configured to transmit control messages 98 to control the operation of the environmental devices 88, 90, 92 and the entertainment devices 56, 84, 86.

[0165] In some embodiments of the system 20-6, the environmental devices include one or more of the following: electric blinds 88, electric curtains (also labeled with reference numeral 88), indoor lights 90, reading lights (also labeled with reference numeral 90), or a thermostat 92. The entertainment devices of the system 20-6 include a television 84. Alternatively or additionally, the entertainment devices of the system 20-6 include a speaker unit 56 configured to play the audio of a logbook, voice-based games, and quizzes. Optionally, the microphone of the system 20-6 is included in the speaker unit 56. Further optionally, the system 20-6 further includes a hospital bed 30 configured to support the patient, and the speaker unit 56 is included in the hospital bed 30.

[0166] If desired, the entertainment devices of the system 20-6 include a second entertainment device (e.g., a remote control 86) separated from the speaker unit 56, and the control messages 98 from the IoT hub 96 for controlling the operation of the environmental devices 88, 90, 92 and the second entertainment device 86 are routed to the environmental devices 88, 90, 92 and the second entertainment device 86 via the speaker unit 56. The present disclosure contemplates that at least some of the control messages of the system 20-6 can be received by the speaker unit 56 from the IoT hub 96 as wireless control messages 108. Alternatively or additionally, the control messages 94 of the system 20-6 sent from the speaker unit 56 to the environmental devices 88, 90, 92 and the second entertainment device 86 are wirelessly transmitted.

[0167] In some embodiments, system 20-6 further includes second environmental devices 88, 90, 92, second entertainment devices 56, 84, 86, and a remote computer communicatively coupled to the microphone and having speech recognition software (e.g., the VCA computer of network 60 or a computer of an external network coupled to IoT hub 96). The remote computer is configured to process voice control commands and send second control messages to control the operation of second environmental devices 88, 90, 92 and second entertainment devices 56, 84, 86. Optionally, the second control messages are transmitted to second environmental devices 88, 90, 92 and second entertainment devices 56, 84, 86 without involving IoT hub 96. Further optionally, system 20-6 includes speaker unit 56, the microphone is included in speaker unit 56, and the second control messages are transmitted through speaker unit 56 to second environmental devices 88, 90, 92 and second entertainment devices 56, 84, 86.

[0168] As Figures 1 to 6 shown, systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6 include various wireless communication links 24, 28, 28’, 52, 62, 64, 76, 94, 98, 104, 104’, 106, 108 between components of the respective systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6. The wireless communication technology for wireless communication links 24, 28, 28’, 52, 62, 64, 76, 94, 98, 104, 104’, 106, 108 is at the discretion of the system designer. However, examples of wireless communication technologies that may be employed in systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6 include: Bluetooth (BT), such as Bluetooth Low Energy (BLE); WiFi (e.g., according to any of the IEEE 802.11x protocols); Ultra-Wideband (UWB); Zigbee; Z-wave; 6LoWPAN; Thread; WiFi-ah (HaLow); 2G (GSM); 3G; 4G; 5G; LTE Cat 0, 1 & 3; LTE-M1; NB-IoT; RFID; SigFox; LoRaWAN; Ingenu; Weightless-N; Weightless-P; Weightless-W; ANT & ANT+; DigiMesh; MiWi; EnOcean; Dash7; and WirelessHART, to name a few.

[0169] Regarding some functions of medical devices of systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6, for corresponding patients regarding a care protocol for tracking and recording compliance, it is desired to record information regarding compliance with a care protocol (e.g., fall prevention protocol, safe skin protocol, sepsis care protocol, lung clearance protocol, etc.) in the EMR system. The care protocol documentation is just another task that increases the workload of the caregiver but is not directly related to patient care. For example, in many medical-surgical (Med-Surg) units of a healthcare facility, a caregiver may be required to record every two hours that they have followed the fall prevention procedure. The caregiver may be required to record some things directly related to bed 30 and some things not related to it. For example, the caregiver may be required to record the following: two, three, or four side rails up (e.g., the side rails are in the raised position), the bed lowered (e.g., the lift of bed 30 supports the upper frame of bed 30 at a lower position relative to the base frame of bed 30), the brakes set (e.g., braking one or more casters of the bed), the out-of-bed alert activated (e.g., turning on the out-of-bed system of the hospital bed 30 to monitor the patient's position relative to the bed and sounding an alarm if the patient moves to a position indicating out of bed or moves towards out of bed 30 by a threshold amount), the patient accessible nurse call pendant (also known as a "bedside speaker"), and the passage from bed 30 to the ward bathroom is unobstructed.

[0170] The present disclosure contemplates that bed 30 is equipped with a speaker and microphone unit 48, and systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6 include SCP software, VR software, etc. for processing voice input on bed 30 or on one or more remote computers on network 60, so it is possible to record protocol compliance into the EMR system. In some embodiments of system 20, as a supplement or alternative to voice input to the microphone and speaker unit 48 of the bed, voice input for EMR recording may also be accomplished via voice input to the caregiver's mobile phone 22 or speaker unit 56.

[0171] According to an example workflow for recording protocol compliance into the EMR system, where bed 30 is available from Hill-Rom Company The bed, the caregiver enters the ward with the bed 30 and says the following voice input "Centrella, perform fall prevention check". In response to this voice input, the bed 30 checks and confirms that the bed is in a safe state for a patient at risk of falling - the side rails are up, the bed is lowered, the brakes are set, and the out-of-bed alarm is activated for vigilance. If the bed 30 is not in a safe state, the bed prompts the caregiver to change the settings or position of the bed as needed. For example, the prompt is a text message on the graphical user interface (GUI) of the bed 30, a text message that appears on the caregiver's mobile phone 22 (e.g., in a pop-up window on the display of the phone 22), and / or an audible message played through the speaker unit 48 of the bed 30. If the bed 30 is in a safe state, the bed plays an audible message to, for example, tell the caregiver: "bed is in safe state for falls risk patient". Alternatively or additionally, a similar text message is displayed on the GUI of the bed 30 and / or the caregiver's mobile phone 22. Further alternatively or additionally, an audible message is played through the speaker of the caregiver's mobile phone 22.

[0172] After the bed controller 34 has confirmed that the bed 30 is in a safe state, the bed 30 plays an audible message through the speaker unit 48 of the bed 30 to ask the caregiver or the patient whether there is a nurse call pendant available (accessible) to the patient. Alternatively or additionally, in some embodiments, a text message asking whether the nurse call pendant is within the patient's reach is displayed on the GUI of the bed 30 and / or the caregiver's mobile phone 22 or even the patient's mobile phone 22'. If the answer to the inquiry about the availability of the nurse call pendant for the patient is "no", the bed 30 prompts the caregiver to correct the situation (e.g., move the nurse call pendant to be accessible to the patient) and confirm. The pendant availability prompt can be heard via the speaker unit 48 of the bed 30 or the caregiver's mobile phone 22, or the pendant availability prompt can be text, such as displayed on the GUI of the bed 30 or the caregiver's mobile phone 22.

[0173] After the caregiver confirms to the bed 30 that the nurse call pendant is available for the patient through a positive voice input to the microphone 48 of the bed 30 or the mobile phone 22 via the WAM 26 transmitted to the bed 30 or a positive manual input to the GUI of the bed 30 or the display screen of the mobile phone 22 via the WAM 26 transmitted to the bed 30, the bed 30 plays an audible message through the speaker unit 48 of the bed 30 to request the caregiver to confirm that the path around the bed 30 is unobstructed. Alternatively or additionally, a text message asking whether the path around the bed is unobstructed is displayed on the GUI of the bed 30 and / or the caregiver's mobile phone 22. If the answer to the inquiry about whether the path around the bed 30 is unobstructed for the patient is "no", the bed 30 prompts the caregiver to correct the situation (e.g., clear the path around the bed 30 for the patient, especially the path from the bed 30 to the bathroom) and confirm. The unobstructed path prompt can be heard via the speaker unit 48 of the bed 30 or the caregiver's mobile phone 22, or the unobstructed path prompt can be text, such as displayed on the GUI of the bed 30 or the caregiver's mobile phone 22.

[0174] After the caregiver confirms to the bed 30 that the path around the bed 30 is unobstructed through a positive voice input to the microphone 48 of the bed 30 or the mobile phone 22 via the WAM 26 transmitted to the bed 30 or a positive manual input to the GUI of the bed 30 or the display screen of the mobile phone 22 via the WAM 26 transmitted to the bed 30, the bed 30 notifies the caregiver in an audible and / or text manner via the GUI of the bed 30, the speaker unit 48 on the bed 30, the speaker of the phone 22, and / or the display screen of the mobile phone 22 that the fall prevention check has been completed and compliance with the fall prevention protocol has been achieved, and asks the caregiver whether he / she is ready to record the compliance check into the EMR system (e.g., for storage in the database of the EMR computer). In response to the caregiver answering "yes" to the recording query, information about the fall prevention check is recorded from the bed 30 into the EMR system either audibly or via a manual input on the touch screen of the GUI of the bed 30 or the mobile phone 22. Thus, the present disclosure contemplates that the bed 30 has voice capabilities and can interact with the caregiver and the patient to ensure compliance with the care protocol and automatically record information about a successful care protocol check into the EMR system of a medical institution in response to the caregiver confirming that the respective care protocol has been followed.

[0175] Some operations on medical devices may inherently pose hazards to patients. For example, when the patient is in traction, any slat segment of the slats 42 of the articulated bed 30 may potentially cause harm to the patient. For a bed that requires manual input (such as pressing a button) to articulate the slat segments, at any point during the movement of the slat segments, the user can release the articulation button to stop the movement and potentially prevent harm to the patient. Similar hazards inherent in the bed 30 involve operating the lift of the bed 30 to lower the upper frame of the bed 30 relative to the base frame.

[0176] In an embodiment of a system 20 in which a bed 30 or other medical device with an inherent danger is operated by voice, it is desirable to include voice safety features for such medical products in the system 20. In particular, it is desirable to be able to utter a voice input to stop certain actions of the bed 30 or other medical device before any harm to the patient occurs. However, other functions of the bed 30 and medical devices that are not intended to be stopped should continue to operate normally. One way contemplated by the present disclosure to achieve this is to assume that when a caregiver issues a stop command, the caregiver is observing a potentially harmful action and the caregiver correctly realizes the potential harm that may occur if the function continues. In this regard, an embodiment of the system 20 is optionally configured with software that can infer where the caregiver's eyes are looking by determining the direction in which the caregiver's face and thus the caregiver's eyes are pointing when the caregiver is speaking via microphone beamforming.

[0177] A microphone array deployed in the product (e.g., the microphone 48 on the bed 30) and / or a microphone array around the room (e.g., the microphone of the speaker unit 56 or the microphone in the audio station of the nurse call system (see Figure 11 )) has outputs that allow a beamforming localization device (e.g., the VCA computer of the system 60) to translate and process the incoming voice information from the microphones and share with a device such as the bed 30 information as to whether it has been inferred that the caregiver is looking at the device, which includes whether the caregiver is looking at the operating, potentially patient-harming relevant part of the device.

[0178] It should be noted that the more the caregiver speaks, the more accurately the beamforming localization device can distinguish the caregiver's face and infer the direction in which the caregiver's eyes are pointing. Accordingly, this safety feature of the system 20 is most suitable for situations where the caregiver communicates frequently with the device, such that the direction of the caregiver's eyes is continuously updated on an ongoing basis, during which time the risk to the patient can be mitigated. Thus, the present disclosure contemplates that the system 20 is configured with at least one computer that is operable to infer the eye position based on the directionality of the caregiver's voice. This information is used by the system 20 in response to an oral stop command for mitigating any danger that may occur due to the operation of the medical product that the caregiver is looking at. In some embodiments, if a patient issues an audible stop command and the VCA computer or the bed controller 34 identifies that the voice input is from the patient, the movement of any medical device in the room that the patient is using is stopped, regardless of the patient's face / eye directionality.

[0179] In an embodiment of system 20 of a medical device related to an oral stop command, the bed functions to be stopped may include, for example: bed articulation (e.g., movement of the slat 42 section of the frame 40 of bed 30), bed-based therapies or mattress movement (such as percussion and vibration (P&V) therapy, continuous lateral rotation (CLRT) therapy, and turning assist function) typically performed by controlling the inflation and deflation of the mattress airbag, and movement of the upper bed relative to the base frame such as by raising, lowering, or tilting the upper bed. By using a microphone array to determine the directionality of the face / eyes related to the oral stop command of the caregiver, the movement of a patient lift (such as an overhead patient lift, a ceiling-mounted patient lift, a patient lift integrated into bed 30, etc.) for translating or transferring a patient to or from bed 30 and the movement of the operating table section can be stopped in a similar manner.

[0180] Thus, based on the above, the present disclosure contemplates a system 20 to mitigate risks to a patient in a medical environment. The system 20 includes a medical product (e.g., bed 30) having at least one function that may cause harm to a patient during operation. A circuit (e.g., bed controller 34) is carried by the medical product and includes a processor 36 and a memory 38 storing software. The system 20 also has a microphone array (e.g., microphone 48, the microphone in the speaker unit 56, the microphone in the audio station of the nurse call system, the microphone of other medical devices, and / or a standalone microphone in the ward) configured to receive voice input from a person near the medical product. The microphone array communicates with the circuit, and the software is configured to cooperate with the microphone array to use beamforming technology to infer the direction of the person's eye gaze based on the voice input. The circuit is configured to stop at least one function that may cause harm to a patient in response to the person uttering an audible stop command when it is inferred that the person's eyes are directed at the medical product.

[0181] In some embodiments, the medical product includes bed 30, and the microphone array 48 is mounted to bed 30. Optionally, bed 30 includes at least one side rail 46 movable between a raised position that prevents a patient from leaving the bed and a lowered position that releases the prevention of the patient from leaving the bed. At least one microphone 48 in the microphone array is mounted to at least one side rail.

[0182] If the medical product includes a hospital bed 30, some of the microphones in the microphone array can be mounted to one or both of the room walls or ceiling of the ward where the hospital bed 30 is located. For example, the microphone array can include a first microphone mounted to the medical product and a second microphone mounted to one of the room walls or ceiling of the ward where the medical product is located. Further optionally, the medical product can include a patient lift, and the microphone array can be mounted to one or both of the room walls and ceiling of the ward where the patient lift is located. If desired, the patient lift can include a mobile patient lift or an overhead patient lift.

[0183] In addition, if the medical product includes a hospital bed 30, at least one function can include one or more of the following: moving the mattress support section of the mattress support deck 42 of the hospital bed 30, moving the upper frame of the hospital bed relative to the base frame of the hospital bed 30, operating the percussion and vibration (P&V) treatment function of the mattress 44 of the hospital bed 30, operating the flip assist function of the mattress 44 of the hospital bed 30, or operating the continuous lateral rotation therapy (CLRT) function of the mattress 44 of the hospital bed 30. Further optionally, the medical product can include an operating table, and at least one function can include moving a first operating table portion relative to a second operating table portion.

[0184] In some embodiments, the microphone array of the system 20 wirelessly communicates with the circuit 34 of the medical product. Alternatively or additionally, the microphone array can communicate with the circuit 34 of the medical product in a wired manner. If desired, the system 20 can further include mobile phones 22, 22' that can be carried by a person. The mobile phones 22, 22' can be configured to receive voice commands from the person and transmit a command message corresponding to the voice command to the medical product to initiate the operation of at least one function. Alternatively or additionally, the system 20 can further include at least one computer (e.g., the VCA computer of the network 60) that can be remote from the medical product. The at least one computer can have clinical speech recognition software. The microphone array can communicate the voice commands received from the person to the at least one computer. The at least one computer can be configured to transmit a command message corresponding to the voice command to the medical product to initiate the operation of at least one function.

[0185] The present disclosure contemplates that the circuit 34 is configured to not respond to an audible stop command spoken by a person to stop at least one function that may cause harm to the patient when the person's eye pointing to the medical product is not inferred. If desired, the circuit 34 is configured to be trained to recognize the voice of the patient, and the circuit is configured to stop at least one function that may cause harm to the patient in response to an audible stop command spoken by the patient regardless of the patient's eye directionality. In such embodiments, the medical product can include a hospital bed 30 that supports the patient.

[0186] According to the present disclosure, system 20 is configured to allow voice input for a medical device such as bed 30 to associate the medical device with a location in a healthcare facility. In such a device-to-room association system 20, the medical device has a circuit (e.g., controller 34) that includes a processor 36, a memory 38, and a transmitter (e.g., one of the electrical components of controller 34 and / or WAM 26). The device-to-room association system 20 also has at least one microphone (e.g., microphone 48, the microphone of speaker unit 56, or some other microphone, such as those disclosed herein) communicatively coupled to circuit 34. Memory 38 stores software that is configured to receive voice input via the at least one microphone. The device-to-room association system 20 also includes a positioning system that includes at least one positioning computer (e.g., a computer of network 60) configured to store the device-to-room association. The circuit 34 of the medical device is configured to receive, via the at least one microphone, voice input from a person indicating a location identifier (ID) where the medical device is located. Circuit 34 is configured to store the location ID in the memory 38 of the medical device and transmit the location ID, along with the medical device ID, to the at least one positioning computer. The at least one positioning computer is configured to establish a first device-to-room association based on the medical device ID and the location ID transmitted from the medical device.

[0187] In some embodiments, at least one microphone 48 of the device-to-room association system 20 is carried by the medical device. Optionally, at least one microphone of the device-to-room association system 20 includes a microphone array carried by the medical device. Further optionally, at least one microphone of the device-to-room association system 20 is spaced apart from the medical device and mounted in place. For example, at least one microphone of the device-to-room association system 20 can include a microphone array that is spaced apart from the medical device and mounted in place. If desired, at least one microphone of the device-to-room association system 20 is configured to wirelessly communicate with the circuit of the medical device.

[0188] The present disclosure contemplates that at least one microphone of the device-to-room association system 20 includes a first microphone carried by the medical device and a second microphone spaced apart from the medical device. In some such embodiments of the device-to-room association system 20, the second microphone is configured to wirelessly communicate with the circuit of the medical device.

[0189] In some embodiments, the circuit 34 of the medical device of the device-room association system 20 further includes a display screen that displays the location ID after the circuit 34 receives the location ID via at least one microphone. Optionally, the circuit 34 of the medical device of the device-room association system 20 is configured to wirelessly transmit the location ID and the bed ID for reception by at least one positioning computer. Further optionally, at least one positioning computer stores the association between the patient and the location, and after receiving the medical device ID and the location ID, can establish the association between the device and the patient. In such embodiments, at least one positioning computer is configured to transmit the patient ID corresponding to the patient related to the association between the device and the patient to the medical device. If needed, the circuit 34 of the medical device of the device-room association system 20 includes a display screen, and the circuit 34 is configured to display the patient ID on the display screen.

[0190] The present disclosure further contemplates that if the voice input does not include a valid location ID, the circuit 34 of the medical device of the device-room association system 20 is configured to generate a query for additional information to a person. For example, the circuit 34 of the medical device of the device-room association system 20 further includes at least one speaker, and the query includes an audible message played through the at least one speaker. Alternatively or additionally, the circuit 34 of the medical device of the device-room association system 20 includes a display screen, and the query includes a text message displayed on the display screen.

[0191] In some embodiments of the device-room association system 20, the circuit of the medical device further includes a display screen, and the circuit 34 is configured to display a location menu of the valid location ID of the medical institution in response to an audible request from a person. In this regard, the circuit 34 of the medical device is configured to display menu levels related to location options, and the circuit is configured to allow a person to navigate through the menu levels audibly to reach the location menu.

[0192] Optionally, the circuit 34 of the medical device of the device-room association system 20 includes at least one speaker, and the circuit 34 is configured to play an audible confirmation message through the at least one speaker in response to the location ID included in the voice input being a valid location ID. Further optionally, the circuit 34 of the medical device of the device-room association system 20 is configured to receive a disassociation input from a person via at least one microphone indicating that the first device-room association should be cancelled. The circuit 34 is configured to transmit the disassociation input together with the medical device ID to at least one positioning computer. At least one positioning computer is configured to cancel the first device-room association based on the medical device ID and the disassociation input transmitted from the medical device.

[0193] Now refer to Figure 9, System 20-9 has two beds 30 in the ward. Thus, when a caregiver or a patient attempts to control one of the beds 30 in the room in an audible manner, it is desirable for System 20-9 to know which one of the beds 30 to control based on the voice input. In the illustrative example, one of the beds 30 is schematically labeled CENTRELLA A and the other bed 30 is schematically labeled CENTRELLA B. In Figure 9 System 20-9, there is shown for determining which one of a plurality of medical devices in the room (e.g., the bed 30 in the illustrative example) is to be controlled by voice. In particular, the caregiver uses a key phrase that includes a keyword (e.g., "hey") followed by a unique name (e.g., "bed name A") to indicate that bed A is to be controlled by the caregiver's voice rather than bed B. Thus, in the illustrative example, the speech bubble of the caregiver indicates that the caregiver has spoken the voice input: "HEY CENTRELLA A. SET BRAKE". System 20-9 responds by setting the brake of the bed 30 labeled CENTRELLA A and not setting the brake of the bed 30 labeled CENTRELLA B.

[0194] In Figure 9 , a graphical user interface (GUI) 110 is displayed on one of the side rails 46 of each bed 30.

[0195] Accordingly, based on the above, the present disclosure contemplates that a system 20-9 for voice control of medical devices in a room includes a first medical device and a second medical device. The first medical device has a first circuit 34 that includes a first processor 36, a first memory 38, and a first microphone 48. The second medical device has a second circuit 34 that includes a second processor 34, a second memory 36, and a second microphone 48. The first medical device and the second medical device of System 20-9 are close enough to each other such that a voice input spoken by a person is received by both the first microphone 48 and the second microphone 48. The first circuit 34 of the first medical device is configured to be enabled for voice control in response to a voice input including a first code phrase, and the second circuit 34 of the second medical device is configured to be enabled for voice control in response to a voice input including a second code phrase.

[0196] In some embodiments of system 20-9, the first code phrase and the second code phrase may each begin with a common code word. For example, the common code word may include the word "hey". Optionally, the first code phrase may include a first unique name corresponding to the first medical device and spoken immediately after the common code word. Similarly, the second code phrase may include a second unique name corresponding to the second medical device and spoken immediately after the common code word. In the case where the first medical device and the second medical device have the same model name, the first unique name may be in the format of "Model Name A" and the second unique name may be in the format of "Model Name B". Alternatively or additionally, in the case where the first medical device and the second medical device have the same model name, the first unique name may be in the format of "Model Name 1" and the second unique name may be in the format of "Model Name 2". In some embodiments of system 20-9, the specific unique names of the first medical device and the second medical device are stored in the memory 38 of the corresponding medical device and / or stored in a remote computer, such as the VCA computer of network 60.

[0197] After each of the first medical device and the second medical device in system 20-9 is enabled for voice control, the corresponding first circuit 34 and second circuit 34 are enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold period of time, such as from five seconds to one minute, merely giving a range of arbitrary threshold periods. After the threshold period has passed, in the case where at least one voice command is not received by the corresponding first medical device and second medical device, the corresponding first medical device and second medical device are disabled for voice control, such as until the microphone of system 20-9 receives another code phrase specifying a particular medical voice control. The present disclosure contemplates that in response to receiving a valid voice command during the threshold period, the threshold period is reset so that additional voice commands may be provided to the corresponding medical device if desired.

[0198] Now referring to Figure 10 FIG. 20-10 is shown, where the caregiver badge 25 is proximate to the medical device to be controlled by voice (e.g., the bed 30 in the illustrative example) for determining which medical device among the plurality of medical devices in the ward is the one to be controlled. Thus, Figure 10FIG. is a schematic diagram of a second way to determine which medical device among multiple medical devices in a room is to be controlled by voice. In system 20-10, a caregiver badge 25 worn by a caregiver transmits a near-field communication (NFC) signal, which is detected by a WAM 26 of a medical device (e.g., a hospital bed 30 in the illustrative example) when the caregiver approaches the medical device (e.g., within about three feet (1 meter) or closer). In response to the WAM 26 of the medical device detecting the NFC signal from the badge 25, the medical device is enabled for voice control by a controller 34. In the illustrative example, a speech bubble of the caregiver indicates that when the caregiver badge 35 approaches the WAM 26, the caregiver has spoken a voice input: "CENTRELLAMCM ON (CENTRELLA, turn on MCM)". MCM is an acronym for the microclimate management feature of the mattress 44 of the bed 30.

[0199] Based on the above, system 20-10 for enabling a medical device (e.g., bed 30) for voice control includes an identifier item carried by a caregiver and configured to transmit a wireless identification (ID) signal. System 20-10 also includes a medical device having a circuit 34 that includes a processor 36, a memory 38, a microphone 48, a transmitter (e.g., included in the WAM 26), and a proximity detector (e.g., also included in the WAM 26), the proximity detector being configured to receive a wireless ID signal from the identifier item 25 when the identifier item 25 is within a range of three feet (1 m) or closer to the medical device. System 20-10 further includes at least one voice control authorization (VCA) computer (e.g., the VCA computer of network 60) remote from the medical device and communicatively coupled to the medical device. In response to the proximity detector of the WAM 26 receiving the wireless ID signal, the circuit 34 transmits, via the transmitter of the WAM 26, the ID data included in the wireless ID signal for reception by the VCA computer. The VCA computer is configured to verify that the ID data corresponds to a caregiver authorized to control the medical device by voice input. If the caregiver authorization is verified by the VCA computer, the VCA computer is configured to transmit an authorization message to the medical device. In response to the circuit 34 of the medical device receiving the authorization message via the WAM 26, voice control of the medical device is enabled.

[0200] In some embodiments of system 20-10, the identifier item further includes a mobile phone 22 as a supplement to or in place of the caregiver badge 25. In some embodiments of system 20-10 where the identifier item is the caregiver badge 25, the identifier item is a radio frequency identification (RFID) badge. Further alternatively or additionally, the identifier item of system 20-10 may include a near-field communication (NFC) transponder that transmits a wireless ID signal in response to receiving electromagnetic energy transmitted by the WAM 26 of the circuit 34 of the medical device.

[0201] If desired, after enabling voice control of the medical device, the voice input received by microphone 48 of the circuit is transmitted via the transmitter of the circuit to the VCA computer. In this regard, the VCA computer of system 20-10 is configured to determine that the voice input corresponds to at least one valid control command among a plurality of valid control commands for the medical device. If the voice input corresponds to a valid control command among the plurality of valid control commands, the VCA computer is configured to transmit a device control message to the medical device. In response to the device control message being received by circuit 34 of the medical device, the medical device performs a function corresponding to the device control message.

[0202] Optionally, after enabling voice control of the medical device of system 20-10, circuit 34 is enabled to receive voice commands to control the functions of the medical device for a threshold period of time, such as from five seconds to one minute, merely giving a range of any threshold period. After the threshold period has elapsed, in the case where the medical device of system 20-10 does not receive at least one voice command, the medical device is disabled for voice control. The present disclosure contemplates that in response to receiving a valid voice command during the threshold period, the threshold period is reset so that additional voice commands can be provided to the corresponding medical device if desired. In other embodiments of system 20-10, circuit 34 can be enabled to receive voice commands to control the functions of the medical device as long as the identifier article remains within the communication range of the WAM 26 of the medical device.

[0203] Now referring to Figure 11 FIG. 20-11 shows a system in which the loudness of the voice input received at each of a plurality of microphones is used to determine which of a plurality of medical devices within a ward is the one to be controlled by voice. Thus, Figure 11 FIG. 20-12 shows a schematic diagram of a third way of determining which of a plurality of medical devices within a room is to be controlled by voice. In Figure 11 illustrative system 20-11, the hospital bed 30 has a microphone 48, the second medical device 112 has a microphone 114, and the third medical device 116 has a microphone 118. The second medical device 112 is shown as an IV pump in Figure 11 FIG. 20-13, but can also be a vital sign monitor, treatment equipment, etc. The third medical device 116 of illustrative system 20-11 is an audio station of a nurse call system. The audio station 116 is mounted to the room wall at a fixed position, while the bed 30 and the IV pump 112 are movable pieces of medical equipment that can be transported from one position to another within a medical institution. In other embodiments of system 20-11, one or more speaker units 56 can also be provided within the ward as a supplement to or in place of microphones 48, 114, 118.

[0204] Based on the above, a system 20-11 for enabling voice control of in-room medical devices 30, 112, 116 includes a first medical device (e.g., one of the devices 30, 112, 116) and a second medical device (e.g., another one of the devices 30, 112, 116). The first medical device has a first circuit 34 including a first processor 36, a first memory 38, and a first microphone (e.g., one of the microphones 48, 114, 118). The second medical device has a second circuit 34 including a second processor 36, a second memory 38, and a second microphone (e.g., the other one of the microphones 48, 114, 118). The first and second medical devices of the system 20-11 are close enough to each other such that a voice input spoken by a person is received by both the first microphone and the second microphone. The first circuit of the first medical device is configured to enable voice control in response to the voice input received by the first microphone being louder than the voice input received by the second microphone. The second circuit of the second medical device is configured to enable voice control in response to the voice input received by the second microphone being louder than the voice input received by the first microphone.

[0205] In some embodiments of the system 20-11, the first circuit is configured to transmit a first loudness value for reception by the second circuit, and the second circuit is configured to transmit a second loudness value for reception by the first circuit. The first medical device of the system 20-11 is configured to enable voice control in response to the first circuit determining that the first loudness value is greater than the second loudness value. Similarly, the second medical device of the system 20-11 is configured to enable voice control in response to the second circuit determining that the second loudness value is greater than the first loudness value.

[0206] In some embodiments, the system 20-11 further includes at least one voice control authorization (VCA) computer (e.g., the VCA computer of the network 60) that is remote from the first and second medical devices and communicatively coupled to the first and second medical devices. In such embodiments of the system 20-11, the first circuit is configured to transmit a first loudness value for reception by the at least one VCA computer, and the second circuit is configured to transmit a second loudness value for reception by the at least one VCA computer. The VCA computer is configured to transmit a first message that enables the first medical device for voice control to the first medical device in response to the VCA computer determining that the first loudness value is greater than the second loudness value. Similarly, the VCA computer is configured to transmit a second message that enables the second medical device for voice control to the second medical device in response to the VCA computer determining that the second loudness value is greater than the first loudness value.

[0207] Optionally, after each of the first and second medical devices in system 20-11 is enabled for voice control, the corresponding first circuit 34 and second circuit 34 are enabled to receive voice commands to control the functions of the corresponding first and second medical devices for a threshold time period, such as from five seconds to one minute, merely giving an example range of any threshold time period. After the threshold time period has elapsed, in the case where at least one voice command is not received by the corresponding first and second medical devices in system 20-11, the corresponding first and second medical devices are disabled for voice control. The present disclosure contemplates that in response to receiving a valid voice command during the threshold time period, the threshold time period is reset so that additional voice commands can be provided to the corresponding medical devices if desired.

[0208] In the illustrative example of system 20-11 above, each medical device 30, 112, 116 has its own microphone 48, 114, 118, respectively. However, this need not be the case in other embodiments. Thus, according to a variant embodiment of system 20-11, a microphone array is positioned within the ward, but each microphone in the array is spaced apart from the medical devices capable of being controlled by voice. Thus, the present disclosure contemplates that a variant embodiment of system 20-11 includes a first medical device and a second medical device, the first medical device having a first circuit 34 including a first processor 36 and a first memory 38, and the second medical device having a second circuit 34 including a second processor 36 and a second memory 38. The variant embodiment of system 20-11 also has a microphone array positioned within the room and spaced apart from the first and second medical devices.

[0209] In a variant embodiment of system 20-11, the microphone array includes a first microphone that is closer to the first medical device than to the second medical device and a second microphone that is closer to the second medical device than to the first medical device. However, the first and second medical devices and the first and second microphones in the variant embodiment of system 20-11 are close enough to each other so that a voice input spoken by a person is received by both the first microphone and the second microphone. The first circuit 34 of the first medical device in the variant embodiment of system 20-11 is configured to be enabled for voice control in response to a voice input received by the first microphone being louder than a voice input received by the second microphone. The second circuit of the second medical device in the variant embodiment of system 20-11 is configured to be enabled for voice control in response to a voice input received by the second microphone being louder than a voice input received by the first microphone.

[0210] In some embodiments of system 20-11, the first microphone is included in a first microphone circuit that is configured to transmit a first loudness value for receipt by a first circuit 34 of a first medical device and a second circuit 34 of a second medical device. The second microphone of such embodiments of system 20-11 is included in a second microphone circuit that is configured to transmit a second loudness value for receipt by the first circuit 34 of the first medical device and the second circuit 34 of the second medical device. A first medical device of a variant embodiment of system 20-11 is configured to be enabled for voice control in response to the first circuit 34 determining that the first loudness value is greater than the second loudness value. Similarly, a second medical device of a variant embodiment of system 20-11 is configured to be enabled for voice control in response to the second circuit 34 determining that the second loudness value is greater than the first loudness value.

[0211] If desired, a microphone array of a variant embodiment of system 20-11 includes a communication circuit coupled to the first microphone and the second microphone. The communication circuit is configured to determine a first loudness value based on a first loudness of a voice input received by the first microphone and to determine a second loudness value based on a second loudness of a voice input received by the second microphone. The communication circuit is configured to transmit the first loudness value and the second loudness value for receipt by the first circuit 34 of the first medical device and the second circuit 34 of the second medical device. A first medical device of a variant embodiment of system 20-11 is configured to be enabled for voice control in response to the first circuit 34 determining that the first loudness value is greater than the second loudness value. Similarly, a second medical device of a variant embodiment of system 20-11 is configured to be enabled for voice control in response to the second circuit 34 determining that the second loudness value is greater than the first loudness value.

[0212] Optionally, a variant embodiment of system 20-11 further includes at least one voice control authorization (VCA) computer remote from the first medical device and the second medical device and communicatively coupled to the first microphone and the second microphone in the microphone array. The VCA computer receives a first loudness value based on a first loudness of a voice input received by the first microphone and a second loudness value based on a second loudness of a voice input received by the second microphone. The VCA computer is configured to transmit a first message to the first medical device to enable the first medical device for voice control in response to the VCA computer determining that the first loudness value is greater than the second loudness value. Similarly, the VCA computer is configured to transmit a second message to the second medical device to enable the second medical device for voice control in response to the VCA computer determining that the second loudness value is greater than the first loudness value.

[0213] Further optionally, after each of the first and second medical devices in the variant embodiment of the system 20-11 is enabled for voice control, the corresponding first circuit 34 and second circuit 34 are enabled to receive voice commands to control the functions of the corresponding first and second medical devices for a threshold period of time, such as from five seconds to one minute, merely giving a range of an arbitrary threshold period. After the threshold period has passed, in the case where at least one voice command is not received by the corresponding first and second medical devices, the corresponding first and second medical devices in the variant embodiment of the system 20-11 are disabled for voice control. The present disclosure contemplates that in response to receiving a valid voice command during the threshold period, the threshold period may be reset so that additional voice commands may be provided to the corresponding medical device if desired.

[0214] Now referring to Figure 12 FIG. 20-12 is shown, in which a camera 120 provided on a medical device in a ward is used to determine which one of a plurality of medical devices in the ward is the one to be controlled by voice. Thus, Figure 12 FIG. shows a schematic diagram of a fourth way of determining which one of a plurality of medical devices in a room is to be controlled by voice. In Figure 12 the example of the system 20-12 of FIG., each of two hospital beds 30 is equipped with a corresponding camera 120. In the illustrative example, the camera 120 is attached to the footboard 54 of the bed 30. Alternatively or additionally, the camera 120 is provided at other positions on the bed 30, such as located on one or more side rails 46 or on the headboard of the bed 30. When a person provides a voice input to control the function of one of the beds 30, the circuit or controller 34 of each bed 30 processes the image captured by the corresponding camera 120 when the voice input is spoken to see if the person is looking at the camera 120.

[0215] In the illustrative example of the system 20-12, Figure 12 the speech bubble in FIG. indicates that the person has provided the voice input "CENTRELLA BED EXIT ON (CENTRELLA, open bed exit)" to turn on or enable the bed exit system of the bed in the foreground of FIG. The person is looking at the camera 120 of the bed 30 in the Figure 12 foreground rather than Figure 12 the camera 120 of the bed in the Figure 12Camera 120 of the bed 30 in the background. Thus, when a voice input is spoken, the camera 120 of the bed 30 in the foreground captures an image of the person's face, while the camera 120 of the bed 30 in the background captures an image without any person's face. The controller 34 of each bed 30 or a remote computer (such as the VCA computer of the network 60) processes the images captured by the corresponding camera 120 to determine whether the voice input is related to that particular bed. In the illustrative example, after the controller 34 determines or is notified that the captured image contains a person's face, the bed 30 of the system 20-12 in the foreground performs the voice input (e.g., enables the corresponding out-of-bed system).

[0216] Thus, based on the above, the present disclosure contemplates that the system 20-12 includes a first medical device (e.g., Figure 12 one of the beds 30) and a second medical device (e.g., Figure 12 another one of the beds 30), the first medical device having a first circuit 34 including a first processor 36, a first memory 38, a first microphone 48, and a first camera 120, and the second medical device having a second circuit 34 including a second processor 36, a second memory 38, a second microphone 48, and a second camera 120. The first circuit 34 of the first medical device of the system 20-12 is configured to enable voice control in response to the first processor 36 identifying a first person face image captured by the first camera 120. Similarly, the second circuit 34 of the second medical device of the system 20-12 is configured to enable voice control in response to the second processor 36 identifying a second person face image captured by the second camera 120.

[0217] In some embodiments of the system 20-12, the first camera 120 captures a first person image for processing by the processor 36 in response to the first microphone 48 receiving a voice command from a person, and the second camera 120 captures a second person image for processing by the processor 36 in response to the second microphone 48 receiving a voice command from a person. For example, the voice command can include any valid device control command among a plurality of valid device control commands.

[0218] Optionally, with respect to system 20-12, the first circuit 34 further includes a first display screen 110, and the second circuit 34 further includes a second display screen 110. If the first camera 120 and the second camera 120 both capture a corresponding first person face image and second person face image in response to a voice command, then both the first medical device 30 and the second medical device 30 are kept disabled for voice control, and the first display screen 110 and the second display screen 110 each display a notification message that advises the person to face only the first camera 120 or the second camera 120 of the corresponding first medical device 30 or second medical device 30 that the person wishes to control by voice. To determine that the cameras 120 of both beds 30 have captured a person face image, the beds 30 communicate appropriate messages with each other, such as via an in-room network, directly via the WAM 26 of the beds 30, or via the network 60. Alternatively or additionally, a remote computer of the network 60 sends a notification message to the beds 30 that indicates that both cameras 120 have captured a person face image, and thus it is not known which of the beds 30 is the one to be voice controlled by the person. To achieve this, each image captured by the cameras 120 is marked with a timestamp so that images captured simultaneously or within a short time threshold (e.g., shorter than one second) can be detected.

[0219] In some embodiments of system 20-12, the first medical device includes a first hospital bed 30 having a first patient departure barrier (e.g., a side rail 46 or a footboard 54) to which a first camera 120 is coupled, and the second medical device includes a second hospital bed 30 having a second patient departure barrier (e.g., a side rail 46 or a footboard 54) to which a second camera 120 is coupled. For example, the first patient departure barrier and the second patient departure barrier each include a corresponding first headboard and second headboard or a corresponding first footboard 54 and second footboard 54. Alternatively or additionally, the first patient departure barrier and the second patient departure barrier each include a corresponding first side rail 46 and second side rail 46. Optionally, the first circuit 34 further includes a first display screen 110 coupled to the first side rail 46, the second circuit further includes a second display screen 110 coupled to the second side rail 46, the first camera 120 is positioned adjacent to the first display screen 110, and the second camera 120 is positioned adjacent to the second display screen 110.

[0220] If desired, system 20-12 further includes at least one Voice Control Authorization (VCA) computer that is remote from and communicatively coupled to the first and second medical devices. In such embodiments, the first circuit 34 is configured to transmit the first image for receipt by at least one VCA computer, such as via the WAM 26 of the first medical device, and the second circuit 34 is configured to transmit the second image for receipt by at least one VCA computer, such as via the WAM 26 of the second medical device. The VCA computer of system 20-12 is configured to transmit a first message to the first medical device that enables the first medical device for voice control in response to the VCA computer determining, based on analysis of the first image, that a person is authorized to operate the first medical device by voice control. Similarly, the VCA computer is configured to transmit a second message to the second medical device that enables the second medical device for voice control in response to the VCA computer determining, based on analysis of the second image, that a person is authorized to operate the second medical device by voice control.

[0221] Optionally, after each of the first and second medical devices of system 20-12 is enabled for voice control, the respective first and second circuits 34 are enabled to receive voice commands to control the functions of the respective first and second medical devices for a threshold period of time, such as from five seconds to one minute, merely by way of example of a range of threshold periods of time. After the threshold period of time has elapsed, in the event that the respective first and second medical devices of system 20-12 do not receive at least one voice command, the respective first and second medical devices are disabled for voice control. The present disclosure contemplates that the threshold period of time may be reset in response to receipt of a valid voice command during the threshold period of time so that additional voice commands may be provided to the respective medical devices if desired.

[0222] Now referring to Figure 13 FIG. 20-13 is shown, where a caregiver presses a button 122 on a medical device (e.g., a button on one of the side rails of the hospital bed 30) to enable the medical device for voice control at the time the button 122 is pressed or within a threshold period of time after the button 122 is pressed (such as within five seconds to one minute). Thus, Figure 13 FIG. 20-14 is a schematic diagram showing a fifth way to determine which of a plurality of medical devices in a room is to be controlled by voice. Although Figure 13Only one medical device (illustrated as hospital bed 30) is shown, but it should be understood that the system 20-13 includes other medical devices within the ward, which also include buttons 122 for selection regarding inputting voice input to the corresponding medical device. Although pressing the button 122 on the medical device to enable voice control has the drawback of not being fully hands-free for controlling the medical device, it has the advantage that the user does not need to use the GUI 110 to navigate through complex screen menu hierarchies to achieve specific control of the device functions.

[0223] Based on the above, the present disclosure contemplates that the system 20-13 includes a medical device having a first circuit 34, and the first circuit 34 includes a processor 36, a memory 38, a button 122, and a microphone 48. The circuit 34 of the medical device of the system 20-13 is configured to be enabled for voice control in response to a person selecting the button 122 and then receiving a valid voice input via the microphone 48 within a threshold time period (such as within five seconds to one minute, just giving an arbitrary time threshold range).

[0224] In some embodiments of the system 20-13, the valid voice input includes a code word. For example, the code word may include a first unique name that corresponds to the medical device and is received by the microphone 48 within the threshold time period. Optionally, the unique name may include the model name of the medical device. If necessary, after the medical device of the system 20-13 is enabled for voice control due to receiving a code word during the threshold time period (e.g., the first threshold time period), the corresponding circuit 34 is enabled to receive voice commands to control the functions of the medical device for a second threshold time period, such as within five seconds to one minute, just giving an arbitrary time threshold range. After the second threshold time period has passed, in the case where the medical device does not receive at least one voice command, the medical device is disabled for voice control. The present disclosure contemplates that in response to receiving a valid voice command during the second threshold time period, the second threshold time period is reset so that additional voice commands can be provided to the corresponding medical device if needed.

[0225] In some embodiments of the system 20-13, the valid voice input includes any device control command among a plurality of device control commands. The present disclosure contemplates that if no valid voice input is received within the threshold time period, the medical device of the system 20-13 remains disabled for voice control.

[0226] Now refer to Figure 14 FIG. 20-14 is shown, where the caregiver has an IR indicator 126 that transmits an IR signal towards the IR receiver 124 of a specific medical device (e.g., hospital bed 30) to be voice-controlled. Thus, Figure 14A schematic diagram showing a sixth way to determine which medical device among multiple medical devices in a room is to be controlled by voice. In response to the receiver 124 receiving an IR signal from the IR indicator 126, the medical device is enabled for voice control for a threshold time period. In an illustrative example, the size and shape of the IR indicator 126 are designed to conform to a human finger. In other embodiments, the IR indicator 126 is configured to be mounted to the mobile phone 22, or in the shape of a writing pen or stylus, or in the shape of a keychain. Optionally, the IR indicator 126 is mounted to or included in the caregiver badge 25. A button is provided on the IR indicator 126, and pressing the button sends an IR signal from the IR indicator 126.

[0227] Based on the above, the system 20-14 includes a first medical device and a second medical device. The first medical device has a first circuit 34 including a first processor 36, a first memory 38, a first microphone 48, and a first infrared (IR) receiver 124. The second medical device has a second circuit 34 including a second processor 36, a second memory 38, a second microphone 48, and a second IR receiver 124. The system 20-14 further includes an IR indicator 126 having an IR transmitter. The first circuit 34 of the first medical device is configured to be enabled for voice control in response to the first IR receiver 124 receiving an IR signal from the IR transmitter of the IR indicator 126. The second circuit 34 of the second medical device is configured to be enabled for voice control in response to the second IR receiver 124 receiving an IR signal from the IR transmitter of the IR indicator 126.

[0228] In some embodiments of the system 20-14, the IR indicator 126 is configured to be worn on a person's finger. Alternatively or additionally, the IR indicator 126 can be mounted to the mobile phone 22. Further alternatively or additionally, the IR indicator 126 has the shape of a stylus. Still further alternatively or additionally, the IR indicator 126 has the shape of a keychain.

[0229] The present disclosure contemplates that a first medical device of system 20-14 includes a first hospital bed 30 having a first patient egress barrier (e.g., side rail 46 or footboard 54 or headboard) with a first IR receiver 124 coupled thereto, and a second medical device of system 20-14 includes a second hospital bed 30 having a second patient egress barrier with a second IR receiver 124 coupled thereto. For example, the first patient egress barrier and the second patient egress barrier each include a respective first headboard and second headboard or a respective first footboard and second footboard. Alternatively or additionally, the first patient egress barrier and the second patient egress barrier each include a respective first side rail 46 and second side rail 46. In such embodiments, the first circuit 34 further includes a first display screen 110 coupled to the first side rail 46, the second circuit 34 further includes a second display screen 110 coupled to the second side rail 46, the first IR receiver 124 is positioned adjacent the first display screen 110, and the second IR receiver 124 is positioned adjacent the second display screen 110.

[0230] If desired, after each of the first medical device and the second medical device of system 20-14 is enabled for voice control, the respective first circuit 34 and second circuit 34 are enabled to receive voice commands to control the functions of the respective first medical device and second medical device for a threshold time period, and after the threshold time period has elapsed, in the case where the respective first medical device and second medical device do not receive at least one voice command, the respective first medical device and second medical device are disabled for voice control. The present disclosure contemplates that the threshold time period may be reset in response to receiving a valid voice command during the threshold time period.

[0231] According to the present disclosure, far-field microphones are embedded in vital sign monitors, hospital beds, end wall interfaces, caregiver badges, location tags, disposable patient ID bracelets and / or clothing, and seats to form a ward microphone array. At least one remote computer combines the voice signals received from these devices. Beamforming software is used to amplify and / or identify the voice signals. Interrupt software is used to filter out constant ambient audio that may correspond to background noise. Automatic speech recognition software is used to determine code words or wake words (e.g., "Hey Hillrom", "Hey Centrella", "Hey Voalte", "Hey Navicare", to name a few). Additional processing such as through anaphora resolution, Markov models, speaker recognition / voice biometrics, composite command parsing, natural language processing algorithms is also used in some embodiments of system 20 according to the present disclosure.

[0232] The above-described feature combinations and / or some sub-combinations are included in embodiments of system 20. In this regard, the far-field microphones are dispersed throughout the ward. In some embodiments, the far-field microphones are microphone arrays that use their position in space to amplify and attenuate signals. With respect to suppressing ambient noise, the far-field microphone arrays use algorithms to help deliver a clear signal. The microphones can be embedded in bed-side electronics, vital-signs monitoring electronics, location / tracking tags, end-wall interfaces, graphic audio stations on the wall, ceiling fixtures, and / or hospital patient lifts, as determined by the system designers. In some embodiments, each microphone actually comprises a microphone array, such as a single piece of hardware including a plurality of individual microphones operating in series.

[0233] The present disclosure contemplates that electronics / computers / circuits located within the room and / or remotely have software that processes and enhances signals and determines what clinical action to take or what patient-requested action to take. The present disclosure further contemplates that the software includes speech recognition / ASR conversion from spoken to written text, code-word / wake-word recognition (e.g., Hey Centrella, Hey Navicare, Hey Voalte, Hey Nurse, Hey... etc.), so as to pick up the words following the code word or wake word. The software of system 20 is also configured to compare the voice commands with a database of acceptable hospital commands and words to see if something is being commanded; if something is being commanded, execute the command in the table; if nothing is being commanded, attempt to determine if this is a sign of patient or caregiver distress.

[0234] In some embodiments, distance processing is employed in system 20. For example, if the distance between microphones is known (e.g., the software knows the distance between the end-wall microphone and the graphic audio station microphone on the wall), the software uses this distance as a factor in determining what is being said / heard through the microphones. With respect to the interrupt technology used in system 20, the software determines what constant / environmental noise is present in the room (e.g., based on the time the signal is heard, its volume, its characteristics, its frequency, etc.). The interrupt software filters out the constant sounds to best capture the dictated commands. The beamforming software enables the microphones to amplify speech and reduce noise.

[0235] According to the present disclosure, the speaker recognition software of system 20 is used to determine who is speaking. This can be achieved through the characteristics of speech and a variety of techniques including Markov models, pattern recognition algorithms, neural networks, and voice biometrics. The software includes algorithms that perform the following functions: (i) verification, which aims to verify whether the speaker is who they claim to be, and (ii) identification, which includes the task of determining the identity of an unknown speaker. Markov model software involves a stochastic change system for predicting future states. Such software attempts to determine what the speaker is saying, what was said previously, the environment, the initial words, and what typically follows those words, etc. via context. Thus, the software in some embodiments of the present disclosure involves pattern recognition, artificial neural networks, natural language processing (NLP), and / or natural language understanding. In this regard, NLP software analyzes, understands, and derives meaning from what is said. Thus, NLP software can pick up and understand a large number of similar commands that are intended to represent the same thing and can convert them into a structured form to execute the single command being conveyed.

[0236] In some embodiments, the system 20 contemplated by the present disclosure also uses anaphora resolution software. Such software allows system 20 to recall what was said earlier and use that to infer the current intent. For example, if a patient says "turn on the TV" and later says "turn it up", the software can use this technique to know that it is the TV that the intent is to turn up the volume of. Some embodiments of system 20 are configured with the ability to recognize compound commands. For example, if a patient says "turn off the TV and call the nurse", the text is parsed to know that it actually means two commands - the turn off the TV command causes the TV to turn off, and the call the nurse command causes a nurse call signal to be placed on the nurse call line. Accordingly, the present disclosure contemplates that system 20 can act as a virtual assistant or chatbot capable of performing tasks for the patient. Thus, the above-mentioned medical device may include a voice user interface (VUI) for performing these functions.

[0237] Based on the above, Figure 15FIG. shows a flowchart of an algorithm 300 for controlling a medical device via voice input. Broadly speaking, the algorithm includes the following instructions: (i) combining voice inputs received from a person by a far-field microphone array in a room; (ii) using beamforming software to amplify and identify the voice inputs; (iii) using interrupt software to filter out ambient noise; (iv) executing speech recognition software to determine which of a plurality of medical devices is the designated medical device to be controlled via voice input; and (v) transmitting a control message to the designated medical device to control a first function of the designated medical device based on the voice input. The instructions of algorithm 300 are executed by one or more of the bed controller 34, the speaker unit 56, or the VCA computer of the network 60. Thus, not all parts of algorithm 300 need to be executed on a single computer device, but this possibility is not excluded in some embodiments of system 20.

[0238] Still referring to Figure 15 , algorithm 300 begins at block 302 where an array of far-field microphones (e.g., microphones 48, 56, 114, 118) receives sounds in the ward. Then, algorithm 300 uses distance processing to determine the nearest medical device or microphone that is picking up sound, as shown at block 304. Thereafter, algorithm 300 uses interrupt software to filter out ambient noise from the incoming voice signal, as shown at block 306. Next, algorithm 300 uses beamforming processing to amplify the speech in the signal corresponding to the detected sound, as shown at block 308. At block 310, algorithm 300 determines whether a wake word has been spoken.

[0239] If it is determined at block 310 that the wake word has not been spoken, then algorithm 300 proceeds to block 312 where natural language processing (NLP) is used to determine what was said. At block 314, algorithm 300 determines whether the sound detected by the microphone array 48 of the bed 30 indicates patient movement plus patient fall. If patient movement and fall are detected at block 314, then the algorithm proceeds to block 316 where a fall alert is issued to one or more caregivers via the nurse call system. For example, the nurse call system will send an alert message to the mobile phone 22 of one or more caregivers to whom the alert is issued. In some embodiments of the nurse call system, the ceiling light near the ward door is also lit to indicate the alert condition in the room. In some embodiments, the electronic whiteboard at the main station of the nurse call also displays the alert condition regarding a possible patient fall.

[0240] If at block 314 the bed microphone 48 does not indicate movement plus a fall, algorithm 300 proceeds to block 318 to determine whether the words detected by the microphone array indicate a patient fall. If at block 318 these words do indicate a fall, the algorithm proceeds to block 316 to issue an alert of a possible fall to one or more caregivers via the nurse call system as described above. If at block 318 the words do not indicate a fall, algorithm 300 returns to block 302 and continues therefrom as described herein.

[0241] If at block 310 algorithm 300 determines that a wake word has been spoken, algorithm 300 proceeds to block 320 to use NLP to determine what was said after the wake word was spoken. Thereafter, algorithm 300 proceeds to block 322 to determine (or attempt to determine) who is speaking based on a comparison of the voice information with the voice biometrics of an authorized user stored in a database (such as the database of the VCA computer or the memory 38 of the bed controller 34). Next, algorithm 300 proceeds to block 324 to determine whether a caregiver is speaking.

[0242] If at block 324 algorithm 300 determines that a caregiver is speaking, algorithm 300 proceeds to block 326 to enter the caregiver command library. If at block 324 algorithm 300 determines that a caregiver is not speaking, algorithm 300 proceeds to block 328 to jump to another command library. Thus, the present disclosure contemplates that more features of the medical devices in the room are allowed to be voice controlled by a caregiver as compared to features that allow a patient or other non-caregiver (e.g., a visitor) to perform voice control.

[0243] After each of blocks 326, 328, algorithm 300 proceeds to block 330 to use anaphora processing and Markov processing to determine whether the detected speech is related to a previously stored command or a predicted command. Thereafter, algorithm 300 proceeds to block 332 to determine whether a compound command has been spoken. Then, algorithm 300 proceeds to block 334 to determine the content of the specific command and perform a bed operation, an operation of other medical devices, or an operation of room devices (e.g., environmental equipment or entertainment equipment) based on the identified one or more commands. In some embodiments of system 20, with respect to block 334 of algorithm 300, a nurse call with a recorded voice may also be sent as appropriate. After executing one or more commands at block 334, algorithm 300 proceeds to block 336 to perform Markov processing to predict the next command the user may speak. After block 336, algorithm 300 returns to block 302 and continues therefrom as described herein.

[0244] It should be understood that any one of systems 20-9, 20-10, 20-11, 20-12, 20-13, 20-14 can be implemented in any one of systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6. In addition, all combinations and permutations of systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6, 20-9, 20-10, 20-11, 20-12, 20-13, 20-14 are contemplated within the scope of the present disclosure. In this regard, the use of the reference numeral 20 without any hyphenated suffix itself encompasses all embodiments of systems 20-1, 20-2, 20-3, 20-4, 20-5, 20-6, 20-9, 20-10, 20-11, 20-12, 20-13, 20-14 disclosed herein. Further, the present disclosure contemplates that when a medical device (such as the illustrative bed 30) is enabled for voice control, a visual or audible indicator is provided for this setting. Thus, in some embodiments, an indicator light on the medical device is illuminated to notify a user (e.g., a caregiver or a patient) that the medical device is ready to receive voice input to control the functions of the device. Alternatively or additionally, a message or icon is displayed on the display screen 110 of the medical device and / or on the user's mobile phone 22, 22' to notify the user that the medical device is ready to receive voice input to control the functions of the device. Further alternatively or additionally, an audible message, such as "ready for voice control", is played through the speaker 48 or other sound-emitting element or speaker unit 46 of the medical device or through the speaker of the user's mobile phone 22, 22'.

[0245] The present disclosure contemplates that in some embodiments of each of the above systems 20, one or more of the following voice commands, given by way of non-exhaustive list only, are used to control the hospital bed 30.

[0246] Table 1

[0247]

[0248]

[0249]

[0250]

[0251]

[0252] In accordance with the present disclosure, a controller of a medical device (such as controller 34 of bed 30) implements rules for determining which of two potentially conflicting commands is the command to be executed. For example, bed 30 includes buttons on side rail 46, some of which are available to the patient on the surface of the respective side rail 46 facing the patient, and some of which are available to the caregiver on the surface of the respective side rail 46 facing away from the patient. These buttons can be pressed by the caregiver or the patient to control the corresponding bed functions. The caregiver can also select soft buttons (e.g., buttons or icons presented on GUI 110) to control the corresponding bed functions.

[0253] If a patient button on side rail 46 is pressed to implement a function contrary to a voice command issued by the caregiver (e.g., the caregiver issues a "head up" voice command to raise the head section of deck 42, and the patient presses the head down button), the present disclosure contemplates that, in some embodiments, bed 30 will execute the caregiver voice command and ignore the contrary patient-pressed button. On the other hand, if a caregiver button on side rail 46 is pressed to implement a function contrary to a voice command issued by the patient, the present disclosure contemplates that bed 30 will execute the function corresponding to the caregiver-pressed button and ignore the patient voice request. Thus, in some embodiments, caregiver commands entered by pressing a hard button or a soft button or by voice input always take precedence over contrary patient commands entered by pressing a hard button or by voice input. In other embodiments, if contrary manual and voice inputs are received, bed 30 will not execute any function.

[0254] Embodiments in which some functions of bed 30 are not executed in view of conflicting inputs while other functions of bed 30 are executed based on caregiver precedence over the patient are also within the scope of the present disclosure. For example, movement of the deck segments of deck 42 of bed 30 may not be executed in view of conflicting inputs because bed movement is considered a high-risk function, while airbag pressure adjustment of the mattress may be executed based on caregiver input rather than conflicting patient input because airbag pressure adjustment is considered a low-risk function.

[0255] Some voice commands inherently involve functions that allow visual feedback to be provided to the user due to movement of a part of the medical device. However, the present disclosure contemplates that, in some embodiments, the amount of movement is restricted for safety reasons. For example, if the caregiver issues a "lower head of bed" voice command, controller 34 of bed 30 will lower the bed by only a small number of degrees (e.g., 1 degree to 5 degrees, just to give an arbitrary range of movement) at a time in order to reduce the likelihood of injury to a person whose body part is under the moving component. Additional voice input is then required to move the movable component an additional increment. For example, each time the movement stops, the caregiver can provide such additional voice input by saying "more". The system 20 recognizes that the word "more" refers back to the initial voice command regarding movement of a part of bed 30.

[0256] The degree or amount of change can be configured for all beds 30 within the system (e.g., if the upper frame of the bed 30 is lowered relative to the base frame, centimeters or inches can be configured), but it should be limited within the safety range according to the present disclosure. This feedback-based control can be implemented in different ways depending on whether the caregiver is actually present in the room as determined by, for example, RTLS or viewing the patient through a camera using their computer or cellular phone without being in the ward. Thus, a smaller movement threshold can be used if the caregiver is not in the room, while a larger movement threshold can be used if the caregiver is in the room. In other embodiments of the system 20, the movement threshold is the same regardless of whether the caregiver issuing the voice command is in the room or not.

[0257] In some embodiments, after the voice command function of a medical device such as the bed 30 has been completed or otherwise finished its task, the system 20 provides a voice command confirmation. For example, as feedback to the caregiver, this confirmation can be provided as a text message on the caregiver's mobile phone 22 or displayed on the GUI 110 of the bed 30 or on the display screen of the audio station 116 or on some other computer. As another example, this confirmation can be played as an audible message through the caregiver's mobile phone 22 or through the speaker unit 48 of the bed 30 or through the speaker of the audio station 116 or through the speaker of some other computer. Sometimes the voice command confirmation feedback is inherent, so no text message or audible message is needed. For example, if the voice command is to turn on or off the bed light or the room light, the user will see the corresponding light turned on or off, as the case may be. In such cases of inherent visual feedback, no further feedback is required. However, if the user remotely controls the bed 30 without such inherent feedback, it would be helpful to obtain a text confirmation or an audible confirmation of the task completion. Thus, according to the user's location determined by RTLS, if the caregiver is not in the room of the medical device controlled by voice, text feedback and / or audible feedback is provided.

[0258] As described above, the present disclosure contemplates that some voice commands are combined commands. That is, a single command is intended to control multiple devices and / or multiple features of one or more medical devices substantially simultaneously or sequentially under appropriate conditions. For example, in response to the combined command "sleep mode", the system 20 performs actions to turn off the television in the room, turn on the walking light or night light on the base frame of the bed 30 that illuminates the floor near the bed 30, return the head and foot angles of the bed (i.e., the tilt angles of the head laminate section and the foot laminate section of the laminate 42) to a patient-specific angle, set the room temperature to the default value for sleep using the thermostat 92, notify the caregiver via the mobile phone 22 or via the nurse call system that the patient has switched to sleep mode, etc.

[0259] In some embodiments where the devices within the ward are self-propelled, the result of the sleep mode input is to reposition the bed 30, one or more seats, a walker, etc. to appropriate positions within the room as necessary.

[0260] The present disclosure further contemplates that group commands may be provided to the system 20 as voice inputs. Dictating group commands enables controlling all or a subset of the bed 30, medical devices, entertainment devices, and / or environmental devices together. Thus, if the "sleep mode" voice command is formed as a group command within the system 20, the result is, for example, configuring the devices within multiple wards according to the sleep mode as described above. Changing the caregiver's rounds parameters (e.g., the frequency at which caregivers are required to check on their assigned patients) is another example of a group command according to the present disclosure. In some embodiments, such group commands may be input into the system 20 via voice or through a computer user interface (UI). For example, in some embodiments, group commands may only be input into the system 20 at the main nurse's station computer.

[0261] The various contemplated inventions may be defined by the following numbered clauses:

[0262] 1. A voice control system for a healthcare facility, the voice control system comprising: a hospital bed having a weighing scale for weighing a patient supported on the hospital bed and having a display screen for displaying the patient's weight; a voice recorder configured to record digital models of the voices of a plurality of caregivers; and a server to which the digital models are transmitted to determine the voice biometrics of each of the plurality of caregivers, wherein the hospital bed is configured to receive a voice input from a first caregiver among the plurality of caregivers instructing the hospital bed to weigh the patient, wherein the hospital bed is configured to communicate with the server to confirm, based on the voice biometrics, that the caregiver is authorized to control the hospital bed via the voice input, and wherein, after confirming that the first caregiver is authorized to control the hospital bed, the patient is weighed using the weighing scale and the patient's weight is displayed on the display screen.

[0263] 2. The voice control system according to clause 1, wherein the voice recorder is included in a computer.

[0264] 3. The voice control system according to clause 1, wherein the voice recorder is included in a mobile phone.

[0265] 4. The voice control system according to clause 1, wherein a caregiver identification (ID) is transmitted to the server together with the digital model of each of the plurality of caregivers by the voice recorder.

[0266] 5. The voice control system according to clause 1, wherein the hospital bed is configured to receive a zero-scale voice input from a first caregiver, the zero-scale voice input instructing the hospital bed to zero the weighing scale by measuring the weight using the weighing scale when the patient is not in the bed, wherein the hospital bed is configured to communicate with a server to confirm, based on voice biometrics, that the caregiver is authorized to control the hospital bed via the zero-scale voice input, and wherein, after confirming that the first caregiver is authorized to control the hospital bed, the hospital bed zeros the weighing scale.

[0267] 6. The voice control system according to clause 1, wherein the hospital bed is configured to display an acceptance button on a display screen for the first caregiver to select to accept the displayed patient weight for storage in one or both of the memory of the hospital bed and the electronic medical record of the patient.

[0268] 7. The voice control system according to clause 6, wherein, if the displayed weight accepted by the first caregiver differs from the previously accepted patient weight by a threshold amount, the hospital bed displays a message on the display screen, the message instructing the first caregiver to check to determine whether the weighing scale of the hospital bed has been correctly zeroed.

[0269] 8. The voice control system according to clause 7, wherein, if the hospital bed does not detect a problem, the hospital bed displays a message on the display screen, the message indicating that the patient weight has been successfully stored in one or both of the memory of the hospital bed and the electronic medical record of the patient.

[0270] 9. The voice control system according to clause 1, further comprising a real-time location system (RTLS) that determines the locations of multiple caregivers in a healthcare facility, and the server uses information from the RTLS in addition to voice biometrics to confirm that the first caregiver is authorized to control the hospital bed via voice input.

[0271] 10. The voice control system according to clause 9, wherein the hospital bed is configured to display a personal identification number (PIN) screen on the display screen for the first caregiver to input the PIN, and the server uses the PIN in addition to voice biometrics to confirm that the first caregiver is authorized to control the hospital bed via voice input.

[0272] 11. The voice control system according to clause 1, wherein the hospital bed is configured to display a personal identification number (PIN) screen on the display screen for the first caregiver to input the PIN, and the server uses the PIN in addition to voice biometrics to confirm that the first caregiver is authorized to control the hospital bed via voice input.

[0273] 12. The voice control system according to clause 1, wherein the hospital bed is configured to display a voice input button on the display screen, the voice input button being available for the first caregiver to select to enable the hospital bed to receive voice input.

[0274] 13. A voice control system for a medical institution, the voice control system comprising: medical equipment for nursing patients; and a mobile device, the mobile device including a voice recorder configured to record a digital model of the voice of a caregiver, wherein the digital model is transferred from the mobile device to the medical equipment, the medical equipment being configured to determine the voice biometrics of the caregiver based on the digital model, wherein the medical equipment is configured to receive a voice input from the caregiver instructing the medical equipment to perform a function, wherein the medical equipment is configured to confirm that the caregiver is authorized to control the medical equipment via the voice input based on the voice biometrics, and wherein, after confirming that the caregiver is authorized to control the medical equipment, the function is performed by the medical equipment.

[0275] 14. The voice control system according to clause 13, wherein the caregiver identification (ID) of the caregiver is transferred from the mobile device to the medical equipment together with the digital model of the voice of the caregiver.

[0276] 15. The voice control system according to clause 13, wherein the medical equipment is configured to display an accept button on a display screen for the caregiver to select to accept the displayed patient information for storage in one or both of the memory of the medical equipment and the electronic medical record of the patient.

[0277] 16. The voice control system according to clause 15, wherein if the medical equipment does not detect a problem, the medical equipment displays a message on the display screen indicating that the patient information has been successfully stored in one or both of the memory of the medical equipment and the electronic medical record of the patient.

[0278] 17. The voice control system according to clause 13, further comprising a real-time location system (RTLS) that determines the location of the caregiver in the medical institution, and the medical equipment uses information from the RTLS in addition to voice biometrics to confirm that the caregiver is authorized to control the medical equipment via the voice input.

[0279] 18. The voice control system according to clause 17, wherein the medical equipment is configured to display a personal identification number (PIN) screen on the display screen for the caregiver to input the PIN, and the medical equipment uses the PIN in addition to voice biometrics to confirm that the first caregiver is authorized to control the medical equipment via the voice input.

[0280] 19. The voice control system according to clause 13, wherein the medical equipment is configured to display a personal identification number (PIN) screen on the display screen for the caregiver to input the PIN, and the medical equipment uses the PIN in addition to voice biometrics to confirm that the first caregiver is authorized to control the medical equipment via the voice input.

[0281] 20. The voice control system according to clause 13, wherein the medical device is configured to display a voice input button on a display screen, and the voice input button is available for a caregiver to select to enable the medical device to receive voice input.

[0282] 21. A voice control system for a medical institution, the voice control system comprising: a hospital bed having a weighing scale for weighing a patient supported on the hospital bed and having a display screen for displaying the patient's weight; and a real-time location system (RTLS) for tracking the positions of multiple caregivers in the medical institution, the real-time location system being configured to send a message to the hospital bed notifying that a first caregiver has entered the room where the hospital bed is located, wherein the hospital bed is configured to receive a voice input from the first caregiver instructing the hospital bed to weigh the patient, wherein the hospital bed is configured to confirm that the first caregiver is authorized to control the hospital bed by voice input based on the voice biometrics of the first caregiver stored in the memory of the hospital bed, and wherein, after confirming that the first caregiver is authorized to control the hospital bed, the patient is weighed by the weighing scale and the patient's weight is displayed on the display screen.

[0283] 22. The voice control system according to clause 21, wherein the hospital bed is configured to play an audio message asking the first caregiver whether the first caregiver wants to record the displayed patient weight for storage in the patient's electronic medical record.

[0284] 23. The voice control system according to clause 22, wherein, in response to the first caregiver making an affirmative response to the audio message in an audible manner, the hospital bed communicates with the RTLS to reconfirm that the first caregiver is authorized to record the patient weight for storage in the patient's electronic medical record.

[0285] 24. The voice control system according to clause 23, wherein, after the RTLS reconfirms that the first caregiver is authorized, the patient weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0286] 25. The voice control system according to clause 21, wherein the hospital bed is configured to display a record button on the display screen for the first caregiver to select to record the displayed patient weight for storage in the patient's electronic medical record.

[0287] 26. The voice control system according to clause 25, wherein, in response to the first caregiver's selection of the record button, the hospital bed communicates with the RTLS to reconfirm that the first caregiver is authorized to record the patient weight for storage in the patient's electronic medical record.

[0288] 27. The voice control system according to clause 26, wherein, after the RTLS reconfirms that the first caregiver is authorized, the patient weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0289] 28. The voice control system according to clause 22, wherein, in response to a first caregiver making an affirmative response to the audio message in an audible manner, the hospital bed displays a personal identification number (PIN) screen on the display for the first caregiver to enter the PIN, and the hospital bed uses the PIN to reconfirm that the first caregiver is authorized to record the patient's weight for storage in the patient's electronic medical record.

[0290] 29. The voice control system according to clause 28, wherein, after the hospital bed reconfirms that the first caregiver is authorized based on the PIN, the patient's weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0291] 30. The voice control system according to clause 25, wherein, in response to the first caregiver's selection of the record button, the hospital bed displays a personal identification number (PIN) screen on the display for the first caregiver to enter the PIN, and the hospital bed uses the PIN to reconfirm that the first caregiver is authorized to record the patient's weight for storage in the patient's electronic medical record.

[0292] 31. The voice control system according to clause 30, wherein, after the hospital bed reconfirms that the first caregiver is authorized based on the PIN, the patient's weight is transmitted to the EMR system for storage in the patient's electronic medical record.

[0293] 32. A hospital bed, comprising: a frame configured to support a patient; and a circuit carried by the frame and including a processor, a memory, a speaker, a microphone, and a transmitter, the memory storing software configured to receive voice input via the microphone and output voice messages via the speaker, wherein, in response to receiving a first voice input detected by the microphone, the first voice input including a fall prevention inspection statement from a caregiver, the processor and the software cooperate to determine whether the hospital bed is correctly configured according to a fall prevention protocol, wherein, if the hospital bed is not correctly configured according to the fall prevention protocol, the circuit is configured to prompt the caregiver to correct one or more hospital bed settings for configuration according to the fall prevention protocol, wherein, if the hospital bed is correctly configured according to the fall prevention protocol, the circuit is configured to play a confirmation message via the speaker to confirm to the caregiver that the hospital bed is correctly configured according to the fall prevention protocol, wherein, after playing the confirmation message, the circuit is configured to convey a record query to the caregiver regarding whether fall prevention protocol compliance information should be recorded in the patient's electronic medical record, and in response to receiving an affirmative input from the caregiver in response to the record query, the circuit transmits the fall prevention protocol compliance information via the transmitter for storage in the patient's electronic medical record.

[0294] 33. The hospital bed according to clause 32, wherein the circuit is configured to prompt the caregiver to correct one or more hospital bed settings by playing an audio message via the speaker of the circuit that has information about the hospital bed settings that need to be corrected.

[0295] 34. The hospital bed according to clause 32, wherein the circuit further includes a display screen, and the circuit prompts a caregiver to correct one or more hospital bed settings by displaying a visual message on the display screen that has information about the hospital bed settings that need to be corrected.

[0296] 35. The hospital bed according to clause 34, wherein the visual message includes text information.

[0297] 36. The hospital bed according to clause 34, wherein the visual message includes picture information.

[0298] 37. The hospital bed according to clause 32, further including a plurality of side rails that are coupled to the frame and each side rail is movable between a raised position that prevents a patient from leaving the frame and a lowered position that releases the prevention of the patient from leaving the frame; a plurality of casters that are coupled to the frame; and a fall-off bed system that is carried by the frame and coupled to the circuit, wherein the frame includes a base frame and an upper frame that is supported above the base frame by a lifting system, and wherein, in order to correctly configure the bed according to a fall prevention protocol, two or more of the side rails of the frame need to be in their respective raised positions, at least one of the plurality of casters needs to be braked, the fall-off bed system needs to activate a warning to monitor the patient's fall-off condition, and the upper frame needs to be in a lower position relative to the base frame.

[0299] 38. The hospital bed according to clause 32, wherein the circuit is configured to convey a recording query to a caregiver by playing an audio recording message via a speaker of the circuit that asks the caregiver whether they wish to record fall prevention compliance information into the patient's electronic medical record.

[0300] 39. The hospital bed according to clause 38, wherein an affirmative input from the caregiver is an oral statement detected by a microphone.

[0301] 40. The hospital bed according to clause 32, wherein the circuit further includes a display screen, and the circuit is configured to convey a recording query to a caregiver by displaying a recording message on the display screen.

[0302] 41. The hospital bed according to clause 40, wherein an affirmative input from the caregiver includes a selection of a button displayed on the display screen.

[0303] 42. The hospital bed according to clause 32, wherein after playing a confirmation message and before making a recording query, the circuit is configured to convey a nurse call pendant availability query to the caregiver that asks whether the nurse call pendant is within the patient's reach.

[0304] 43. The hospital bed according to clause 42, wherein the circuit is configured to communicate a nurse call pendant availability query to a caregiver by playing an audio availability message via a speaker of the circuit.

[0305] 44. The hospital bed according to clause 42, wherein the circuit further includes a display screen, and the circuit is configured to communicate a nurse call pendant availability query to a caregiver by displaying the nurse call pendant availability query on the display screen.

[0306] 45. The hospital bed according to clause 42, wherein if the caregiver negatively answers the nurse call pendant availability query, the circuit is configured to prompt the caregiver to move the nurse call pendant within the reach of the patient and confirm that the nurse call pendant has been moved within the reach of the patient.

[0307] 46. The hospital bed according to clause 45, wherein the circuit is configured to prompt the caregiver to move the nurse call pendant within the reach of the patient by playing an audio message via a speaker of the circuit.

[0308] 47. The hospital bed according to clause 45, wherein the circuit further includes a display screen, and the circuit is configured to prompt the caregiver to move the nurse call pendant within the reach of the patient by displaying a visual message on the display.

[0309] 48. The hospital bed according to clause 45, wherein the circuit is configured to confirm that the nurse call pendant has been moved within the reach of the patient in response to receiving an oral confirmation message from the caregiver detected by a microphone.

[0310] 49. The hospital bed according to clause 45, wherein the circuit further includes a display screen, and wherein the circuit is configured to confirm that the nurse call pendant has been moved within the reach of the patient in response to the caregiver selecting a confirmation button displayed on the display screen.

[0311] 50. The hospital bed according to clause 42, wherein after playing a confirmation message and before making a record query, the circuit is configured to communicate a clear path query to the caregiver asking whether the path around the hospital bed is clear.

[0312] 51. The hospital bed according to clause 50, wherein the circuit is configured to communicate the clear path query to the caregiver by playing an audio clear path message via a speaker of the circuit.

[0313] 52. The hospital bed according to clause 50, wherein the circuit further includes a display screen, and the circuit is configured to communicate the clear path query to the caregiver by displaying the clear path query on the display screen.

[0314] 53. The hospital bed according to clause 50, wherein, if the caregiver answers the unobstructed path query negatively, the circuit is configured to prompt the caregiver to clear the path around the hospital bed and confirm that the path around the hospital bed has been cleared.

[0315] 54. The hospital bed according to clause 53, wherein the circuit is configured to prompt the caregiver to clear the path around the hospital bed by playing an audio message via a speaker of the circuit.

[0316] 55. The hospital bed according to clause 53, wherein the circuit further includes a display screen, and the circuit is configured to prompt the caregiver to clear the path around the hospital bed by displaying a visual message on the display screen.

[0317] 56. The hospital bed according to clause 53, wherein the circuit is configured to confirm that the path around the hospital bed is unobstructed in response to receiving an oral confirmation message from the caregiver detected by the microphone.

[0318] 57. The hospital bed according to clause 53, wherein the circuit further includes a display screen, and wherein the circuit is configured to confirm that the path around the hospital bed is unobstructed in response to the caregiver selecting a confirmation button displayed on the display screen.

[0319] 58. A system for reducing risks to a patient in a medical environment, the system comprising: a medical product having at least one function that has the potential to cause harm to a patient during operation; a circuit carried by the medical product and having a processor and a memory storing software; and a microphone array configured to receive voice input from a person near the medical product, wherein the microphone array communicates with the circuit, and the software is configured to cooperate with the microphone array to use beamforming technology to infer the direction of a person's eye gaze based on the voice input, wherein the circuit is configured to stop at least one function that has the potential to cause harm to a patient in response to the person uttering an audible stop command when it is inferred that the person's eyes are directed at the medical product.

[0320] 59. The system according to clause 58, wherein the medical product includes a hospital bed, and the microphone array is mounted to the hospital bed.

[0321] 60. The system according to clause 59, wherein the hospital bed includes at least one side rail movable between a raised position that prevents a patient from leaving the hospital bed and a lowered position that releases the prevention of the patient from leaving the hospital bed, and wherein at least one microphone of the microphone array is mounted to at least one side rail.

[0322] 61. The system according to clause 58, wherein the medical product includes a hospital bed, and the microphone array is mounted to one or both of a room wall or a ceiling of the room where the hospital bed is located.

[0323] 62. The system according to clause 58, wherein the microphone array includes a first microphone mounted to the medical product and a second microphone mounted to a room wall or ceiling of the ward where the medical product is located.

[0324] 63. The system according to clause 58, wherein the medical product includes a patient lift, and the microphone array is mounted to one or both of the room wall and ceiling of the ward where the patient lift is located.

[0325] 64. The system according to clause 63, wherein the patient lift includes a mobile patient lift or a ceiling-mounted patient lift.

[0326] 65. The system according to clause 58, wherein the medical product includes a hospital bed supporting a mattress, and at least one function includes one or more of the following functions: moving a mattress support section of a mattress support laminate of the hospital bed, moving an upper frame of the hospital bed relative to a base frame of the hospital bed, operating a percussion and vibration (P&V) treatment function of the mattress of the hospital bed, operating a flip assist function of the mattress of the hospital bed, or operating a continuous lateral rotation therapy (CLRT) function of the mattress of the hospital bed.

[0327] 66. The system according to clause 58, wherein the medical product includes an operating table, and at least one function includes moving a first operating table portion relative to a second operating table portion.

[0328] 67. The system according to clause 58, wherein the microphone array communicates wirelessly with the circuit of the medical product.

[0329] 68. The system according to clause 58, wherein the microphone array communicates wiredly with the circuit of the medical product.

[0330] 69. The system according to clause 58, further comprising a mobile phone carried by a person, the mobile phone being configured to receive a voice command from the person and transmit a command message corresponding to the voice command to the medical product to initiate the operation of at least one function.

[0331] 70. The system according to clause 58, further comprising at least one computer remote from the medical product, the at least one computer having clinical speech recognition software, and the microphone array communicating a voice command received from a person to the at least one computer, and wherein the at least one computer is configured to transmit a command message corresponding to the voice command to the medical product to initiate the operation of at least one function.

[0332] 71. The system according to clause 58, wherein the circuit is configured not to respond to an audible stop command spoken by a person to stop at least one function that may cause harm to a patient when the person's eye pointing to the medical product is not inferred.

[0333] 72. The system according to clause 58, wherein the circuit is configured to be trained to recognize the patient's voice, and wherein the circuit is configured to stop at least one function that may cause harm to the patient in response to an audible stop command spoken by the patient and originating from the patient without considering the patient's eye orientation.

[0334] 73. The system according to clause 72, wherein the medical product includes a patient bed for supporting the patient.

[0335] 74. A system for associating a medical device with a location in a healthcare facility, the system comprising: a medical device having a circuit including a processor, a memory, and a transmitter; at least one microphone communicatively coupled to the circuit, the memory storing software configured to receive voice input via the at least one microphone; and a positioning system including at least one positioning computer configured to store an association of the device with a room, wherein the circuit of the medical device is configured to receive, via the at least one microphone, voice input from a person indicating a location identifier (ID) of the location where the medical device is located, wherein the circuit is configured to store the location ID in the memory of the medical device and transmit the location ID together with the medical device ID to the at least one positioning computer, and wherein the at least one positioning computer is configured to establish an association of the first device with the room based on the medical device ID and the location ID transmitted from the medical device.

[0336] 75. The system according to clause 74, wherein the at least one microphone is carried by the medical device.

[0337] 76. The system according to clause 74, wherein the at least one microphone includes a microphone array carried by the medical device.

[0338] 77. The system according to clause 74, wherein the at least one microphone is spaced apart from the medical device and mounted in place.

[0339] 78. The system according to clause 77, wherein the at least one microphone is configured to communicate wirelessly with the circuit of the medical device.

[0340] 79. The system according to clause 77, wherein the at least one microphone includes a microphone array spaced apart from the medical device and mounted in place.

[0341] 80. The system according to clause 74, wherein the at least one microphone includes a first microphone carried by the medical device and a second microphone spaced apart from the medical device.

[0342] 81. The system according to clause 80, wherein the second microphone is configured to communicate wirelessly with the circuit of the medical device.

[0343] 82. The system according to clause 74, wherein the circuit of the medical device further includes a display screen that displays the location ID after the circuit receives the location ID via at least one microphone.

[0344] 83. The system according to clause 74, wherein the circuit of the medical device is configured to wirelessly transmit the location ID and the bed ID for reception by at least one positioning computer.

[0345] 84. The system according to clause 74, wherein at least one positioning computer stores the association between the patient and the location and establishes the association between the device and the patient after receiving the medical device ID and the location ID.

[0346] 85. The system according to clause 84, wherein at least one positioning computer is configured to transmit the patient ID corresponding to the patient related to the association between the device and the patient to the medical device.

[0347] 86. The system according to clause 85, wherein the circuit of the medical device includes a display screen, and wherein the circuit is configured to display the patient ID on the display screen.

[0348] 87. The system according to clause 74, wherein if the voice input does not include a valid location ID, the circuit of the medical device is configured to generate a query for additional information to a person.

[0349] 88. The system according to clause 87, wherein the circuit of the medical device further includes at least one speaker, and the query includes an audible message played through the at least one speaker.

[0350] 89. The system according to clause 87, wherein the circuit of the medical device further includes a display screen, and the query includes a text message displayed on the display screen.

[0351] 90. The system according to clause 74, wherein the circuit of the medical device further includes a display screen, and wherein the circuit is configured to display a location menu of valid location IDs of the medical institution in response to an audible request from a person.

[0352] 91. The system according to clause 90, wherein the circuit of the medical device is configured to display menu levels related to location options, and wherein the circuit is configured to allow a person to navigate through the menu levels audibly to reach the location menu.

[0353] 92. The system according to clause 74, wherein the circuit of the medical device further includes at least one speaker, and the circuit is configured to play an audible confirmation message through the at least one speaker in response to the location ID included in the voice input being a valid location ID.

[0354] 93. The system according to clause 74, wherein the circuit of the medical device is configured to receive, via at least one microphone, a disassociation input from a person indicating that the association between the first device and the room should be cancelled, wherein the circuit is configured to transmit the disassociation input together with the medical device ID to at least one location computer, and wherein the at least one location computer is configured to cancel the association between the first device and the room based on the medical device ID and the disassociation input transmitted from the medical device.

[0355] 94. A system for voice control of medical devices within a room, the system comprising: a first medical device having a first circuit including a first processor, a first memory, and a first microphone; and a second medical device having a second circuit including a second processor, a second memory, and a second microphone, wherein the first medical device and the second medical device are close enough to each other such that a voice input spoken by a person is received by both the first microphone and the second microphone, and wherein the first circuit of the first medical device is configured to be enabled for voice control in response to the voice input including a first code phrase, and the second circuit of the second medical device is configured to be enabled for voice control in response to the voice input including a second code phrase.

[0356] 95. The system according to clause 94, wherein the first code phrase and the second code phrase each begin with a common code word.

[0357] 96. The system according to clause 95, wherein the common code word includes the word "hey".

[0358] 97. The system according to clause 95, wherein the first code phrase includes a first unique name corresponding to the first medical device and spoken immediately after the common code word, and wherein the second code phrase includes a second unique name corresponding to the second medical device and spoken immediately after the common code word.

[0359] 98. The system according to clause 97, wherein the first medical device and the second medical device have the same model name, the first unique name is in the format of "Model Name A", and the second unique name is in the format of "Model Name B".

[0360] 99. The system according to clause 97, wherein the first medical device and the second medical device have the same model name, the first unique name is in the format of "Model Name 1", and the second unique name is in the format of "Model Name 2".

[0361] 100. The system according to clause 94, wherein after each of the first medical device and the second medical device is enabled for voice control, the corresponding first circuit and second circuit are enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold time period, and wherein after the threshold time period has elapsed, in the case where at least one voice command is not received by the corresponding first medical device and second medical device, the corresponding first medical device and second medical device are disabled for voice control.

[0362] 101. The system according to clause 100, wherein in response to receiving a valid voice command during the threshold time period, the threshold time period is reset.

[0363] 102. A system for enabling voice control of a medical device, the system comprising: an identifier item carried by a caregiver and configured to transmit a wireless identification (ID) signal; a medical device having a circuit including a processor, a memory, a microphone, a transmitter, and a proximity detector configured to receive the wireless ID signal from the identifier item when the identifier item is within three feet or less of the medical device; and at least one voice control authorization (VCA) computer remote from the medical device and communicatively coupled to the medical device, wherein in response to the proximity detector receiving the wireless ID signal, the circuit transmits the ID data included in the wireless ID signal to the VCA computer via the transmitter, wherein the VCA computer is configured to verify that the ID data corresponds to a caregiver authorized to control the medical device by voice input, and wherein if the caregiver authorization is verified by the VCA computer, the VCA computer is configured to transmit an authorization message to the medical device, and wherein in response to the circuit of the medical device receiving the authorization message, voice control of the medical device is enabled.

[0364] 103. The system according to clause 102, wherein the identifier item includes a mobile phone.

[0365] 104. The system according to clause 102, wherein the identifier item includes a radio frequency identification (RFID) badge.

[0366] 105. The system according to clause 102, wherein the identifier item includes a near field communication (NFC) transponder that transmits the wireless ID signal in response to receiving electromagnetic energy transmitted by the circuit of the medical device.

[0367] 106. The system according to clause 102, wherein, after enabling voice control of the medical device, the voice input received by the microphone of the circuit is transmitted to the VCA computer via the transmitter of the circuit, wherein the VCA computer is configured to determine that the voice input corresponds to at least one valid control command among a plurality of valid control commands for the medical device, and wherein, if the voice input corresponds to one of the valid control commands among the plurality of valid control commands, the VCA computer is configured to transmit a device control message to the medical device, and wherein, in response to the circuit of the medical device receiving the device control message, the medical device executes a function corresponding to the device control message.

[0368] 107. The system according to clause 102, wherein, after enabling voice control of the medical device, the circuit is enabled to receive voice commands to control the functions of the medical device for a threshold time period, and wherein, after the threshold time period has elapsed and the medical device has not received at least one voice command, the medical device is disabled for voice control.

[0369] 108. The system according to clause 107, wherein, in response to receiving a valid voice command during the threshold time period, the threshold time period is reset.

[0370] 109. A system for voice control of a medical device in a room, the system comprising: a first medical device having a first circuit including a first processor, a first memory, and a first microphone; and a second medical device having a second circuit including a second processor, a second memory, and a second microphone, wherein the first medical device and the second medical device are close enough to each other such that a voice input spoken by a person is received by both the first microphone and the second microphone, wherein the first circuit of the first medical device is configured to be enabled for voice control in response to the voice input received by the first microphone being louder than the voice input received by the second microphone, and wherein the second circuit of the second medical device is configured to be enabled for voice control in response to the voice input received by the second microphone being louder than the voice input received by the first microphone.

[0371] 110. The system according to clause 109, wherein the first circuit is configured to transmit a first loudness value for receipt by the second circuit, the second circuit is configured to transmit a second loudness value for receipt by the first circuit, the first medical device is configured to be enabled for voice control in response to the first circuit determining that the first loudness value is greater than the second loudness value, and the second medical device is configured to be enabled for voice control in response to the second circuit determining that the second loudness value is greater than the first loudness value.

[0372] 111. The system according to clause 109, further comprising at least one Voice Control Authorization (VCA) computer that is remote from the first medical device and the second medical device and communicatively coupled to the first medical device and the second medical device, and wherein the first circuit is configured to transmit a first loudness value for reception by the at least one VCA computer, the second circuit is configured to transmit a second loudness value for reception by the at least one VCA computer, the VCA computer is configured to transmit a first message to enable the first medical device for voice control to the first medical device in response to the VCA computer determining that the first loudness value is greater than the second loudness value, and the VCA computer is configured to transmit a second message to enable the second medical device for voice control to the second medical device in response to the VCA computer determining that the second loudness value is greater than the first loudness value.

[0373] 112. The system according to clause 109, wherein after each of the first medical device and the second medical device is enabled for voice control, the respective first circuit and second circuit are enabled to receive voice commands to control the functions of the respective first medical device and second medical device for a threshold period of time, and wherein after the threshold period of time has elapsed, in the case where at least one voice command is not received by the respective first medical device and second medical device, the respective first medical device and second medical device are disabled for voice control.

[0374] 113. The system according to clause 112, wherein the threshold period of time is reset in response to a valid voice command being received during the threshold period of time.

[0375] 114. A system for voice control of in-room medical devices, the system comprising: a first medical device having a first circuit including a first processor and a first memory; a second medical device having a second circuit including a second processor and a second memory; and a microphone array positioned within the room and spaced apart from the first medical device and the second medical device, the microphone array including a first microphone closer to the first medical device than to the second medical device and a second microphone closer to the second medical device than to the first medical device, wherein the first medical device and the second medical device are close enough to each other such that a voice input spoken by a person is received by both the first microphone and the second microphone, wherein the first circuit of the first medical device is configured to be enabled for voice control in response to the voice input received by the first microphone being louder than the voice input received by the second microphone, and wherein the second circuit of the second medical device is configured to be enabled for voice control in response to the voice input received by the second microphone being louder than the voice input received by the first microphone.

[0376] 115. The system according to clause 114, wherein the first microphone is included in a first microphone circuit configured to transmit a first loudness value for reception by a first circuit of a first medical device and a second circuit of a second medical device, the second microphone is included in a second microphone circuit configured to transmit a second loudness value for reception by the first circuit of the first medical device and the second circuit of the second medical device, the first medical device is configured to enable voice control in response to the first circuit determining that the first loudness value is greater than the second loudness value, and the second medical device is configured to enable voice control in response to the second circuit determining that the second loudness value is greater than the first loudness value.

[0377] 116. The system according to clause 114, wherein the microphone array includes a communication circuit coupled to the first microphone and the second microphone, the communication circuit is configured to determine a first loudness value based on a first loudness of a voice input received by the first microphone and a second loudness value based on a second loudness of a voice input received by the second microphone, the communication circuit is configured to transmit the first loudness value and the second loudness value for reception by the first circuit of the first medical device and the second circuit of the second medical device, the first medical device is configured to enable voice control in response to the first circuit determining that the first loudness value is greater than the second loudness value, and the second medical device is configured to enable voice control in response to the second circuit determining that the second loudness value is greater than the first loudness value.

[0378] 117. The system according to clause 114, further comprising at least one voice control authorization (VCA) computer remote from the first medical device and the second medical device and communicatively coupled to the first microphone and the second microphone in the microphone array, the VCA computer receiving a first loudness value based on a first loudness of a voice input received by the first microphone and a second loudness value based on a second loudness of a voice input received by the second microphone, the VCA computer being configured to transmit a first message to the first medical device to enable the first medical device for voice control in response to the VCA computer determining that the first loudness value is greater than the second loudness value, and the VCA computer being configured to transmit a second message to the second medical device to enable the second medical device for voice control in response to the VCA computer determining that the second loudness value is greater than the first loudness value.

[0379] 118. The system according to clause 114, wherein after each of the first medical device and the second medical device is enabled for voice control, the corresponding first circuit and second circuit are enabled to receive voice commands to control the functions of the corresponding first medical device and second medical device for a threshold period of time, and wherein after the threshold period has elapsed and no at least one voice command is received by the corresponding first medical device and second medical device, the corresponding first medical device and second medical device are disabled for voice control.

[0380] 119. The system according to clause 118, wherein, in response to receiving a valid voice command during a threshold time period, the threshold time period is reset.

[0381] 120. A system for voice control of in-room medical devices, the system comprising: a first medical device having a first circuit including a first processor, a first memory, a first microphone, and a first camera; and a second medical device having a second circuit including a second processor, a second memory, a second microphone, and a second camera, wherein the first circuit of the first medical device is configured to enable voice control in response to the first processor identifying a first person face image captured by the first camera, and wherein the second circuit of the second medical device is configured to enable voice control in response to the second processor identifying a second person face image captured by the second camera.

[0382] 121. The system according to clause 120, wherein the first camera captures a first person image for processing by the processor in response to the first microphone receiving a voice command from a person, and wherein the second camera captures a second person image for processing by the processor in response to the second microphone receiving a voice command from a person.

[0383] 122. The system according to clause 121, wherein the voice command includes any valid device control command among a plurality of valid device control commands.

[0384] 123. The system according to clause 121, wherein the first circuit includes a first display screen, the second circuit includes a second display screen, and if both the first camera and the second camera capture a corresponding first person face image and second person face image in response to a voice command, both the first medical device and the second medical device remain disabled for voice control, and the first display screen and the second display screen each display a notification message that advises the person to face only the first camera or the second camera of the corresponding first medical device or second medical device that the person wishes to control by voice.

[0385] 124. The system according to clause 120, wherein the first medical device includes a first hospital bed having a first patient departure barrier with a first camera coupled thereto, and the second medical device includes a second hospital bed having a second patient departure barrier with a second camera coupled thereto.

[0386] 125. The system according to clause 124, wherein the first patient departure barrier and the second patient departure barrier each include a corresponding first headboard and second headboard or a corresponding first footboard and second footboard.

[0387] 126. The system according to clause 124, wherein the departure of the first patient from the barrier and the departure of the second patient from the barrier each include a respective first side rail and a second side rail.

[0388] 127. The system according to clause 126, wherein the first circuit further includes a first display screen coupled to the first side rail, the second circuit further includes a second display screen coupled to the second side rail, the first camera is positioned adjacent to the first display screen, and the second camera is positioned adjacent to the second display screen.

[0389] 128. The system according to clause 120, further comprising at least one voice control authorization (VCA) computer remote from the first medical device and the second medical device and communicatively coupled to the first medical device and the second medical device, and wherein the first circuit is configured to transmit a first image for reception by the at least one VCA computer, the second circuit is configured to transmit a second image for reception by the at least one VCA computer, the VCA computer is configured to transmit a first message enabling the first medical device for voice control to the first medical device in response to the VCA computer determining based on analysis of the first image that a person is authorized to operate the first medical device by voice control, and the VCA computer is configured to transmit a second message enabling the second medical device for voice control to the second medical device in response to the VCA computer determining based on analysis of the second image that a person is authorized to operate the second medical device by voice control.

[0390] 129. The system according to clause 120, wherein after each of the first medical device and the second medical device is enabled for voice control, the respective first circuit and second circuit are enabled to receive voice commands to control the functions of the respective first medical device and second medical device for a threshold time period, and wherein after the threshold time period has elapsed, in the case where at least one voice command is not received by the respective first medical device and second medical device, the respective first medical device and second medical device are disabled for voice control.

[0391] 130. The system according to clause 129, wherein in response to receiving a valid voice command during the threshold time period, the threshold time period is reset.

[0392] 131. A system for voice control, the system including a medical device having a first circuit including a processor, a memory, a button, and a microphone, wherein the circuit of the medical device is configured to be enabled for voice control in response to a person selecting the button and then receiving a valid voice input via the microphone within a threshold time period.

[0393] 132. The system according to clause 131, wherein the valid voice input includes a code word.

[0394] 133. The system according to clause 132, wherein the code word includes a first unique name corresponding to a medical device and received by a microphone within a threshold time period.

[0395] 134. The system according to clause 133, wherein the unique name includes a model name of the medical device.

[0396] 135. The system according to clause 131, wherein after the medical device is enabled for voice control, the corresponding circuit is enabled to receive voice commands to control the functions of the medical device for a second threshold time period, and wherein after the second threshold time period has passed, in the case where the medical device does not receive at least one voice command, the medical device is disabled for voice control.

[0397] 136. The system according to clause 135, wherein in response to receiving a valid voice command during the second threshold time period, the threshold time period is reset.

[0398] 137. The system according to clause 131, wherein the valid voice input includes any device control command among a plurality of device control commands.

[0399] 138. The system according to clause 131, wherein if no valid voice input is received within the threshold time period, the medical device remains disabled for voice control.

[0400] 139. A system for voice control of a medical device in a room, the system comprising: a first medical device having a first circuit including a first processor, a first memory, a first microphone, and a first infrared (IR) receiver; a second medical device having a second circuit including a second processor, a second memory, a second microphone, and a second IR receiver; and an IR indicator having an IR transmitter, wherein the first circuit of the first medical device is configured to be enabled for voice control in response to the first IR receiver receiving an IR signal from the IR transmitter of the IR indicator, and wherein the second circuit of the second medical device is configured to be enabled for voice control in response to the second IR receiver receiving an IR signal from the IR transmitter of the IR indicator.

[0401] 140. The system according to clause 139, wherein the IR indicator is configured to be worn on a person's finger.

[0402] 141. The system according to clause 139, wherein the IR indicator can be mounted on a mobile phone.

[0403] 142. The system according to clause 139, wherein the IR indicator has the shape of a stylus.

[0404] 144. The system according to clause 139, wherein the IR indicator has the shape of a keychain.

[0405] 145. The system according to clause 139, wherein the first medical device includes a first hospital bed having a first patient exit barrier with a first IR receiver coupled thereto, and the second medical device includes a second hospital bed having a second patient exit barrier with a second IR receiver coupled thereto.

[0406] 146. The system according to clause 145, wherein the first patient exit barrier and the second patient exit barrier each include a respective first headboard and second headboard or a respective first footboard and second footboard.

[0407] 147. The system according to clause 145, wherein the first patient exit barrier and the second patient exit barrier each include a respective first side rail and second side rail.

[0408] 148. The system according to clause 147, wherein the first circuit further includes a first display coupled to the first side rail, the second circuit further includes a second display coupled to the second side rail, the first IR receiver is adjacent to the first display, and the second IR receiver is adjacent to the second display.

[0409] 149. The system according to clause 139, wherein after each of the first medical device and the second medical device is enabled for voice control, the respective first circuit and second circuit are enabled to receive voice commands to control the functions of the respective first medical device and second medical device for a threshold time period, and wherein after the threshold time period has elapsed and no at least one voice command is received by the respective first medical device and second medical device, the respective first medical device and second medical device are disabled for voice control.

[0410] 150. The system according to clause 149, wherein in response to receiving a valid voice command during the threshold time period, the threshold time period is reset.

[0411] 151. A system for voice control of in-room medical devices, the system comprising: a plurality of medical devices in a room; a far-field microphone array dispersed throughout the room; and at least one computer communicatively coupled to the plurality of medical devices and the far-field microphone array, the at least one computer configured to: (i) combine voice inputs received from a person by the far-field microphone array; (ii) use beamforming software to amplify and identify the voice inputs; (iii) use interruption software to filter out ambient noise; (iv) execute speech recognition software to determine which of the plurality of medical devices is the designated medical device to be controlled by the voice input; and (v) transmit a control message to the designated medical device to control a first function of the designated medical device based on the voice input.

[0412] 152. The system according to clause 151, wherein each of the plurality of medical devices bears at least one far-field microphone of the far-field microphone array.

[0413] 153. The system according to clause 152, wherein the plurality of medical devices includes two or more of the following devices: a vital signs monitor, a hospital bed, an end-wall interface, a caregiver badge, a location tag, a patient identification (ID) bracelet, a patient gown, an audio station of a nurse call system, a patient lift, and a seat.

[0414] 154. The system according to clause 151, wherein the speech recognition software includes one or more of the following software: speech-to-text conversion software, codeword recognition software, wake-word recognition software, and natural language processing (NLP) software.

[0415] 155. The system according to clause 151, wherein the at least one computer is further configured with distance processing software that is executed to determine which of the far-field microphones in the far-field microphone array is the far-field microphone closest to the person and to determine which of the plurality of medical devices is closest to the closest far-field microphone.

[0416] 156. The system according to clause 151, wherein the interruption software determines the ambient noise to be filtered out based on the characteristics or frequency of noise for a continuous threshold period.

[0417] 157. The system according to clause 151, wherein the at least one computer is further configured with speaker recognition software to determine the identification (ID) of the person providing the voice input.

[0418] 158. The system according to clause 157, wherein the speaker recognition software includes one or more of the following software: Markov model software, pattern recognition software, voice biometric software, neural network software, natural language processing (NLP) software, natural language understanding software, and anaphora resolution software.

[0419] 159. The system according to clause 151, wherein at least one computer is further configured to determine that the voice input includes a composite voice command regarding a designated medical device and a second designated medical device, and wherein at least one computer is further configured to transmit a second control message to the second designated medical device to control a second function of the second designated medical device based on a part of the voice input regarding the second medical device.

[0420] 160. The system according to clause 151, wherein at least one computer is further configured to determine that the voice input includes a composite voice command regarding a first function and a second function of a designated medical device, and wherein the control message transmitted by at least one computer to the designated medical device includes a first part for controlling the first function of the designated medical device and a second part for controlling the second function of the designated medical device.

[0421] 161. A hospital bed, comprising: a frame configured to support a patient; a far-field microphone array carried by the frame; and a circuit carried by the frame and coupled to the far-field microphone array, the circuit including a processor and a memory, the circuit being configured to: (i) combine voice inputs received from a person by the far-field microphone array; (ii) use beamforming software to amplify and identify the voice inputs; (iii) use interruption software to filter out ambient noise; (iv) execute speech recognition software to determine a first function of the hospital bed to be performed based on the voice inputs; and (v) control the hospital bed to perform the first function.

[0422] 162. The hospital bed according to clause 161, wherein the hospital bed includes a plurality of barriers coupled to the frame, and wherein each of the plurality of barriers carries at least one far-field microphone of the far-field microphone array.

[0423] 163. The hospital bed according to clause 161, wherein the speech recognition software includes one or more of the following software: speech-to-text conversion software, codeword recognition software, wake word recognition software, and natural language processing (NLP) software.

[0424] 164. The hospital bed according to clause 161, wherein the interruption software determines the ambient noise to be filtered out based on the characteristics or frequency of noise for a continuous threshold period.

[0425] 165. The hospital bed according to clause 161, wherein the circuit is further configured with speaker recognition software to determine the identification (ID) of the person providing the voice input.

[0426] 166. The hospital bed according to clause 165, wherein the speaker recognition software includes one or more of the following software: Markov model software, pattern recognition software, voice biometric software, neural network software, natural language processing (NLP) software, natural language understanding software, and anaphora resolution software.

[0427] 167. The hospital bed according to clause 166, wherein the circuit is further configured to determine that the voice input includes a composite voice command regarding a first function and a second function of the hospital bed, and wherein the circuit is configured to control the second function while controlling the first function of the hospital bed.

[0428] 168. The hospital bed according to clause 161, wherein the circuit is configured to control the functions of the hospital bed according to one or more rows (excluding the header row) provided in the following table:

[0429]

[0430]

[0431]

[0432]

[0433]

[0434]

[0435] 169. A system for voice control in a ward environment, the system comprising: environmental equipment that is operable to control the ward environment; entertainment equipment that is operable to provide entertainment to a patient in the ward; a microphone that is located within the ward and configured to receive voice control commands from the patient for controlling the environmental equipment and the entertainment equipment; and a remote computer that is communicatively coupled to the microphone and has voice recognition software, the remote computer being configured to process the voice control commands and send control messages to control the operation of the environmental equipment and the entertainment equipment.

[0436] 170. The system according to clause 169, wherein the environmental equipment includes one or more of the following: motorized blinds, motorized curtains, indoor lights, reading lights, or a thermostat.

[0437] 171. The system according to clause 169, wherein the entertainment equipment includes a television.

[0438] 172. The system according to clause 169, wherein the entertainment equipment includes a speaker unit that is configured to play the audio of audiobooks, voice-based games, and quizzes.

[0439] 173. The system according to clause 172, wherein the microphone is included in the speaker unit.

[0440] 174. The system according to clause 172, further comprising a hospital bed configured to support a patient, and wherein the speaker unit is included in the hospital bed.

[0441] 175. The system according to clause 172, wherein the entertainment device includes a second entertainment device separated from the speaker unit, and wherein control messages for controlling the operation of the environmental device and the second entertainment device are routed to the environmental device and the second entertainment device through the speaker unit.

[0442] 176. The system according to clause 175, wherein the control message is received by the speaker unit as a wireless control message.

[0443] 177. The system according to clause 175, wherein the control message sent from the speaker unit to the environmental device and the second entertainment device is wirelessly transmitted.

[0444] 178. A system for voice control of a ward environment, the system comprising: an environmental device operable to control the ward environment; an entertainment device operable to provide entertainment to a patient in the ward; a microphone located in the ward and configured to receive voice control commands from the patient for controlling the environmental device and the entertainment device; and an Internet of Things (IoT) hub coupled to the microphone, the microphone configured to transmit the voice control commands to the IoT hub, wherein the IoT hub is configured to transmit control messages to control the operation of the environmental device and the entertainment device.

[0445] 179. The system according to clause 178, wherein the environmental device includes one or more of the following: electric blinds, electric curtains, indoor lights, reading lights, or a thermostat.

[0446] 180. The system according to clause 178, wherein the entertainment device includes a television.

[0447] 181. The system according to clause 178, wherein the entertainment device includes a speaker unit configured to play the audio of audiobooks, voice-based games, and quizzes.

[0448] 182. The system according to clause 181, wherein the microphone is included in the speaker unit.

[0449] 183. The system according to clause 181, further comprising a hospital bed configured to support a patient, and wherein the speaker unit is included in the hospital bed.

[0450] 184. The system according to clause 181, wherein the entertainment device includes a second entertainment device separated from the speaker unit, and wherein control messages from the IoT hub for controlling the operations of the environmental device and the second entertainment device are routed to the environmental device and the second entertainment device via the speaker unit.

[0451] 185. The system according to clause 184, wherein at least some of the control messages are received by the speaker unit from the IoT hub as wireless control messages.

[0452] 186. The system according to clause 184, wherein the control messages sent from the speaker unit to the environmental device and the second entertainment device are wirelessly transmitted.

[0453] 187. The system according to clause 178, further comprising a second environmental device, a second entertainment device, and a remote computer communicatively coupled to a microphone and having speech recognition software, the remote computer configured to process voice control commands and send second control messages to control the operations of the second environmental device and the second entertainment device.

[0454] 188. The system according to clause 187, wherein the second control messages are transmitted to the second environmental device and the second entertainment device without involving the IoT hub.

[0455] 189. The system according to clause 188, further comprising a speaker unit, the microphone being included in the speaker unit, and the second control messages being transmitted to the second environmental device and the second entertainment device through the speaker unit.

[0456] 190. A voice control system for a medical institution, the voice control system comprising: a hospital bed having a weighing scale for weighing a patient supported on the hospital bed and a display screen for displaying the patient's weight; and a real-time location system (RTLS) for tracking the positions of multiple caregivers in the medical institution, the real-time location system configured to send a message to the hospital bed notifying that a first caregiver has entered the room where the hospital bed is located, wherein the hospital bed is configured to receive a voice input from the first caregiver instructing the hospital bed to weigh the patient, wherein the hospital bed is configured to confirm that the first caregiver is authorized to control the hospital bed, and wherein, after confirming that the first caregiver is authorized to control the hospital bed, the patient is weighed by the weighing scale.

[0457] 191. The voice control system according to clause 190, wherein the hospital bed is configured to confirm that the first caregiver is authorized to control the hospital bed through voice input based on the voice biometrics of the first caregiver stored in the memory of the hospital bed.

[0458] 192. The voice control system according to clause 190, wherein the hospital bed is configured to display the patient's weight on a display screen after weighing the patient.

[0459] 193. The voice control system according to clause 190, in combination with any one or more of clauses 22 to 31.

[0460] 194. A hospital bed, comprising: a frame configured to support a patient; and a circuit carried by the frame and including a processor, a memory, a speaker, a microphone, and a transmitter, the memory storing software configured to receive voice input via the microphone and output voice messages via the speaker, wherein in response to receiving a first voice input detected by the microphone, the first voice input including a fall prevention inspection statement from a caregiver, the processor and the software cooperate to determine whether the hospital bed is correctly configured according to a fall prevention protocol, wherein if the hospital bed is not correctly configured according to the fall prevention protocol, the circuit is configured to allow correction of one or more hospital bed settings to be configured according to the fall prevention protocol, wherein if the hospital bed is correctly configured according to the fall prevention protocol, the circuit is configured to play a confirmation message via the speaker to confirm to the caregiver that the hospital bed is correctly configured according to the fall prevention protocol.

[0461] 195. The hospital bed according to clause 194, wherein the circuit is configured to prompt the caregiver to correct one or more hospital bed settings to be configured according to the fall prevention protocol.

[0462] 196. The hospital bed according to clause 194, wherein after playing the confirmation message, the circuit is configured to convey a record query to the caregiver regarding whether fall prevention protocol compliance information should be recorded in the patient's electronic medical record, and in response to receiving an affirmative input from the caregiver in response to the record query, the circuit transmits the fall prevention protocol compliance information via the transmitter for storage in the patient's electronic medical record.

[0463] 197. The hospital bed according to clause 194, in combination with any one or more of clauses 33 to 57.

[0464] Although certain exemplary embodiments have been described in detail above, variations and modifications exist within the scope and spirit of the ...

Claims

1. A system for reducing risks to a patient in a medical environment, the system comprising: A medical product having at least one function that has the potential to cause harm to the patient during operation; A circuit carried by the medical product and having a processor and a memory storing software; And A microphone array configured to receive voice input from a person near the medical product, wherein the microphone array communicates with the circuit, and the software is configured to cooperate with the microphone array to use beamforming technology to infer the direction of the person's eye gaze based on the voice input, wherein the circuit is configured to stop at least one function that has the potential to cause harm to the patient in response to the person speaking an audible stop command when it is inferred that the person's eyes are directed at the medical product.

2. The system according to claim 1, wherein The medical product includes a hospital bed, and the microphone array is mounted to the hospital bed.

3. The system according to claim 2, wherein, The hospital bed includes at least one side rail that can move between a raised position that prevents the patient from leaving the hospital bed and a lowered position that releases the prevention of the patient from leaving the hospital bed, and at least one microphone of the microphone array is mounted to the at least one side rail.

4. The system according to claim 1, wherein, The medical product includes a hospital bed, and the microphone array is mounted to one or both of the room wall or ceiling of the ward where the hospital bed is located.

5. The system according to claim 1, wherein The microphone array includes a first microphone mounted to the medical product and a second microphone mounted to the room wall or ceiling of the ward where the medical product is located.

6. The system according to claim 1, wherein, The medical product includes a patient lift, and the microphone array is mounted to one or both of the room wall and ceiling of the ward where the patient lift is located.

7. The system according to claim 6, wherein, The patient lift includes a mobile patient lift or a ceiling-mounted patient lift.

8. The system according to claim 1, wherein, The medical product includes a hospital bed supporting a mattress, and the at least one function includes one or more of the following functions: moving a mattress support section of a mattress support laminate of the hospital bed, moving an upper frame of the hospital bed relative to a base frame of the hospital bed, operating a percussion and vibration therapy function of the mattress of the hospital bed, operating a flip assist function of the mattress of the hospital bed, or operating a continuous lateral rotation therapy function of the mattress of the hospital bed.

9. The system according to claim 1, wherein, The medical product includes an operating table, and the at least one function includes moving a first operating table portion relative to a second operating table portion.

10. The system according to claim 1, wherein The microphone array communicates wirelessly with the circuit of the medical product.

11. The system according to claim 1, wherein, The microphone array communicates wiredly with the circuit of the medical product.

12. The system according to claim 1, further comprising a mobile phone carried by the person, the mobile phone being configured to receive a voice command from the person and transmit a command message corresponding to the voice command to the medical product to initiate operation of the at least one function.

13. The system according to claim 1, further comprising at least one computer remote from the medical product, the at least one computer having clinical speech recognition software, the microphone array communicating voice commands received from the person to the at least one computer, and wherein, The at least one computer is configured to transmit a command message corresponding to the voice command to the medical product to initiate operation of the at least one function.

14. The system according to claim 1, wherein The circuit is configured not to stop the at least one function that has the potential to cause harm to the patient in response to the person speaking an audible stop command when it is not inferred that the person's eyes are directed at the medical product.

15. The system according to claim 1, wherein, The circuit is configured to be trained to recognize the speech of the patient, and wherein the circuit is configured to stop the at least one function that may cause harm to the patient in response to an audible stop command from the patient, without considering the eye orientation of the patient.

16. The system according to claim 15, wherein, The medical product includes a patient bed that supports the patient.

Images