Nursing billboard interaction system based on intelligent control

Abstract

The invention relates to the technical field of interaction systems, in particular to an intelligent control-based nursing board interaction system, which comprises a nursing board, and is characterized in that the nursing board internally comprises a voice recognition and control module integration, a board data interaction and display module, a board function page control module, an intelligent equipment control module and a feedback and interaction module; the voice recognition and control module integration, the billboard data interaction and display module, the billboard function page control module, the intelligent equipment control module and the feedback and interaction module are electrically connected. According to the method, a visual nursing billboard large screen is provided, interaction with the visual nursing billboard large screen is carried out through an API interface, instruction analysis and execution are supported, meanwhile, real-time voice and visual feedback and a multi-mode interaction mode are provided, and the user experience is remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of interactive systems, and in particular to a nursing signboard interactive system based on intelligent control. Background Art

[0002] As we all know, there are many shortcomings in data interaction, intelligent control, and patient information page retrieval, which limit the efficiency and quality of medical care. With the development of technology and the increase in medical needs, the introduction of advanced technologies such as voice recognition has become an inevitable trend to improve the current status of medical care. The existing interactive system is inefficient: Traditional data interaction methods rely on manual operations, such as using a keyboard, mouse or touch screen to input and query information, which is not only time-consuming but also prone to errors. Especially in emergency or high-intensity work environments, the operating speed of medical staff may not be able to keep up with actual needs, affecting work efficiency; cumbersome operations: Medical staff need to frequently switch between different interfaces, input complex commands or search for specific information, which increases the complexity of operations. Especially when retrieving patient information pages, they may need to switch back and forth between multiple systems or databases, reducing work efficiency and accuracy; Insufficient intelligent control capabilities: In the absence of voice, medical staff cannot easily access the patient information. Even with the support of recognition technology, the control of medical equipment mainly relies on manual operation or preset programs, and it is difficult to achieve intelligent adjustment based on real-time voice commands. This limits the ability of medical equipment in personalized care, emergency response, etc., and reduces the flexibility and efficiency of care; it is cumbersome to retrieve patient information pages: traditional patient information management methods often rely on paper medical records or electronic medical record systems. When medical staff need to view patient information, they need to manually browse medical records or switch between different systems. The process is cumbersome and time-consuming, which not only affects the work efficiency of medical staff, but may also affect the patient's diagnosis and care due to untimely information search. Summary of the invention

[0003] 1. Technical issues to be resolved In view of the deficiencies in the prior art, the present invention provides a nursing board interactive system based on intelligent control.

[0004] (II) Technical solution To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a nursing board interactive system based on intelligent control, comprising a nursing board, wherein the nursing board internally comprises a speech recognition and control module integration, a board data interaction and display module, a board function page control module, an intelligent device control module and a feedback and interaction module, wherein the speech recognition and control module integration, the board data interaction and display module, the board function page control module, the intelligent device control module and the feedback and interaction module are electrically connected, and the speech recognition and control module integration comprises: Voice signal acquisition and processing: Use microphone arrays and other hardware devices to collect user voice signals and perform preprocessing operations, including noise suppression, echo cancellation, automatic gain control, etc., to improve the input quality of the voice recognition engine, thereby improving recognition accuracy. Application of speech recognition algorithm: The pre-processed speech signal is input into the speech recognition engine, which uses deep learning algorithm to analyze and decode the speech signal and finally outputs the corresponding text instructions. API interface interaction: The voice recognition and control module implements data interaction with the visual nursing dashboard by calling the API interface provided by the dashboard. These interfaces include data query interface, command execution interface, etc., to ensure that the module can accurately convert user instructions into operations that can be recognized by the dashboard. Instruction parsing and execution: When the voice recognition module outputs a text instruction, the system will parse the instruction to determine its type and target module. For information that needs to be displayed on the large screen (such as patient care records, items to be inspected, etc.), the system will send a query request to the large screen through the API interface and receive the returned data for display; for operations that need to control the large screen display (such as switching pages, adjusting display modes, etc.), the system will directly send control instructions to the large screen through the API interface. Real-time feedback and interaction: During the execution of instructions, the system will use speech synthesis technology to feedback the execution results to the user in the form of voice, and at the same time provide visual feedback in the form of pop-up windows, highlight displays, etc. on the visual nursing dashboard screen to ensure that users can understand the status of instruction execution and system feedback information in real time. Multimodal interaction support: In order to improve the user experience and the naturalness of system interaction, the voice recognition and control module can also be integrated with other interaction methods (such as touch screen operation, gesture recognition, etc.) to form a multimodal interaction system. In this way, users can choose the appropriate interaction method to interact with the large screen according to their personal habits and scene requirements. The dashboard data interaction and display module includes: Connecting HIS system data: According to the interface specifications of the HIS system, integrate the corresponding interface connection program to realize data interaction with the HIS system, including integrating API calls, processing returned data, etc. Adopt a configurable graphical user interface (GUI): According to system requirements, design a dynamically configurable nursing dashboard interface layout, including patient information display area, function button area, etc. Use the graphics library to dynamically configure and realize the visualization of patient data, which includes displaying the acquired patient data on the nursing dashboard in the form of tables, charts, etc. Dynamic configuration adds interactive functions to the GUI, such as clicking buttons to query patient information and dragging to adjust the interface layout. Implement voice broadcast and pop-up notification: Integrate the voice recognition module into the data interaction and display module to receive and analyze voice commands. Use the voice recognition and control module to broadcast the query results to medical staff in voice form. This usually includes converting text data into voice data and playing it through the speaker. When new patient information is received or medical staff needs to be reminded, the system will notify them in the form of a pop-up window. The kanban function page control module includes: Dynamically create a template library: create an independent HTML template file for each functional page, name each template file for quick retrieval later, and classify and store the templates according to business scenarios. Command parsing: Parse the user's voice commands and define the output format of the command parsing results (JSON object), including the command type and related information. Instruction mapping: Create a mapping table from instructions to templates so that the corresponding template file can be found according to the parsing results. Listening command: A listener is set in the function page control module to receive the command analysis results sent by the voice recognition module. Template loading: According to the instruction parsing results, find the corresponding template file from the template library and load it to the front end using asynchronous loading technology (AJAX). Template rendering: Use the rendering mechanism of the front-end template engine or framework to combine the template with dynamic data to generate the final HTML structure, ensuring that the rendering process is fast and efficient to avoid users waiting too long. Set dynamics according to business scenario requirements and configure necessary interactive elements such as forms, buttons, links, etc. in the pop-up window. Event processing: bind event processing functions to interactive elements in the pop-up window, such as clicking a button, submitting a form, etc., and execute corresponding business logic based on user interaction, such as querying data, updating status, etc. Data interaction: If dynamic data needs to be displayed in the pop-up window, such as a patient list, treatment information, etc., it is necessary to interact with the backend service to render the data to the corresponding position in the pop-up window so that users can view and operate it. The smart device control module includes: Device access: Configure a communication module for each type of smart device and register it to the IoT module of the management platform to ensure that the device can stably upload status information and receive control instructions. API design method: Use a unified device control API, define the request format (JSON), return code, permission verification, etc., so that front-end applications and back-end services can call, integrate existing drivers for each device type, ensure that the control commands from the IoT platform can be correctly parsed, and perform corresponding physical operations. Speech recognition and command analysis: Command library construction: According to control requirements, natural language command sets are integrated, such as "turn on the bedside lamp", "lower the air conditioner temperature to 26 degrees", etc., and training optimization is performed to achieve the mapping of commands to device control commands, ensuring that the intent can be accurately recognized even when non-standard expressions are used. User interface: supports voice input and result display, and provides manual control options for emergency use, achieving instant feedback of voice commands, such as voice broadcast confirmation and screen display of operation results, to enhance user experience. Multi-platform adaptation: Use mobile APP, web page and integrate into the existing ward management system to facilitate use by different user groups. The feedback and interaction module includes: Voice command feedback, instant confirmation: When the user issues a voice command, the system immediately confirms that the command has been received through voice or screen display, and briefly repeats the command content to enhance the user's trust. Execution status feedback: When the device starts to execute the command, the system should provide a progress bar, animation or short prompt sound to inform the user that the operation is in progress; Result feedback: After the operation is completed, the system should clearly inform the user of the operation result, such as "the light is on", "the air conditioner temperature has been adjusted to 26 degrees", etc., and update the device status on the front-end interface at the same time. Device status synchronization, real-time update: The IoT platform should continuously receive and process status data from smart devices, such as light brightness, air conditioning temperature, curtain position, etc., and synchronize it to the front-end application in real time. Abnormal alarm: When a device fails or the status is abnormal, the system immediately sends an alarm message to the user, including the abnormal type, possible cause and recommended solution. Multimodal interaction, voice + touch screen: Provide touch screen operation options in the front-end application, and users can use gestures such as clicking and sliding to assist or replace voice commands.

[0005] In order to improve the use effect, the present invention has the following improvements: the communication module is Wi-Fi, Zigbee and Bluetooth.

[0006] In order to improve the beautification and interactivity of the page, the present invention has been improved in that the dynamically created template library can use CSS and JavaScript (or a front-end framework) to beautify the page and enhance the interactivity.

[0007] In order to improve the use effect, the present invention has the following improvements: the monitoring instruction is integrated with the control module using voice recognition, and the query result is broadcast to the medical staff in the form of voice.

[0008] In order to facilitate user viewing, the present invention has an improvement in that the data in the data interaction is rendered to a corresponding position in a pop-up window for user viewing and operation.

[0009] (III) Beneficial effects Compared with the prior art, the present invention provides a nursing board interactive system based on intelligent control, which has the following beneficial effects: This nursing board interactive system based on intelligent control uses advanced preprocessing technology and deep learning algorithms to achieve high-precision voice recognition, and interacts with the visual nursing board screen through an API interface, supports command parsing and execution, and provides real-time voice and visual feedback, as well as multimodal interaction methods, which significantly improves user experience. In addition, the system also includes a board data interaction and display module, which obtains and displays patient data in real time by connecting to the hospital HIS system; a board function page control module, which uses a dynamic template library and rendering technology to achieve fast page loading and interaction; an intelligent device control module, which achieves stable control of various intelligent devices through unified API design and driver integration; and a feedback and interaction module, which provides instant voice command feedback, device status synchronization and abnormal alarm functions to ensure that users can understand the system status in real time. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 It is a system diagram of the present invention; Figure 2 For the present invention Figure 1 Schematic diagram of the data interaction and display module of the central dashboard; Figure 3 For the present invention Figure 1 Schematic diagram of the control module of the central dashboard function page; Figure 4 For the present invention Figure 1 Schematic diagram of intelligent device control module; DETAILED DESCRIPTION

[0011] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0012] See also Figure 1-4 , a nursing board interactive system based on intelligent control, including a nursing board, wherein the nursing board internally includes a speech recognition and control module integration, a board data interaction and display module, a board function page control module, an intelligent device control module and a feedback and interaction module, wherein the speech recognition and control module integration, the board data interaction and display module, the board function page control module, the intelligent device control module and the feedback and interaction module are electrically connected, and the speech recognition and control module integration includes: Voice signal acquisition and processing: Use microphone arrays and other hardware devices to collect user voice signals and perform preprocessing operations, including noise suppression, echo cancellation, automatic gain control, etc., to improve the input quality of the voice recognition engine, thereby improving recognition accuracy. Application of speech recognition algorithm: The pre-processed speech signal is input into the speech recognition engine, which uses deep learning algorithm to analyze and decode the speech signal and finally outputs the corresponding text instructions. API interface interaction: The voice recognition and control module implements data interaction with the visual nursing dashboard by calling the API interface provided by the dashboard. These interfaces include data query interface, command execution interface, etc., to ensure that the module can accurately convert user instructions into operations that can be recognized by the dashboard. Instruction parsing and execution: When the voice recognition module outputs a text instruction, the system will parse the instruction to determine its type and target module. For information that needs to be displayed on the large screen (such as patient care records, items to be inspected, etc.), the system will send a query request to the large screen through the API interface and receive the returned data for display; for operations that need to control the large screen display (such as switching pages, adjusting display modes, etc.), the system will directly send control instructions to the large screen through the API interface. Real-time feedback and interaction: During the execution of instructions, the system will use speech synthesis technology to feedback the execution results to the user in the form of voice, and at the same time provide visual feedback in the form of pop-up windows, highlight displays, etc. on the visual nursing dashboard screen to ensure that users can understand the status of instruction execution and system feedback information in real time. Multimodal interaction support: In order to improve the user experience and the naturalness of system interaction, the voice recognition and control module can also be integrated with other interaction methods (such as touch screen operation, gesture recognition, etc.) to form a multimodal interaction system. In this way, users can choose the appropriate interaction method to interact with the large screen according to their personal habits and scene requirements. The dashboard data interaction and display module includes: Connecting HIS system data: According to the interface specifications of the HIS system, integrate the corresponding interface connection program to realize data interaction with the HIS system, including integrating API calls, processing returned data, etc. Adopt a configurable graphical user interface (GUI): According to system requirements, design a dynamically configurable nursing dashboard interface layout, including patient information display area, function button area, etc. Use the graphics library to dynamically configure and realize the visualization of patient data, which includes displaying the acquired patient data on the nursing dashboard in the form of tables, charts, etc. Dynamic configuration adds interactive functions to the GUI, such as clicking buttons to query patient information and dragging to adjust the interface layout. Implement voice broadcast and pop-up notification: Integrate the voice recognition module into the data interaction and display module to receive and analyze voice commands. Use the voice recognition and control module to broadcast the query results to medical staff in voice form. This usually includes converting text data into voice data and playing it through the speaker. When new patient information is received or medical staff needs to be reminded, the system will notify them in the form of a pop-up window. The kanban function page control module includes: Dynamically create a template library: create an independent HTML template file for each functional page, name each template file for quick retrieval later, and classify and store the templates according to business scenarios. Command parsing: Parse the user's voice commands and define the output format of the command parsing results (JSON object), including the command type and related information. Instruction mapping: Create a mapping table from instructions to templates so that the corresponding template file can be found according to the parsing results. Listening command: A listener is set in the function page control module to receive the command analysis results sent by the voice recognition module. Template loading: According to the instruction parsing results, find the corresponding template file from the template library and load it to the front end using asynchronous loading technology (AJAX). Template rendering: Use the rendering mechanism of the front-end template engine or framework to combine the template with dynamic data to generate the final HTML structure, ensuring that the rendering process is fast and efficient to avoid users waiting too long. Set dynamics according to business scenario requirements and configure necessary interactive elements such as forms, buttons, links, etc. in the pop-up window. Event processing: bind event processing functions to interactive elements in the pop-up window, such as clicking a button, submitting a form, etc., and execute corresponding business logic based on user interaction, such as querying data, updating status, etc. Data interaction: If dynamic data needs to be displayed in the pop-up window, such as a patient list, treatment information, etc., it is necessary to interact with the backend service to render the data to the corresponding position in the pop-up window so that users can view and operate it. The smart device control module includes: Device access: Configure a communication module for each type of smart device and register it to the IoT module of the management platform to ensure that the device can stably upload status information and receive control instructions. API design method: Use a unified device control API, define the request format (JSON), return code, permission verification, etc., so that front-end applications and back-end services can call, integrate existing drivers for each device type, ensure that the control commands from the IoT platform can be correctly parsed, and perform corresponding physical operations. Speech recognition and command analysis: Command library construction: According to control requirements, natural language command sets are integrated, such as "turn on the bedside lamp", "lower the air conditioner temperature to 26 degrees", etc., and training optimization is performed to achieve the mapping of commands to device control commands, ensuring that the intent can be accurately recognized even when non-standard expressions are used. User interface: supports voice input and result display, and provides manual control options for emergency use, achieving instant feedback of voice commands, such as voice broadcast confirmation and screen display of operation results, to enhance user experience. Multi-platform adaptation: Use mobile APP, web page and integrate into the existing ward management system to facilitate use by different user groups. The feedback and interaction module includes: Voice command feedback, instant confirmation: When the user issues a voice command, the system immediately confirms that the command has been received through voice or screen display, and briefly repeats the command content to enhance the user's trust. Execution status feedback: When the device starts to execute the command, the system should provide a progress bar, animation or short prompt sound to inform the user that the operation is in progress; Result feedback: After the operation is completed, the system should clearly inform the user of the operation result, such as "the light is on", "the air conditioner temperature has been adjusted to 26 degrees", etc., and update the device status on the front-end interface at the same time. Device status synchronization, real-time update: The IoT platform should continuously receive and process status data from smart devices, such as light brightness, air conditioning temperature, curtain position, etc., and synchronize it to the front-end application in real time. Abnormal alarm: When a device fails or the status is abnormal, the system immediately sends an alarm message to the user, including the abnormal type, possible cause and recommended solution. Multimodal interaction, voice + touch screen: Provide touch screen operation options in the front-end application, and users can use gestures such as clicking and sliding to assist or replace voice commands.

[0013] In this embodiment, the monitoring instruction is integrated with the voice recognition and control module to broadcast the query results to the medical staff in the form of voice.

[0014] In this embodiment, the data in the data interaction is rendered to a corresponding position in a pop-up window for the user to view and operate.

[0015] To sum up, when this system is in use, it uses hardware devices such as microphone arrays to collect the user's voice signals and performs preprocessing operations, including noise suppression, echo cancellation, automatic gain control, etc., to improve the input quality of the speech recognition engine, thereby improving the recognition accuracy. The preprocessed voice signal is input into the speech recognition engine, and the engine uses a deep learning algorithm to analyze and decode the voice signal, and finally outputs the corresponding text instructions. The speech recognition and control module realizes data interaction with the large screen by calling the API interface provided by the visual nursing dashboard large screen. These interfaces include data query interface, instruction execution interface, etc., to ensure that the module can accurately convert user instructions into operations that can be recognized by the large screen. When the speech recognition module After the block outputs the text instruction, the system will parse the instruction, determine its type and target module, and for information that needs to be displayed on the large screen (such as patient care records, items to be inspected, etc.), the system will send a query request to the large screen through the API interface, and receive the returned data for display; for operations that need to control the large screen display (such as switching pages, adjusting display modes, etc.), the system will directly send control instructions to the large screen through the API interface. During the execution of the instruction, the system will use speech synthesis technology to feedback the execution result to the user in the form of voice, and at the same time provide visual feedback on the visual nursing dashboard screen in the form of pop-up windows, highlighted displays, etc., to ensure that users can understand the instruction execution status and system feedback information in real time. In order to improve user experience and The naturalness of system interaction, the voice recognition and control module can also be integrated with other interaction methods (such as touch screen operation, gesture recognition, etc.) to form a multimodal interaction system. In this way, users can choose the appropriate interaction method to interact with the large screen according to personal habits and scene requirements. This system frees your hands through voice interaction: users can easily control all smart devices in the ward through voice commands without touching any physical buttons or mice, which greatly reduces the operating burden of patients and medical staff. Instant feedback, intuitive and clear: the system can respond to commands quickly and provide instant feedback on device status and operation results through voice, screen display, etc., to ensure that users can grasp the ward environment at any time, accurately control, and reduce errors: automated control system It can accurately execute instructions, avoid the errors and uncertainties that may be caused by manual operation, and improve the accuracy and reliability of nursing work. It is personalized and customized to meet needs: the system supports users to set equipment parameters according to personal preferences and needs, such as light brightness, air-conditioning temperature, etc., to provide patients with a personalized comfortable experience. Flexible configuration: users can customize the layout and display content of the dashboard page according to actual needs to meet the nursing needs in different scenarios. Data visualization: The equipment usage data and patient vital signs are intuitively displayed through charts, curves, etc., which is convenient for medical staff to analyze and make decisions, and promote doctor-patient communication: The dashboard function page and data interaction module provide a convenient communication channel for both doctors and patients, which helps to enhance mutual understanding and trust.

[0016] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A nursing board interactive system based on intelligent control, comprising a nursing board, wherein the nursing board internally includes a speech recognition and control module integration, a board data interaction and display module, a board function page control module, an intelligent device control module and a feedback and interaction module, characterized in that: The speech recognition and control module is integrated, and the kanban data interaction and display module, the kanban function page control module, the smart device control module and the feedback and interaction module are electrically connected. The speech recognition and control module is integrated and includes: Voice signal acquisition and processing: Use microphone arrays and other hardware devices to collect user voice signals and perform preprocessing operations, including noise suppression, echo cancellation, automatic gain control, etc., to improve the input quality of the voice recognition engine, thereby improving recognition accuracy. Application of speech recognition algorithm: The pre-processed speech signal is input into the speech recognition engine, which uses deep learning algorithm to analyze and decode the speech signal and finally outputs the corresponding text instructions. API interface interaction: The voice recognition and control module implements data interaction with the visual nursing dashboard by calling the API interface provided by the dashboard. These interfaces include data query interface, command execution interface, etc., to ensure that the module can accurately convert user instructions into operations that can be recognized by the dashboard. Instruction parsing and execution: When the voice recognition module outputs a text instruction, the system will parse the instruction to determine its type and target module. For information that needs to be displayed on the large screen (such as patient care records, items to be inspected, etc.), the system will send a query request to the large screen through the API interface and receive the returned data for display; for operations that need to control the large screen display (such as switching pages, adjusting display modes, etc.), the system will directly send control instructions to the large screen through the API interface. Real-time feedback and interaction: During the execution of instructions, the system will use speech synthesis technology to feedback the execution results to the user in the form of voice, and at the same time provide visual feedback in the form of pop-up windows, highlight displays, etc. on the visual nursing dashboard screen to ensure that users can understand the status of instruction execution and system feedback information in real time. Multimodal interaction support: In order to improve the user experience and the naturalness of system interaction, the voice recognition and control module can also be integrated with other interaction methods (such as touch screen operation, gesture recognition, etc.) to form a multimodal interaction system. In this way, users can choose the appropriate interaction method to interact with the large screen according to their personal habits and scene requirements. The dashboard data interaction and display module includes: Connecting HIS system data: According to the interface specifications of the HIS system, integrate the corresponding interface connection program to realize data interaction with the HIS system, including integrating API calls, processing returned data, etc. Adopt a configurable graphical user interface (GUI): According to system requirements, design a dynamically configurable nursing dashboard interface layout, including patient information display area, function button area, etc. Use the graphics library to dynamically configure and realize the visualization of patient data, which includes displaying the acquired patient data on the nursing dashboard in the form of tables, charts, etc. Dynamic configuration adds interactive functions to the GUI, such as clicking buttons to query patient information and dragging to adjust the interface layout. Implement voice broadcast and pop-up notification: Integrate the voice recognition module into the data interaction and display module to receive and analyze voice commands. Use the voice recognition and control module to broadcast the query results to medical staff in voice form. This usually includes converting text data into voice data and playing it through the speaker. When new patient information is received or medical staff needs to be reminded, the system will notify them in the form of a pop-up window. The kanban function page control module includes: Dynamically create a template library: create an independent HTML template file for each functional page, name each template file for quick retrieval later, and classify and store the templates according to business scenarios. Command parsing: Parse the user's voice commands and define the output format of the command parsing results (JSON object), including the command type and related information. Instruction mapping: Create a mapping table from instructions to templates so that the corresponding template file can be found according to the parsing results. Listening command: A listener is set in the function page control module to receive the command analysis results sent by the voice recognition module. Template loading: According to the instruction parsing results, find the corresponding template file from the template library and load it to the front end using asynchronous loading technology (AJAX). Template rendering: Use the rendering mechanism of the front-end template engine or framework to combine the template with dynamic data to generate the final HTML structure, ensuring that the rendering process is fast and efficient to avoid users waiting too long. Set dynamics according to business scenario requirements and configure necessary interactive elements such as forms, buttons, links, etc. in the pop-up window. Event processing: bind event processing functions to interactive elements in the pop-up window, such as clicking a button, submitting a form, etc., and execute corresponding business logic based on user interaction, such as querying data, updating status, etc. Data interaction: If dynamic data needs to be displayed in the pop-up window, such as a patient list, treatment information, etc., it is necessary to interact with the backend service to render the data to the corresponding position in the pop-up window so that users can view and operate it. The intelligent device control module comprises: Device access: Configure a communication module for each type of smart device and register it to the IoT module of the management platform to ensure that the device can stably upload status information and receive control instructions. API design method: Use a unified device control API, define the request format (JSON), return code, permission verification, etc., so that front-end applications and back-end services can call, integrate existing drivers for each device type, ensure that the control commands from the IoT platform can be correctly parsed, and perform corresponding physical operations. Speech recognition and command analysis: Command library construction: According to control requirements, natural language command sets are integrated, such as "turn on the bedside lamp", "lower the air conditioning temperature to 26 degrees", etc., and training optimization is performed to achieve the mapping of commands to device control commands, ensuring that the intent can be accurately recognized even when non-standard expressions are used. User interface: supports voice input and result display, and provides manual control options for emergency use, achieving instant feedback of voice commands, such as voice broadcast confirmation and screen display of operation results, to enhance user experience. Multi-platform adaptation: Use mobile APP, web page and integrate into the existing ward management system to facilitate use by different user groups. The feedback and interaction module includes: Voice command feedback, instant confirmation: When the user issues a voice command, the system immediately confirms that the command has been received through voice or screen display, and briefly repeats the command content to enhance the user's trust. Execution status feedback: When the device starts to execute the command, the system should provide a progress bar, animation or short prompt sound to inform the user that the operation is in progress; Result feedback: After the operation is completed, the system should clearly inform the user of the operation result, such as "the lights are on", "the air conditioning temperature has been adjusted to 26 degrees", etc., and update the device status on the front-end interface at the same time. Device status synchronization, real-time update: The IoT platform should continuously receive and process status data from smart devices, such as light brightness, air conditioning temperature, curtain position, etc., and synchronize it to the front-end application in real time. Abnormal alarm: When a device fails or the status is abnormal, the system immediately sends an alarm message to the user, including the abnormal type, possible cause and recommended solution. Multimodal interaction, voice + touch screen: Provide touch screen operation options in the front-end application, and users can use gestures such as clicking and sliding to assist or replace voice commands.

2. According to claim 1, a nursing board interactive system based on intelligent control is characterized by: The communication modules are Wi-Fi, Zigbee and Bluetooth.

3. According to claim 2, a nursing board interactive system based on intelligent control is characterized in that: The dynamically created template library can use CSS and JavaScript (or front-end framework) to beautify the page and enhance interactivity.

4. According to claim 3, a nursing board interactive system based on intelligent control is characterized in that: The monitoring instruction is integrated with the voice recognition and control module to broadcast the query results to the medical staff in the form of voice.

5. According to claim 4, a nursing board interactive system based on intelligent control is characterized in that: The data in the data interaction is rendered to the corresponding position in the pop-up window for the user to view and operate.

Images