Intelligent ward interaction system based on non-invasive brain-computer interface

Abstract

The invention relates to an intelligent ward interaction system based on a non-invasive brain-computer interface. The intelligent ward interaction system is characterized by comprising an intelligent head ring used for collecting head signals of a user, a PC end processing system and an intelligent ward system; a head posture detection module, a head electroencephalogram signal acquisition module and a user electro-oculogram signal acquisition module which are respectively used for acquiring a user head posture signal, a user electroencephalogram signal and a user electro-oculogram signal are arranged in the intelligent head ring; after the PC end processing system receives the head signal data of the user, the head signal data is subjected to signal analysis, feature extraction and mode recognition through a built-in man-machine interaction module, and is converted into an ROS instruction which can be recognized by an intelligent ward system; after the intelligent ward system receives the ROS instruction transmitted by the PC end processing system, instruction execution of corresponding equipment is completed through a built-in ROS node management module and a node execution unit. The problems that an existing intelligent ward system is complex in operation, poor in stability and poor in user experience are solved.

Description

Technical Field

[0001] The present invention belongs to the field of brain-computer interface medical technology application systems, and specifically relates to an intelligent ward interaction system based on a non-invasive brain-computer interface. Background Art

[0002] With the rapid development of science and technology, the deep integration and continuous innovation of cutting-edge technologies such as the Internet of Things, artificial intelligence, big data, and cloud computing are profoundly changing the face of smart wards and even the entire smart living space. As a shining pearl in this technological wave, the smart ward system uses the Internet of Things technology to build a bridge for seamless connection between devices, achieving a high degree of intelligent and scenario-based coordination, and greatly enhancing the safety, convenience, comfort and aesthetic experience of the ward environment. However, in the process of moving towards higher intelligence and personalization, the traditional smart ward system that relies on remote controls, mobile phone apps and voice control, although it has significantly improved the user experience, is still insufficient in the pursuit of extreme convenience, intuitive operation and personalized customization.

[0003] Faced with the current situation of accelerated aging of my country's social structure and the increasing proportion of the elderly population, the demand for aging-friendly and intelligent transformation of the living environment of the elderly group is becoming more urgent. In order to more accurately meet the special needs of this group, the state machine control method of the smart ward system based on non-invasive brain-computer interface technology came into being, opening up a new path for the future development of smart wards. This technology not only breaks the limitations of traditional control methods, but also realizes an unprecedented natural, intuitive and personalized control method by directly analyzing the user's EEG signals.

[0004] The introduction of non-invasive brain-computer interface technology means that elderly patients can easily control various devices in the ward with their brains, such as adjusting the brightness of lights, controlling the opening and closing of curtains, and adjusting the height of beds, without the need for any external equipment or complicated operation steps, greatly improving the convenience and comfort of operation. At the same time, the technology can also conduct personalized learning based on the user's EEG characteristics, gradually optimize the control logic, make the system more in line with the user's personalized needs and habits, and truly realize the intelligent experience of "what you want is what you get".

[0005] The non-invasive brain-computer interface technology based on Python programming, with its powerful data processing capabilities and rich library support, provides strong technical support for the implementation of the smart ward control system. The algorithm written in Python can efficiently process EEG signals, accurately identify the patient's control intentions, and convert them into corresponding control instructions to achieve precise control of various devices in the ward. This control method is not only more intuitive and convenient, but also can be flexibly adjusted according to the patient's personalized needs, bringing an unprecedented level of intelligence to the smart ward control system.

[0006] In summary, the development of an intelligent ward control system based on a non-invasive brain-computer interface not only conforms to the current development trend of intelligent ward technology, but also meets the needs of the elderly and special medical environments for intelligent and personalized services. It has important practical significance and broad application prospects. Summary of the invention

[0007] The purpose of the present invention is to provide a smart ward interaction system based on a non-invasive brain-computer interface to solve the problems of complex operation, insufficient stability and poor user experience of existing smart ward systems; to achieve direct recognition of user intentions and precise control of ward equipment, thereby improving the user's sense of security, comfort and convenience of life. This is of great significance to groups such as the elderly with limited mobility and the disabled.

[0008] To achieve the above purpose, the technical solution of the present invention is as follows:

[0009] A smart ward interaction system based on a non-invasive brain-computer interface, the system comprising a smart headband for collecting user head signals, a PC-side processing system communicatively connected to the smart headband, and a smart ward system communicatively connected to the PC-side processing system; the smart headband is provided with a head posture detection module, a head EEG signal collection module and a user EEG signal collection module for respectively collecting user head posture signals, user EEG signals and user EEG signals; after receiving the user head signal data, the PC-side processing system performs signal analysis, feature extraction and pattern recognition through a built-in human-computer interaction module, and converts the signal into a ROS instruction recognizable by the smart ward system; after receiving the ROS instruction from the PC-side processing system, the smart ward system completes the instruction execution of the corresponding device through a built-in ROS node management module and a node execution unit.

[0010] As a further improvement of the above solution, the user obtains the posture data of the user's head in real time through a gyroscope provided in the head posture detection module.

[0011] As a further improvement of the above solution, a multimodal brain-computer interface system is provided in the human-computer interaction module to allow the user to control external devices according to the actual application design program.

[0012] This invention will promote the cross-integration and innovative development of brain-computer interface technology, Internet of Things technology, artificial intelligence and other fields, and bring new growth points to the smart ward industry. At the same time, the system simulates the natural communication mode of human beings to achieve seamless interaction between people and ward equipment, and enhance the naturalness and affinity of human-computer interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is a schematic diagram of the overall hardware framework of the present invention.

[0014] Figure 2 It is a state flow chart of the present invention.

[0015] Figure 3 It is a schematic diagram of the underlying code execution logic of the present invention. DETAILED DESCRIPTION

[0016] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0017] Reference Figure 1 , Figure 2 and Figure 3 , an intelligent ward interaction system based on a non-invasive brain-computer interface, the system comprising an intelligent headband 1 for collecting user head signals, a PC-side processing system 2 communicatively connected to the intelligent headband 1, and an intelligent ward system 3 communicatively connected to the PC-side processing system 2; the intelligent headband 1 is provided with a head posture detection module, a head EEG signal acquisition module and a user EEG signal acquisition module for respectively collecting user head posture signals, user EEG signals and user EEG signals; after receiving the user head signal data, the PC-side processing system 2 performs signal analysis, feature extraction and pattern recognition through the built-in human-computer interaction module, and converts them into ROS instructions recognizable by the intelligent ward system 3; after receiving the ROS instructions from the PC-side processing system, the intelligent ward system completes the instruction execution of the corresponding device through the built-in ROS node management module and node execution unit.

[0018] The user obtains the head posture data of the user in real time through the gyroscope in the head posture detection module. The human-computer interaction module is provided with a multi-modal brain-computer interface system to allow the user to control the external device according to the actual application design program.

[0019] The smart headband uses the blink detection SDK, and the user uses the HNNK EEG acquisition headband to complete the collection and analysis of eyeball signals, and finally realizes the operation function of controlling the PC processing system through blinking.

[0020] Reference Figure 1 , Figure 2 and Figure 3 , which consists of a technical solution for an intelligent ward interaction system based on a non-invasive brain-computer interface.

[0021] 1. Hardware composition.

[0022] Smart headband: Integrates high-precision head EEG signal acquisition module and user eye electrogram signal acquisition module to ensure accurate signal capture and transmission.

[0023] PC processing system: receives signal data transmitted by the headband, performs signal analysis, feature extraction and pattern recognition through the human-computer interaction module, and converts them into ROS (Robot Operating System) instructions that can be recognized by the smart ward system.

[0024] Smart ward system: includes management module and execution unit, which are responsible for receiving PC instructions and executing corresponding operations, covering air conditioners, refrigerators, sweeping robots, rice cookers, lighting systems, curtains, smart door locks, electric wheelchairs, music players and other equipment.

[0025] 2. Control process.

[0026] Device selection: The user wears the headband and selects the target device from the preset device list by moving the head up and down.

[0027] Function execution: After selecting a device, the user continues to move his head up, down, left, and right to execute specific functions, such as turning the device on and off, adjusting the temperature / brightness, etc.

[0028] Attention detection: Before the control process starts, the system detects the user's attention level through a built-in algorithm to ensure that the user is in a focused state and improve control accuracy and safety.

[0029] Multi-modal integrated control: supports access and control of multiple smart ward devices, uses IoT technology to achieve seamless connection and collaborative work between devices, and improves the overall intelligence level of the ward environment.

[0030] 3. Other aspects.

[0031] Head posture detection module, head EEG signal acquisition module and user eye electrogram signal acquisition module: use non-invasive EEG sensors to collect patient EEG signals in real time, and use signal processing algorithms to analyze patient intentions.

[0032] Network communication module: Use HTTP protocol and network communication library to connect to the network of smart devices in the ward to realize device status query and remote control.

[0033] Smart device control module: automatically generates control instructions based on the analyzed patient intentions and sends them to the smart device through the network communication module.

[0034] User interaction interface: Provides a visual interface to display ward environmental parameters, equipment status, and patient health status, and receives asynchronous responses from smart devices to update interface information.

[0035] The network communication module supports TCP / IP protocol: establishes a connection with the smart device through the IP address and port number in the local area network.

[0036] Software system: This system uses Python to write the underlying control logic. At the user interface level, the PyQt framework is used for page development to implement API interfaces for calling multiple devices on one control interface.

[0037] The specific implementation steps are as follows: First, the built-in gyroscope of the smart headband worn on the head captures the subtle movements of the head in real time to achieve "mind control" of the mouse. The user only needs to turn his head left or right to simulate the left and right movement of the mouse on the screen; lowering the head and raising the head correspond to the up and down movement of the mouse respectively. This design greatly simplifies the tedious operation of traditional mouse and makes the operation more natural and smooth.

[0038] Furthermore, the headband can collect and analyze the user's EEG and EOG signals in real time. When the EEG signal strength in a specific direction exceeds the preset threshold, the system recognizes that the user intends to move the mouse in that direction. When the user actively performs a single blink, and the EOG signal at this time also exceeds the set threshold, it is regarded as a mouse click. This innovative combination allows users to complete complex command input without any external equipment or hand movements, only by head posture and blinking.

[0039] In order to improve the user experience, the present invention also considerately sets a "return" button on each operation page, so that users can withdraw or reselect operations at any time. Users only need to wear the headband and establish a connection with the PC through the built-in Bluetooth module to enter the software human-computer interaction interface carefully designed by the researchers of the present invention.

[0040] Taking the air conditioning control in the smart ward as an example, when the user selects the ward page, he or she adjusts the cursor to the air conditioning icon position through head gestures and performs a single blink action to confirm entering the air conditioning function selection page. Then, he or she moves the head up, down, left, and right to select the air conditioning mode such as cooling, heating, dehumidification, and blowing, and blinks again to execute the selected function.

[0041] In addition, with the in-depth research and development of the present invention, users can also control other smart devices in the ward in the same way, such as robots (start, recharge), rice cookers (mode selection, start / stop), lights (on / off), music players (play / pause, switch songs), curtains (on / off) and smart door locks (access control). The integration of this series of functions not only greatly improves the intelligent level of ward management, but also brings unprecedented convenience and comfort to patients and medical staff.

[0042] Beneficial effects of this embodiment.

[0043] 1. Improve user experience: Users do not need to rely on remote controls, mobile phone apps or voice commands, but can directly control the ward through EEG signals. The operation is more intuitive and natural, significantly improving the user experience.

[0044] 2. Enhance the ability to take care of oneself: For special groups such as the elderly and disabled people with limited mobility, this method provides a new and independent control method to effectively enhance their ability to take care of themselves.

[0045] 3. Improve control convenience and intuitiveness: The system can capture and identify the user's control intention in real time, respond quickly and execute corresponding operations, making ward control more convenient and efficient.

[0046] 4. Expand application scenarios: Promote the penetration of smart ward technology into more fields, such as medical rehabilitation, education and entertainment, and enrich the application scenarios of smart wards.

[0047] 5. Promote technological innovation and development: The implementation of this invention will promote the cross-integration and innovative development of brain-computer interface technology, Internet of Things technology, artificial intelligence and other fields, and bring new growth points to the smart ward industry.

[0048] 6. Enhance the naturalness and affinity of human-computer interaction: By simulating the natural way of human communication, seamless interaction between people and ward equipment can be achieved, enhancing the naturalness and affinity of human-computer interaction.

[0049] The present invention solves the problems of complicated operation, insufficient stability and poor user experience of existing smart ward systems; it can directly identify user intentions and accurately control ward equipment, thereby improving users' sense of security, comfort and convenience of life. This is of great significance to groups such as the elderly with limited mobility and the disabled.

[0050] The examples described above clearly illustrate the embodiments of the present invention in order to better illustrate the technical ideas of the present invention. For technicians in this field, various forms of changes and modifications can be made on the basis of this specification, and the obvious and reasonable extensions of these changes and modifications still fall within the scope of protection of the present invention.

Claims

1. An intelligent ward interaction system based on a non-invasive brain-computer interface, characterized in that: The system includes a smart headband for collecting user head signals, a PC-side processing system connected to the smart headband for communication, and a smart ward system connected to the PC-side processing system for communication; the smart headband is provided with a head posture detection module, a head EEG signal collection module, and a user EEG signal collection module for respectively collecting user head posture signals, user EEG signals, and user EEG signals; after receiving the user head signal data, the PC-side processing system performs signal analysis, feature extraction, and pattern recognition through a built-in human-computer interaction module, and converts the signal into a ROS instruction recognizable by the smart ward system; after receiving the ROS instruction from the PC-side processing system, the smart ward system completes the instruction execution of the corresponding device through a built-in ROS node management module and a node execution unit.

2. According to claim 1, a smart ward interaction system based on a non-invasive brain-computer interface is characterized in that: The user obtains the posture data of the user's head in real time through the gyroscope arranged in the head posture detection module.

3. According to claim 1, the intelligent ward interaction system based on non-invasive brain-computer interface is characterized in that: The human-computer interaction module is provided with a multimodal brain-computer interface system, so that the user can control the external device according to the actual application design program.

Images