Immersive somatosensory interaction clinical nursing skill simulation medical staff training cabin

Abstract

The invention discloses an immersive somatosensory interaction clinical nursing skill simulation medical staff training cabin, and belongs to the field of medical training. An immersive somatosensory interactive clinical nursing skill simulation medical staff training cabin comprises a multi-sense immersion system, a somatosensory interaction system and a data recording system. The problem that in the prior art, the practice opportunities of students are limited is solved, the multi-sensory immersion system provides a highly real and immersive nursing scene for trainees by simulating environmental factors such as temperature, smell and background noise, the somatosensory interaction system captures actions in real time through the multi-sensor fusion technology, and the training effect is improved. The system combines functions of tactile feedback, emotion simulation, voice interaction, team cooperation and the like to provide immersive interaction experience for trainees, and the data recording system provides a real-time observation and intervention tool for a tutor by monitoring and recording the training process in real time, so that the tutor can accurately know the long-term training effect of the trainees.

Description

Technical Field

[0001] The present invention relates to the field of medical training technology, and in particular to an immersive somatosensory interactive clinical nursing skills simulation training cabin for medical personnel. Background Art

[0002] Clinical nursing is a patient-centered, practical discipline within the healthcare system that promotes patient recovery through professional assessment, intervention, and health education. Its core is to provide patients with comprehensive, personalized medical care, encompassing disease prevention, treatment assistance, rehabilitation support, and other aspects of health management throughout the entire lifecycle. Traditional clinical nursing education is often limited by resource scarcity, single scenarios, and high risk. This results in limited student practical opportunities and slow skill development. Therefore, it falls short of current needs. To address this, we have developed an immersive, interactive clinical nursing skills simulation training cabin for medical staff. Summary of the Invention

[0003] The purpose of the present invention is to provide an immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin. Through the multi-sensory immersion system, by simulating environmental factors such as temperature, smell and background noise, a highly realistic and immersive nursing scene is provided for trainees. The somatosensory interaction system uses multi-sensor fusion technology to capture movements in real time, and combines tactile feedback, emotion simulation function, voice interaction and team collaboration to provide trainees with an immersive interactive experience. The data recording system provides instructors with real-time observation and intervention tools by real-time monitoring and recording of the training process, enabling instructors to accurately evaluate the long-term progress and skill improvement of trainees, solving the problems raised in the above-mentioned background technology.

[0004] To achieve the above objectives, the present invention provides the following technical solutions: an immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin, the training cabin comprising a multi-sensory immersion system, a somatosensory interaction system, and a data recording system; The multi-sensory immersion system is configured to simulate different temperature environments, clinical odors, and ward background noises in the training cabin, and provide trainees with nursing scenario templates of varying complexity; Among them, by monitoring the respiratory rate in real time and comparing it with the preset threshold, when the respiratory rate does not exceed the threshold, the odor is simulated according to the preset basic drug gas concentration; When the respiratory rate exceeds the preset respiratory rate threshold, the error rate of the current trainee's operation is retrieved and normalized; The normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration; The somatosensory interaction system is configured to capture the trainer's movements through multi-sensor fusion technology, adjust the tactile feedback intensity in real time, and introduce an emotion simulation function so that the virtual nursing object can show different emotional reactions based on the trainer's behavior. It also supports voice interaction and multi-trainer simulation team collaboration scenarios; The data recording system is configured to monitor the training process of the trainees in real time, allowing the instructor to observe the training process of the trainees in real time and intervene in the training scenario.

[0005] Furthermore, the multi-sensory immersive system includes: The sensory simulation unit is configured to simulate different temperature environments, clinical odors, and ward background noise in the training cabin through a temperature control device, an odor simulation device, and a sound effect device installed on the top of the training cabin; The scene simulation unit is configured based on a modular scene library, which contains a variety of nursing scene templates. It creates immersive nursing scenes by combining the temperature control, smell and sound effects of the sensory simulation unit.

[0006] Furthermore, the sensory simulation unit includes: A temperature control simulation module is configured to simulate nursing scenarios under different temperature environments in the training cabin through a temperature control device; an odor simulation module, configured to simulate odors in a clinical environment in the training cabin through an odor simulation device, including but not limited to disinfectant and medicine odors; The sound effect simulation module is configured to simulate the background noise in the ward in the training cabin through the sound effect device, including but not limited to the sound of instruments and the coughing of patients.

[0007] Furthermore, the odor simulation module executes the steps including: Real-time monitoring of trainees’ respiratory rate; comparing the trainee's respiratory rate to a preset respiratory rate threshold; When the trainee's respiratory rate does not exceed a preset respiratory rate threshold, simulating the odor in a clinical environment according to a preset basic drug gas concentration; When the trainee's breathing rate exceeds a preset breathing rate threshold, the error rate of the trainee's current operation is retrieved; comparing the error rate of the current trainee's operation with a preset error rate reference value; When the error rate of the current trainee's operation does not exceed the preset error rate reference value, the current basic drug gas concentration is not adjusted; When the error rate of the current trainee's operation exceeds a preset error rate reference value, normalizing the error rate of the current trainee's operation to obtain a normalized error rate value; The normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration.

[0008] Furthermore, the normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration. The execution steps include: Retrieve the normalized error rate value; Retrieve the drug gas concentration adjustment sensitivity coefficient from the database; Real-time monitoring of the trainee's breathing rate; Obtaining a standard deviation of the trainee's respiratory rate according to the current trainee's respiratory rate; extracting the difference between the error rate when the error rate of the current trainee's operation exceeds the preset error rate reference value and the error rate reference value; The basic drug gas concentration is adjusted using the difference between the error rate and the error rate reference value in combination with the trainee's respiratory rate standard deviation and the drug gas concentration adjustment sensitivity coefficient.

[0009] Furthermore, the somatosensory interaction system includes: A motion capture unit is configured to capture the trainee's hand, head, and whole-body movements in real time through multi-sensor fusion technology during simulated nursing operations, and to analyze the captured motion data through a deep learning model to identify the trainee's operational behavior; A tactile feedback unit is configured to adjust the tactile feedback intensity in real time based on the trainee's operation and the nursing scenario, simulating resistance and feedback during operation; An emotion simulation unit is configured to dynamically adjust the virtual care recipient's facial expressions, voice intonation, body language, and various emotional responses based on the analysis results of the motion capture unit. The emotion simulation unit incorporates an emotion memory mechanism, allowing the virtual care recipient to adjust its emotional responses based on historical interaction records. If the trainer repeatedly demonstrates patience and care in their actions, the virtual care recipient's emotions will gradually stabilize. a voice interaction unit configured to achieve two-way voice interaction through voice recognition and voice synthesis technology, so that the training personnel can communicate with the virtual nursing object through voice; The group collaboration unit is configured to support simultaneous training of multiple trainees, simulate team collaboration scenarios, and evaluate the coordination between team members through real-time data synchronization and collaborative feedback mechanisms.

[0010] Furthermore, the tactile feedback unit includes: An adaptive module configured to dynamically adjust the lightness of tactile feedback according to the complexity of the nursing scenario, including but not limited to providing high-precision resistance feedback during simulated surgery and providing soft tactile prompts during simulated patient transport; The touch simulation module is configured to combine temperature, vibration and pressure sensors to simulate the touch of different nursing tools and temperature changes of the patient's body.

[0011] Furthermore, the voice interaction unit includes: A semantic analysis module configured to collect and analyze the trainee's speech content in real time using natural language processing technology to identify the trainee's emotional state and semantic intent; The voice interaction module is configured to generate voice interaction content of the virtual nursing object through speech synthesis technology, and adjust the voice tone and expression of the virtual nursing object according to the emotional state and semantic intention of the trainer.

[0012] Furthermore, the group collaboration unit includes: a role assignment module configured to assign different roles to trainees based on their previous skill levels and historical training data, and to introduce random events, including but not limited to equipment failures and patient emergencies; The effect evaluation module is configured to perform real-time synchronization and collaborative feedback on team collaboration data. Based on real-time data synchronization and collaborative feedback, it evaluates the cooperation effect between team members, including communication efficiency, rationality of task division, emergency response and response speed, and generates a collaboration evaluation report.

[0013] Furthermore, the data recording system includes: The data monitoring unit is configured as a monitoring device installed on the walls around the training cabin, which monitors and records the training process of the trainees in real time and obtains the training data of the trainees; an observation intervention unit, configured to provide a dedicated control interface for the instructor and allow the instructor to observe the trainee's training process in real time, and based on the observed training process, the instructor adjusts the trainee's nursing scenario complexity or the virtual nursing object's response in real time through the control interface; A visualization unit is configured to display the training process and training data in the form of images and videos and conduct comparative analysis to understand the long-term training effect of the trainees; Among them, the training process and training data shown are compared and analyzed, and the following process is performed: Store the training history data of trainees at different time points; Compare and analyze the current training data and training process with the stored training history data; Through comparative analysis, you can view the performance of trainees at different time points and understand the long-term training effects of trainees.

[0014] Compared with the prior art, the present invention has the following beneficial effects: The multi-sensory immersion system of the present invention provides trainees with highly realistic and immersive nursing scenarios by simulating environmental factors such as temperature, smell and background noise, thereby helping trainees to quickly adapt to the complex and changing clinical environment. The somatosensory interaction system uses multi-sensor fusion technology to capture movements in real time, and combines tactile feedback and emotion simulation functions to enable trainees to feel realistic operational resistance and the emotional reactions of virtual nursing objects, thereby improving operational skills and emotional management capabilities. The voice interaction function further enhances the authenticity and interactivity of training, enabling trainees to effectively communicate with virtual nursing objects through natural language. The group collaboration function can support multiple trainees to participate in team collaboration scenarios at the same time, effectively improving team collaboration capabilities. The data recording system provides instructors with real-time observation and intervention tools by real-time monitoring and recording of the training process, and also supports visualization and comparative analysis of training data, enabling instructors to accurately evaluate the long-term progress and skill improvement of trainees. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is the overall structural diagram of the training cabin of the present invention; Figure 2 This is a schematic diagram of the modules of the training cabin of the present invention.

[0016] In the figure: 1. Temperature control device; 2. Odor simulation device; 3. Sound effect device; 4. Monitoring device. DETAILED DESCRIPTION

[0017] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0018] In order to solve the technical problems of current clinical nursing teaching, which is often limited by scarce resources, single scenarios, high risks, limited opportunities for students to practice, and slow skill improvement, please refer to Figure 1-Figure 2 , this embodiment provides the following technical solutions: An immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin, which includes a multi-sensory immersion system, a somatosensory interaction system, and a data recording system; The multi-sensory immersion system is configured to simulate different temperature environments, clinical odors, and ward background noises in the training cabin, and provide trainees with nursing scenario templates of varying complexity; Among them, by monitoring the respiratory rate in real time and comparing it with the preset threshold, when the respiratory rate does not exceed the threshold, the odor is simulated according to the preset basic drug gas concentration; When the respiratory rate exceeds the preset respiratory rate threshold, the error rate of the current trainee's operation is retrieved and normalized; The normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration; The somatosensory interaction system is configured to capture the trainer's movements through multi-sensor fusion technology, adjust the tactile feedback intensity in real time, and introduce an emotion simulation function so that the virtual nursing object can show different emotional reactions based on the trainer's behavior. It also supports voice interaction and multi-trainer simulation team collaboration scenarios; The data recording system is configured to monitor the training process of the trainees in real time, allowing the instructor to observe the training process of the trainees in real time and intervene in the training scenario.

[0019] The technical effects of the above technical solution are as follows: the multi-sensory immersion system simulates different temperature environments, clinical odors and ward background noises, and the training cabin can create a highly realistic clinical nursing scene, helping trainees to conduct skill training under conditions close to the real environment, thereby improving their ability to cope with complex clinical environments. The somatosensory interaction system uses multi-sensor fusion technology to capture movements in real time, and combines tactile feedback, emotion simulation functions, voice interaction and team collaboration to provide trainees with an immersive interactive experience, further enhancing the sense of immersion, and the data recording system can monitor the training process in real time and provide instructors with comprehensive training data support, so that instructors can observe the training process in real time and intervene to ensure the correctness of the training direction.

[0020] Multi-sensory immersion system, including: The sensory simulation unit is configured to simulate different temperature environments, clinical odors, and ward background noise in the training cabin through the temperature control device 1, odor simulation device 2, and sound effect device 3 installed on the top of the training cabin; The scenario simulation unit is configured as a modular scenario library with a variety of preset nursing scenario templates. It creates immersive nursing scenarios by combining the temperature control, smell and sound effects of the sensory simulation unit; Among them, the sensory simulation unit includes: The temperature control simulation module is configured to simulate nursing scenarios under different temperature environments (such as high temperature, low temperature or normal temperature) in the training cabin through the temperature control device 1, so as to help trainees adapt to nursing work in extreme or special environments and enhance their coping capabilities; An odor simulation module is configured to simulate odors in a clinical environment, including but not limited to disinfectant and medicine odors, in a training cabin through an odor simulation device 2, so that trainees can become familiar with the olfactory characteristics of real nursing scenarios in the simulated environment and improve their sensitivity to abnormal odors; The sound simulation module is configured to simulate the background noise in the ward in the training cabin through the sound device 3, including but not limited to the sound of instruments and the coughing of patients, so as to create a realistic auditory environment and help trainees stay focused in noisy or specific sound environments.

[0021] The technical effect of the above technical solution is: the sensory simulation unit can create a highly immersive nursing environment through the synergistic effect of temperature control, smell and sound effects, allowing trainees to feel the real clinical scenes in terms of vision, hearing, smell and touch, thereby improving the authenticity and sense of substitution of training. This multi-sensory immersion helps trainees adapt to the real environment more quickly and reduce tension or mistakes caused by unfamiliar environment. The scene simulation unit provides a variety of preset scene templates, which can be quickly switched or combined according to training needs to meet the training requirements of different nursing skills.

[0022] Specifically, the odor simulation module executes the following steps: Real-time monitoring of trainees’ respiratory rate; comparing the trainee's respiratory rate to a preset respiratory rate threshold; When the trainee's respiratory rate does not exceed a preset respiratory rate threshold, simulating the odor in a clinical environment according to a preset basic drug gas concentration; When the trainee's breathing rate exceeds a preset breathing rate threshold, the error rate of the trainee's current operation is retrieved; comparing the error rate of the current trainee's operation with a preset error rate reference value; When the error rate of the current trainee's operation does not exceed the preset error rate reference value, the current basic drug gas concentration is not adjusted; When the error rate of the current trainee's operation exceeds a preset error rate reference value, normalizing the error rate of the current trainee's operation to obtain a normalized error rate value; The normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration.

[0023] The technical advantages of the above-mentioned technical solution are: by monitoring respiratory rate in real time and comparing it with a threshold, simulating odor at a preset baseline drug gas concentration when the respiratory rate does not exceed the threshold, this system provides a stable, standard clinical odor simulation environment when the trainee's condition is relatively stable, ensuring the consistency and accuracy of the basic training environment. When the respiratory rate exceeds the threshold, the gas concentration is further adjusted based on the operation error rate. This allows for dynamic and precise adjustments to the simulation environment based on the trainee's actual condition, ensuring that the odor simulation better matches their current training performance and physiological state, and improving the adaptability of the simulation environment to the trainee's actual condition. Adjusting drug gas concentration based on respiratory rate and operation error rate, and providing feedback to the trainee in the form of odor, provides an intuitive and timely training feedback method. Trainees can perceive in real time the impact of their own condition and operation performance on the training environment, helping them quickly identify training issues, such as excessive operation errors or changes in physiological state, and thus promptly adjust their training strategies and operation behaviors to enhance training effectiveness. By using the operation error rate as a basis, normalization processing and adjustment of gas concentration can achieve dynamic adjustment of training intensity. When the error rate is high, the gas concentration is increased to increase the training pressure, prompting trainees to focus and improve operational accuracy. When the error rate is low, the concentration is maintained or appropriately reduced to create a relatively relaxed training atmosphere and avoid excessive stress. This dynamic regulation ensures that the training intensity is always within a reasonable range, adapting to the training progress and ability level of different trainees, and improving training efficiency and quality. This technical solution comprehensively considers the trainees' physiological indicators (respiratory rate) and operational performance (error rate) to comprehensively assess their training status. Compared with a single indicator evaluation, it can more accurately reflect the trainees' actual situation during training, avoid unreasonable training environment settings caused by one-sided judgments, and overall improve the accuracy and reliability of the training system's assessment of the trainees' status, thereby optimizing performance indicators during training.

[0024] Specifically, the normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration. The execution steps include: Retrieve the normalized error rate value; Retrieve the drug gas concentration adjustment sensitivity coefficient from the database; Real-time monitoring of the trainee's breathing rate; Obtaining a standard deviation of the trainee's respiratory rate according to the current trainee's respiratory rate; extracting the difference between the error rate when the error rate of the current trainee's operation exceeds the preset error rate reference value and the error rate reference value; The basic drug gas concentration is adjusted using the difference between the error rate and the error rate reference value in combination with the trainee's respiratory rate standard deviation and the drug gas concentration adjustment sensitivity coefficient.

[0025] The adjusted drug gas concentration is obtained by the following formula: in, Indicates the concentration of drug gas after adjustment; Indicates the basic drug gas concentration; Indicates the sensitivity coefficient of drug gas concentration adjustment, with a value range of 0.3-0.7; Represents the normalized error rate value; It represents the physiological protection factor, with a value range of 0.1-0.3; Indicates the difference between the error rate and the error rate reference value; represents the standard deviation of the trainees’ respiratory rate; Represents the maximum respiratory rate of the trainee. The inverse tangent function normalizes the error rate value Map to The error rate is adjusted to a certain range, making the effect of the error rate show nonlinear changes. Avoiding a simple linear relationship between the error rate and the concentration adjustment, but affecting the concentration adjustment to different degrees at different stages according to the error rate. For example, when the error rate is small, the adjustment range is relatively slow; when the error rate increases to a certain level, the adjustment range changes faster, which is more in line with the differentiated feedback needs for different error levels in actual training. At the same time, The larger the value, the higher the error rate. The greater the change, the greater the impact on the adjustment of drug gas concentration, that is, the more strongly the system responds to the trainee's operating errors. middle, The purpose of dividing the two and taking the maximum value is to measure the effect of respiratory rate fluctuation in adjusting the drug gas concentration. The value is large), indicating that the trainee's physiological state is unstable. After the comparison is made, the concentration adjustment range will be reduced in the exponential term to protect the trainee's physiological state. Large, indicating serious operational errors, After comparing and taking the larger value, if the value is larger, the degree of inhibition of the index term on concentration adjustment is mainly determined based on the error rate difference, and corresponding feedback is given to operational errors while considering physiological protection. The exponential term scales the concentration adjustment exponentially based on the above calculation results. A large exponential term indicates that a significant suppression of concentration increases is necessary (because the exponent is negative) to ensure the trainee's physiological safety. A small exponential term indicates a minimal suppression of concentration adjustments, and concentrations can be adjusted appropriately based on factors such as error rate to provide training feedback.

[0026] The technical effect of the above technical solution is: by integrating multiple factors such as the normalized error rate value, respiratory rate standard deviation, error rate difference, etc., the drug gas concentration can be accurately and dynamically adjusted according to the trainee's real-time status. The odor in the simulated clinical environment is closely related to the trainee's operating performance and physiological state, improving the adaptability of the training environment and ensuring the accuracy and effectiveness of the training effect. Introducing the physiological protection factor When increasing the training intensity (adjusting the drug gas concentration) based on factors such as error rate, it is necessary to prevent adverse physiological effects on trainees due to excessive adjustment, ensure the physiological safety of trainees while strengthening training feedback, balance training intensity and trainee health, and improve the reliability and safety of the training system. The concentration adjustment range can be flexibly controlled. Under different training scenarios or individual differences of trainees, by setting appropriate value, making the system more sensitive to trainee operation errors and physiological changes, timely and appropriately adjusting the gas concentration, enhancing the training system's ability to respond to trainee status changes, and optimizing training experience and effects. On the other hand, the formula provided by the above technical solution combines the inverse tangent function and exponential functions , making the drug gas concentration adjustment nonlinear. For different degrees of error rate and respiratory rate fluctuation, the concentration adjustment range is not a simple linear change, which can adapt to the trainee's state changes more delicately. When there is a slight error or a small fluctuation in respiratory rate, the adjustment range is small; when there is a serious error or a large fluctuation in respiratory rate, the adjustment range is increased, improving the accuracy and rationality of the adjustment and optimizing training performance. By integrating the factors related to operation errors ( 、 ) and physiological status factors ( 、 ) and adjust the sensitivity coefficient Comprehensive calculations comprehensively consider the multiple factors that influence the adjustment of drug gas concentration. These factors work in synergy and balance with each other, ensuring that the adjusted drug gas concentration not only effectively addresses operational issues but also takes into account the trainee's physiological state, achieving a balance between training intensity and physiological safety, thereby improving the overall performance of the training system.

[0027] Somatosensory interaction system, including: A motion capture unit is configured to capture the trainee's hand, head, and whole-body movements in real time through multi-sensor fusion technology during simulated nursing operations, and to analyze the captured motion data through a deep learning model to identify the trainee's operational behavior; A tactile feedback unit is configured to adjust the tactile feedback intensity in real time based on the trainee's operation and the nursing scenario, simulating resistance and feedback during operation; an emotion simulation unit configured to dynamically adjust the facial expressions, voice intonation, body language, and different emotional responses of the virtual nursing object based on the analysis results of the motion capture unit; a voice interaction unit configured to achieve two-way voice interaction through voice recognition and voice synthesis technology, so that the training personnel can communicate with the virtual nursing object through voice; The group collaboration unit is configured to support simultaneous training of multiple trainees, simulate team collaboration scenarios, and evaluate the coordination between team members through real-time data synchronization and collaborative feedback mechanisms.

[0028] The technical effects of the above technical solution are as follows: the motion capture unit captures the trainee's hand, head and whole body movements in real time through multi-sensor fusion technology, and combines it with a deep learning model for behavioral analysis, which can accurately identify the trainee's operating behavior; the tactile feedback unit dynamically adjusts the tactile feedback intensity according to the nursing scenario, simulates the resistance and feedback of different operations (such as injection, wound treatment, etc.), and enables the trainee to feel real tactile stimulation in the simulated environment, which helps the trainee to stay focused in a complex environment and improve the stability and adaptability of the operation; the emotion simulation unit dynamically adjusts the expression, voice tone and body language of the virtual nursing object according to the analysis results of the motion capture unit, and simulates the patient's emotional response in different situations (such as anxiety, pain, anger The speech interaction unit uses speech recognition and synthesis technology to achieve two-way speech communication between trainers and virtual nursing objects, simulating real doctor-patient communication scenarios, thereby helping trainers improve their language expression skills, become familiar with how to communicate effectively with patients in complex situations, and enhance communication accuracy and empathy. The group collaboration unit supports multiple trainers to participate in team collaboration scenarios at the same time. Through real-time data synchronization and collaborative feedback mechanisms, it evaluates the coordination effect between team members, helps trainers become familiar with team division of labor, communication and collaboration mechanisms, improves team collaboration efficiency, and cultivates team awareness and a sense of responsibility.

[0029] In summary, the somatosensory interaction system provides a highly intelligent, realistic and collaborative training environment for nursing training through the combination of precise motion recognition, real tactile feedback, dynamic emotion simulation, voice interaction and team collaboration functions, significantly improving the trainees' operational skills, communication skills and team collaboration capabilities.

[0030] A tactile feedback unit, comprising: An adaptive module configured to dynamically adjust the lightness of tactile feedback according to the complexity of the nursing scenario, including but not limited to providing high-precision resistance feedback during simulated surgery and providing soft tactile prompts during simulated patient transport; The touch simulation module is configured to combine temperature, vibration and pressure sensors to simulate the touch of different nursing tools and temperature changes of the patient's body.

[0031] The technical effects of the above technical solution are: the adaptive module can dynamically adjust the intensity of tactile feedback according to the complexity of the nursing scenario. The dynamic adjustment mechanism helps trainees quickly adapt to changes in tactile feedback in different scenarios, thereby improving operational flexibility and adaptability. The tactile simulation module combines temperature, vibration and pressure sensors to simulate the touch of different nursing tools (such as syringes, surgical instruments, etc.) and temperature changes of the patient's body (such as fever or low temperature). The realistic tactile simulation significantly enhances the realism of training, allowing trainees to feel tactile stimulation consistent with real nursing operations in a simulated environment, thereby improving the accuracy and proficiency of operations.

[0032] The emotion simulation unit introduces an emotion memory mechanism, and the virtual care recipient adjusts his or her emotional response based on historical interaction records. If the trainer's operational behavior repeatedly shows patience and care, the virtual care recipient's emotions will gradually stabilize.

[0033] The technical effect of the above technical solution is: the emotional memory mechanism enables the virtual nursing object to adjust its emotional response according to the historical behavior of the trainer (such as patience, care or rough operation), simulating the complexity of the emotional changes of real patients in long-term care. When the trainer's operation behavior repeatedly shows patience and care, the emotion of the virtual nursing object gradually stabilizes. This positive feedback can motivate the trainer to continue to show positive behavior, thereby helping the trainer to establish a sense of trust with the patient.

[0034] Voice interaction unit, including: A semantic analysis module configured to collect and analyze the trainee's speech content in real time using natural language processing technology to identify the trainee's emotional state and semantic intent; The voice interaction module is configured to generate voice interaction content of the virtual nursing object through speech synthesis technology, and adjust the voice tone and expression of the virtual nursing object according to the emotional state and semantic intention of the trainer.

[0035] The technical effects of the above technical solution are as follows: the semantic analysis module collects and analyzes the trainee's voice content in real time through natural language processing technology, and can accurately identify the trainee's emotional state (such as anxiety, calmness, impatience, etc.) and semantic intentions (such as inquiry, comfort, guidance, etc.). The real-time analysis capability helps the virtual nursing object quickly understand the trainee's emotions and intentions, providing a basis for subsequent voice interaction, and improving the authenticity and efficiency of communication. The voice interaction module dynamically adjusts the voice tone and expression of the virtual nursing object according to the trainee's emotional state and semantic intention, so that the virtual nursing object's response is closer to the real patient's response. The voice interaction unit provides a highly realistic, dynamically adjusted and personalized feedback voice interaction environment for nursing training through the combination of semantic analysis and personalized voice interaction, which significantly improves the trainee's communication skills, emotional management ability and training efficiency.

[0036] Group collaboration units include: a role assignment module configured to assign different roles to trainees based on their previous skill levels and historical training data, and to introduce random events, including but not limited to equipment failures and patient emergencies; The effect evaluation module is configured to perform real-time synchronization and collaborative feedback on team collaboration data. Based on real-time data synchronization and collaborative feedback, it evaluates the cooperation effect between team members, including communication efficiency, rationality of task division, emergency response and response speed, and generates a collaboration evaluation report.

[0037] The technical effects of the above technical solution are as follows: the role allocation module assigns different roles to trainees according to their skill level and historical training data, ensuring that each trainee in the team undertakes tasks that match their abilities, thereby improving the skills of each trainee in a targeted manner while ensuring the rationality of the overall team collaboration. At the same time, by introducing random events (such as equipment failures and patient emergencies), the unpredictability in real nursing scenarios is simulated to help team members respond quickly under high-pressure environments. The effect evaluation module dynamically monitors the communication efficiency, rationality of task division and emergency response speed among team members through real-time data synchronization and collaborative feedback mechanisms, thereby helping team members to adjust collaboration strategies in a timely manner and optimize team cooperation effects.

[0038] Data recording system, including: The data monitoring unit is configured as a monitoring device 4 installed on the walls around the training cabin, which monitors and records the training process of the trainee in real time and obtains the training data of the trainee; an observation intervention unit, configured to provide a dedicated control interface for the instructor and allow the instructor to observe the trainee's training process in real time, and based on the observed training process, the instructor adjusts the trainee's nursing scenario complexity or the virtual nursing object's response in real time through the control interface; The visualization unit is configured to display the training process and training data through images and videos and conduct comparative analysis to understand the long-term training effect of the trainees. Specifically, the following process is performed: Store the training history data of trainees at different time points; Compare and analyze the current training data and training process with the stored training history data; Through comparative analysis, you can view the performance of trainees at different time points and understand the long-term training effects of trainees.

[0039] The technical effects of the above technical solution are as follows: the data monitoring unit can monitor and record the training process of the trainees in real time and obtain comprehensive training data through the monitoring devices 4 installed on the walls around the training cabin. The real-time monitoring mechanism ensures that every detail of the training process is recorded, providing detailed data support for subsequent evaluation and analysis. The observation and intervention unit provides a dedicated control interface for the instructor, allowing the instructor to observe the training process of the trainees in real time and dynamically adjust the complexity of the training scene or the response of the virtual nursing object according to the observation results. The real-time intervention capability enables the instructor to adjust the training difficulty in time according to the actual performance of the trainees to ensure the pertinence and effectiveness of the training. The visualization unit displays the training process and training data in the form of images and videos. At the same time, by storing the training history data at different time points and comparing and analyzing it with the current training data, the performance changes of the trainees at different stages can be clearly seen, thereby evaluating the long-term training effect of the trainees and providing a clear direction for subsequent training.

[0040] Working Principle: The multi-sensory immersion system simulates environmental factors such as temperature, odor, and background noise. The training cabin can create a highly realistic clinical nursing scenario, thereby helping trainees quickly adapt to the complex and changing clinical environment. The somatosensory interaction system uses multi-sensor fusion technology to capture movements in real time, and combines tactile feedback, emotion simulation functions, voice interaction and team collaboration to provide trainees with an immersive interactive experience, further enhancing the sense of immersion. The data recording system can provide instructors with comprehensive training data support by monitoring and recording the training process in real time, allowing instructors to observe the training process in real time and intervene, enabling instructors to accurately evaluate the long-term progress and skill improvement of trainees to ensure the correctness of the training direction.

[0041] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus.

[0042] While the embodiments of the present invention have been shown and described, it will be apparent to those skilled in the art that various changes, modifications, substitutions, and alterations can be made to the embodiments without departing from the principles and spirit of the invention.

Claims

1. Immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin, characterized by: The training cabin includes a multi-sensory immersion system, a somatosensory interaction system and a data recording system; The multi-sensory immersion system is configured to simulate different temperature environments, clinical odors, and ward background noises in the training cabin, and provide trainees with nursing scenario templates of varying complexity; Among them, by monitoring the respiratory rate in real time and comparing it with the preset threshold, when the respiratory rate does not exceed the threshold, the odor is simulated according to the preset basic drug gas concentration; When the respiratory rate exceeds the preset respiratory rate threshold, the error rate of the current trainee's operation is retrieved and normalized; The normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration; The somatosensory interaction system is configured to capture the trainer's movements through multi-sensor fusion technology, adjust the tactile feedback intensity in real time, and introduce an emotion simulation function so that the virtual nursing object can show different emotional reactions based on the trainer's behavior. It also supports voice interaction and multi-trainer simulation team collaboration scenarios; The data recording system is configured to monitor the training process of the trainees in real time, allowing the instructor to observe the training process of the trainees in real time and intervene in the training scenario.

2. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 1 is characterized by: The multi-sensory immersive system comprises: The sensory simulation unit is configured to simulate different temperature environments, clinical odors, and ward background noise in the training cabin through a temperature control device (1), an odor simulation device (2), and a sound effect device (3) provided on the top of the training cabin; The scene simulation unit is configured based on a modular scene library, which contains a variety of nursing scene templates. It creates immersive nursing scenes by combining the temperature control, smell and sound effects of the sensory simulation unit.

3. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 2 is characterized by: The sensory simulation unit comprises: A temperature control simulation module is configured to simulate nursing scenarios under different temperature environments in a training cabin through a temperature control device (1); an odor simulation module configured to simulate odors in a clinical environment in a training cabin through an odor simulation device (2), including but not limited to disinfectant and medicine odors; The sound effect simulation module is configured to simulate the background noise in the ward in the training cabin through the sound effect device (3), including but not limited to the sound of instruments and the coughing of patients.

4. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 3 is characterized by: The odor simulation module performs the following steps: Monitor the trainee's respiratory rate in real time; comparing the trainee's respiratory rate to a preset respiratory rate threshold; When the trainee's respiratory rate does not exceed a preset respiratory rate threshold, simulating the odor in a clinical environment according to a preset basic drug gas concentration; When the trainee's breathing rate exceeds a preset breathing rate threshold, the error rate of the trainee's current operation is retrieved; comparing the error rate of the current trainee's operation with a preset error rate reference value; When the error rate of the current trainee's operation does not exceed the preset error rate reference value, the current basic drug gas concentration is not adjusted; When the error rate of the current trainee's operation exceeds a preset error rate reference value, normalizing the error rate of the current trainee's operation to obtain a normalized error rate value; The normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration.

5. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 4 is characterized by: The normalized error rate value is used to adjust the basic drug gas concentration, and the odor in the clinical environment is simulated according to the adjusted drug gas concentration. The execution steps include: Retrieve the normalized error rate value; Retrieve the drug gas concentration adjustment sensitivity coefficient from the database; Real-time monitoring of the trainee's breathing rate; Obtaining a standard deviation of the trainee's respiratory rate according to the current trainee's respiratory rate; extracting the difference between the error rate when the error rate of the current trainee's operation exceeds the preset error rate reference value and the error rate reference value; The basic drug gas concentration is adjusted using the difference between the error rate and the error rate reference value in combination with the trainee's respiratory rate standard deviation and the drug gas concentration adjustment sensitivity coefficient.

6. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 1 is characterized by: The somatosensory interaction system includes: A motion capture unit is configured to capture the trainee's hand, head, and whole-body movements in real time through multi-sensor fusion technology during simulated nursing operations, and to analyze the captured motion data through a deep learning model to identify the trainee's operational behavior; A tactile feedback unit is configured to adjust the tactile feedback intensity in real time based on the trainee's operation and the nursing scenario, simulating resistance and feedback during operation; An emotion simulation unit is configured to dynamically adjust the virtual care recipient's facial expressions, voice intonation, body language, and various emotional responses based on the analysis results of the motion capture unit. The emotion simulation unit incorporates an emotion memory mechanism, allowing the virtual care recipient to adjust its emotional responses based on historical interaction records. If the trainer repeatedly demonstrates patience and care in their actions, the virtual care recipient's emotions will gradually stabilize. a voice interaction unit configured to achieve two-way voice interaction through voice recognition and voice synthesis technology, so that the training personnel can communicate with the virtual nursing object through voice; The group collaboration unit is configured to support simultaneous training of multiple trainees, simulate team collaboration scenarios, and evaluate the coordination between team members through real-time data synchronization and collaborative feedback mechanisms.

7. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 6 is characterized by: The tactile feedback unit comprises: An adaptive module configured to dynamically adjust the lightness of tactile feedback according to the complexity of the nursing scenario, including but not limited to providing high-precision resistance feedback during simulated surgery and providing soft tactile prompts during simulated patient transport; The touch simulation module is configured to combine temperature, vibration and pressure sensors to simulate the touch of different nursing tools and temperature changes of the patient's body.

8. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 6 is characterized by: The voice interaction unit includes: A semantic analysis module configured to collect and analyze the trainee's speech content in real time using natural language processing technology to identify the trainee's emotional state and semantic intent; The voice interaction module is configured to generate voice interaction content of the virtual nursing object through speech synthesis technology, and adjust the voice tone and expression of the virtual nursing object according to the emotional state and semantic intention of the trainer.

9. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 6, characterized in that: The group collaboration unit includes: a role assignment module configured to assign different roles to trainees based on their previous skill levels and historical training data, and to introduce random events, including but not limited to equipment failures and patient emergencies; The effect evaluation module is configured to perform real-time synchronization and collaborative feedback on team collaboration data. Based on real-time data synchronization and collaborative feedback, it evaluates the cooperation effect between team members, including communication efficiency, rationality of task division, emergency response and response speed, and generates a collaboration evaluation report.

10. The immersive somatosensory interactive clinical nursing skills simulation medical staff training cabin according to claim 1, characterized in that: The data recording system comprises: The data monitoring unit is configured as a monitoring device (4) installed on the walls around the training cabin, and the training process of the trainee is monitored and recorded in real time by the monitoring device (4), thereby obtaining the training data of the trainee; an observation intervention unit, configured to provide a dedicated control interface for the instructor and allow the instructor to observe the trainee's training process in real time, and based on the observed training process, the instructor adjusts the trainee's nursing scenario complexity or the virtual nursing object's response in real time through the control interface; A visualization unit is configured to display the training process and training data in the form of images and videos and conduct comparative analysis to understand the long-term training effect of the trainees; Among them, the training process and training data shown are compared and analyzed, and the following process is performed: Store the training history data of trainees at different time points; Compare and analyze the current training data and training process with the stored training history data; Through comparative analysis, you can view the performance of trainees at different time points and understand the long-term training effects of trainees.

Images