A modular virtual reality (VR)-based CPR training system with multimodal feedback mechanisms

Abstract

A modular, virtual reality (VR)-based CPR training system with multimodal feedback mechanisms, including: a robust VR environment platform configured to generate real-time interactive simulations of realistic medical scenarios, with the platform monitoring compression depth and rate, ensuring real-time feedback for accurate skill assessment and correction; a VR headset operatively connected to the rugged VR environment platform and configured to display the realistic medical scenarios to the user, wherein the virtual scene generated by the rugged VR environment platform and displayed by the VR headset includes an interactive virtual patient that dynamically responds to the user's actions and provides visual and tactile cues to guide the correct technique for CPR; one or more visual feedback mechanisms within the virtual environment generated by the VR environment platform to provide real-time guidance to the user, wherein the visual feedback mechanism includes a dynamic UI slider and a color-coded chest overlay transition; a haptic feedback module configured to provide haptic cues to the user when the compression depth exceeds the predefined threshold, wherein the haptic feedback module comprises a linear resonant actuator (LRA) mounted on the back of the user's index finger to provide the haptic cues through vibrations, and a haptic feedback driver configured to control the tactile signal, wherein the haptic feedback module provides a strong vibration alert via the actuator, allowing the user to immediately correct over-compression; and a microcontroller acting as a core processing unit with a control interface configured to control the operation of the proposed feedback system, wherein the microcontroller communicates with the VR environment platform, the VR headset, and the haptic feedback module, wherein the VR environment platform communicates with the microcontroller via serial communication to trigger the haptic feedback module, wherein the microcontroller processes the received signals and generates appropriate pulse width modulation (PWM) signals for the haptic feedback driver to actuate the actuator.

Description

FIELD OF THE INVENTION

[0001] The present disclosure relates to a system for cardiopulmonary resuscitation (CPR) training, and more particularly to a modular, virtual reality (VR)-based CPR training system with multimodal feedback mechanisms. More particularly, the present invention relates to a system that utilizes virtual reality (VR) and augmented reality (AR) to create immersive training environments that replicate realistic scenarios, wherein the system utilizes multimodal feedback systems to enhance the training experience. The system combines visual feedback—such as a dynamic UI slider and a color-coded chest overlay—with tactile feedback delivered by a linear resonant actuator (LRA), the mechanisms providing immediate, actionable guidance that allows users to precisely adjust compression depth and rate during training.This enables error correction in real time and promotes muscle memory. BACKGROUND OF THE INVENTION

[0002] Cardiopulmonary resuscitation (CPR) is a vital emergency procedure that significantly improves the chance of survival in cases of cardiac arrest. However, its effectiveness depends on precise depth and rate of chest compressions, which can be difficult to learn and retain. Traditional mannequin-based training methods, while widely used, provide limited real-time feedback and cannot replicate the complexity of real-life scenarios. Emerging technologies such as virtual reality (VR) and augmented reality (AR) offer the opportunity to overcome these challenges by creating immersive and interactive training environments. Existing VR-based CPR systems, such as those for neonatal resuscitation and advanced CPR with ultrasound imaging, have shown promise but often lack integrated multimodal feedback systems.

[0003] The use of VR in medical training is gaining increasing traction due to its ability to simulate realistic scenarios and provide repeatable, consistent practice opportunities. Our previous work explored the integration of visual and haptic feedback in VR to enhance user interaction and skill acquisition. Specifically, visual feedback systems, including dynamic UI sliders and color-coded overlays, were developed to guide users in maintaining ideal compression parameters. Haptic feedback, provided by a linear resonant actuator (LRA), further enhanced the training experience by providing physical cues of over- or under-compression, enabling a more intuitive and effective learning process.

[0004] Despite these advances, many existing solutions lack the ability to combine visual and tactile feedback into a unified system. The present invention closes this gap by introducing a CPR training system that integrates multiple feedback mechanisms and provides a comprehensive and immersive learning platform. This approach not only improves the user's technical skills but also promotes confidence and muscle memory, thereby overcoming the key limitations of conventional methods and advancing the field of medical training technologies. SUMMARY OF THE INVENTION

[0005] The present disclosure relates to a modular, virtual reality (VR)-based CPR training system with multimodal feedback mechanisms. The present invention provides a virtual reality (VR)-based CPR training system that utilizes multimodal feedback mechanisms to provide a comprehensive and immersive training experience. This system overcomes the limitations of traditional mannequin-based training by integrating advanced visual, haptic, and auditory feedback to ensure precise depth and speed of chest compressions during cardiopulmonary resuscitation. Designed for ease of use, the invention allows participants to improve their skills while minimizing reliance on expert supervision.The heart of the system is the VR environment, powered by the VR headset, which immerses users in realistic medical scenarios. The virtual scene includes an interactive mannequin that dynamically responds to the user's actions and provides visual and tactile cues to guide proper technique. The VR environment was developed in the VR Environment Platform, a robust platform for creating interactive, real-time simulations. The platform continuously monitors compression depth and rate, ensuring real-time feedback for accurate skill assessment and correction.

[0006] In one embodiment, the integrated mechanisms include a dynamic UI slider and a color-coded chest overlay. The dynamic UI slider is a visual indicator displayed in the VR environment that represents the chest compression force and rate in real time. As the user performs compressions, the slider moves dynamically, providing an intuitive understanding of whether their actions adhere to the recommended guidelines. This visual feedback helps users adjust their technique during training sessions without external intervention. The color-coded chest overlay is a visual system that is applied to the virtual patient's chest and changes color based on the user's performance. Green indicates the ideal compression depth and rate, yellow indicates insufficient depth or rate, and red warns of excessive force.This immediate visual feedback simplifies error detection and encourages the user to maintain optimal parameters.

[0007] The system also includes tactile feedback via a linear resonant actuator (LRA). To complement the visual feedback, a linear resonant actuator mounted on the back of the user's index finger provides haptic cues when the compression depth exceeds the predefined threshold. The tactile signal, controlled by the DRV2605 driver via an ESP32 microcontroller, delivers a strong vibration alert, allowing the user to immediately correct any over-compression. The haptic effect is enabled via Unity's serial communication with the Arduino IDE, ensuring seamless synchronization between the system's virtual and physical components.

[0008] The visual component of the proposed system provides clear, intuitive guidance, while the tactile feedback ensures the user develops muscle memory for the correct compression technique. This multimodal approach enhances the overall training experience and promotes skill retention compared to traditional techniques. Furthermore, the system is designed to be portable and cost-effective, making it accessible to a wide range of users, including medical students, healthcare professionals, and first responders. The modular design allows for easy updates and customization, allowing the system to adapt to evolving medical guidelines and user needs. By combining advanced VR technology with innovative feedback systems, this invention aims to set a new standard for CPR training.It provides an effective, scalable, and interactive platform to enhance skill acquisition and ultimately contribute to better outcomes in real-life cardiac emergencies.

[0009] The present disclosure aims to provide a modular, virtual reality (VR)-based CPR training system with multimodal feedback mechanisms. The system comprises: a robust VR environment platform configured to generate real-time interactive simulations of realistic medical scenarios. The platform monitors compression depth and rate, ensuring real-time feedback for accurate skills assessment and correction;a VR headset operably connected to the rugged VR environment platform and configured to display the realistic medical scenarios to the user, wherein the virtual scene generated by the rugged VR environment platform and displayed by the VR headset includes an interactive virtual patient that dynamically responds to the user's actions and provides visual and tactile cues to guide the proper technique for CPR; one or more visual feedback mechanisms within the virtual environment generated by the VR environment platform to provide real-time guidance to the user, wherein the visual feedback mechanism includes a dynamic UI slider and a color-coded chest overlay transition;a haptic feedback module configured to provide haptic cues to the user when the compression depth exceeds the predefined threshold, wherein the haptic feedback module includes a linear resonance actuator (LRA) mounted on the back of the user's index finger to provide the haptic cues through vibrations and a haptic feedback driver configured to control the tactile signal, wherein the haptic feedback module provides a strong vibration alert via the actuator, allowing the user to immediately correct over-compression;and a microcontroller acting as a core processing unit with a control interface configured to control the operation of the proposed feedback system, wherein the microcontroller communicates with the VR environment platform, the VR headset, and the haptic feedback module, wherein the VR environment platform communicates with the microcontroller via serial communication to trigger the haptic feedback module, wherein the microcontroller processes the received signals and generates appropriate pulse width modulation (PWM) signals for the haptic feedback driver to actuate the actuator.;

[0010] An object of the present disclosure is to provide a modular, virtual reality (VR) based CPR training system with multimodal feedback mechanisms.

[0011] Another objective of the present disclosure is to provide an immersive, virtual reality-based CPR training system that provides real-time, multimodal feedback through visual and tactile mechanisms to improve users' compression technique.

[0012] Another object of the present disclosure is to provide a portable, cost-effective alternative to conventional mannequin CPR training that reduces the dependence on expert supervision while maintaining or improving the effectiveness of the training.

[0013] Another objective of the present disclosure is to develop a system that facilitates the development of correct muscle memory for CPR through immediate error correction and comprehensive performance tracking.

[0014] Another objective of the present disclosure is to create a flexible training platform that can be easily calibrated and updated for different users to adapt to evolving medical guidelines for CPR.

[0015] To clarify the advantages and features of the present disclosure, a more detailed description of the invention will be given by reference to specific embodiments illustrated in the accompanying drawings. These drawings are understood to illustrate only typical embodiments of the invention and are therefore not to be considered limiting the scope of the invention. The invention will be further described and explained with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE CHARACTERS

[0016] These and other features, aspects, and advantages of the present disclosure will be better understood when the following detailed description is read with reference to the accompanying drawings, in which like characters represent like parts throughout the drawings, wherein: Fig. 1 shows a block diagram of a modular, virtual reality (VR)-based CPR training system with multimodal feedback mechanisms according to an embodiment of the present disclosure; Fig. 2 illustrates a block diagram showing the operation of the CPR training system with multimodal feedback according to an embodiment of the present disclosure; and Fig. 3 illustrates a block diagram of the feedback system of the proposed system according to an embodiment of the present disclosure.

[0017] Those skilled in the art will understand that the elements in the drawings are shown for convenience and are not necessarily drawn to scale. For example, the flowcharts illustrate the method by key steps to enhance understanding of aspects of the present disclosure. Furthermore, one or more components of the device may be represented in the drawings by conventional symbols, and the drawings may show only the specific details relevant to understanding embodiments of the present disclosure in order not to clutter the drawings with details that would be readily apparent to one skilled in the art having read the present description. DETAILED DESCRIPTION:

[0018] To facilitate an understanding of the invention, reference will now be made to the embodiment illustrated in the drawings and described in specific terms. It should be understood, however, that this is not intended to limit the scope of the invention, and such changes and further modifications to the illustrated system, and such further applications of the principles of the invention embodied therein, are contemplated as would normally occur to one skilled in the art to which the invention pertains.

[0019] It will be understood by those skilled in the art that the foregoing general description and the following detailed description are exemplary and explanatory of the invention and are not to be considered as limiting.

[0020] When this specification refers to "one aspect," "another aspect," or the like, it means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, the terms "in one embodiment," "in another embodiment," and similar expressions throughout this specification may or may not all refer to the same embodiment.

[0021] The terms "comprises," "including," or other variations thereof are intended to cover non-exclusive inclusion, such that a process or method comprising a list of steps not only comprises those steps, but may also include other steps not expressly listed or included in such process or method. Likewise, one or more devices or subsystems or elements or structures or components introduced with "comprises...a" do not preclude, without further limitation, the existence of other devices or other subsystems or other elements or other structures or other components or additional devices or additional subsystems or additional elements or additional structures or additional components.

[0022] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The system, methods, and examples described herein are illustrative only and are not intended to be limiting.

[0023] Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0024] The present invention provides a modular, virtual reality-based CPR training system with multimodal feedback mechanisms. The proposed system combines visual feedback—such as a dynamic slider on the user interface and a color-coded chest overlay—with tactile feedback delivered by a linear resonant actuator (LRA). These mechanisms provide immediate, actionable guidance, allowing the user to precisely adjust compression depth and rate during training. By enabling real-time error correction and promoting muscle memory, this feedback-centric approach overcomes the limitations of conventional training techniques and improves skill retention. This innovation has the potential to revolutionize cardiopulmonary resuscitation by making it more accessible and effective, aligning with real-world needs.

[0025] Fig. 1 shows a block diagram of a modular, virtual reality (VR)-based CPR training system (100) with multimodal feedback mechanisms according to an embodiment of the present disclosure.

[0026] Referring to Fig. 1, the system (100) comprises a rugged VR environment platform (102) configured to generate a real-time, interactive simulation of realistic medical scenarios, wherein the platform (102) monitors compression depth and rate, ensuring real-time feedback for accurate assessment and correction of skills; a VR headset (104) operatively connected to the rugged VR environment platform (102) and configured to display the realistic medical scenarios to the user, wherein the virtual scene generated by the rugged VR environment platform (102) and displayed by the VR headset (104) includes an interactive virtual patient that dynamically responds to the user's actions and provides visual and tactile cues to guide the correct technique for CPR;one or more visual feedback mechanisms (106) within the virtual environment generated by the VR environment platform (102) to provide real-time guidance to the user, the visual feedback mechanism (106) comprising a dynamic UI slider and a color-coded chest overlay transition;a haptic feedback module (108) configured to provide haptic cues to the user when the compression depth exceeds the predefined threshold, wherein the haptic feedback module (108) includes a linear resonant actuator (LRA) (108a) mounted on the back of the user's index finger to provide the haptic cues through vibrations, and a haptic feedback driver (108b) configured to control the tactile signal, wherein the haptic feedback module (108) provides a strong vibration alert via the actuator (108a) that allows the user to immediately correct over-compression;and a microcontroller (110) acting as a core processing unit having a control interface (110a) configured to control the operation of the proposed feedback system (100), wherein the microcontroller (110) is in communication with the VR environment platform (102), the VR headset (104), and the haptic feedback module (108), wherein the VR environment platform (102) communicates with the microcontroller (110) via serial communication to drive the haptic feedback module (108), wherein the microcontroller (110) processes the received signals and generates appropriate pulse width modulation (PWM) signals for the haptic feedback driver (108b) to actuate the actuator (108a);

[0027] In one embodiment, the VR environment platform (102) together with the VR headset (104) visualizes the virtual patient, the compression metrics, and the visual feedback mechanism while communicating with the microcontroller, and wherein the VR environment platform is further configured to: provide a tutorial that guides the user on how to interact with the system; record the performance metrics during the training session; and generate a performance summary after the training session that highlights areas for improvement.

[0028] In one embodiment, the VR environment platform (102) displays a dynamic user interface slider in the VR headset that displays the compression force and rate in real time, and wherein the VR environment platform (102) also renders a color-coded overlay on the virtual patient's chest that changes color based on the compression depth and rate.

[0029] In one embodiment, the rendered color-coded overlay comprises: a green color indicating an ideal compression depth and rate; a yellow color indicating an insufficient compression depth or rate; and a red color indicating an excessive compression depth or rate.

[0030] In one embodiment, the VR environment platform (102) is further configured to: display a heat map visualization in the VR headset (104) indicating the pressure distribution on the chest of the virtual patient; and enable the user to detect and correct uneven force application during compression.

[0031] In one embodiment, the VR environment platform (102) further provides: an interactive dashboard with virtual control buttons; and user-interactive results displays with feedback and analysis functions, wherein, following the CPR training session, the VR environment platform (102) provides the user with a performance summary highlighting areas for improvement, the summary including compression depth and rate statistics, feedback response times, and overall efficiency scores.

[0032] In one embodiment, the VR environment platform (102) communicates with the microcontroller (110) to activate the haptic feedback module (108) when the monitored compression depth exceeds a predefined threshold, wherein the microcontroller (110) communicates with the haptic feedback driver (108b) to trigger the actuator (108a) to generate a strong vibration alarm that allows the user to immediately correct over-compression, this feedback being controlled by the haptic feedback driver (108b) via the I2C communication protocol with pre-configured effects for optimal user response.

[0033] In one embodiment, the microcontroller (110) is configured to: receive signals from the VR environment platform (102) via serial communication; and generate appropriate pulse width modulation (PWM) signals for the haptic driver (108b) to actuate the linear resonant actuator (108a).

[0034] In one embodiment, the system (100) further comprises a calibration module (112) configured to adjust the feedback thresholds for different users and a framework integrated into the system configured to ensure minimal latency between user actions and feedback responses.

[0035] In one embodiment, the system (100) is configured to provide multimodal feedback to the user through visual feedback via the user interface's dynamic slider and color-coded overlay, and tactile feedback via the haptic feedback module (108).

[0036] The present invention relates to an advanced modular, virtual reality-based cardiopulmonary resuscitation (CPR) training system that significantly enhances skill acquisition through multimodal feedback mechanisms. The system utilizes a VR headset to immerse users in realistic medical scenarios where they interact with a virtual patient requiring CPR. As the user performs chest compressions, the VR environment platform continuously monitors the depth and rate of chest compressions and provides instant feedback through multiple channels.

[0037] The system's visual feedback includes a dynamic UI slider that displays compression force and rate in real time, allowing users to adjust their technique during the session. Additionally, a color-coded overlay on the virtual patient's chest indicates ideal, insufficient, and excessive compression in green, yellow, and red. This intuitive color system allows users to immediately identify when their technique deviates from recommended guidelines.

[0038] The system features tactile feedback from a Linear Resonance Actuator (LRA) mounted on the back of the user's index finger. When the compression depth exceeds the medically recommended threshold of 60 millimeters, the LRA, controlled by a DRV2605 driver via an ESP32 microcontroller, provides vibrating feedback, prompting the user to make immediate adjustments. This haptic component helps the user develop muscle memory for proper compression technique without interrupting immersion in the training scenario.

[0039] The system's microcontroller communicates with the VR platform via a serial connection, processes signals, and generates corresponding PWM signals for the haptic driver, ensuring seamless integration between virtual and physical feedback mechanisms. Other features include visualization of pressure distribution, customizable calibration for different users, and comprehensive performance tracking that generates detailed summaries after each session. An interactive dashboard provides users with control buttons and performance metrics to track their progress over time. The system also includes tutorials to show new users how to effectively interact with the virtual environment.This combination of immersive technology and multimodal feedback creates a comprehensive training tool that overcomes the limitations of traditional mannequin-based CPR training.

[0040] Fig. 2 shows a block diagram illustrating the operation of the CPR training system with multimodal feedback according to an embodiment of the present disclosure; and

[0041] Fig. 3 illustrates a block diagram of the feedback system of the proposed system according to an embodiment of the present disclosure.

[0042] As from Fig. 2 and Fig. As shown in Figure 3, the system consists of a variety of components. A microcontroller (1) serves as the central processing unit for the system, managing the input signals from the Unity software and controlling the LRA driver to actuate the motor. The system uses an ESP32-based microcontroller for efficient processing and communication. Fig.3, the LRA driver (2) (DRV2605) is a haptic driver that receives PWM signals from the microcontroller to regulate the vibration intensity of the LRA motor. This ensures precise feedback and enhances the training experience. The LRA motor (3), a linear resonance actuator (LRA), mounted on the back of the right hand, provides tactile feedback. It vibrates when the compression depth exceeds the recommended range, e.g., 60 mm, and alerts the user to necessary adjustments. A virtual patient (4) in the VR environment simulates realistic CPR training scenarios and allows the user to interact with a lifelike representation. A compression rate slider (5) dynamically displays the chest compression rate, assisting in maintaining correct technique. This helps the user to maintain the recommended 100-120 compressions per minute, with the slider changing color (e.g.green for the ideal rate) to indicate accuracy. The system also features compression depth feedback (6), which monitors in real time whether the user is maintaining an ideal depth of 50-60 mm. If the compression depth deviates from this range, appropriate feedback is triggered. In addition, a compression heat map (7) visualizes the pressure distribution across the virtual patient's chest, allowing the user to identify and correct any uneven force application. Both hands play a crucial role in VR training. The left hand (8) represents the user's left hand, which performs chest compressions, while the right hand (9) is equipped with an LRA motor mounted on the back of the index finger. This motor provides vibration feedback to assist the user in performing corrective actions in real time.The Unity platform (10) is responsible for managing the VR environment. It visualizes the virtual patient, compression metrics, and feedback systems, and ensures seamless communication with the hardware components. Finally, the Arduino IDE (11) is used to program the microcontroller, which integrates the LRA motor and feedback mechanisms into the system for smooth operation.

[0043] The invention presents an innovative, virtual reality (VR)-based CPR training system that utilizes multimodal feedback mechanisms to enable comprehensive and immersive training. This system overcomes the limitations of conventional mannequin training by integrating advanced visual, haptic, and auditory feedback to ensure precise depth and speed of chest compression during CPR. The invention is easy to use and allows participants to improve their skills while minimizing their dependence on expert supervision.

[0044] The heart of the system is the VR environment, operated via the VR headset, which immerses users in realistic medical scenarios. The virtual scene includes an interactive mannequin that dynamically responds to the user's actions and provides visual and tactile cues to guide proper technique. The VR environment was developed in Unity, a robust platform for creating interactive, real-time simulations. Unity continuously monitors compression depth and rate, providing real-time feedback for accurate assessment and correction of skills. The invention's unique feedback system consists of three integrated mechanisms. First, the Dynamic UI Slider serves as a visual indicator displayed in the VR environment, representing the chest compression force and rate in real time.As the user performs compressions, the slider moves dynamically, providing an intuitive understanding of whether their actions adhere to the recommended guidelines. This visual feedback helps users adjust their technique during training sessions without external intervention. Second, the color-coded chest overlay is a visual system that is placed on the virtual patient's chest and changes color based on the user's performance. Green indicates the ideal compression depth and speed, yellow means insufficient depth or speed, and red warns of excessive force. This immediate visual feedback simplifies error detection and encourages users to maintain optimal parameters. Third, tactile feedback via a linear resonant actuator (LRA) complements the visual feedback.A linear resonant actuator mounted on the back of the user's index finger provides haptic cues when the compression depth exceeds a predefined threshold. The tactile signal, controlled by the DRV2605 driver via an ESP32 microcontroller, delivers a strong vibration alert, allowing the user to immediately correct any over-compression. The haptic effect is activated via Unity's serial communication with the Arduino IDE, ensuring seamless synchronization between the system's virtual and physical components.

[0045] The integration of these feedback mechanisms is key to the invention's effectiveness. While the visual components provide clear, intuitive guidance, the tactile feedback ensures the user develops muscle memory of proper compression technique. This multimodal approach enhances the overall training experience and promotes skill retention compared to traditional methods. Furthermore, the system is designed to be portable and cost-effective, making it accessible to a wide range of users, including medical students, healthcare professionals, and first responders. The modular design allows for easy updates and customization, allowing the system to adapt to evolving medical guidelines and user needs.By combining advanced VR technology with innovative feedback systems, this invention aims to set a new standard for CPR training. It provides an effective, scalable, and interactive platform to enhance skill acquisition and ultimately contribute to better outcomes in real-life cardiac emergencies.

[0046] The system consists of several key components that work together to create an immersive and responsive CPR training experience. The virtual reality environment is powered by a Meta Quest 3 VR headset and presents a dynamic virtual scene that replicates a real-life CPR scenario. This environment includes a virtual patient, a chest compressions interface, and visual feedback mechanisms that provide real-time guidance. To improve user performance, the system employs feedback mechanisms in both visual and haptic form. The visual feedback system includes a dynamic UI slider that displays compression force and rate, allowing the user to monitor their performance. In addition, a color-coded chest overlay alternates between green (ideal), yellow (inadequate), and red (excessive) depending on the depth and rate of compressions.Complementing this, the haptic feedback system utilizes a Linear Resonance Actuator (LRA) mounted on the back of the user's hand. The LRA provides strong vibration feedback when the compression depth exceeds 60 mm, allowing for instant adjustments. The tactile feedback is precisely controlled by the DRV2605 driver via the I2C communication protocol, leveraging preprogrammed effects to optimize user response. The control and communication system is responsible for efficient signal processing and transmission. The Unity software manages the VR environment and tracks compression metrics in real time. It communicates with an ESP32 microcontroller via serial communication to trigger haptic feedback. The ESP32 processes the incoming signals and generates appropriate pulse-width modulation (PWM) signals for the DRV2605 driver to ensure precise actuation of the LRA.Finally, the integration framework ensures seamless coordination between hardware and software, minimizing latency between user actions and feedback responses. The system also includes calibration modules that allow for customized adjustment of feedback thresholds to accommodate different users and ensure an optimal training experience.

[0047] Operation of the proposed training system involves the user wearing the VR headset for a virtual training environment generated by the VR platform. The platform displays a tutorial panel to guide the user through interacting with the system and ensure the user understands the controls and mechanics before beginning the training session. During the training session, controlled by the VR environment platform, users perform chest compressions on a virtual patient while the system continuously monitors the compression depth and rate in real time. If the user deviates from the optimal range, the system provides immediate feedback for correction via multiple channels.A color-coded chest overlay visually indicates the problem, a dynamic slider on the user interface dynamically updates to reflect deviations, and a haptic actuator provides vibrating feedback when the compression depth exceeds 60 mm. These mechanisms work together to maintain accuracy and improve proper technique. Throughout the session, users receive immediate feedback through visual and tactile means, allowing them to make adjustments in real time. Performance data is recorded for post-session analysis, allowing users to track their progress and identify areas for improvement, enhancing learning outcomes through tangible insights into performance trends.Upon completion of the session, users receive a comprehensive performance summary highlighting key aspects such as compression depth and rate, response times to feedback, and overall efficiency scores. An interactive dashboard displays all relevant controls and allows users to engage with their ratings, feedback, and detailed performance analysis. The proposed system is integrated with the feedback system to increase user engagement and promote retention. The system is equipped with both visual and tactile feedback, with visual cues providing intuitive guidance, while haptic feedback allows for immediate correction without breaking immersion.

[0048] The system offers numerous advantages, including a highly realistic and immersive training environment that accurately simulates real-life CPR scenarios. It enables large-scale remote training, allowing many participants to practice simultaneously without the need for mannequins or live patients. Furthermore, the detailed performance insights provided by the interactive dashboard enhance the learning experience through accurate, data-driven feedback. The system is scalable and adaptable, suitable for diverse user groups, from medical professionals to laypeople. By incorporating these advanced features, this training system effectively addresses critical gaps in conventional CPR training methods. It provides an accessible, efficient, and highly engaging platform for developing life-saving skills, ensuring users receive the most comprehensive and practical training possible.

[0049] The drawings and the foregoing description provide examples of embodiments. Those skilled in the art will understand that one or more of the described elements may well be combined into a single functional element. Alternatively, certain elements may be separated into multiple functional elements. Elements from one embodiment may be added to another embodiment. For example, the order of the processes described herein may be changed and is not limited to the manner described herein. Furthermore, the actions of a flowchart need not be performed in the order shown; nor do all actions necessarily need to be performed. Also, those acts that are not dependent on other acts may be performed in parallel with the other acts. The scope of the embodiments is in no way limited by these specific examples.Numerous variations are possible, whether explicitly stated in the description or not, such as differences in structure, dimensions, and use of materials. The scope of the embodiments is at least as broad as indicated in the following claims.

[0050] Advantages, other benefits, and solutions to problems have been described above with respect to specific embodiments. However, the advantages, benefits, solutions to problems, and components that may cause an advantage, benefit, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature or component of any or all of the claims. References 102 Robust VR environment platform 104 VR headset 106 One or more visual feedback mechanisms 108 Haptic feedback module 110 microcontrollers 112 Calibration module 110a Control interface 108a Linear resonance drive 108b driver for haptic feedback 1 microcontroller 2 LRA drivers 3 LRA engine 4 Virtual Patient 5 Dynamic Slider UI 6 Depth feedback 7 Thermal imaging map 8 Left hand 9 Right hand 10 Arduino IDE 11 Unified platform 302 LRA motor on the back of the user's finger

Claims

[1] A modular, virtual reality (VR)-based CPR training system with multimodal feedback mechanisms, including: a robust VR environment platform configured to generate real-time interactive simulations of realistic medical scenarios, with the platform monitoring compression depth and rate, providing real-time feedback for accurate skill assessment and correction; a VR headset operatively connected to the rugged VR environment platform and configured to display the realistic medical scenarios to the user, wherein the virtual scene generated by the rugged VR environment platform and displayed by the VR headset includes an interactive virtual patient that dynamically responds to the user's actions and provides visual and tactile cues to guide the correct technique for CPR; one or more visual feedback mechanisms within the virtual environment generated by the VR environment platform to provide real-time guidance to the user, wherein the visual feedback mechanism comprises a dynamic UI slider and a color-coded chest overlay transition; a haptic feedback module configured to provide haptic cues to the user when the compression depth exceeds the predefined threshold, wherein the haptic feedback module comprises a linear resonant actuator (LRA) mounted on the back of the user's index finger to provide the haptic cues through vibrations, and a haptic feedback driver configured to control the tactile signal, wherein the haptic feedback module provides a strong vibration alert via the actuator, allowing the user to immediately correct over-compression; and a microcontroller acting as a core processing unit with a control interface configured to control the operation of the proposed feedback system, wherein the microcontroller communicates with the VR environment platform, the VR headset, and the haptic feedback module, wherein the VR environment platform communicates with the microcontroller via serial communication to trigger the haptic feedback module, wherein the microcontroller processes the received signals and generates appropriate pulse width modulation (PWM) signals for the haptic feedback driver to actuate the actuator. [2] The system of claim 1, wherein the VR environment platform, together with the VR headset, visualizes the virtual patient, the compression metrics, and the visual feedback mechanism while communicating with the microcontroller, and wherein the VR environment platform is further configured to: provide a tutorial that guides users on how to interact with the system; record the performance metrics during the training session; and generate a performance summary after the training session that highlights areas for improvement. [3] The system of claim 1, wherein the VR environment platform displays a dynamic user interface slider in the VR headset that indicates the compression force and rate in real time, and wherein the VR environment platform also displays a color-coded overlay on the virtual patient's chest that changes color based on the compression depth and rate. [4] The system of claim 3, wherein the color-coded overlay includes: a green color indicating ideal compression depth and rate; a yellow color indicating insufficient compression depth or rate; and a red color indicating excessive compression depth or rate. [5] The system of claim 1, wherein the VR environment platform is further configured to: display a heat map visualization in the VR headset indicating the pressure distribution on the chest of the virtual patient; and enable the user to detect and correct uneven force application during compression. [6] The system of claim 1, wherein the VR environment platform further provides: an interactive dashboard with virtual control knobs; and user-interactive results displays with feedback and analysis capabilities, wherein, following the CPR training session, the VR environment platform provides the user with a performance summary highlighting areas for improvement, the summary including compression depth and rate statistics, feedback response times, and overall efficiency scores. [7] The system of claim 1, wherein the VR environment platform communicates with the microcontroller to activate the haptic feedback module when the monitored compression depth exceeds a predefined threshold, the microcontroller communicating with the haptic feedback driver to trigger the actuator to generate a strong vibration alarm signal allowing the user to immediately correct over-compression, this feedback being controlled by the haptic feedback driver via the I2C communication protocol with pre-configured effects for optimal user response. [8] The system of claims 1 and 7, wherein the microcontroller is configured to: Receives signals from the VR environment platform via serial communication; and generates appropriate pulse width modulation (PWM) signals for the haptic driver to actuate the linear resonant actuator. [9] The system of claim 1 further comprises a calibration module configured to adjust feedback thresholds for different users, and a framework integrated into the system configured to ensure minimal latency between user actions and feedback responses. [10] The system of claim 1, wherein the system is configured to provide multimodal feedback to the user through visual feedback via the dynamic user interface slider and the color-coded overlay, and tactile feedback via the haptic feedback module.

Images