Preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology

Abstract

This invention discloses a preoperative psychological counseling and relaxation training system based on virtual and augmented reality (VR) technology, belonging to the field of medical information technology. It includes a user basic data collection module integrating terminals, devices, and interfaces; a preoperative psychological assessment module integrating data to construct a profile; a VR / AR scene generation module building a scene library supporting personalization and virtual-real overlay; a psychological counseling interaction module relying on a virtual counselor for real-time interaction; a multimodal relaxation training module providing immersive training guidance; a real-time physiological state monitoring module continuously collecting relevant data; a data processing and analysis module completing data optimization and correlation analysis; a dynamic feedback adjustment module optimizing various parameters in real time; a data storage and traceability module encrypting storage and supporting traceability; and a system adaptation and permission management module adapting to devices and assigning permission roles. This invention achieves accurate psychological assessment through multi-dimensional data collection; effectively alleviates negative preoperative emotions, and contributes to improved surgical safety and treatment outcomes.

Description

Technical Field

[0001] This invention relates to the field of medical information technology, and in particular to a preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology. Background Technology

[0002] Surgery, as a common invasive medical procedure in clinical treatment, easily triggers negative emotions such as preoperative anxiety, fear, and depression in patients. Clinical epidemiological surveys show that the incidence of preoperative anxiety among patients undergoing elective surgery remains high. These emotions not only lead to physiological reactions such as sleep disturbances, increased heart rate, and elevated blood pressure, but also cause excessive activation of the hypothalamus-pituitary-adrenal axis, resulting in increased cortisol secretion, which in turn suppresses immune function and prolongs wound healing time. Simultaneously, the incidence of non-compliance behaviors is significantly increased in anxious patients, such as incomplete preoperative fasting and concealment of medication history, directly increasing the risk of intraoperative anesthesia and postoperative complications, seriously affecting surgical safety and treatment outcomes. The World Health Organization has clearly listed "preoperative psychological assessment and intervention" as a core quality indicator for perioperative management, highlighting its important role in clinical medicine; however, many healthcare systems worldwide still fail to provide standardized preoperative psychological support.

[0003] Current preoperative psychological interventions in clinical practice primarily rely on the traditional model of face-to-face communication between doctors and patients, written education combined with basic relaxation guidance, which has many insurmountable limitations. On the one hand, the scarcity of medical resources results in generally short preoperative communication sessions, making it difficult to fully cover patients' individualized information needs regarding surgical procedures, anesthesia risks, and postoperative recovery. Furthermore, there is a shortage of professional psychological counselors, and many hospitals have not incorporated preoperative psychological assessments into standardized procedures, resulting in a large number of patients' psychological problems going unidentified and unaddressed. On the other hand, traditional intervention methods lack immersion and personalization. Verbal explanations or graphic materials alone are insufficient to alleviate patients' fear of unfamiliar surgical environments and procedures. Assessment tools often rely on single scales or unstructured interviews, making them susceptible to subjective biases and leading to unreliable assessment results, and even missed diagnoses of serious psychological problems. In addition, traditional intervention methods are limited by time and space; patients with mobility issues or living in remote areas may not receive adequate preoperative psychological support, and information relayed by family members may be inaccurate or incomplete, further reducing the effectiveness of the intervention.

[0004] With the development of digital healthcare technology, virtual reality (VR) and augmented reality (AR) technologies are gradually being applied to preoperative psychological intervention scenarios. Some hospitals are attempting to use VR devices to provide patients with relaxation content such as natural landscape viewing and breathing exercises, or to simulate surgical environments to reduce fear of the unknown. However, existing technologies still have significant shortcomings: VR / AR scenarios are mostly fixed templates, lacking personalized customization based on different patients' ages, genders, interests, preferences, and psychological states, making it difficult to adapt to diverse psychological needs; deep integration of physiological data and psychological intervention has not been achieved, making it impossible to dynamically adjust scenario content and intervention strategies based on patients' real-time physiological indicators such as heart rate and skin conductivity; the consultation and interaction process lacks intelligent guidance, making it difficult to accurately address patients' core concerns; at the same time, patient psychological data, training records, and other information are stored in a scattered manner, failing to effectively connect with hospital electronic medical record systems and clinical information systems, which is not conducive to multidisciplinary team collaborative evaluation, and the data privacy protection mechanism is not perfect. These problems make it difficult for existing technologies to form systematic and precise preoperative psychological intervention programs, and cannot meet the high-quality clinical needs for preoperative psychological care. Summary of the Invention

[0005] The present invention proposes a preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology to solve the problems mentioned in the prior art.

[0006] To achieve the above objectives, the present invention adopts the following technical solution: a preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology, comprising the following modules: The user basic data collection module integrates a questionnaire filling terminal, bioinformatics collection equipment and medical data interface to collect information, capture core physiological indicators, and retrieve medical data from electronic medical records. All data is uniformly encoded and associated with timestamps. The preoperative psychological assessment module has a built-in multi-dimensional psychological assessment model, integrates basic user data, constructs a preoperative psychological state profile, and generates a quantitative assessment report. The VR / AR scene generation module, based on evaluation reports and user preferences, constructs a virtual scene library that includes natural scenes, medical process simulations, and relaxation training. It supports personalized scene adjustments and real-time rendering, and overlays virtual elements onto the real environment using AR technology. The psychological counseling interaction module is equipped with an intelligent question-and-answer engine and a virtual counselor. It provides popular science and guidance for users’ core concerns, records user feedback and dynamically adjusts the counseling content. The multimodal relaxation training module has four built-in training modes and provides immersive guidance in VR / AR scenarios. It assists users in completing relaxation training through visual, audio, and voice prompts. The real-time physiological state monitoring module continuously collects various types of physiological data and user interaction behavior data during the consultation and training process; The data processing and analysis module receives various types of transmitted data, analyzes the correlation between physiological data and emotional state and training effect, and judges the degree of improvement in psychological state. The dynamic feedback adjustment module adjusts scene presentation parameters, consultation strategies, and training intensity in real time based on data analysis results to adapt to changes in user emotions. The data storage and traceability module adopts an encrypted storage architecture to store all relevant data throughout the process, associates it with a unique identifier and timestamp, and supports data traceability and auditing. The system adaptation and permission management module supports adaptation to mainstream VR / AR devices, establishes a hierarchical permission management system, divides roles into three categories, and clarifies their respective operation permissions.

[0007] Furthermore, it also includes a dynamic quantification unit for psychological state, which integrates multi-dimensional physiological data and psychological assessment results to calculate the user's preoperative anxiety level in real time. The calculation formula is as follows: J represents the quantitative value of anxiety level, and T represents the assessment period. Let be the abnormality function of the physiological indicators at time t. Let be the emotion correlation coefficient at time t. The weight of the k-th psychological assessment dimension. This represents the score for the k-th psychological assessment dimension.

[0008] Furthermore, it also includes a VR / AR scene personalization customization unit, which adjusts the environmental elements, color scheme, sound effect type, and interaction method of the virtual scene based on the user's basic data such as age, gender, interests, preferences, and psychological state profile. For children, it adds cartoon-style elements and interactive mini-games, while for adults, it provides a simple and comfortable scene design, allowing users to choose the core elements and background atmosphere of the scene themselves.

[0009] Furthermore, it also includes a relaxation training effectiveness evaluation unit. By comparing physiological indicators, psychological scale scores, and user subjective feedback before and after training, the training effect is comprehensively evaluated. A training fit calculation model is introduced to optimize the training program. The calculation formula is as follows: S represents the training fit score, and m represents the number of physiological indicators used in the evaluation. Let i be the weight of the i-th physiological indicator. This represents the quantified value of the i-th physiological indicator before training. This represents the quantified value of the i-th physiological indicator after training. denoted as the subjective feedback weight, and h as the user's subjective satisfaction score.

[0010] Furthermore, it also includes a multilingual interaction support unit, allowing users to choose their own interaction language. The virtual consultant's voice output, text prompts in the scene, and questionnaire filling interface are all switched to the selected language in sync, achieving smooth interaction between different languages ​​through natural language processing technology.

[0011] Furthermore, it also includes a remote psychological counseling module, which supports users to conduct real-time video interaction with remote psychological counselors through VR / AR devices, build a virtual counseling room scene to simulate a face-to-face communication environment, complete the capture and real-time transmission of body movements in the virtual scene, support psychological counselors to remotely adjust the user's VR / AR scene parameters and training plan, and simultaneously view the user's physiological monitoring data and psychological assessment reports.

[0012] Furthermore, it also includes a surgical procedure cognition enhancement module. Based on the user's type of surgery, it uses animation in a VR scene to intuitively display the key steps of the surgery, the required time, the anesthesia method, and the postoperative recovery process. Through interactive demonstrations, users can click to view detailed explanations of each step, answer their questions about the surgical process, and provide virtual demonstrations of postoperative care precautions to help users prepare psychologically and physiologically in advance.

[0013] Furthermore, it also includes an emergency emotional intervention unit that monitors the user's emotional state in real time during psychological counseling or relaxation training. When a strong emotional fluctuation is detected, the emergency intervention process is automatically activated, switching to a preset emergency relief scenario. The virtual counselor issues a soothing voice and provides simple emotional regulation techniques, while simultaneously sending an alert notification to the associated psychological counselor, suspending the current training or counseling process, and resuming or adjusting the plan after the user's emotions have stabilized.

[0014] Furthermore, it also includes a training progress management unit, which allows users to create personalized preoperative training plans, specifying daily training duration, training mode, and training frequency, recording the completion status and effect data of each training session, generating training progress reports, and visually displaying training results through two types of elements in VR / AR scenes: progress bars and achievement badges, to motivate users to complete training according to plan.

[0015] Furthermore, it also includes a data sharing and integration module, which supports data integration with the hospital's electronic medical record system and clinical information system. It synchronizes the user's psychological assessment report, training effect data, and physiological monitoring records to the electronic medical record, providing clinicians with a reference for the user's preoperative psychological state. It supports data export according to medical data sharing standards, and the data sharing process adopts an encrypted transmission protocol and strictly follows medical data privacy protection regulations.

[0016] Compared with existing technologies, the beneficial effects of this invention are: This invention integrates virtual and augmented reality technologies, multi-source data acquisition and analysis, and intelligent interaction technologies to construct a comprehensive and efficient preoperative psychological counseling and relaxation training system, bringing significant benefits in many aspects.

[0017] In terms of the accuracy of psychological assessment, the system comprehensively acquires users' demographic information, medical data, physiological indicators and psychological history information through multi-dimensional data collection and integration. Combined with a professional assessment model, it can accurately identify the type and intensity of negative emotions such as anxiety, fear and depression, and clarify the patient's core concerns related to surgery. Compared with traditional single assessment methods, the assessment results are more objective and comprehensive, providing solid data support for subsequent personalized intervention.

[0018] In terms of intervention experience and effectiveness, the VR / AR scene generation module constructs a multi-type virtual scene library, transforming abstract medical information into a concrete, immersive experience, effectively reducing patients' fear caused by the unknown. Scenes support personalized customization, allowing adjustments to environmental elements and interaction methods based on patient age and preferences, significantly improving user acceptance and immersion. The psychological counseling interaction module enables real-time intelligent interaction through a virtual counselor, providing targeted answers to user questions and offering psychological guidance, compensating for the lack of emotional support in traditional interventions. The multimodal relaxation training module offers various training modes to suit the relaxation needs of different users, further enhancing emotion regulation effects when combined with scene guidance.

[0019] In terms of dynamic adaptability of intervention, the real-time physiological state monitoring module continuously collects users' physiological data and interactive behavior data, the data processing and analysis module quickly explores the correlation between data and emotional state and training effect, and the dynamic feedback adjustment module optimizes scene parameters, consultation strategies and training intensity in real time based on this, ensuring that intervention measures are always accurately matched with users' psychological state, responding to emotional fluctuations in a timely manner, and avoiding the drawbacks of the "one-size-fits-all" approach in traditional interventions.

[0020] In terms of data management and clinical collaboration, the encrypted storage architecture and hierarchical access control system ensure user data security and privacy compliance. The data sharing and integration module supports seamless integration with hospital electronic medical record systems and clinical information systems, enabling efficient flow of psychological assessment reports and training effect data. This provides clinicians with comprehensive preoperative psychological status references, facilitating multidisciplinary team collaboration in developing treatment plans and promoting the deep integration of psychological intervention and clinical treatment. Simultaneously, the system supports adaptation to mainstream VR / AR devices, is compatible with different terminal types, and the hierarchical access control design meets the usage needs of different roles such as administrators, psychological counselors, and users, improving the system's clinical applicability and ease of operation.

[0021] Overall, this invention effectively solves the problems of insufficient precision, poor experience, poor dynamic adaptability, and poor data collaboration in traditional preoperative psychological interventions. It significantly improves the professionalism, personalization, and systematization of preoperative psychological interventions, helps patients face surgery with a more stable psychological state, reduces intraoperative risks and the probability of postoperative complications, provides strong protection for surgical safety and treatment effectiveness, optimizes the efficiency of medical resource allocation, and promotes the development of perioperative psychological nursing towards standardization and precision. Attached Figure Description

[0022] Figure 1 This is a schematic block diagram of the preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology proposed in this invention; Figure 2 Line graph showing the trend of anxiety levels during preoperative relaxation training; Figure 3 A bar chart comparing the core effects of different intervention methods; Figure 4 A pie chart showing the distribution of users' preferences for relaxation training modes. Detailed Implementation

[0023] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0024] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," and "counterclockwise," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0025] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified. Furthermore, the terms "installed," "connected," and "linked" should be interpreted broadly; for example, they may refer to a fixed connection, a detachable connection, or an integral connection; they may refer to a mechanical connection or an electrical connection; they may refer to a direct connection or an indirect connection through an intermediate medium; and they may refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances. The invention will now be described in further detail with reference to the accompanying drawings.

[0026] Reference Figures 1 to 4 A preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology, comprising the following modules: The user basic data collection module integrates a questionnaire filling terminal, bioinformatics collection equipment, and medical data interface. It collects user demographic information, preoperative disease diagnosis information, surgery type and expected time, past psychological history, and surgery-related anxiety scale scores. Through the bioinformatics collection equipment, it captures physiological indicators such as heart rate, respiratory rate, skin conductivity, and electromyography signals in real time, and simultaneously retrieves surgery-related medical data from the user's electronic medical record. All collected data is encoded in a unified format and associated with timestamps. The preoperative psychological assessment module has a built-in multi-dimensional psychological assessment model. It integrates scale scores, physiological indicators and psychological history information from the user's basic data to build a profile of the user's preoperative psychological state, identify the type and intensity of three types of negative emotions: anxiety, fear and depression, determine the user's core concerns about the surgical procedure, postoperative recovery and pain perception, and generate a quantitative psychological state assessment report. The VR / AR scene generation module, based on psychological assessment reports and user preference data, constructs a multi-type virtual scene library, including soothing natural scenes, medical process simulation scenes, and relaxation training exclusive scenes. Natural scenes include three types of environmental elements: forest, seaside, and grassland. The medical process simulation scenes restore the key links of preoperative preparation, intraoperative operation, and postoperative care according to the type of surgery, and remove bloody and stimulating scenes. The relaxation training scenes are adapted to the spatial needs of different relaxation methods, support personalized adjustment and real-time rendering of scene elements, and use AR technology to overlay virtual relaxation guidance elements onto the real ward environment. The psychological counseling interaction module is equipped with an intelligent psychological question-and-answer engine and a virtual counselor avatar. The virtual counselor interacts with users in real time through voice and body language, provides professional answers to users' core concerns, offers popular science knowledge about surgery, psychological counseling scripts, supports users to actively initiate consultation topics through voice commands and gestures, records users' emotional feedback and problem requests during the interaction process, and dynamically adjusts the depth and expression of the consultation content. The multimodal relaxation training module includes four training modes: breathing relaxation, guided meditation, progressive muscle relaxation, and mindfulness training. It provides immersive training guidance by combining VR / AR scenarios. The breathing training mode guides users to adjust their breathing rhythm through dynamic visual elements in the scene. The meditation training mode creates a focused state with soothing audio and scene atmosphere. The progressive muscle relaxation mode guides users to relax the muscles of different parts of the body in turn through voice prompts and virtual action demonstrations. The real-time physiological state monitoring module continuously collects five types of physiological data from users during psychological counseling and relaxation training: heart rate variability, respiratory rate, skin conductivity, electromyography signal, and blood oxygen saturation. The sampling frequency is no less than 10Hz, and the data is transmitted to the data processing module in real time. It also monitors the user's interactive behavior data in the VR / AR scene, including gaze focus, movement amplitude, and dwell time. The data processing and analysis module receives data transmitted from the real-time physiological state monitoring module and the interaction module, uses signal filtering algorithms to remove noise interference in the physiological data, maps different types of physiological indicators to a unified quantitative range through data standardization processing, analyzes the correlation between physiological data and user emotional state and training execution effect, and judges the degree of improvement of user psychological state by relaxation training. The dynamic feedback adjustment module adjusts the presentation parameters of the VR / AR scene, the interaction strategy of psychological counseling, and the intensity of relaxation training content in real time based on the data processing and analysis results. When it detects that the user's physiological indicators show an increase in anxiety level, it automatically switches to a more soothing virtual scene, enhances the guidance in relaxation training, and adjusts the communication tone and content focus of the virtual counselor. The data storage and traceability module adopts an encrypted storage architecture to store user basic data, psychological assessment reports, VR / AR scene configuration information, consultation interaction records, relaxation training data, physiological monitoring data and feedback adjustment logs. All data is associated with the user's unique identifier and timestamp, supporting full traceability and auditing of the data. The system adaptation and permission management module supports hardware adaptation for mainstream VR / AR devices, is compatible with terminal devices of different resolutions and interaction methods, and establishes a hierarchical permission management system, dividing the permissions into three categories: administrator, psychological counselor, and user. The administrator is responsible for system parameter configuration and data maintenance, the psychological counselor can view user data and adjust training plans, and the user can only access personal data and training content.

[0027] This invention also includes a dynamic quantification unit for psychological state, which integrates multi-dimensional physiological data and psychological assessment results to calculate the user's preoperative anxiety level in real time. The calculation formula is as follows: J represents the anxiety level quantification, ranging from 0 to 10, with higher values ​​indicating higher anxiety levels. T represents the assessment period. Let be the abnormality function of physiological indicators at time t, reflecting the degree to which physiological data deviates from the normal range. The emotion correlation coefficient at time t represents the strength of the correlation between physiological indicators and anxiety. Let be the weight of the k-th psychological assessment dimension, with values ​​ranging from 0 to 1 and a sum of 1. The score for the kth psychological assessment dimension ranges from 0 to 1. By integrating the time dimension and weighted summing the scores from multiple dimensions, the level of anxiety is accurately and dynamically quantified.

[0028] This invention also includes a VR / AR scene personalization customization unit. Based on the user's basic data, such as age, gender, interests, and psychological state profile, it adjusts the environmental elements, color scheme, sound effects, and interaction methods of the virtual scene. For children, it adds cartoon-style elements and interactive mini-games, while for adults, it provides a simple and comfortable scene design. Users can choose the core elements and background atmosphere of the scene themselves. By customizing the scene, it enhances the user's immersion and acceptance, and improves the effectiveness of psychological counseling and relaxation training.

[0029] This invention also includes a relaxation training effect evaluation unit, which comprehensively evaluates the training effect by comparing physiological index data, psychological scale scores, and user subjective feedback before and after training. A training fit calculation model is introduced to optimize the training program; the calculation formula is as follows: S represents the training fitness score, ranging from 0 to 1, with higher values ​​indicating better fitness. m represents the number of physiological indicators used in the evaluation. Let i be the weight of the i-th physiological indicator. This represents the quantified value of the i-th physiological indicator before training. This represents the quantified value of the i-th physiological indicator after training. The subjective feedback weight ranges from 0.3 to 0.4, and h represents the user's subjective satisfaction score, ranging from 0 to 1. By combining the degree of improvement in physiological indicators with subjective feedback, the suitability of the training program for the user can be accurately determined.

[0030] This invention also includes a multilingual interaction support unit with built-in Chinese, English, Japanese, and German language packs. It allows users to select their own interaction language, and the virtual counselor's voice output, text prompts in the scene, and questionnaire filling interface are all switched to the selected language in sync. Through natural language processing technology, it achieves smooth interaction between different languages, eliminates the impact of language barriers on the psychological counseling and training process, and adapts to the usage needs of users of different nationalities.

[0031] This invention also includes a remote psychological counseling module, which supports users to conduct real-time video interaction with remote psychological counselors through VR / AR devices, construct a virtual counseling room scene to simulate a face-to-face communication environment, realize the capture and real-time transmission of body movements in the virtual scene, support psychological counselors to remotely adjust the user's VR / AR scene parameters and training plan, and simultaneously view the user's physiological monitoring data and psychological assessment reports, providing users with personalized remote psychological guidance.

[0032] This invention also includes a surgical procedure cognition enhancement module. Based on the user's surgical type, it intuitively displays the key steps of the surgery, the required time, the anesthesia method, and the postoperative recovery process in a VR scene in the form of animation. Through interactive demonstrations, users can click to view detailed descriptions of each step, answer users' questions about the surgical process, reduce anxiety caused by the unknown, and provide virtual demonstrations of postoperative care precautions to help users prepare psychologically and physiologically in advance.

[0033] This invention also includes an emergency emotional intervention unit, which monitors the user's emotional state in real time during psychological counseling or relaxation training. When it detects strong emotional fluctuations in the user, including a sharp increase in heart rate, a sudden change in skin conductivity, or the active expression of fear, it automatically initiates the emergency intervention process, switches to a preset emergency relief scenario, and the virtual counselor issues a soothing voice and provides simple emotional regulation techniques. At the same time, it sends a warning notification to the associated psychological counselor, suspends the current training or counseling process, and resumes or adjusts the plan after the user's emotions have stabilized.

[0034] This invention also includes a training progress management unit, which creates personalized preoperative training plans for users, specifies the daily training duration, training mode, and training frequency, records the completion status and effect data of each training session, generates training progress reports, and visualizes the training results through two types of elements in the VR / AR scene: progress bars and achievement badges, to motivate users to complete the training according to the plan, and dynamically adjusts the subsequent training arrangements based on the training progress and effect to ensure that the user reaches the best psychological state before the surgery.

[0035] This invention also includes a data sharing and integration module, which supports data integration with the hospital's electronic medical record system and clinical information system. It synchronizes the user's psychological assessment report, training effect data, and physiological monitoring records to the electronic medical record, providing clinicians with a reference for the user's preoperative psychological state. It supports exporting data according to medical data sharing standards, facilitating multidisciplinary team collaboration in assessing the user's preoperative preparation. The data sharing process uses an encrypted transmission protocol and strictly adheres to medical data privacy protection standards.

[0036] The following two examples further illustrate the specific implementation of this system: Example 1: Application of preoperative psychological intervention for patients undergoing elective surgery in a general hospital This embodiment is applied to patients undergoing elective laparoscopic cholecystectomy in the general surgery department of a comprehensive hospital, covering a patient population of different ages (20-65 years old) and educational backgrounds. Patients generally have concerns about surgical pain, postoperative complications, and anesthesia risks before surgery. Some patients, such as foreign patients, experience communication barriers due to language differences. The system needs to alleviate preoperative anxiety and improve surgical understanding through multi-dimensional data collection, personalized VR / AR scene intervention, intelligent psychological counseling and relaxation training, combined with remote support and data sharing, thus ensuring surgical safety.

[0037] I. Core Implementation Details Multi-source data acquisition and integration: The user basic data acquisition module integrates a tablet-style questionnaire completion terminal, a wrist-worn bioinformatics acquisition device, and an interface with the hospital's HIS system. After admission, patients complete a surgery-related anxiety scale and a questionnaire on their past psychological state using the questionnaire completion terminal. The bioinformatics acquisition device continuously collects heart rate, respiratory rate, skin conductivity, and electromyography signals at a sampling frequency of 10Hz. Simultaneously, it retrieves the patient's disease diagnosis information, surgery type, expected time, and past medical history and medication history from the HIS system. All data is encoded in JSON format and associated with the patient's unique hospital number and timestamp. During data acquisition, the questionnaire completion terminal supports switching between Chinese and English to meet the needs of foreign patients.

[0038] Preoperative psychological assessment and dynamic quantification: The preoperative psychological assessment module utilizes a multi-dimensional psychological assessment model, integrating scale scores, physiological indicators, and psychological history information to construct a patient psychological profile. It generates a quantitative assessment report addressing core pain points such as patients' fear of surgical pain and anxieties about postoperative recovery. The dynamic quantification unit integrates physiological data and assessment results in real time, using algorithms to analyze changes in anxiety levels, providing data support for subsequent interventions. After the assessment, the system automatically identifies patients with high anxiety and pushes the data to the psychological counselor's workbench.

[0039] Personalized VR / AR Scene Customization and Generation: Based on survey results showing patients' preference for natural landscapes and quiet environments, the VR / AR scene generation module retrieves a forest scene from the scene library and makes personalized adjustments, adding elements such as streams and birdsong sounds that patients like, and adjusting the color scheme to a soft green tone. The surgical procedure simulation scene recreates key steps of laparoscopic cholecystectomy, including preoperative preparation, anesthesia induction, surgical procedures, and postoperative suturing, presented in animation. Detailed images of surgical instrument operations are removed, highlighting the professional operation of medical staff and safety measures. Using AR technology, a virtual breathing guidance sphere is superimposed onto the ward ceiling, allowing patients to adjust their breathing in rhythm with the sphere while lying down.

[0040] Interactive Psychological Counseling and Multilingual Support: The interactive psychological counseling module features a virtual counselor avatar, dressed in a white coat, speaking in a gentle tone, and answering patients' questions through voice interaction. Patients can use voice commands to explain the risks of anesthesia, and the virtual counselor will explain the procedure and safety of general anesthesia in plain language, using animations to demonstrate the mechanism of action of anesthetic drugs. When patients express concerns about postoperative scarring, the virtual counselor will provide information on postoperative scar care and recovery case studies. Foreign patients can switch to English via voice commands, and the virtual counselor's voice output and scene text prompts will simultaneously switch to English, achieving smooth communication.

[0041] Multimodal relaxation training and effectiveness assessment: The multimodal relaxation training module creates personalized training plans for patients, twice daily for 20 minutes each time. In the breathing training mode, the flow rate of the stream in the VR scene changes with the patient's breathing rhythm, slowing down during inhalation and speeding up during exhalation, guiding the patient to maintain deep and slow breathing; the meditation training mode is accompanied by soothing piano music and a forest scene atmosphere, with voice prompts guiding the patient to focus on breathing and bodily sensations; the progressive muscle relaxation mode guides the patient to tighten and relax muscles from head to toe through virtual movement demonstrations. The relaxation training effectiveness assessment unit compares heart rate variability, skin conductance data, and patient subjective satisfaction scores before and after training, dynamically adjusting the training mode and duration to improve intervention effectiveness.

[0042] Surgical Procedure Cognition Enhancement and Remote Support: The surgical procedure cognitive enhancement module displays key surgical steps in an interactive animation format within a VR environment. Patients can click on icons representing anesthesiologists and surgical instruments to view detailed explanations of the corresponding steps. When patients have questions about preoperative fasting requirements, they can initiate a video request through the remote psychological counseling module to connect with a hospital psychologist. The virtual counseling room simulates a face-to-face communication environment, allowing the counselor to highlight key points of the surgical procedure using screen sharing, remotely adjust the VR scene's display content, and provide personalized guidance.

[0043] Physiological monitoring and dynamic feedback adjustment: The real-time physiological state monitoring module continuously collects data such as heart rate variability, respiratory rate, and skin conductivity during consultation and training, and transmits it to the data processing module for filtering and standardization. When the system detects that the patient's heart rate is consistently higher than 80 beats / minute or there is a sudden change in skin conductivity, the dynamic feedback adjustment module automatically switches the VR scene to a more soothing seaside scene, lowers the background music volume, and the virtual consultant issues a calming voice asking the patient to relax, adjust their breathing to follow the sound of the waves, and simultaneously increases the guidance intensity of breathing training and prolongs the exhalation duration.

[0044] Emergency Intervention and Training Progress Management: The emergency emotional intervention unit monitors the patient's emotional state in real time. When a patient experiences an emotional breakdown upon seeing a simulated surgical scene and actively expresses fear, the system immediately activates the emergency procedure, switching to a preset starry sky scene, playing a gentle lullaby, and a virtual counselor issuing a reassuring instruction to pause the training and take three deep breaths together. Simultaneously, an alert notification is sent to the associated psychological counselor. The training progress management unit visualizes training results through a progress bar and reassurance badges within the VR scene. Patients unlock one badge after completing daily training; accumulating five badges allows for one scene customization privilege, motivating patients to complete training as planned.

[0045] Data storage, sharing, and access control: The data storage and traceability module uses AES-256 encryption to store all patient data, including basic information, assessment reports, scene configurations, consultation records, training data, etc., linked to hospital numbers and timestamps, supporting full traceability. The data sharing and integration module synchronizes patient psychological assessment reports, training effect data, and physiological monitoring records to the hospital's electronic medical record system. Clinicians can view this data through their workstations as a reference for preoperative assessment. Multidisciplinary teams can export data according to medical data sharing standards to collaboratively assess patients' preoperative preparation. The system adaptation and access control module supports mainstream VR headsets and tablet devices. Administrators configure system parameters and maintain the scene library through the backend. Psychotherapists can view patient data and adjust training plans, while patients can only access their personal training content and assessment reports.

[0046] Table 1 Comparison of the effects of preoperative psychological intervention on surgical patients in general hospitals

[0047] Table 1 clearly demonstrates the significant advantages of the system of this invention in preoperative intervention for surgical patients in general hospitals. Traditional psychological interventions rely on verbal explanations and paper materials, resulting in limited anxiety relief, unclear patient understanding of the surgical procedure, low training compliance and counseling satisfaction, indirectly leading to a higher incidence of postoperative complications. The system of this invention effectively alleviates anxiety through multi-dimensional data collection and precise assessment, personalized VR / AR scenarios and intelligent counseling, enhances patient understanding of the surgical procedure through surgical procedure reinforcement, improves compliance through gamified training progress management, and optimizes preoperative preparation through data sharing and multidisciplinary collaboration, ultimately reducing the incidence of postoperative complications and fully meeting the standardized and precise needs of preoperative psychological intervention in general hospitals.

[0048] Example 2: Application of preoperative psychological intervention for orthopedic surgery patients in a pediatric hospital This embodiment is applied to patients aged 4-12 years undergoing fracture reduction surgery in the orthopedic department of a pediatric hospital. Children often exhibit preoperative crying and resistance to treatment due to fear of the unfamiliar medical environment, surgical pain, and separation anxiety. The system needs to be tailored to children's psychological characteristics, using cartoon-style VR / AR scenarios, gamified relaxation training, and simplified interaction methods to alleviate preoperative fear and improve treatment cooperation. It also supports remote consultation with parents to ensure the intervention's effectiveness.

[0049] I. Core Implementation Details Multi-source data acquisition and child-friendly design: The user basic data acquisition module uses a child-friendly tablet-based questionnaire terminal, equipped with a cartoon interface and voice reading function. It is a lightweight, wrist-worn bio-information acquisition device with a cartoon design, weighing less than 50g, and interfaces with the hospital's pediatric HIS system. Parents assist children in completing a simplified anxiety scale. The bio-information acquisition device collects the child's heart rate, respiratory rate, and blood oxygen saturation at a sampling frequency of 10Hz to avoid causing resistance during the collection process. Simultaneously, it retrieves the child's disease diagnosis, surgical type, and past medical history from the HIS system. All data is linked to medical record numbers and timestamps according to child-friendly coding rules.

[0050] Preoperative psychological assessment and personalized customization: The preoperative psychological assessment module simplifies the assessment dimensions based on children's psychological characteristics, focusing on identifying core concerns such as separation anxiety, pain fear, and fear of medical equipment, generating a child-appropriate visual assessment report including cartoon emotion charts. The VR / AR scene personalization unit is based on children's age and preferences, such as a liking for cartoon animals and animation IPs. For example, a soothing natural scene is customized as a cartoon forest, featuring animal characters like bears and rabbits, with trees and flowers in bright colors. The surgical procedure simulation scene uses animation to demonstrate a simplified procedure for fracture reduction surgery, replacing real medical staff with cartoon characters and using childlike expressions like "magical disinfection" and "sleep anesthesia" instead of professional terminology to avoid triggering fear.

[0051] Interactive and Gamified Training in Psychological Counseling: The interactive module features a cartoon virtual counselor, Doctor Panda, who interacts with children using simple and easy-to-understand language, combined with body language such as waving and nodding to enhance approachability. Children can initiate a consultation by giving Doctor Panda voice commands (e.g., "I'm afraid of injections") or by pointing to their own arm. Doctor Panda then uses animation to demonstrate the painless principle of injections and provides virtual courage stickers. The multimodal relaxation training module incorporates gamified elements. In the breathing training mode, children adjust their breathing by following the rise and fall of a cartoon whale in a VR scene—inhaling when the whale rises and exhaling when it sinks. The progressive muscle relaxation training combines a robot charging game, with voice prompts guiding children to tighten their muscles to charge and relax them to discharge. Completing these prompts unlocks cartoon scene levels.

[0052] Multilingual support and remote parent-child consultation: The multilingual interaction support unit has built-in Chinese and English children's language packs. Parents can switch languages ​​via tablet settings. The virtual counselor's voice output and scene text prompts are adjusted synchronously to meet the needs of foreign children. The remote psychological counseling module allows parents to connect to the child's VR device via a mobile app. When parents are not at the hospital, they can initiate remote video consultations. The virtual consultation room scene displays the parent's image, allowing for interaction between the child, parent, and virtual counselor. Parents assist in calming the child's emotions, and the psychological counselor remotely adjusts the training plan.

[0053] Surgical Procedure Recognition Enhancement and Emergency Intervention: The surgical procedure recognition enhancement module presents the surgical procedure in an interactive game format within a VR environment. Children can trigger corresponding animated explanations by clicking on cartoon medical devices in the scene. For example, clicking on the disinfectant spray shows medical staff disinfecting a cartoon character, explaining that disinfection can drive away bacteria; clicking on the anesthesia mask shows a cartoon character falling asleep after putting on the mask, illustrating that surgery is painless during sleep. The emergency emotional intervention unit detects a sudden increase in the child's heart rate or abnormal electromyographic signals due to crying. It immediately switches to a preset cartoon playground scene, plays the child's favorite animated theme song, and a panda doctor issues a soothing voice saying, "Let's play on the slide for a while, then we can continue, okay?" Simultaneously, an alert notification is sent to parents and medical staff, suspending the current intervention until the child's emotions stabilize.

[0054] Training Progress Management and Data Sharing: The training progress management unit creates fun training plans for children, once a day for 15 minutes each time. Progress is displayed through a "Courage Tree" in a VR scene. After completing a training session, the Courage Tree grows a leaf. Accumulating 5 leaves can be redeemed for a cartoon sticker reward. The data storage and traceability module uses encrypted storage to protect children's privacy data and links it to the child's medical record number and timestamp. The data sharing and integration module synchronizes children's psychological assessment reports and training effect data to the pediatric electronic medical record system. Orthopedic surgeons and psychologists collaborate to assess the child's preoperative psychological state and adjust surgical plans and interventions. It also supports data export according to pediatric medical data sharing standards, facilitating data flow during referrals.

[0055] Table 2 Comparison of the effects of preoperative psychological intervention on pediatric orthopedic surgery patients

[0056] Table 2 shows the data highlighting the suitability and effectiveness of the system of this invention in preoperative psychological intervention for children. Traditional child psychological interventions often rely on methods such as toy soothing and parental persuasion, which fail to address the core of children's fears, resulting in low rates of fear improvement, poor surgical cooperation, and low parental satisfaction. The system of this invention, through customized cartoon scenes, gamified training design, and simplified interaction methods, aligns with children's psychological characteristics, effectively alleviating fears and improving training acceptance and surgical cooperation. Remote parent-child counseling supports parental participation, enhancing children's sense of security and significantly increasing parental satisfaction. Improved preoperative psychological state indirectly increases postoperative pain tolerance, providing strong support for the smooth conduct of pediatric orthopedic surgery and postoperative recovery, perfectly meeting the preoperative psychological intervention needs of pediatric hospitals.

[0057] Reference Figure 2 This figure clearly demonstrates the effect of the relaxation training system of this invention on alleviating preoperative anxiety. Before training, the user's anxiety level was as high as 8.2, indicating a state of high anxiety. This directly reflects the patient's preoperative emotions such as uncertainty about the surgery and fear of pain. As the number of training sessions increased, the anxiety level gradually decreased, dropping to 2.7 after 5 sessions, and further to 1.9 one day before surgery, indicating a low anxiety level. This change stems from the scientific design of the system's multimodal relaxation training module. Modes such as breathing relaxation and guided meditation, combined with VR immersive scenarios, effectively guide users to regulate their physiological state and alleviate psychological stress. Data trends prove that the system, through gradual training, helps users gradually adapt to surgical expectations, reduces negative emotions, and lays a psychological foundation for the smooth conduct of the surgery, highlighting the system's continuity and effectiveness in emotional intervention.

[0058] Reference Figure 3This figure visually compares the comprehensive effects of different intervention methods, highlighting the significant advantages of the system of this invention. Traditional verbal intervention relies on manual explanation, lacks immersion and personalization, has an anxiety relief rate of only 42%, and results in users having a vague understanding of the surgery and low satisfaction. While single VR scene intervention can alleviate some anxiety through scene immersion, it lacks intelligent psychological counseling and dynamic adjustment, limiting its effectiveness. The system of this invention integrates multi-source data collection, personalized VR / AR scenes, intelligent counseling, and multimodal training, achieving an excellent performance of 88% anxiety relief rate, 92% surgical cognition accuracy rate, and 94% user satisfaction. This is due to the synergistic effect of the various modules of the system: preoperative psychological assessment accurately identifies pain points, scene customization and intelligent interaction enhance the experience, relaxation training directly targets the core of emotions, and multidimensionally improves the intervention effect, comprehensively surpassing the limitations of traditional intervention and single-technology intervention.

[0059] Reference Figure 4 This chart reflects user preferences for the system's multimodal relaxation training modes, providing data support for future system optimization. The breathing relaxation mode, accounting for 35%, is the most popular due to its simple operation, immediate effects, and, combined with dynamic visual guidance in VR scenarios, quickly helps users regulate their physiological state. The meditation-guided mode, accounting for 28%, effectively helps users focus their minds and alleviate distractions thanks to the combination of soothing audio and immersive natural scenes. The progressive muscle relaxation mode, accounting for 22%, guides users through the gradual tightening and relaxation of individual muscle groups, making it suitable for relieving muscle tension caused by anxiety. The mindfulness training mode, accounting for 15%, is more suitable for users with some prior experience, helping to regulate their mental state in the long term. The diversity of preferences demonstrates the rationality of the system's multimodal design, meeting the relaxation habits and needs of different users and improving training adherence. It also points the way for future system optimization, allowing for further enrichment of scenarios and guidance methods for high-preference modes, and simplification and enhancement of the experience for low-preference modes, continuously improving the system's applicability.

[0060] The above are merely preferred embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any equivalent substitutions or modifications made by those skilled in the art within the scope of the technology disclosed in the present invention, based on the technical solution and inventive concept of the present invention, should be covered within the scope of protection of the present invention.

Claims

1. A preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology, characterized in that, Includes the following modules: The user basic data collection module integrates a questionnaire filling terminal, bioinformatics collection equipment and medical data interface to collect information, capture core physiological indicators, and retrieve medical data from electronic medical records. All data is uniformly encoded and associated with timestamps. The preoperative psychological assessment module has a built-in multi-dimensional psychological assessment model, integrates basic user data, constructs a preoperative psychological state profile, and generates a quantitative assessment report. The VR / AR scene generation module, based on evaluation reports and user preferences, constructs a virtual scene library that includes natural scenes, medical process simulations, and relaxation training. It supports personalized scene adjustments and real-time rendering, and overlays virtual elements onto the real environment using AR technology. The psychological counseling interaction module is equipped with an intelligent question-and-answer engine and a virtual counselor. It provides popular science and guidance for users’ core concerns, records user feedback and dynamically adjusts the counseling content. The multimodal relaxation training module has four built-in training modes and provides immersive guidance in VR / AR scenarios. It assists users in completing relaxation training through visual, audio, and voice prompts. The real-time physiological state monitoring module continuously collects various types of physiological data and user interaction behavior data during the consultation and training process; The data processing and analysis module receives various types of transmitted data, analyzes the correlation between physiological data and emotional state and training effect, and judges the degree of improvement in psychological state. The dynamic feedback adjustment module adjusts scene presentation parameters, consultation strategies, and training intensity in real time based on data analysis results to adapt to changes in user emotions. The data storage and traceability module adopts an encrypted storage architecture to store all relevant data throughout the process, associates it with a unique identifier and timestamp, and supports data traceability and auditing. The system adaptation and permission management module supports adaptation to mainstream VR / AR devices, establishes a hierarchical permission management system, divides roles into three categories, and clarifies their respective operation permissions.

2. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a dynamic quantification unit for psychological state, which integrates multi-dimensional physiological data and psychological assessment results to calculate the user's preoperative anxiety level in real time. The calculation formula is as follows: J represents the quantitative value of anxiety level, and T represents the assessment period. Let be the abnormality function of the physiological indicators at time t. Let be the emotion correlation coefficient at time t. The weight of the k-th psychological assessment dimension. This represents the score for the k-th psychological assessment dimension.

3. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a VR / AR scene personalization customization unit, which adjusts the environmental elements, color scheme, sound effect type, and interaction method of the virtual scene based on the user's basic data such as age, gender, interests, preferences, and psychological state profile. For children, it adds cartoon-style elements and interactive mini-games, while for adults, it provides a simple and comfortable scene design, allowing users to choose the core elements and background atmosphere of the scene.

4. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a relaxation training effectiveness evaluation unit, which comprehensively evaluates the training effect by comparing physiological indicators, psychological scale scores, and user subjective feedback before and after training. A training fit calculation model is introduced to optimize the training program; the calculation formula is: S represents the training fit score, and m represents the number of physiological indicators used in the evaluation. Let i be the weight of the i-th physiological indicator. This represents the quantified value of the i-th physiological indicator before training. This represents the quantified value of the i-th physiological indicator after training. denoted as the subjective feedback weight, and h as the user's subjective satisfaction score.

5. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a multilingual interaction support unit, allowing users to choose their own interaction language. The virtual consultant's voice output, text prompts in the scene, and questionnaire filling interface are all switched to the selected language in sync, achieving smooth interaction between different languages ​​through natural language processing technology.

6. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a remote psychological counseling module, which supports users to conduct real-time video interaction with remote psychological counselors through VR / AR devices, build a virtual counseling room scene to simulate a face-to-face communication environment, complete the capture and real-time transmission of body movements in the virtual scene, support psychological counselors to remotely adjust the user's VR / AR scene parameters and training plan, and simultaneously view the user's physiological monitoring data and psychological assessment reports.

7. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a surgical procedure cognition enhancement module, which uses animation to intuitively demonstrate the key steps, required time, anesthesia method, and postoperative recovery process of the surgery in a VR scene based on the user's type of surgery. Through interactive demonstrations, users can click to view detailed explanations of each step, answer their questions about the surgical process, and provide virtual demonstrations of postoperative care precautions to help users prepare psychologically and physiologically in advance.

8. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes an emergency emotional intervention unit, which monitors the user's emotional state in real time during psychological counseling or relaxation training. When a strong emotional fluctuation is detected, the emergency intervention process is automatically activated, switching to a preset emergency relief scenario. The virtual counselor issues a soothing voice and provides simple emotional regulation techniques, while sending an alert notification to the associated psychological counselor, suspending the current training or counseling process, and resuming or adjusting the plan after the user's emotions have stabilized.

9. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a training progress management unit, which allows users to create personalized preoperative training plans, specifying daily training duration, training mode, and training frequency, recording the completion status and effect data of each training session, generating training progress reports, and visually displaying training results through two types of elements in VR / AR scenes: progress bars and achievement badges, to motivate users to complete training according to plan.

10. The preoperative psychological counseling and relaxation training system based on virtual and augmented reality technology according to claim 1, characterized in that, It also includes a data sharing and integration module, which supports data integration with the hospital's electronic medical record system and clinical information system. It synchronizes the user's psychological assessment report, training effect data, and physiological monitoring records to the electronic medical record, providing clinicians with a reference for the user's preoperative psychological state. It supports data export according to medical data sharing standards. The data sharing process uses an encrypted transmission protocol and strictly follows medical data privacy protection regulations.

Images