1566 results about "Simulation training" patented technology

The invention belongs to the technical field of robot control, and discloses a high-gear-ratio humanoid robot robust walking control method and system based on potential dynamics self-adaption, and the method comprises the steps: designing a control strategy training frame based on deep reinforcement learning, and carrying out the optimization through an Actor-Critic structure and a PPO algorithm; constructing a potential dynamic adaptive network LDAN, and extracting environment and ontology dynamic parameters through a variational auto-encoder; designing a multi-dimensional reward function; constructing a periodic gait library by using von Mises distribution and motion capture data; gradually introducing terrain disturbance and dynamic change through curriculum type simulation training; the trained strategy and the LDAN module are deployed on the high-gear-ratio driven humanoid robot, the problems that the high-gear-ratio humanoid robot is poor in motion stability, poor in adaptability and insufficient in action expression in a variable environment are solved, and the high-gear-ratio driven humanoid robot has the advantages of being high in robustness, high in natural expressivity and high in migration ability.

The invention provides a scene reproduction and augmented reality simulation training method for floating installation. The method comprises the following steps: acquiring an external environment and an equipment state in real time; acquiring operation behavior data of the trainee in the training process, performing timestamp matching on the operation behavior data and the dynamic simulation scene, constructing a synchronous model, calculating a key performance index based on the synchronized data to quantify the operation effect of the trainee, and obtaining an operation performance record; when it is detected that the student fails to operate, a failure scene of the student is reconstructed based on currently collected operation behavior data and a dynamic simulation scene, and a failure path is analyzed by using a reinforcement learning model; generating an optimized floating track and an optimized posture adjustment path according to the failure scene of the reconstructed student and the optimization suggestion; and the trainee completes the floating support installation operation according to the optimized path displayed by the augmented reality equipment. According to the invention, the efficiency and effect of floating support installation training can be greatly improved, and a more efficient and intelligent solution is provided for the ocean engineering field.

The invention provides a PICC puncture virtual simulation training system and method constructed based on XR. A nursing skill simulation training platform and an intelligent training room based on augmented reality (XR) combine a simulation medical technology, an artificial intelligence large model, XR intelligent hardware, intelligent agent application, space calculation, computer vision and a mainstream technology of Internet of Things in scheme planning and design. According to the PICC puncture virtual simulation training platform, the ground practice, standardization, high virtual simulation and adaptive application of PICC puncture virtual simulation training are realized, and the intelligent development process and teaching concept of PICC puncture teaching are improved. According to the PICC puncture teaching system, intelligent virtual tutors, puncture teaching holographic three-dimensional sharing, virtual reality fusion technologies and the like are provided, an interactive teaching mode can be brought to PICC puncture teaching, the interest of students in teaching and clear operation guidance are improved, the theory and practice are fused, and the clinical cooperation ability is improved.

The invention provides a storage environment deep reinforcement learning multi-AGV conflict-free path planning method, and the method comprises the steps: creating a virtual storage simulation training environment, and extracting virtual storage simulation training environment information from the virtual storage simulation training environment; determining a state observation value code of each AGV according to the virtual storage simulation training environment information; setting an action space of the AGV, and constructing a reward function of deep reinforcement learning; and constructing a distributed conflict-free multi-AGV path planner introducing a dynamic grouping mechanism, carrying out iterative training on the distributed conflict-free multi-AGV path planner through a deep reinforcement learning network according to the reward function and the state observation value code and the action space of each AGV, updating network parameters of the distributed conflict-free multi-AGV path planner, and carrying out path planning on the distributed conflict-free multi-AGV path planner according to the network parameters of the distributed conflict-free multi-AGV path planner. A trained distributed conflict-free multi-AGV path planner is obtained; and carrying out conflict-free path planning on a plurality of AGVs in an actual storage environment by using the trained distributed conflict-free multi-AGV path planner to obtain a conflict-free path of each AGV.

The invention relates to the technical field of robot training. The robot self-adaptive training method based on reinforcement learning comprises the steps that task sub-target information is generated through a high-level strategy network, the task sub-target information is input into a low-level execution network, an action control instruction is generated according to the task sub-target information, interaction feedback information is collected in the execution process, and the action control instruction is sent to a robot through a robot. Calculating a reward value according to the interaction feedback information, carrying out association processing on the reward value and the scene complexity parameter, executing a dynamic reward shaping operation, generating an adjusted reward signal, generating a strategy model optimized by meta-learning based on the adjusted reward signal, loading the strategy model in a simulation environment, and carrying out dynamic reward shaping. A target strategy model optimized through simulation training is generated, the target strategy model is loaded to the robot, and the robot is controlled to execute task operation in the actual interaction scene. The method has the effect of realizing adaptive task learning of the robot in a multi-interaction scene.

The invention discloses a snake-shaped robot control method based on reinforcement learning. The snake-shaped robot control method comprises the steps that a complex terrain simulation scene comprising walls, cubic obstacles and low channels is built; modeling is conducted on the structure, joints and kinetic parameters of the snake-shaped robot, and a snake-shaped robot simulation model is obtained; defining a state space and an action space of the snakelike robot, and designing a diversified reward function; constructing an action network and a value network by adopting a multi-layer perceptron (MLP) structure; and performing multi-round simulation training on the snakelike robot by applying a reinforcement learning algorithm, so that the robot learns a parameter set for making an optimization decision under different scenes, thereby realizing optimization control of the snakelike robot and reaching a target point. According to the method, visual information does not need to be depended on, efficient and stable motion control of the snake-shaped robot in a complex environment can be achieved through autonomous learning, and the crossing capacity of the snake-shaped robot in a low and narrow space is improved.

The invention relates to the technical field of safety simulation training drilling, in particular to an intelligent assessment and evaluation method for mine accident emergency risk avoiding, which comprises the following steps of: S1, acquiring multi-dimensional data in an emergency risk avoiding capability drilling process of a student; s2, performing data preprocessing on the multi-dimensional data, and constructing an evaluation data set; s3, constructing an emergency risk avoiding capability evaluation system, wherein the system comprises evaluation items and distribution weights of the evaluation items; s4, establishing a weight evaluation model, and dynamically adjusting the distribution weight of the evaluation item in combination with the environmental data; and S5, scoring is completed according to the emergency risk avoiding capability evaluation system, and a personalized evaluation report is generated. According to the invention, comprehensive, objective and real-time evaluation of the emergency risk avoiding capability of the miner is realized, and the influence of human factors on the evaluation result can be reduced; the method can flexibly adapt to different environments and scenes through dynamic adjustment of the evaluation model, provides personalized evaluation reports and improvement suggestions, and effectively assists students in improving the emergency risk avoiding capability.

The invention relates to the technical field of robot control methods, in particular to a simulation-to-reality migration-oriented robot gait optimization method, which comprises the following steps of: acquiring input characteristics of a robot; constructing a gait control model by adopting a near-end strategy optimization reinforcement learning algorithm; training the gait control model in parallel in a physical simulation environment; the input feature matrix is input into the trained gait control model, a joint target position control instruction is generated, and the robot is controlled to execute gait actions; executing domain randomization operation by applying simulation to a reality checking tool; the simulation parameters are adjusted according to the difference parameters, and optimized gait control model parameters are output. The uncertainty of the real environment is covered by applying simulation to reality troubleshooting tool execution domain randomization operation, the systematized difference positioning process is combined, the simulation and real machine difference parameters are recognized, and the accuracy of the gait control model is improved. And action malformation, poor stability or hardware damage of the gait strategy of simulation training during real machine deployment can be prevented.

The invention relates to the technical field of automatic driving, and discloses an explanatory enhancement method and device for an automatic driving scene, and the method comprises the steps: obtaining a driving scene label and sensor performance data corresponding to the driving scene label, and determining a plurality of weight combinations based on the driving scene label and the sensor performance data; performing experimental simulation training based on the sensor performance data and the plurality of weight combinations to generate experimental record data; performing anti-fact simulation on the experimental record data to generate anti-fact simulation record data; and finally, based on the experimental record data and the anti-fact simulation record data, performing causal model verification optimization to obtain a sensor weight distribution strategy in the automatic driving scene. According to the method, dynamic evaluation and optimization of sensor performance data in different driving scenes are realized, the problem of'black box 'in an automatic driving system is solved, and interpretability and transparency of a sensor fusion process are realized.

The invention discloses a quadruped robot motion control method based on adaptive deep reinforcement learning. The method comprises the following steps: S1, determining a network model, a composite reward function, a state space and a bionic action generation mechanism of a simulation training environment; the state space provides environment information input, the network model processes the input information and generates a decision, the bionic action mechanism executes a specific decision behavior, and the composite reward function evaluates a behavior effect and optimizes a decision direction; s2, constructing a simulation training environment of the quadruped robot, wherein the simulation environment comprises quadruped robot model information and simulation environment information; s3, training the network model by using a deep reinforcement learning algorithm based on robot model information and simulated environment information to obtain a trained motion control strategy; and S4, verifying the feasibility of utilizing the trained motion control strategy by controlling the motion of the quadruped robot in a real environment. According to the invention, the self-adaptive capability to a complex environment is obviously improved.

The invention belongs to the technical field of new energy automobile teaching, and particularly relates to a VR interactive new energy automobile high-voltage electrical principle teaching method, system and equipment, and the method comprises the steps: obtaining the physical parameter data and dynamic circuit simulation data of a new energy automobile high-voltage electrical system; constructing a high-precision 3D model according to the physical parameter data, inputting dynamic circuit simulation data into the model, and generating interactive principle annotations and particle effect animations; based on a gesture recognition model and a new energy automobile VR interaction technology, circuit state changes in the particle effect animation are obtained, a new energy automobile high-voltage system principle and a signal flow are displayed, a practical operation simulation training scene is constructed, student operation data are recorded according to the practical operation simulation training scene, an AI evaluation model is trained, and an evaluation report is obtained. And adjusting interaction feedback parameters of the training scene, and meanwhile, generating a personalized learning report of the trainee. Therefore, the problems of safety risk, teaching lag, abstraction obstacle and the like in the prior art are solved.

The invention discloses a dexterous palm internal operation control method based on reinforcement learning and real-time pose feedback, and the method comprises the steps: building an under-actuated dexterous palm internal operation experiment scene, and carrying out the data collection in a simulation environment; aiming at an operation task in the under-actuated dexterous palm, building a reinforcement learning algorithm framework, and designing a refined state space, an action space and a reward function according to task requirements and structural characteristics of the under-actuated dexterous palm; an IsaacLab environment is configured to realize efficient interaction between a reinforcement learning algorithm and a physical simulation platform; simulation training is carried out in the environment, and an optimal strategy is learned; different task scenes are set, pure state input driving decisions are adopted, and the autonomous adaptability and generalization control ability of the under-actuated dexterous hand are improved. The problems that a current robot underactuated dexterous hand is insufficient in control flexibility in a complex environment and is difficult to adapt to an unstructured environment, and reinforcement learning training results are difficult to migrate from simulation to reality can be solved.

The invention relates to the field of electroencephalogram signal processing, and particularly discloses a multi-mode electroencephalogram characteristic cognitive ability evaluation system based on a neural network, comprising: an acquisition module used for synchronously acquiring whole brain signals and eye movement data during pilot simulation training; the data preprocessing module is used for primarily processing the received whole brain signals and the eye movement data, monitoring the primarily processed data in real time by utilizing a preset monitoring mechanism, and triggering to generate interaction test starting signals if preset symbolic fluctuation occurs in the whole brain signals or the eye movement data; and the test interaction sub-module is used for generating arithmetic test questions according to a preset rule after receiving the interaction test starting signal, and synchronously recording answer correlation parameters of the pilot. By adopting the technical scheme of the invention, the deep-level reaction mechanism of the brain under the stimulation of the special complex cognitive task of flight training can be fully considered, and the cognitive load change of the pilot in the simulated training can be comprehensively and accurately reflected.

The invention provides an automatic history fitting method for gas drive numerical reservoir simulation, which comprises the following steps of: 1, establishing a gas drive numerical simulation mathematical model, and correcting the gas drive numerical simulation mathematical model by using a gas drive PVT phase state fitting experiment; 2, solving the corrected gas drive numerical simulation mathematical model obtained in the step 1, performing parameter analysis, and screening main control factors influencing accumulated oil production; 3, generating a numerical simulation training sample set based on an orthogonal experiment, and obtaining the main control factor parameter initial value constraint screened out in the step 2 through a machine learning algorithm; step 4, establishing a multi-parameter fitting objective function for realizing historical fitting; and step 5, using the main control factor parameter initial value constraint obtained in the step 3, performing iterative calculation through a projection gradient method, fitting the target function established in the step 4, and terminating when a convergence condition is satisfied. According to the method provided by the invention, the constraint parameter values can be adaptively calculated, automatic historical fitting is completed, and the definition of the fitting parameter range does not depend on empirical and experimental determination any more.

The invention discloses an interactive control method for virtual simulation training of electric power operation and maintenance, and particularly relates to the technical field of electric power operation and maintenance simulation, which comprises the following steps of: acquiring operation behavior data of students, performing real-time capability grading on the students by utilizing a multi-dimensional capability evaluation model, and performing real-time capability grading on the students; a difference adaptation parameter model is constructed in combination with the difference between the virtual device and the target actual device, training content with corresponding difficulty is matched from a preset training task library, a knowledge graph of students is constructed, and a personalized training path is generated through a path recommendation engine. Iteratively updating the training difficulty and the recommended path according to the newly generated behavior data and the performance of the trainee in the aspect of the difference adaptive capacity, constructing a difference adaptive parameter model, bringing the difference into a training task adjustment and capacity evaluation mechanism, dynamically adjusting the training task parameters to fit the actual equipment complexity, and evaluating the performance of the trainee in the aspect of the difference adaptive capacity. And a migration barrier between virtual training and real operation and maintenance is broken through.

The invention discloses a drainage basin intelligent flood control scheduling method and system based on digital twinborn, and relates to the technical field of flood control and disaster mitigation, and the method comprises the steps: collecting static data and dynamic data of a drainage basin, building a hydrological and hydrodynamic coupling model based on the static data and the dynamic data, and forming a drainage basin digital twinborn body; inputting the received numerical weather forecast into the digital twin of the watershed for simulation, generating a plurality of flood routing scenes in a future time period, and calculating a dynamic flood risk probability graph; the method comprises the following steps: constructing a simulation training environment by using historical flood data and a high-precision drainage basin digital twinborn body, carrying out offline training on a scheduling strategy network in the simulation training environment based on a reinforcement learning algorithm, and outputting a scheduling instruction according to a real-time drainage basin state to complete training of the scheduling strategy network. According to the method, the core problem that the traditional method is insufficient in decision timeliness and weak in adaptive capacity in an uncertain environment is effectively solved.

The invention discloses an aircraft control simulation platform construction method, and the method comprises the steps: constructing a terrain multi-dimensional model, fusing a cross-scale meteorological particle system, and dynamically obtaining an environment disturbance factor; a space obstacle dynamic database is generated in combination with millimeter-level space positioning data, and virtual collision detection is carried out; performing eye movement-gesture collaborative decision, and identifying a control instruction with high confidence; the six-degree-of-freedom kinetic equation is coupled with an unreal engine interface in real time, and a high-fidelity instrument is driven to feed back; generating a training defect thermodynamic diagram, triggering an adaptive optimization strategy and iterating platform parameters; the invention provides a solution integrating multi-modal high-precision data acquisition, dynamic environment-physical rule coupling, intelligent decision and closed-loop optimization so as to realize aircraft control simulation training with high immersion degree, high fidelity and high adaptability.

The invention discloses a PICC virtuality and reality combined simulation training system and method, solves the problems that puncture simulation training is not real enough and students cannot perform intensive training aiming at a puncture technology due to the fact that an existing venipuncture simulation platform lacks necessary puncture force feedback, and belongs to the technical field of virtual training. The system is composed of a personal information management module, a simulation training terminal, a virtual model management module and a man-machine interaction module, and student operation information is collected in real time based on a multi-dimensional sensor; the virtual model management module reconstructs real anatomical structures such as blood vessels and skin of a human body through a high-precision 3D modeling technology, a physical engine is matched to provide a vivid puncture hand feeling, students can experience a scene very close to real operation, and the simulation training terminal can simulate the real operation through a force feedback technology in a virtual scene. The trainee can feel the touch similar to that of real puncture, so that the understanding of the trainee on the puncture process and the control of the trainee on the puncture strength and angle are improved.

The invention discloses a deep reinforcement learning robot-assisted ultrasonic scanning system and method based on security constraints. The invention discloses a deep reinforcement learning mechanical arm ultrasonic scanning method and system based on security constraints. A scanning system comprising a mechanical arm, an ultrasonic probe, a joint torque and visual sensor and a control unit is constructed. The environment state space covers the joint angle, the tail end pose, the contact force, the scanning path and the safety state variable of the mechanical arm, and the action space is a tail end linear speed instruction of the mechanical arm. A deep reinforcement learning model is built based on a near-end strategy optimization (PPO) algorithm, and a reward function including image quality, task completion reward and multiple penalty terms is designed. A control barrier function (CBFs) is used for implementing safety constraint on motion of the mechanical arm, and the safety constraint is fused into deep reinforcement learning training through a penalty function method. A model is trained in a simulation environment simulating an actual scanning scene and then deployed to an actual system, and a mechanical arm is controlled to scan and monitor safety constraints according to a real-time environment state. The mechanical arm can efficiently execute the ultrasonic scanning task under the condition that the safety constraint is met, and a reliable scheme is provided for ultrasonic scanning automation. Meanwhile, the system is provided with a data acquisition module, a state construction module, a reward calculation module, a security constraint module, a control module and the like, and the model performance can be improved through simulation training.

A method of generating a simulated image for training a model to detect resident space objects (RSOs), a method of training the model, and a method of detecting RSOs are provided. The method includes generating a foreground of the simulated image including RSOs by calculating coordinates of an imaging satellite at a given time, determining an area of interest given a field of view (FOV) of the imaging satellite, and calculating coordinates of all RSOs and saving the coordinates if the RSO is within the area of interest. The method further includes generating a background of the simulated image including stars by querying a star catalogue database for coordinates of all stars that fall inside the FOV, adding noise, and translating RSO and star coordinates to pixel coordinates. The method further includes generating the simulated image by choosing an imaging mode, setting an exposure time, and rendering the simulated image.

The invention provides an anesthesia virtual simulation training system fusing knowledge, skills and a thinking closed loop. The anesthesia virtual simulation training system comprises a medical knowledge base module, a clinical thinking module, a skill training module, an examination question brushing module, a knowledge graph module and an intelligent platform bottom layer framework. The intelligent platform underlying architecture comprises a data middle platform, an AI engine and a 3D engine, collects student behavior data of each module, constructs a dynamic student ability portrait through a gradient boosting tree algorithm and a collaborative filtering recommendation model, analyzes knowledge blind areas and skill shortages, plans a personalized learning path and pushes targeted training content, and provides a personalized learning result. A closed-loop process of evaluation, learning, practice and re-evaluation is formed; and deep fusion of theoretical knowledge, clinical thinking and skill operation is realized through a cross-module collaboration mechanism. The problems that traditional anesthesia teaching is high in practical operation risk, scattered in resource and insufficient in individuation are solved, and the clinical comprehensive ability and teaching quality of anesthetists are effectively improved.

The invention relates to a simulation dialogue partner training system based on a large model. The simulation dialogue partner training system comprises a product knowledge base module, a question and answer library construction and management module, a pair training simulation module, a stage control module, a supernatural voice dialogue module, a verbal skill prompt module, a real-time evaluation module and a dialogue summary report module. The intelligent partner training system for customer communication training has high simulation dialogue ability, flexible configuration ability and a perfect evaluation feedback mechanism, can effectively replace a traditional scripted training or real person simulation partner training mode, and improves the communication actual combat ability of front-line personnel such as sales personnel and customer service personnel. According to the invention, low-efficiency links in a traditional training mode are replaced by an intelligent means, the training quality, the standardization degree and the reproducibility are improved, an enterprise is finally assisted to create a more professional and efficient customer front-line team, and the system can be widely applied to scenes such as enterprise training, new employee on-duty training and product popularization preparation.

The invention discloses a flight training digital twin system, which comprises a data acquisition module (for collecting real-time data of an aircraft and an environment to enable virtual and actual conditions to be consistent), a model and simulation module (for creating an aircraft, an operating environment and an airborne equipment simulation model), and an intelligent analysis and control module (for analyzing operation and equipment states through big data, and analyzing and analyzing the real-time data of the aircraft and the environment to enable virtual and actual conditions to be consistent). Feedback and optimization suggestions are generated), and an interaction and training module (based on real-time data scoring feedback and immersive interaction-aid operation). According to the system, states and behaviors of physical entities such as an aircraft, a pilot and an environment are mapped to a virtual space through a high-precision virtual simulation technology, and a real-time interaction and dynamic feedback simulation training platform is constructed. The system integrates multi-dimensional data, can be linked with physical equipment, and assists a pilot in improving skills and enhancing the coping ability of complex conditions in a safe and controllable virtual environment by simulating a real scene and providing a personalized scheme, intelligent decision and risk prediction.

The invention discloses a multi-interface interactive training simulation method and system, a medium and a program product, and relates to the technical field of simulation training, and the method comprises the steps: determining a target training subject according to the selection of a student, determining a standard training procedure, displaying a virtual operation panel corresponding to the target training subject on a first display screen, a working principle animation corresponding to the target training subject is displayed on a second display screen, and a real-time simulation state corresponding to the target training subject is displayed on a third display screen; acquiring operation data of a student on the virtual operation panel in real time, matching the operation data with an operation step sequence in a standard training procedure, generating an operation instruction sequence, driving a working principle animation of the second display screen and a real-time simulation state of the third display screen, and recording actual execution time and operation deviation data; and inputting to a preset scoring model to obtain a final operation score, and generating a training report. According to the invention, pertinence of the trainee in simulated driving training can be improved.

The invention relates to the technical field of multi-agent cooperation, provides a multi-agent cooperative unmanned aerial vehicle cluster simulation training method, system and device, and a storage medium, and solves the problems of low penetration success rate and poor formation cooperation efficiency of an unmanned aerial vehicle cluster. The method comprises the following steps: collecting pigeon flock biological motion data, cluster trajectory data when an unmanned aerial vehicle cluster executes a historical penetration task, and magnetic field gradient data of a simulation environment; constructing a three-dimensional path library, and calculating geomagnetic course angle deviation; on the basis of the geomagnetic course angle deviation and the three-dimensional path library, a multi-target collaborative path is generated in combination with a swarm intelligent optimization model; generating a flight control instruction based on the multi-target cooperation path in combination with the real-time state data of the unmanned aerial vehicle cluster; and loading the flight control instruction to a simulation model of the unmanned aerial vehicle cluster, and driving the unmanned aerial vehicle cluster to carry out cooperative defense penetration training in a simulation environment. According to the invention, the penetration success rate and formation cooperation efficiency of the unmanned aerial vehicle cluster in a complex electromagnetic environment are improved.

The invention provides a mixed reality industrial simulation training system which is composed of a space fusion perception unit, a multi-physics field simulation unit, a cooperative training management unit and a self-adaptive teaching engine. The space fusion sensing unit is composed of a real-time environment modeling and positioning subsystem and a physical interaction detection algorithm, and the real-time environment modeling and positioning subsystem dynamically constructs a three-dimensional space coordinate system of a real industrial scene through a visual sensor array and a radio frequency scanning device; generating a pose matrix of the virtual equipment model in the perspective display interface; the physical interaction detection algorithm realizes contact force feedback between virtual and real objects based on dynamic solution of collision volume, and when an operator triggers a virtual switch through a handheld controller, a real equipment control signal is synchronously driven; the multi-physics field simulation unit comprises a physical engine core module and a fault injection interface.

The invention belongs to the technical field of analog simulation, and particularly discloses an intelligent agent-based dynamic confrontation simulation system, which comprises a data acquisition module, an intelligent analysis module, a decision generation module, an intelligent agent behavior self-adaption module, a training evaluation module and a multi-mode man-machine interaction module, physiological, action, voice and eye movement data of trainees are collected in real time through a multi-modal sensor, and a tactical intention is recognized and a dynamic three-dimensional battlefield situation thermodynamic diagram is generated in combination with virtual battlefield environment parameters; an agent coping strategy is generated based on reinforcement learning and a decision tree, and an agent is driven to carry out real-time confrontation; and performing multi-dimensional quantitative evaluation on the whole training process through a training evaluation module, and performing closed-loop optimization on an agent decision and strategy library based on an evaluation result. The method supports various natural interaction modes such as voice, gestures and eye movement, remarkably improves the fidelity, intelligence and training efficiency of simulation training, and is suitable for the field of military training and tactical drilling.

The invention discloses a nursing medicine education system based on the Internet, and relates to the field of computer application technology and education management, and the system comprises a theory learning module which is used for achieving the online teaching and personalized learning pushing of nursing theory knowledge, the nursing skill training module is used for training and evaluating the standardized nursing operation ability of students, the virtual simulation practical training module is used for providing an immersive virtual clinical training environment, and the structured nursing document training module is used for improving the ability of the students to write standard nursing documents. The intelligent evaluation module is used for carrying out automatic, multi-dimensional and structured comprehensive evaluation on the learning and training process of students, and the system integration interface module is used for realizing data exchange and interaction between the teaching platform and an existing information system of a hospital. The system has the advantages of complete functions, closed-loop data and accurate intelligent evaluation, and can effectively improve the standardization, practicability and intelligent level of nursing education.

The invention relates to the technical field of medical simulation training, in particular to an ultrasonic operation intelligent training method and device based on multiple modalities, and the method comprises the steps: obtaining real-time six-degree-of-freedom pose data of an ultrasonic probe held by an operator, and generating an ultrasonic image in real time through a first deep learning model in cooperation with scene parameters; wherein the first deep learning model is trained to learn and establish a continuous mapping relation from an ultrasonic probe pose space to an ultrasonic image space; performing section classification on the ultrasound image by using a second deep learning model, and determining deviation information for a non-standard section; and based on the real-time six-degree-of-freedom pose data and a division result of a preset standard section and an ultrasonic probe pose, generating visual guide information for guiding an operator to adjust the probe pose, and displaying the visual guide information. In this way, the problems that an existing virtual training image is discontinuous and guiding is inaccurate are solved, and meanwhile the training efficiency and the reality sense of ultrasonic operation are remarkably improved.

The invention relates to the technical field of occupational simulation training evaluation, and discloses a system for college student occupational scene simulation training evaluation. The system comprises a task analysis unit, a dynamic behavior modeling unit, a multi-mode interaction management unit, a state evolution tracking unit, a strategy adaptation unit and a comprehensive evaluation generation unit. The system receives the initial scene description and generates a structured task framework, and behavior parameters are configured for student roles; constructing a multi-modal interaction atlas by fusing aligned voice, action and sight line data in real time; identifying a key decision node, and dynamically tracking a team state evolution path; matching and adjusting strategies in a behavior rule base according to the evolution sequence, and outputting an adaptive intervention scheme; and finally generating a multi-dimensional structured evaluation report. According to the system, deep insight and dynamic and objective intelligent evaluation of complex interaction behaviors in the simulation training process are realized.