Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

5320results about "Cosmonautic condition simulations" patented technology

PICC puncture virtual simulation training system and method based on XR construction

The invention provides a PICC puncture virtual simulation training system and method constructed based on XR. A nursing skill simulation training platform and an intelligent training room based on augmented reality (XR) combine a simulation medical technology, an artificial intelligence large model, XR intelligent hardware, intelligent agent application, space calculation, computer vision and a mainstream technology of Internet of Things in scheme planning and design. According to the PICC puncture virtual simulation training platform, the ground practice, standardization, high virtual simulation and adaptive application of PICC puncture virtual simulation training are realized, and the intelligent development process and teaching concept of PICC puncture teaching are improved. According to the PICC puncture teaching system, intelligent virtual tutors, puncture teaching holographic three-dimensional sharing, virtual reality fusion technologies and the like are provided, an interactive teaching mode can be brought to PICC puncture teaching, the interest of students in teaching and clear operation guidance are improved, the theory and practice are fused, and the clinical cooperation ability is improved.
Owner:ZHEJIANG UNIV

Interactive simulation teaching processing method and device for marine electromechanical safeguard system

The invention provides an interactive simulation teaching processing method and device for ship electromechanical guarantee, and relates to the technical field of interactive simulation teaching, and the method comprises the steps: building a ship electromechanical full-structure model in a virtual simulation platform, digitally mapping real equipment operation parameters into virtual parts with real-time response characteristics, and carrying out the real-time simulation of the virtual parts; synchronous acquisition and normalized calibration of operation instructions, equipment feedback and environment disturbance in a teaching scene are realized, and a unified teaching simulation data set is generated. State recognition, fault simulation and operation evaluation calculation are completed through multi-layer task scheduling, and real-time teaching feedback is generated and visually displayed on a terminal. Based on difference analysis of dynamic evaluation data and a standard operation template, operation deviation and abnormity are automatically identified, and a targeted guide prompt is generated. According to the invention, unified modeling and data linkage can be carried out on student operation behaviors, equipment dynamic responses and teaching feedback results, and the problems of teaching feedback lagging and lack of pertinence in operation correction are solved.
Owner:CHINA STATE SHIPBUILDING CORP LTD RESEARCH INSTITUTE 719 +1

Intelligent driving system and method and electronic equipment

The invention provides an intelligent driving system and method and electronic equipment, relates to the technical field of intelligent driving, and realizes personalized improvement of driver ability and safety guarantee of a driving environment through three cooperative mechanisms including a teaching strategy module, a safety perception module and a behavior management module. Analyzing the multi-dimensional student data through a teaching strategy module by using a multi-modal large language model, and generating a personalized teaching strategy adaptive to the ability of the student; a driving environment is monitored through a safety sensing module, when a specific complex scene is detected, a multi-source heterogeneous sensor data fusion strategy is adjusted according to a scene type and a preset intervention degree, and then a safety coping strategy matched with environment interference is generated; the driving behavior data are recognized through the behavior management module, and multi-mode interaction feedback is generated in combination with the physiological data and the state data of the driver and used for guiding and correcting the driving behavior.
Owner:YIXIAN INTELLIGENCE

CT guided liver puncture training method and system based on virtual reality

The invention provides a CT guided liver puncture training method and system based on virtual reality, and relates to the technical field of virtual reality. A deformable liver model and a virtual CT reconstruction engine under respiration driving are constructed, needle body posture mapping and image fusion display are achieved by fusing an inertia-electromagnetic dual-mode sensor, path interaction control, tissue dynamic response and score feedback are supported, the scene difficulty is automatically adjusted based on a training result, and the accuracy and the reliability of the system are improved. Progressive puncture skill training of static breath-holding, shallow breath and free breath scenes is achieved, the sense of reality of training, operation feedback and teaching efficiency are improved, and the system is suitable for development and clinical teaching application of an interventional therapy training system under the guidance of medical images.
Owner:CANCER CENT OF GUANGZHOU MEDICAL UNIV

Road roller construction quality real-time monitoring system based on digital twinning

The invention discloses a road roller construction quality real-time monitoring system based on digital twinning, and relates to the technical field of road roller construction intelligent monitoring, and the road roller construction quality real-time monitoring system comprises a data acquisition module which uses a multi-modal fusion sensor network and edge calculation to comprehensively acquire and preprocess data; the digital twinborn model building module is used for modeling by combining physical-data dual drive with geological characteristics; the data transmission module is used for ensuring efficient and safe transmission by using a software defined network and a block chain; the real-time monitoring and analysis module is used for carrying out multi-scale space-time correlation analysis and generating virtual data; and the decision support module fuses deep reinforcement learning and a knowledge graph, supports man-machine cooperation decision, and provides intelligent suggestions for construction. According to the invention, the advantages are obvious, multi-modal acquisition and edge calculation ensure accurate and real-time data, a dual-drive model truly simulates construction, an advanced transmission technology ensures data safety, multi-scale analysis comprehensively evaluates quality, full-process coverage improves construction quality and management intelligence, and cost reduction and efficiency improvement are realized.
Owner:WEIFANG LEITENG POWER MASCH CO LTD +1

Psychological consultation platform and method based on Multi-agent

The invention discloses a Multi-agent-based psychological counseling platform and method. The counseling platform comprises an evaluation agent used for dynamically extracting psychological features based on dialogue behaviors of a visitor agent and updating results to a traits library module; the planning agent is used for constructing a personalized psychological counseling scheme based on the traits library module and dynamically adjusting a counseling process and a strategy according to counseling feedback; the consultant agent is used for carrying out dialogue interaction with the visitor agent according to the personalized consultation scheme and implementing emotion pacification and psychological intervention; the visitor agent is used for expressing psychological troubles, feeding back psychological state changes and promoting the consultation process; the historical dialogue long and short-term memory module is used for storing multiple rounds of psychological counseling interaction contents and comprises historical dialogue short-term memory and historical dialogue long-term memory; and the dynamic probability memory retrieval module is used for generating probability distribution based on the current consultation context and dynamically calling memory nodes from the historical dialogue long and short term memory module or the traits library module.
Owner:TIANJIN UNIV

Disaster emergency rescue nursing skill training system based on virtual reality

The invention discloses a disaster emergency rescue nursing skill training system based on virtual reality, and relates to the technical field of virtual reality. A high-simulation virtual disaster scene is constructed based on real data, diversified injury condition virtual objects matched with the scene are generated, a secondary disaster risk diffusion effect and emergency prompt information are overlaid in real time, physiological state changes such as blood pressure and respiration generated by nursing operation differences in the rescue process of wounded personnel are dynamically simulated, and the rescue effect of the wounded personnel is improved. The problems of single scene and fixed injury condition in traditional training are solved, real-time and multi-modal feedback of student operation is realized through accurate comparison and hierarchical identification of multi-dimensional operation characteristics, the defects of guidance lagging and general are overcome, a personalized and adaptive training scheme is generated according to a comprehensive evaluation result, the progress is dynamically adjusted, and the training efficiency is improved. And scene simulation, operation practice, accurate feedback and personalized improvement are integrated.
Owner:SECOND MEDICAL CENT OF CHINESE PLA GENERAL HOSPITAL

Human-computer interaction virtual-real simulation method and system of intestinal nutrition nursing teaching system

The invention provides a human-computer interaction virtual-real simulation method and system of an intestinal nutrition nursing teaching system, and relates to the technical field of virtual interaction teaching. By integrating a force feedback glove, a bioelectric sensor and a pressure detector, multi-mode interaction data acquisition including intubation angle deviation, maximum force application pressure value and step interval time is realized; the operation feedback dimension and immersion are improved; the system is combined with a scene construction and intelligent guide module, when the detection operation goodness of fit is lower than a preset threshold value or the process completion degree is insufficient, force feedback vector correction and cognitive prompt are triggered, and standard attitude and step memory are guided; and the comprehensive evaluation module summarizes key indexes to calculate a total operation score, performs defect positioning and training suggestion matching on low-score behaviors, generates a structured visual learning report, constructs a cognition-operation-feedback closed loop, and solves the problems of single interactive feedback, insufficient teaching structuralization and lack of feedback mechanisms.
Owner:AFFILIATED HOSPITAL OF NANTONG UNIV

Intelligent scene type CPR visual training system based on MR technology

The invention discloses an intelligent scene type CPR visual training system based on an MR technology, which belongs to the technical field of non-special measurement for specific variables and comprises a training request sensing module, an intelligent scene automatic generation module, a sensing data acquisition module, a visual display and voice prompt module and a network performance evaluation management and control module. According to the method, the performance parameters of the sensing source nodes built in the simulation human body model are acquired and analyzed in real time, so that the data feedback precision in the training process is improved, and the data feedback precision in the training process is further improved; the problem of poor CPR visual training experience caused by lack of real-time performance monitoring and feedback mechanisms in the prior art is effectively solved.
Owner:HUNAN SHENGYI INTELLIGENT TECH CO LTD

PICC virtual-real combination simulation training system and method

The invention discloses a PICC virtuality and reality combined simulation training system and method, solves the problems that puncture simulation training is not real enough and students cannot perform intensive training aiming at a puncture technology due to the fact that an existing venipuncture simulation platform lacks necessary puncture force feedback, and belongs to the technical field of virtual training. The system is composed of a personal information management module, a simulation training terminal, a virtual model management module and a man-machine interaction module, and student operation information is collected in real time based on a multi-dimensional sensor; the virtual model management module reconstructs real anatomical structures such as blood vessels and skin of a human body through a high-precision 3D modeling technology, a physical engine is matched to provide a vivid puncture hand feeling, students can experience a scene very close to real operation, and the simulation training terminal can simulate the real operation through a force feedback technology in a virtual scene. The trainee can feel the touch similar to that of real puncture, so that the understanding of the trainee on the puncture process and the control of the trainee on the puncture strength and angle are improved.
Owner:PEKING UNIV +2

Training and examination robot system and equipment based on multi-modal large model and computer program product

The invention provides a training and examination robot system based on a multi-modal large model, equipment and a computer program product, and aims to accelerate training transformation and upgrading and improve coping ability as basic appeals, and based on regular training work of teams, training and examination robot, sensor acquisition equipment and big data platform three-terminal equipment. A multi-modal data acquisition layer for realizing real-time attitude detection and motion capture by using an edge calculation algorithm, a data processing and analysis layer for finishing real-time image processing through localized edge calculation in a network-free or power-free environment, and system control functions for finishing intelligent decision making, evaluation, error correction and the like are provided; an intelligent decision-making and control layer of a training subject rewriting decision-making mechanism is established, cross-modal collaborative learning middleware is utilized to realize modal representation consistency while training subject transposition evaluation is realized, training and assessment operations of the same subject of multiple persons or different subjects of multiple persons are supported, and the training and assessment efficiency is remarkably improved.
Owner:GUANGZHOU AEBELL ELECTRICAL TECH

Anesthesia virtual simulation training system fusing knowledge, skills and thinking closed loop

The invention provides an anesthesia virtual simulation training system fusing knowledge, skills and a thinking closed loop. The anesthesia virtual simulation training system comprises a medical knowledge base module, a clinical thinking module, a skill training module, an examination question brushing module, a knowledge graph module and an intelligent platform bottom layer framework. The intelligent platform underlying architecture comprises a data middle platform, an AI engine and a 3D engine, collects student behavior data of each module, constructs a dynamic student ability portrait through a gradient boosting tree algorithm and a collaborative filtering recommendation model, analyzes knowledge blind areas and skill shortages, plans a personalized learning path and pushes targeted training content, and provides a personalized learning result. A closed-loop process of evaluation, learning, practice and re-evaluation is formed; and deep fusion of theoretical knowledge, clinical thinking and skill operation is realized through a cross-module collaboration mechanism. The problems that traditional anesthesia teaching is high in practical operation risk, scattered in resource and insufficient in individuation are solved, and the clinical comprehensive ability and teaching quality of anesthetists are effectively improved.
Owner:TONGJI HOSPITAL ATTACHED TO TONGJI MEDICAL COLLEGE HUAZHONG SCI TECH

Large model-based simulation dialogue partner training system and method

The invention relates to a simulation dialogue partner training system based on a large model. The simulation dialogue partner training system comprises a product knowledge base module, a question and answer library construction and management module, a pair training simulation module, a stage control module, a supernatural voice dialogue module, a verbal skill prompt module, a real-time evaluation module and a dialogue summary report module. The intelligent partner training system for customer communication training has high simulation dialogue ability, flexible configuration ability and a perfect evaluation feedback mechanism, can effectively replace a traditional scripted training or real person simulation partner training mode, and improves the communication actual combat ability of front-line personnel such as sales personnel and customer service personnel. According to the invention, low-efficiency links in a traditional training mode are replaced by an intelligent means, the training quality, the standardization degree and the reproducibility are improved, an enterprise is finally assisted to create a more professional and efficient customer front-line team, and the system can be widely applied to scenes such as enterprise training, new employee on-duty training and product popularization preparation.
Owner:SUZHOU INST OF ARTIFICIAL INTELLIGENCE SHANGHAI JIAOTONG UNIV

Integrated system of systems simulation framework for aircraft

A computer-implemented method for simulating an aircraft system in a closed-loop functional simulation environment is disclosed. The computer-implemented method may include: receiving, at a computer system, one or more control inputs from an interface; processing, by a control system model, the one or more control inputs to generate one or more system command signals; applying the one or more system command signals to one or more virtual system models; simulating a physical response of the aircraft based on output generated by the one or more virtual system models in response to application of the one or more system command signals; generating, responsive to monitoring the output generated by the one or more virtual system models, sensor data; transmitting the sensor data to the control system model; and outputting simulation results, wherein the simulation results at least comprise an indication of the physical response of the aircraft.
Owner:SUPERNAL LLC

AR auxiliary training system for improving diagnosis and treatment capability of general practitioner on undifferentiated diseases

The invention relates to the technical field of auxiliary training, and discloses an AR auxiliary training system for improving the diagnosis and treatment capability of general practitioners on undifferentiated diseases, and an immersive training environment is constructed by adopting an augmented reality technology. The system comprises an environment sensing module, a space positioning module, a case data module, a virtual rendering module, an interactive acquisition module, an intelligent response module, a state control module and an evaluation calculation module. The environment sensing module adopts an RGB-D camera and an inertial measurement unit to collect environment and head movement data of a user; the spatial positioning module determines a virtual patient placement position based on an SLAM algorithm; the virtual rendering module renders a three-dimensional virtual patient in a real environment; the interaction acquisition module supports voice and gesture multi-mode interaction; the intelligent response module generates an intelligent patient answer; the evaluation calculation module carries out comprehensive evaluation from three dimensions. The invention provides a highly immersive and intelligent training environment, and has the advantages of low cost, reusability and high standardization degree.
Owner:THE FIRST PEOPLES HOSPITAL OF NANTONG

Medical training analog simulation system based on big data analysis

The invention relates to a medical training analog simulation system based on big data analysis, in particular to the field of medical training analog simulation, the medical training analog simulation system provides an efficient, accurate and dynamically adaptive training environment through cooperative work of a plurality of modules; the data processing module ensures high quality of input data, the construction module improves the generalization ability of the model through transfer learning and multi-task learning, the dynamic optimization module improves the model prediction precision through self-supervised learning and learning rate adjustment, and the real-time feedback module monitors student operation and provides personalized tutoring; the whole system combines high-quality data, intelligent training and real-time feedback, provides accurate and personalized support for medical education and practical training, and improves operation skills and coping ability of students.
Owner:YANCHENG DAFENG PEOPLES HOSPITAL

Gas safety emergency training system based on VR

The invention relates to the technical field of training simulation, and discloses a VR-based gas safety emergency training system, which comprises a three-dimensional scene construction module, an interactive data acquisition module, an interactive data processing module, an examination data analysis module and an examination evaluation module, entity drilling is replaced, the same scene can be repeatedly trained for infinite times, and the training cost is remarkably reduced; the VR technology provides multi-sensory stimulation, the intuitive cognition of students on danger is enhanced, the safety awareness and the emergency response capability are effectively improved, and no danger exists; by collecting operation data of students, the system automatically calculates key coefficients such as equipment operation precision, process compliance, disposal timeliness and path planning rationality, and scientific quantification and accurate scoring of training effects are achieved; and automatic grading evaluation is carried out according to a grading result, and a customized remedy module is triggered for students with insufficient abilities, so that a'training-assessment-intervention 'closed loop is formed, and the overall training efficiency is improved.
Owner:NANYANG ZHENGRAN GAS CO LTD

Urban rail vehicle simulation driving training method and system based on scene simulation

The invention discloses an urban rail vehicle simulation driving training method and system based on scene simulation, and belongs to the technical field of driving simulation, and the method specifically comprises the steps: collecting rail line parameters, weather data, passenger flow density, vehicle equipment state and driving data in real time, carrying out the preprocessing, constructing a dynamic personalized simulation scene, and simulating driving operation. According to operation of a driver and a preset simulation scene, micro features of eye-brow areas of the driver are recognized, the psychological stress of the driver is analyzed in combination with historical data, the simulation scene is dynamically adjusted according to a psychological stress analysis result, the performance of the driver in the training is scored according to a preset evaluation standard, and a detailed training report is generated. According to the method, pressure analysis is carried out on the eyebrow area, pressure evaluation is carried out in combination with the physiological dimension, the pressure of the driver in a simulation scene can be judged in real time, different simulation scenes are provided for different drivers, and the training effect is greatly improved.
Owner:NANJING ZHIZHUO ELECTRONICS TECH

Control method and artificial intelligence experiment system

The invention provides a control method, which is applied to an artificial intelligence experiment system, at least comprises a robot hardware platform, a controller, a wheeled robot chassis and an industrial mechanical arm, and the method comprises the following steps: starting an operation system and executing hardware self-inspection; loading a large language model service and a traditional AI model, wherein the traditional AI model comprises a speech recognition model, a target detection model and a semantic analysis model; a natural language instruction of a user is received, voice is converted into a structured text through a voice recognition model, an instruction intention is analyzed through a large language model and a semantic analysis model, robot control parameters are generated, and a multi-modal interaction control signal is obtained; based on the multi-mode interaction control signal, a camera is called to collect image data, the position and category of a target object to be grabbed by the robot are recognized through a target detection model, the moving path of the robot and the grabbing track of the mechanical arm are calculated in combination with laser radar data, and the wheeled robot chassis and the industrial mechanical arm are controlled to execute coordinated actions.
Owner:BEIJING ETERNAL CREATIVE TECH CO LTD

Modular multifunctional karst collapse physical simulation experiment platform

The invention provides a modular and multifunctional karst collapse physical simulation experiment platform. Comprising a rigid frame, a bearing device, a moving device, a loading device, a lifting device, a pile foundation construction dynamic load simulation device, a ground traveling dynamic load simulation device, a rainfall simulation device, a computer vision monitoring device, an underground water pumping and draining simulation device and an underground space excavation disturbance simulation device. The moving device is arranged on the bearing device, the lifting device, the loading device and the pile foundation construction dynamic load simulation device are arranged on the moving device, the travelling crane dynamic load simulation device is connected with a traction device of the moving trolley, and the camera shooting monitoring device and the rainfall simulation device are arranged on the rigid frame through a support. According to the method, key disaster-causing conditions in the urban environment are fully considered, the working condition scene coverage is wide, and the applicability is high; modularized design is adopted as a whole, all the modules can be flexibly loaded according to requirements, the real environment can be simulated more truly, and the catastrophe evolution process of surface collapse can be reproduced.
Owner:CHINA UNIV OF MINING & TECH

Internet-based nursing medical education system

The invention discloses a nursing medicine education system based on the Internet, and relates to the field of computer application technology and education management, and the system comprises a theory learning module which is used for achieving the online teaching and personalized learning pushing of nursing theory knowledge, the nursing skill training module is used for training and evaluating the standardized nursing operation ability of students, the virtual simulation practical training module is used for providing an immersive virtual clinical training environment, and the structured nursing document training module is used for improving the ability of the students to write standard nursing documents. The intelligent evaluation module is used for carrying out automatic, multi-dimensional and structured comprehensive evaluation on the learning and training process of students, and the system integration interface module is used for realizing data exchange and interaction between the teaching platform and an existing information system of a hospital. The system has the advantages of complete functions, closed-loop data and accurate intelligent evaluation, and can effectively improve the standardization, practicability and intelligent level of nursing education.
Owner:CHANGCHUN UNIV OF CHINESE MEDICINE

Whole-process vascular interventional operation training method and system based on virtual reality technology

The invention discloses a whole-process vascular interventional operation training method and system based on a virtual reality technology, and the method comprises the steps: firstly, developing a vascular interventional mechanics and collision simulation module, and achieving the deformation simulation of a blood vessel and a guide wire through the combination of position dynamics, a region shape matching technology and a Cosseerat elastic rod model, the collision between the blood vessel and the guide wire is treated by adopting a wide-to-narrow three-layer progressive collision detection method; secondly, constructing an immersive virtual operation scene through model construction and rendering optimization; visual angle roaming, instrument operation and interface interaction are fused, and multi-mode interaction control driving intervention training is achieved; finally, based on a'module-event 'dual-drive framework, operation tasks such as anesthesia, puncture, radiography, intervention, stent release and hemostasis are sequentially connected in series through a unified state machine, and whole-process training is achieved. The accuracy and stability of blood vessel and guide wire simulation are improved, the training immersion sense is enhanced, interventional operation whole-process training is achieved, and high teaching and practical value is achieved.
Owner:TIANJIN UNIV OF SCI & TECH

Ultrasonic operation intelligent training method and equipment based on multiple modes

The invention relates to the technical field of medical simulation training, in particular to an ultrasonic operation intelligent training method and device based on multiple modalities, and the method comprises the steps: obtaining real-time six-degree-of-freedom pose data of an ultrasonic probe held by an operator, and generating an ultrasonic image in real time through a first deep learning model in cooperation with scene parameters; wherein the first deep learning model is trained to learn and establish a continuous mapping relation from an ultrasonic probe pose space to an ultrasonic image space; performing section classification on the ultrasound image by using a second deep learning model, and determining deviation information for a non-standard section; and based on the real-time six-degree-of-freedom pose data and a division result of a preset standard section and an ultrasonic probe pose, generating visual guide information for guiding an operator to adjust the probe pose, and displaying the visual guide information. In this way, the problems that an existing virtual training image is discontinuous and guiding is inaccurate are solved, and meanwhile the training efficiency and the reality sense of ultrasonic operation are remarkably improved.
Owner:BEIJING ANZHEN HOSPITAL AFFILIATED TO CAPITAL MEDICAL UNIV +1

Intelligent network connection automobile active safety teaching control method based on digital twinning

The invention discloses an intelligent network connection automobile active safety teaching control method based on digital twinning. The method comprises the steps that S1, multi-source sensor data are collected and preprocessed to generate a driving state data set; s2, inputting the state data into a digital twin model to drive a traffic scene and outputting a synchronous state; s3, based on Dueling-DDQN, executing strategy learning to generate an active safety control instruction; s4, the instruction response effect is simulated and verified in the virtual environment; s5, collecting driver operation behaviors, inputting the improved MHA-BiLSTM model to extract time sequence features, and outputting behavior features; and S6, comparing the driving behavior with a standard instruction item by item, calculating an operation deviation and a response difference, and generating a personalized active safety teaching task. According to the invention, efficient comparison and teaching feedback of the driving behavior and the active control strategy can be realized, and the intelligent level of driving training is improved.
Owner:ANHUI MECHANICAL IND SCHOOL ANHUI MECHANICAL TECHNICIAN COLLEGE

Equipment detection using a wearable device

A simulation system may comprise a headset and an equipment. A wireless communication interface of the headset may receive position information from the equipment. The headset may detect a passively-instrumented object represented in a captured image. The headset may detect a wearable device coupled to the passively-instrumented object. The headset may determine position information for the passively-instrumented object. The headset may present an image of virtual equipment corresponding to the equipment in accordance with the position information from the equipment and the position information detected for the passively-instrumented object.
Owner:AXON ENTERPRISE INC

Evaluation system for college student occupational scene simulation training

The invention relates to the technical field of occupational simulation training evaluation, and discloses a system for college student occupational scene simulation training evaluation. The system comprises a task analysis unit, a dynamic behavior modeling unit, a multi-mode interaction management unit, a state evolution tracking unit, a strategy adaptation unit and a comprehensive evaluation generation unit. The system receives the initial scene description and generates a structured task framework, and behavior parameters are configured for student roles; constructing a multi-modal interaction atlas by fusing aligned voice, action and sight line data in real time; identifying a key decision node, and dynamically tracking a team state evolution path; matching and adjusting strategies in a behavior rule base according to the evolution sequence, and outputting an adaptive intervention scheme; and finally generating a multi-dimensional structured evaluation report. According to the system, deep insight and dynamic and objective intelligent evaluation of complex interaction behaviors in the simulation training process are realized.
Owner:CHENGDU POLYTECHNIC

Multi-modal interactive virtual teaching method, system, equipment and medium

The invention discloses a multi-mode interactive virtual teaching method and system. The method comprises the following steps: acquiring multi-source data; extracting voice data acoustic features, and inputting the voice data acoustic features into a learning model to obtain a text triple; key terms are extracted from the text data, a traceable operation chain is generated, semantic analysis is carried out, and an operation scheme is output in combination with a knowledge graph; performing abnormal state recognition on the image data through a target detection model, positioning abnormal equipment in combination with a character recognition model, performing action mapping through gesture recognition and a spatial constraint rule, and outputting a corresponding instruction; fusing the three types of outputs to generate a scheduling event chain; and performing semantic analysis, evaluation and optimization on the scheduling event chain, interacting with personnel, updating operation suggestions and providing an operation analysis result. According to the method, manual rechecking requirements are reduced through multi-modal data collaboration, a new man-machine interaction database and a new man-machine interaction standard in the power industry can be formed through multi-modal interaction rules and event chain construction, and data intelligent driving is achieved while the training efficiency is improved.
Owner:GUANGXI POWER GRID CORP

Power equipment three-dimensional dynamic updating method and system for virtual reality training

The invention provides a power equipment three-dimensional dynamic updating method and system for virtual reality training, and the method comprises the steps: collecting the working state data of power equipment in real time through a sensor; processing the working state data based on a preset function model, and calculating the physical state change of the power equipment; according to the physical state change, adjusting physical attributes of the three-dimensional model of the power equipment in real time so as to simulate physical effects of thermal expansion, stress concentration or structural deformation; loading the adjusted three-dimensional model into a virtual reality environment, and performing real-time display through a virtual reality rendering platform; and after the user executes the interactive operation through the virtual reality equipment, the working state of the power equipment is updated, and the influence of the operation on the three-dimensional model of the equipment is dynamically fed back, so that a virtual-real linkage closed-loop training process is formed. The virtual model can change in real time along with the collected data, and the technical verisimilitude and operability of virtual training are remarkably improved.
Owner:STATE GRID SHANGHAI MUNICIPAL ELECTRIC POWER CO

Intelligent customer service practical training system and training method

The invention belongs to the technical field of customer service, and particularly relates to an intelligent customer service practical training system and method, and the system comprises a business scene digital reconstruction layer which is used for constructing a business training scene to form a training scene library, managing the business training scene library, and reconstructing a training scene according to scene configuration data; the AI simulation interaction core layer is used for receiving and recognizing voice and text input of students and generating behavior strategies of AI partner training according to input content on the basis of a current training scene; the training execution layer is used for generating scene configuration data according to a student selection instruction and sending the scene configuration data to the business scene digital reconstruction layer, and the scene configuration data content comprises a training scene, training difficulty and role setting; the training difficulty is dynamically adjusted according to the real-time performance of the trainee; and the quantitative evaluation layer is used for performing multi-dimensional analysis on the training data and generating a quantitative evaluation result and an improvement suggestion. The problems that existing customer service training is low in efficiency and high in cost are solved.
Owner:CHONGQING VISION INFORMATION IND GRP CO LTD

Multi-scene intelligent manufacturing teaching practical training method and system based on digital twinning technology, storage medium and electronic equipment

The invention provides a multi-scene intelligent manufacturing teaching practical training method and system based on a digital twinning technology, a storage medium and electronic equipment. The method comprises the steps of data acquisition and processing, intelligent manufacturing digital twinning model construction, multi-scene integration, practical training process development, resource issuing and sharing, teaching management and the like. A digital twinborn model of equipment, process and environment is constructed and integrated into a three-dimensional virtual scene, and a graphical process design tool and a cloud platform are combined, so that standardized development, online deployment and intelligent evaluation of teaching resources are realized. The method improves the flexibility and efficiency of practical training, and is suitable for the construction and management of intelligent manufacturing multi-type teaching practical training scenes.
Owner:河南开放大学