Multi-user training management evaluation system for otolaryngology department
By designing a multi-user training management evaluation system for otolaryngology, the problem of neglecting practical operations and personalized learning in the traditional medical education model is solved, and systematic evaluation and feedback on the training progress and performance of medical staff are achieved, and learning efficiency and training quality are improved.
Patent Information
- Application Number
- CN202411960141.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-30
- Publication Date
- 2025-04-29
AI Technical Summary
The traditional otolaryngology medical education model ignores practical operations and personalized learning paths, making it difficult for medical staff to cope with diversified needs, affecting the patient's medical experience and the hospital's comprehensive service level.
Design a multi-user training management evaluation system for otolaryngology, including user information management module, training management platform, training status evaluation module, personal performance evaluation module, comprehensive progress evaluation module and personalized learning path planning module. Through the collaborative work of these modules, personalized learning paths and resource allocation are provided.
It has achieved systematic evaluation and feedback on the training progress and performance of medical staff, dynamically adjusting the training content and difficulty, improving learning efficiency, improving professional skills and theoretical knowledge mastery, and ensuring the quality of training and the patient's medical experience.
Smart Images

Figure CN119904139A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of training management and evaluation, and in particular to a multi-user training management and evaluation system for otolaryngology. Background Art
[0002] Innovation in medical education models is an important driving force for the development of medicine. Traditional medical education models often focus on the imparting of theoretical knowledge, but neglect practical operations and the construction of personalized learning paths. In the professional field of otolaryngology, practical operations and personalized learning are equally important. As people's health needs become increasingly stringent, otolaryngology medical care management faces unprecedented challenges. There are differences in concepts, theories and practical operations between medical managers and medical staff, and most hospitals lack systematic training for medical staff, which makes it difficult for medical staff to cope with diversified needs. This not only affects patients' medical experience, but also restricts the improvement of the hospital's comprehensive service level.
[0003] In the existing technology, when training and managing otolaryngology medical staff, it is difficult to provide them with personalized learning paths according to their actual situation and training progress, which in turn affects the learning effect of medical staff. Therefore, how to comprehensively evaluate the personal performance and training progress of medical staff, and allocate corresponding learning resources according to the different progress levels of medical staff, is the problem we need to solve. To this end, a multi-user training management and evaluation system for otolaryngology is proposed. Summary of the invention
[0004] The present invention aims to provide a multi-user training management and evaluation system for otolaryngology to solve the problems raised in the above-mentioned background technology.
[0005] In order to solve the above technical problems, the technical solution adopted by the present invention is:
[0006] A multi-user training management and evaluation system for otolaryngology, comprising a training management and evaluation center, wherein the training management and evaluation center is communicatively connected to a user information management module, a training management platform, a training status evaluation module, a personal performance evaluation module, a comprehensive progress evaluation module, and a personalized learning path planning module, wherein electrical signals are connected between the modules;
[0007] The user information management module is used to record and manage the basic information of ENT medical staff. The basic information of medical staff is the basis for formulating personalized learning paths, which helps to more accurately understand the background and needs of each medical staff;
[0008] The training management platform is used to upload and manage course content and manage medical staff to participate in simulation training of otolaryngology surgery and diagnosis and treatment operations;
[0009] The training status evaluation module is used to track and record the medical staff's participation in training during the evaluation period in real time, so as to extract the medical staff's training status data and evaluate the medical staff's training status, wherein the training status data includes the simulation training duration, simulation training frequency, simulation training completion and simulation training difficulty;
[0010] The personal performance evaluation module analyzes the medical staff's theoretical knowledge mastery, skill proficiency and skill effect evaluation during the evaluation period, and then conducts a comprehensive evaluation of the medical staff's personal performance, which helps to identify the medical staff's strengths and weaknesses;
[0011] The comprehensive progress evaluation module comprehensively evaluates the current training progress of medical staff by combining the evaluation results of the medical staff's training status and personal performance, and divides it into different progress levels to clarify the actual level and ability of medical staff during the training process;
[0012] The personalized learning path planning module is used to formulate a personalized learning path for the medical staff according to their progress level and personal characteristics, including recommended learning content, learning methods, and learning progress, and allocate corresponding learning resources to them.
[0013] A further improvement of the technical solution of the present invention is that in the user information management module, the recording and management process of the basic information of medical staff is as follows:
[0014] Create a nursing information form to collect basic information of medical staff online, including name, age, gender, job title, work experience, education background, and professional skills (otolaryngology nursing knowledge, first aid skills). Add user consent terms at the beginning of the nursing information form to ensure that users have read and agreed before submitting the information;
[0015] After the medical staff fills in and submits the nursing information form, the information is automatically collected into the system and the submission time is recorded for subsequent tracking and auditing. The collected information is further verified using the data verification rules of format verification and logic verification. For the information that passes the verification, the medical staff are divided into different categories according to the number of years of work experience, namely 0-1 years, 1-3 years and more than 3 years;
[0016] Set a quarterly cycle for collecting and updating information, and remind medical staff to update their information, including academic qualifications, skills and work experience, through text messages and internal notifications. Regularly back up data in the user information management module to ensure rapid recovery in the event of data loss or damage.
[0017] A further improvement of the technical solution of the present invention is that: the training management platform includes an interactive learning module, a virtual reality device and a multi-user collaboration module, wherein the modules are connected by electrical signals;
[0018] The interactive learning module is used to upload and manage course content, contains a rich case library and multiple training modes, helps medical staff continuously improve their skills in practice, provides rich learning resources, supports multiple formats, and meets different learning needs and preferences;
[0019] The virtual reality device is used to allow users to participate in the simulation training of otolaryngology surgery and diagnosis and treatment operations in an immersive way;
[0020] The multi-user collaboration module is used to support multiple medical staff to participate in training at the same time, and can conduct real-time communication and collaboration to enhance teamwork skills.
[0021] A further improvement of the technical solution of the present invention is that the application of the training management platform specifically includes:
[0022] Collect and produce relevant course content on otolaryngology surgery and diagnosis and treatment, upload the course content to the interactive learning module, classify and label it, and provide a case library and multiple training modes to adapt to the learning progress and skill levels of different medical staff. The course content includes video tutorials, PPT, PDF documents and interactive Q&A in various forms of learning resources. The case library contains a wealth of otolaryngology surgery and diagnosis and treatment cases. Each case is accompanied by detailed step-by-step instructions and expert comments. The training modes include basic training, advanced training, and actual combat simulation. At the same time, it supports learning resources in multiple formats to meet different learning needs and preferences, including online videos, audio explanations, and graphic tutorials.
[0023] Using virtual reality technology of virtual reality equipment to simulate surgery and treatment environment, including equipment, instruments and patient models, etc., the virtual reality equipment enables medical staff to interact with objects in the simulated environment and provide real-time operation feedback, including operation correctness, time efficiency and risk warning, to help medical staff correct errors in time and improve their skills, so that medical staff can participate in the simulation training of otolaryngology surgery and treatment operations in an immersive way;
[0024] The multi-user collaboration module supports multiple medical staff to participate in training at the same time, conduct real-time communication and collaboration, provide text chat, voice calls and video calls, assist communication and collaboration between medical staff, and set collaborative tasks, including grouping for surgical simulations and jointly solving diagnostic and treatment problems to enhance teamwork skills, allowing instructors to assign different roles to medical staff, including surgeons, assistants, anesthesiologists and nurses, to simulate a real operating room environment.
[0025] A further improvement of the technical solution of the present invention is that in the training status evaluation module, the process of evaluating the training status of medical staff is:
[0026] Track and record the medical staff's participation in training during the evaluation period in real time to collect the medical staff's training status data and determine the various evaluation indicators of the training status data, including simulation training duration, simulation training frequency, simulation training completion and simulation training difficulty. Among them, simulation training duration is used to record the total time the medical staff participate in simulation training, reflecting the time cost of their investment in training; simulation training frequency is used to count the number of times the medical staff participate in simulation training, reflecting their enthusiasm and regularity in participating in training; simulation training completion is used to record the proportion or progress of medical staff completing simulation training, reflecting the completeness and efficiency of their training; simulation training difficulty is used to rate the difficulty according to factors such as the complexity and challenge of simulation training, reflecting the quality of training received by medical staff;
[0027] Clean and organize the collected training status data to ensure the accuracy and completeness of the data, and classify and archive the data according to different training projects to facilitate subsequent analysis and evaluation;
[0028] The scoring criteria and weights of each evaluation indicator of the training status data are preset, and the data of each evaluation indicator is scored. The scoring criteria are formulated according to the actual situation. For example, the longer the simulation training time, the higher the frequency, the higher the degree of completion, and the greater the difficulty, the higher the corresponding score. The weights are allocated according to the importance of different training projects;
[0029] Integrate the calculated scores of various evaluation indicators, combine the weights of each evaluation indicator, calculate the training status evaluation index, and analyze the overall training status of medical staff during the evaluation period;
[0030] According to the training status evaluation index, the training status of medical staff is evaluated by grades, namely, excellent training status level, good training status level, general training status level and poor training status level, and the evaluation threshold of each training status level is determined. According to the evaluation results of different levels, corresponding measures are taken to improve and optimize.
[0031] A further improvement of the technical solution of the present invention is that the calculation formula of the training status evaluation index is:
[0032]
[0033] Among them, T is the training status evaluation index, the value range of T is between 0 and 1, and w i is the weight of the i-th evaluation indicator, which is allocated according to the importance of the training project, s iis the score of the i-th evaluation indicator, α is the exponent of the exponential function, which is used to adjust the intensity of the weight influence, and f i is the actual value of the i-th evaluation indicator, M is the maximum value of the simulated training difficulty, which is used to limit the upper limit of the difficulty score;
[0034] The multiple training status levels correspond one-to-one to the multiple evaluation thresholds, specifically:
[0035] The evaluation threshold range of the excellent training status level is: T A ≤T<1;
[0036] The evaluation threshold range of the good training status level is: T B ≤T <T A ;
[0037] The evaluation threshold range of the general training status level is: T C ≤T <T B ;
[0038] The evaluation threshold range of the poor training status level is: 0 <T<T C ;
[0039] Among them, T is the training status evaluation index, T A is the lower threshold of the excellent training status level and the upper threshold of the good training status level, T B is the lower threshold of good training status and the upper threshold of general training status, T C is the lower threshold of the general training status level and the upper threshold of the poor training status level, T A =0.9, T B =0.75, T C =0.6.
[0040] A further improvement of the technical solution of the present invention is that in the personal performance evaluation module, the evaluation process of the medical staff's personal performance is:
[0041] Collect relevant data of medical staff during the evaluation period, including theoretical knowledge test scores, skill operation records and patient feedback, to analyze the medical staff's theoretical knowledge mastery, skill proficiency and skill effect evaluation;
[0042] Evaluate the theoretical knowledge mastery of medical staff through theoretical examinations and online tests, record the test scores, and score the theoretical knowledge mastery according to the preset scoring standards; evaluate the skill proficiency of medical staff through practical operation assessments, simulation training and case analysis, record the assessment results, and score the skill proficiency according to the accuracy, speed and efficiency of skill execution; evaluate the skill effectiveness of medical staff through patient feedback, feedback from colleagues and superiors, record the evaluation results, and score according to the skill effectiveness evaluation standards;
[0043] The scores of theoretical knowledge mastery, skill proficiency and skill effect evaluation are integrated and matched with corresponding weights to comprehensively calculate the personal performance trend index, so as to comprehensively evaluate the personal performance of medical staff during the evaluation period;
[0044] According to the personal performance trend index, the personal performance of medical staff is evaluated by graded into four levels: excellent performance level, good performance level, average performance level and poor performance level. The corresponding evaluation threshold is matched for each performance level to analyze the strengths and weaknesses of medical staff in theoretical knowledge mastery, skill proficiency and skill effect evaluation.
[0045] A further improvement of the technical solution of the present invention is that the calculation formula of the personal performance trend index is:
[0046]
[0047] Among them, P is the personal performance tendency index, the value range of P is between 0 and 1, K is the theoretical knowledge mastery score, S is the skill proficiency score, E is the skill effect evaluation score, and E max The maximum value of the skill effect evaluation score, used to normalize the skill effect evaluation score;
[0048] The multiple performance levels correspond one-to-one to the multiple evaluation thresholds, specifically:
[0049] The evaluation threshold range of the excellent performance level is: P A ≤P<1;
[0050] The evaluation threshold range of the good performance level is: P B ≤P <P A ;
[0051] The assessment threshold range for the general performance level is: P C ≤P <P B ;
[0052] The evaluation threshold range for the poor performance level is: 0 <P<P C ;
[0053] Among them, P is the personal performance trend index, P A is the lower threshold of the excellent performance level and the upper threshold of the good performance level, P B is the lower threshold of good performance level and the upper threshold of average performance level, P C is the lower threshold of the general performance level and the upper threshold of the poor performance level, P A =0.85, P B =0.6, P C =0.45.
[0054] A further improvement of the technical solution of the present invention is that in the comprehensive progress evaluation module, the process of evaluating the current training progress of medical staff is as follows:
[0055] Record the number of times, duration, course content and completion status of medical staff's training, track their participation, interaction and learning outcomes in training, and obtain their scores on theoretical knowledge mastery, skill proficiency and skill effectiveness evaluation;
[0056] Extract the training status evaluation index and personal performance trend index of medical staff during the evaluation period, and determine the weights of the training status evaluation index and personal performance trend index according to the training objectives and needs;
[0057] Combine the training status evaluation index and the individual performance trend index, as well as their respective weights, to calculate the progress evaluation coefficient, conduct a comprehensive assessment of the current training progress of medical staff, and clarify their actual level and ability during the training process;
[0058] According to the distribution of progress evaluation coefficients, the current training progress of medical staff is divided into corresponding progress levels, namely high progress level, medium progress level and primary progress level, and a corresponding progress evaluation threshold is assigned to each progress level;
[0059] Feedback the progress evaluation coefficient and progress level to the medical staff themselves and relevant departments, point out the strengths and weaknesses of the medical staff in the training process, and the areas that need improvement. According to the evaluation results, formulate a personalized guidance plan for the medical staff, which includes the adjustment of training content, improvement of learning methods and suggestions for skill improvement;
[0060] Provide guidance and follow-up to medical staff according to the guidance plan, and regularly evaluate the progress of medical staff to adjust the guidance plan.
[0061] A further improvement of the technical solution of the present invention is that the calculation formula of the progress evaluation coefficient is:
[0062]
[0063] Among them, PEC is the progress evaluation coefficient, the value range of PEC is between 0 and 1, T is the training status evaluation index, P is the personal performance trend index, and w T and w P are the weights of the training status evaluation index and the personal performance trend index, respectively, and w T +w P =1;
[0064] The multiple progress levels correspond one-to-one to the multiple progress evaluation thresholds, specifically:
[0065] The progress evaluation threshold range of the high progress level is: PEC H ≤PEC<1;
[0066] The progress evaluation threshold range of the medium progress level is: PEC L ≤PEC <PEC H ;
[0067] The progress evaluation threshold range of the primary progress level is: 0 <PEC<PEC L ;
[0068] Among them, PEC is the progress evaluation coefficient, PEC H is the lower threshold of the high progress level and the upper threshold of the medium progress level, PEC L is the lower threshold of the intermediate progress level and the upper threshold of the primary progress level, PEC H =0.8,PEC L =0.6.
[0069] Due to the adoption of the above technical solution, the present invention has the following technical advances compared with the prior art:
[0070] 1. The present invention provides a multi-user training management and evaluation system for otolaryngology. Through systematic data recording and tracking functions, it can accurately capture the participation, learning outcomes and skill mastery of each medical staff in the training process, and through intelligent analysis, it can clarify the learning progress of each medical staff, and then automatically adjust the training content to ensure that medical staff receive learning resources that match their current level, thereby improving training efficiency. At the same time, it can also monitor the skill proficiency of medical staff in real time, promptly discover and solve skill shortcomings, and ensure training quality.
[0071] 2. The present invention provides a multi-user training management and evaluation system for otolaryngology, which dynamically adjusts the training content and difficulty according to the basic information, training status, personal performance and progress evaluation coefficient of medical staff to ensure that the training content matches the actual needs and ability level of medical staff, which helps to improve learning efficiency, reduce training time, and at the same time enhance the professional skills and theoretical knowledge mastery of medical staff. By real-time tracking and evaluating the learning progress and effects of medical staff, the system can provide timely feedback to help medical staff identify and strengthen their weaknesses, thereby providing higher quality medical services in actual work. BRIEF DESCRIPTION OF THE DRAWINGS
[0072] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.
[0073] Figure 1 It is a module diagram of the present invention;
[0074] Figure 2 A flow chart for evaluating the training status of medical personnel for the present invention;
[0075] Figure 3 is a flow chart for evaluating the personal performance of medical personnel of the present invention;
[0076] Figure 4 Flowchart for evaluating the current training progress of healthcare personnel for the present invention. DETAILED DESCRIPTION
[0077] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0078] Embodiment 1, as Figure 1 As shown, the present invention provides a multi-user training management and evaluation system for otolaryngology, including a training management and evaluation center, the training management and evaluation center is communicatively connected with a user information management module, a training management platform, a training status evaluation module, a personal performance evaluation module, a comprehensive progress evaluation module and a personalized learning path planning module, wherein the modules are connected by electrical signals;
[0079] The user information management module is used to record and manage the basic information of ENT medical staff. The basic information of medical staff is the basis for formulating personalized learning paths, which helps to more accurately understand the background and needs of each medical staff. Nursing information forms are created to collect the basic information of medical staff online. The basic information of medical staff includes name, age, gender, job title, work experience, educational background and professional skills (ENT nursing knowledge, first aid skills). User consent terms are added at the beginning of the nursing information form to ensure that users have read and agreed before submitting the information. Medical staff fill in and submit the nursing information form After that, the information is automatically collected into the system and the submission time is recorded for subsequent tracking and auditing. The collected information is further verified using data verification rules for format verification and logic verification. For the information that passes the verification, medical staff are divided into different categories according to the number of years of work experience, namely 0-1 years, 1-3 years and more than 3 years. The cycle for collecting and updating information is set once a quarter. Medical staff are reminded to update their information, including academic qualifications, skills and work experience, through text messages and internal notifications. The data in the user information management module is backed up regularly to ensure rapid recovery in case of data loss or damage.
[0080] Training management platform, used to upload and manage course content, and manage medical staff to participate in simulation training of ENT surgery and diagnosis and treatment operations;
[0081] The training management platform includes an interactive learning module, a virtual reality device, and a multi-user collaboration module. The modules are connected by electrical signals. The interactive learning module is used to upload and manage course content. It contains a rich case library and multiple training modes to help medical staff continuously improve their skills in practice. It provides rich learning resources and supports multiple formats to meet different learning needs and preferences. The virtual reality device is used to enable users to participate in immersive simulation training of otolaryngology surgery and diagnosis and treatment operations. The multi-user collaboration module is used to support multiple medical staff to participate in training at the same time, and can communicate and collaborate in real time to enhance teamwork skills.
[0082] Furthermore, the application of the training management platform specifically includes:
[0083] Collect and produce relevant course content on otolaryngology surgery and diagnosis and treatment operations, upload the course content to the interactive learning module, classify and label it, and provide a case library and multiple training modes to adapt to the learning progress and skill levels of different medical staff. The course content includes video tutorials, PPT, PDF documents and interactive Q&A in various forms of learning resources. The case library contains a wealth of otolaryngology surgery and diagnosis and treatment operation cases. Each case is equipped with detailed step-by-step instructions and expert comments. The training modes include basic training, advanced training, and actual combat simulation. At the same time, it supports learning resources in multiple formats to meet different learning needs and preferences, including online videos, audio explanations, and graphic tutorials. It uses the virtual reality technology of virtual reality equipment to simulate the surgical and treatment environment, including equipment, instruments, and patients. Human models, etc., use virtual reality equipment to enable medical staff to interact with objects in the simulated environment, and provide real-time operational feedback, including operational correctness, time efficiency and risk warning, to help medical staff correct errors in a timely manner and improve their skills, so that medical staff can participate in immersive simulation training of otolaryngology surgery and diagnosis and treatment operations. Through the multi-user collaboration module, multiple medical staff can participate in training at the same time, conduct real-time communication and collaboration, provide text chat, voice call and video call, assist communication and collaboration between medical staff, and set collaborative tasks, including grouping for surgical simulation and jointly solving diagnosis and treatment problems to enhance teamwork skills, allowing instructors to assign different roles to medical staff, including surgeons, assistants, anesthesiologists and nurses, to simulate a real operating room environment;
[0084] The training status evaluation module is used to track and record the medical staff's participation in training in real time during the evaluation period, so as to extract the medical staff's training status data and evaluate the medical staff's training status. The training status data includes the duration of simulation training, the frequency of simulation training, the completion of simulation training and the difficulty of simulation training.
[0085] The personal performance evaluation module analyzes the medical staff's theoretical knowledge mastery, skill proficiency and skill effect evaluation during the evaluation period, and then conducts a comprehensive evaluation of the medical staff's personal performance, which helps to identify the medical staff's strengths and weaknesses;
[0086] The comprehensive progress evaluation module combines the evaluation results of medical staff's training status and personal performance to comprehensively evaluate the current training progress of medical staff and divide them into different progress levels to clarify the actual level and ability of medical staff in the training process;
[0087] The personalized learning path planning module is used to develop personalized learning paths for medical staff based on their progress level and personal characteristics, including recommended learning content, learning methods, and learning progress, and allocate corresponding learning resources to them to meet the learning needs of medical staff at different stages and help them improve their professional capabilities and comprehensive qualities more effectively.
[0088] Embodiment 2, as Figure 2 , Figure 3 As shown, based on Example 1, the present invention provides a technical solution: Preferably, in the training status evaluation module, the process of evaluating the training status of medical staff is:
[0089] Real-time tracking and recording of medical staff's participation in training during the evaluation period to collect medical staff's training status data and determine various evaluation indicators of training status data, including simulation training duration, simulation training frequency, simulation training completion and simulation training difficulty. Among them, simulation training duration is used to record the total duration of medical staff's participation in simulation training, reflecting the time cost of their investment in training; simulation training frequency is used to count the number of times medical staff participate in simulation training, reflecting their enthusiasm and regularity in participating in training; simulation training completion is used to record the proportion or progress of medical staff completing simulation training, reflecting the completeness and efficiency of their training; simulation training difficulty is used to rate the difficulty according to factors such as the complexity and challenge of simulation training, reflecting the quality of training received by medical staff; the collected training status data is cleaned and organized to ensure the accuracy and completeness of the data; the data is classified and archived according to different training projects to facilitate subsequent analysis and evaluation; and scoring standards for each evaluation indicator of training status data are preset. The evaluation criteria and weights are used to score the data of each evaluation indicator. The scoring criteria are formulated according to the actual situation. For example, the longer the simulation training time, the higher the frequency, the higher the degree of completion, and the greater the difficulty, the higher the corresponding score. The weights are allocated according to the importance of different training projects. The calculated scores of various evaluation indicators are integrated, and the training status evaluation index is calculated in combination with the weights of each evaluation indicator. The overall training status of medical staff during the evaluation period is analyzed. According to the training status evaluation index, the training status of medical staff is graded and evaluated, which are excellent training status level, good training status level, general training status level and poor training status level, and the evaluation threshold of each training status level is determined. According to the evaluation results of different levels, corresponding measures are taken to improve and optimize. For excellent and good medical staff, commendation and rewards are given to encourage them to continue to maintain and carry forward good training habits. For general and poor medical staff, training and guidance are strengthened to help them improve the quality and efficiency of training.
[0090] Furthermore, the calculation formula of the training status evaluation index is:
[0091]
[0092] Among them, T is the training status evaluation index, the value range of T is between 0 and 1, and w i is the weight of the i-th evaluation indicator, which is allocated according to the importance of the training project, s i is the score of the i-th evaluation indicator, α is the exponent of the exponential function, which is used to adjust the intensity of the weight influence, and f i is the actual value of the i-th evaluation indicator, M is the maximum value of the simulated training difficulty, which is used to limit the upper limit of the difficulty score. is the sum of weighted scores, reflecting the weighted sum of the scores of each evaluation indicator. is the αth power of the weighted score sum, which is used to adjust the scale of the sum result. The logarithm of the combined result of the minimum function and the sum function is taken, where the minimum function ensures that the difficulty of the simulation training does not exceed the preset maximum value M. When the duration, frequency, and completion of the simulation training increase and the difficulty is moderate, the T value increases, indicating that the training status is good. When any indicator score is low, the T value decreases, indicating that training needs to be strengthened in this area. The closer the T value is to 1, the better the training status is; the closer it is to 0, the worse the training status is.
[0093] Multiple training status levels correspond to multiple evaluation thresholds, specifically:
[0094] The evaluation threshold range of excellent training status level is: T A ≤T<1; indicates that the medical staff performed well in the simulation training, with long training time, high frequency, high completion rate and high difficulty, and should be commended and rewarded to encourage them to continue to maintain and carry forward good training habits;
[0095] The evaluation threshold range of good training status level is: T B ≤T <T A ; It means that the medical staff performed well in the simulation training and most of the indicators reached the expected goals. They can be given certain rewards and encouragements to promote them to move towards the excellent level;
[0096] The evaluation threshold range of general training status level is: T C ≤T <T B ; It is stated that the performance of medical staff in simulation training is average, and some indicators have not reached the expected goals. It is necessary to strengthen training and guidance to help them improve the quality and efficiency of training;
[0097] The evaluation threshold range for poor training status level is: 0 <T<T C ; It indicated that the medical staff performed poorly in the simulation training, and most indicators did not reach the expected targets, requiring special attention and enhanced training to improve the training effect;
[0098] Among them, T is the training status evaluation index, T A is the lower threshold of the excellent training status level and the upper threshold of the good training status level, T B is the lower threshold of good training status and the upper threshold of general training status, T C is the lower threshold of the general training status level and the upper threshold of the poor training status level, T A =0.9, T B =0.75, T C =0.6;
[0099] In the personal performance evaluation module, the evaluation process of medical staff's personal performance is as follows:
[0100] Collect relevant data of medical staff during the evaluation cycle, including theoretical knowledge test scores, skill operation records and patient feedback, in order to analyze the theoretical knowledge mastery, skill proficiency and skill effectiveness evaluation of medical staff; evaluate the theoretical knowledge mastery of medical staff through theoretical examinations and online tests, record test scores, and score theoretical knowledge mastery according to preset scoring standards; evaluate the skill proficiency of medical staff through practical operation assessments, simulation training and case analysis, record assessment results, score skill proficiency according to the accuracy, speed and efficiency of skill execution; evaluate the skill effectiveness of medical staff through patient feedback, feedback from colleagues and superiors , record the evaluation results, score according to the skill effect evaluation standards, integrate the scores of theoretical knowledge mastery, skill proficiency and skill effect evaluation, match the corresponding weights, and comprehensively calculate the personal performance trend index, conduct a comprehensive evaluation of the personal performance of medical staff during the evaluation period, and grade the personal performance of medical staff according to the personal performance trend index, which are divided into four levels: excellent performance level, good performance level, general performance level and poor performance level, and match the corresponding evaluation threshold for each performance level to analyze the strengths and weaknesses of medical staff in theoretical knowledge mastery, skill proficiency and skill effect evaluation;
[0101] Furthermore, the calculation formula of the personal performance trend index is:
[0102]
[0103] Among them, P is the personal performance tendency index, the value range of P is between 0 and 1, K is the theoretical knowledge mastery score, S is the skill proficiency score, E is the skill effect evaluation score, and E maxIt is the maximum value of the skill effect evaluation score and is used to normalize the skill effect evaluation score. When the theoretical knowledge mastery, skill proficiency, and skill effect evaluation scores are all high, the P value is close to 1, indicating that the individual has excellent performance. When any score is low, the P value decreases, indicating that more training is needed in this area. The closer the P value is to 1, the better the individual's performance is; the closer it is to 0, the worse the individual's performance is.
[0104] Multiple performance levels correspond to multiple assessment thresholds, specifically:
[0105] The evaluation threshold range for excellent performance level is: P A ≤P<1;
[0106] The evaluation threshold range for good performance level is: P B ≤P <P A ;
[0107] The general performance level assessment threshold range is: P C ≤P <P B ;
[0108] The evaluation threshold range for poor performance level is: 0 <P<P C ;
[0109] Among them, P is the personal performance trend index, P A is the lower threshold of the excellent performance level and the upper threshold of the good performance level, P B is the lower threshold of good performance level and the upper threshold of average performance level, P C is the lower threshold of the general performance level and the upper threshold of the poor performance level, P A =0.85, P B =0.6, P C =0.45.
[0110] Embodiment 3, as Figure 4 As shown, based on Embodiment 1-2, the present invention provides a technical solution: Preferably, in the comprehensive progress evaluation module, the process of evaluating the current training progress of medical staff is:
[0111] Record the number of times medical staff participate in training, duration, course content and completion status, track the participation, interaction and learning outcomes of medical staff in training, and obtain the scores of medical staff's theoretical knowledge mastery, skill proficiency and skill effectiveness evaluation; extract the training status evaluation index and personal performance trend index of medical staff in the evaluation period, and determine the weights of the training status evaluation index and personal performance trend index according to the training objectives and needs; combine the training status evaluation index and personal performance trend index, as well as their respective weights, and comprehensively calculate the progress evaluation coefficient to comprehensively evaluate the current training progress of medical staff, clarify their actual level and ability in the training process, and according to the progress According to the distribution of the progress evaluation coefficient, the current training progress of medical staff is divided into corresponding progress levels, namely high progress level, medium progress level and primary progress level, and the corresponding progress evaluation threshold is assigned to each progress level. The progress evaluation coefficient and progress level are fed back to the medical staff themselves and relevant departments, pointing out the advantages and disadvantages of the medical staff in the training process, as well as the direction for improvement. According to the evaluation results, a personalized guidance plan is formulated for the medical staff. The guidance plan includes the adjustment of training content, the improvement of learning methods and suggestions for skill improvement. According to the guidance plan, the medical staff are guided and tracked, and the progress of the medical staff is regularly evaluated to adjust the guidance plan;
[0112] Furthermore, the calculation formula of the progress evaluation coefficient is:
[0113]
[0114] Among them, PEC is the progress evaluation coefficient, the value range of PEC is between 0 and 1, T is the training status evaluation index, P is the personal performance trend index, and w T and w P are the weights of the training status evaluation index and the personal performance trend index, respectively, and w T +w P =1, when the values of T and P are higher, the PEC value is closer to 1, indicating that the training progress of medical staff is excellent; when the values of T and P are lower, the PEC value is closer to 0, indicating that the training progress of medical staff is poor;
[0115] Multiple progress levels correspond to multiple progress evaluation thresholds, specifically:
[0116] The progress evaluation threshold range for high progress level is: PEC H ≤PEC<1, indicating that the medical staff's training progress is excellent, they have mastered most of the training content, and their personal performance is outstanding;
[0117] The progress evaluation threshold range for the medium progress level is: PEC L ≤PEC <PEC H, indicating that the training of medical staff is progressing well, but there is still room for improvement;
[0118] The progress evaluation threshold range for the primary progress level is: 0 <PEC<PEC L , indicating that the training progress of medical staff is still in its early stages and requires more training and practice to improve;
[0119] Among them, PEC is the progress evaluation coefficient, PEC H is the lower threshold of the high progress level and the upper threshold of the medium progress level, PEC L is the lower threshold of the intermediate progress level and the upper threshold of the primary progress level, PEC H =0.8,PEC L =0.6.
[0120] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A multi-user training management and evaluation system for otolaryngology, including a training management and evaluation center, characterized in that: The training management and evaluation center is communicatively connected with a user information management module, a training management platform, a training status evaluation module, a personal performance evaluation module, a comprehensive progress evaluation module, and a personalized learning path planning module, wherein the modules are electrically connected with each other; The user information management module is used to record and manage the basic information of ENT medical staff; The training management platform is used to upload and manage course content, and manage medical staff to participate in simulation training of otolaryngology surgery and diagnosis and treatment operations; The training status evaluation module is used to track and record the medical staff's participation in training during the evaluation period in real time and evaluate the training status of the medical staff; The personal performance evaluation module analyzes the medical staff's theoretical knowledge mastery, skill proficiency and skill effect evaluation during the evaluation period, and then conducts a comprehensive evaluation of the medical staff's personal performance; The comprehensive progress evaluation module comprehensively evaluates the current training progress of medical staff and divides it into different progress levels based on the evaluation results of the medical staff's training status and personal performance; The personalized learning path planning module is used to formulate a personalized learning path for the medical staff according to their progress level and personal characteristics, and allocate corresponding learning resources.
2. The multi-user training management and evaluation system for otolaryngology according to claim 1, characterized in that: In the user information management module, the process of recording and managing the basic information of medical staff is as follows: Create a nursing information form to collect basic information of medical staff online, including name, age, gender, job title, work experience, educational background, and professional skills, and add user consent terms at the beginning of the nursing information form; After the medical staff fills in and submits the nursing information form, the information is automatically collected into the system and the submission time is recorded. The collected information is further verified using the data verification rules of format verification and logic verification. For the information that passes the verification, the medical staff are divided into different categories according to the number of years of work experience, namely 0-1 years, 1-3 years and more than 3 years; Set a quarterly cycle for collecting and updating information, and remind medical staff to update their information, including academic qualifications, skills and work experience, through text messages and internal notifications, and regularly back up data in the user information management module.
3. The multi-user training management and evaluation system for otolaryngology according to claim 2, characterized in that: The training management platform includes an interactive learning module, a virtual reality device and a multi-user collaboration module, wherein the modules are connected by electrical signals; The interactive learning module is used to upload and manage course content, including a case library and multiple training modes; The virtual reality device is used to enable users to participate in simulation training of ENT surgery and diagnosis and treatment operations; The multi-user collaboration module is used to support multiple medical staff to participate in the training at the same time and to conduct real-time communication and collaboration.
4. The multi-user training management and evaluation system for otolaryngology according to claim 3, characterized in that: The application of the training management platform specifically includes: Collect and produce relevant course content for ENT surgery and diagnosis and treatment operations, upload the course content to the interactive learning module, classify and label it, and provide a case library and multiple training modes to adapt to the learning progress and skill levels of different medical staff. The course content includes video tutorials, PPT, PDF documents and interactive Q&A in various forms of learning resources. The case library contains ENT surgery and diagnosis and treatment operation cases. Each case is equipped with detailed step-by-step instructions and expert comments. The training modes include basic training, advanced training, and actual combat simulation. At the same time, it supports learning resources in multiple formats, including online videos, audio explanations, and graphic tutorials. Using virtual reality technology of virtual reality equipment to simulate surgery and diagnosis and treatment environments, including equipment, instruments and patient models, to enable medical staff to interact with objects in the simulated environment through virtual reality equipment, and to provide real-time operational feedback, including operational correctness, time efficiency and risk warning; The multi-user collaboration module supports multiple medical staff to participate in training at the same time, conduct real-time communication and collaboration, and assist communication and collaboration between medical staff.
5. The multi-user training management and evaluation system for otolaryngology according to claim 4, characterized in that: In the training status assessment module, the process of assessing the training status of medical staff is as follows: Real-time tracking and recording of medical staff's participation in training during the evaluation period to collect training status data of medical staff and determine various evaluation indicators of training status data, including simulation training duration, simulation training frequency, simulation training completion and simulation training difficulty; Clean and organize the collected training status data, and classify and archive the data according to different training projects; Preset the scoring criteria and weights for each evaluation indicator of the training status data, and score the data of each evaluation indicator; Integrate the calculated scores of various evaluation indicators, combine the weights of each evaluation indicator, calculate the training status evaluation index, and analyze the overall training status of medical staff during the evaluation period; According to the training status evaluation index, the training status of medical staff is evaluated by grades, namely, excellent training status level, good training status level, general training status level and poor training status level, and the evaluation threshold of each training status level is determined. According to the evaluation results of different levels, corresponding measures are taken to improve and optimize.
6. The multi-user training management and evaluation system for otolaryngology according to claim 5, characterized in that: The calculation formula of the training status evaluation index is: Among them, T is the training status evaluation index, the value range of T is between 0 and 1, and w i is the weight of the i-th evaluation indicator, s i is the score of the i-th evaluation indicator, α is the exponent of the exponential function, which is used to adjust the intensity of the weight influence, and f i is the actual value of the i-th evaluation indicator, M is the maximum value of the simulated training difficulty, which is used to limit the upper limit of the difficulty score; The multiple training status levels correspond one-to-one to the multiple evaluation thresholds, specifically: The evaluation threshold range of the excellent training status level is: T A ≤T<1; The evaluation threshold range of the good training status level is: T B ≤T <T A ; The evaluation threshold range of the general training status level is: T C ≤T <T B ; The evaluation threshold range of the poor training status level is: 0 <T<T C ; Among them, T is the training status evaluation index, T A is the lower threshold of the excellent training status level and the upper threshold of the good training status level, T B is the lower threshold of good training status and the upper threshold of general training status, T C is the lower threshold of the general training status level and the upper threshold of the poor training status level, T A =0.9, T B =0.75, T C =0.
6.
7. The multi-user training management and evaluation system for otolaryngology according to claim 6, characterized in that: In the personal performance evaluation module, the evaluation process of the medical staff's personal performance is as follows: Collect relevant data of medical staff during the evaluation period, including theoretical knowledge test scores, skill operation records and patient feedback, to analyze the medical staff's theoretical knowledge mastery, skill proficiency and skill effect evaluation; Evaluate the theoretical knowledge mastery of medical staff through theoretical examinations and online tests, record the test scores, and score the theoretical knowledge mastery according to the preset scoring standards; evaluate the skill proficiency of medical staff through practical operation assessments, simulation training and case analysis, record the assessment results, and score the skill proficiency according to the accuracy, speed and efficiency of skill execution; evaluate the skill effectiveness of medical staff through patient feedback, feedback from colleagues and superiors, record the evaluation results, and score according to the skill effectiveness evaluation standards; The scores of theoretical knowledge mastery, skill proficiency and skill effect evaluation are integrated and matched with corresponding weights to comprehensively calculate the personal performance trend index, so as to comprehensively evaluate the personal performance of medical staff during the evaluation period; According to the personal performance trend index, the personal performance of medical staff is evaluated by graded into four levels: excellent performance level, good performance level, average performance level and poor performance level. The corresponding evaluation threshold is matched for each performance level to analyze the strengths and weaknesses of medical staff in theoretical knowledge mastery, skill proficiency and skill effect evaluation.
8. The multi-user training management and evaluation system for otolaryngology according to claim 7, characterized in that: The calculation formula of the personal performance trend index is: Among them, P is the personal performance tendency index, the value range of P is between 0 and 1, K is the theoretical knowledge mastery score, S is the skill proficiency score, E is the skill effect evaluation score, and E max The maximum value of the skill effect evaluation score, used to normalize the skill effect evaluation score; The multiple performance levels correspond one-to-one to the multiple evaluation thresholds, specifically: The evaluation threshold range of the excellent performance level is: P A ≤P<1; The evaluation threshold range of the good performance level is: P B ≤P <P A ; The assessment threshold range for the general performance level is: P C ≤P <P B ; The evaluation threshold range for the poor performance level is: 0 <P<P C ; Among them, P is the personal performance trend index, P A is the lower threshold of the excellent performance level and the upper threshold of the good performance level, P B is the lower threshold of good performance level and the upper threshold of average performance level, P C is the lower threshold of the general performance level and the upper threshold of the poor performance level, P A =0.85, P B =0.6, P C =0.
45.
9. The multi-user training management and evaluation system for otolaryngology according to claim 8, characterized in that: In the comprehensive progress evaluation module, the process of evaluating the current training progress of medical staff is as follows: Record the number of times, duration, course content and completion status of medical staff's training, track their participation, interaction and learning outcomes in training, and obtain their scores on theoretical knowledge mastery, skill proficiency and skill effectiveness evaluation; Extract the training status evaluation index and personal performance trend index of medical staff during the evaluation period, and determine the weights of the training status evaluation index and personal performance trend index according to the training objectives and needs; Combine the training status evaluation index and the individual performance trend index, as well as their respective weights, to calculate the progress evaluation coefficient, conduct a comprehensive assessment of the current training progress of medical staff, and clarify their actual level and ability during the training process; According to the distribution of progress evaluation coefficients, the current training progress of medical staff is divided into corresponding progress levels, namely high progress level, medium progress level and primary progress level, and a corresponding progress evaluation threshold is assigned to each progress level; Feedback the progress evaluation coefficient and progress level to the medical staff themselves and relevant departments, point out the strengths and weaknesses of the medical staff in the training process, and the areas that need improvement. According to the evaluation results, formulate a personalized guidance plan for the medical staff, which includes the adjustment of training content, improvement of learning methods and suggestions for skill improvement; Provide guidance and follow-up to medical staff according to the guidance plan, and regularly evaluate the progress of medical staff to adjust the guidance plan.
10. The multi-user training management and evaluation system for otolaryngology according to claim 9, characterized in that: The calculation formula of the progress evaluation coefficient is: Among them, PEC is the progress evaluation coefficient, the value range of PEC is between 0 and 1, T is the training status evaluation index, P is the personal performance trend index, and w T and w P are the weights of the training status evaluation index and the personal performance trend index, and w T +w P =1; The multiple progress levels correspond one-to-one to the multiple progress evaluation thresholds, specifically: The progress evaluation threshold range of the high progress level is: PEC H ≤PEC<1; The progress evaluation threshold range of the medium progress level is: PEC L ≤PEC <PEC H ; The progress evaluation threshold range of the primary progress level is: 0 <PEC<PEC L ; Among them, PEC is the progress evaluation coefficient, PEC H is the lower threshold of the high progress level and the upper threshold of the medium progress level, PEC L is the lower threshold of the intermediate progress level and the upper threshold of the primary progress level, PEC H =0.8,PEC L =0.6。
Citation Information
Patent Citations
Intelligent training management method and system for elderly nurses
CN116012205A
Immersive virtual reality acute and critical disease nursing training system
CN118968840A
Artificial intelligence-based platform to optimize skill training and performance
WO2021146368A1