Practical operation examination intelligent appraisal system based on digitization
Through the digital practical assessment intelligent evaluation system, the problems of uniformity and objectivity in the practical skills assessment of medical staff have been solved, automated, standardized and efficient evaluation has been achieved, instant feedback and personalized guidance have been provided, and the quality of medical services has been improved.
Patent Information
- Application Number
- CN202511192099.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-25
- Publication Date
- 2025-10-03
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing technology lacks uniformity and objectivity in the assessment of medical staff's practical skills. It relies on manual assessment, resulting in low efficiency. It is difficult to systematically collect and analyze educational data, and there is a lack of timely feedback and personalized guidance, which affects the quality and efficiency of medical services.
An intelligent evaluation system for practical assessment based on digitalization is designed, including a video upload judgment module, a technical accuracy assessment value acquisition module, a completion assessment value acquisition module and a pass judgment module. The system judges the technical accuracy and completion of the practical assessment through video data set analysis, providing objective evaluation standards.
It has achieved automation and standardization of practical assessments, improved the accuracy and efficiency of assessments, provided immediate feedback and personalized guidance, ensured the fairness and impartiality of assessments, and promoted the improvement of medical staff's skills.
Smart Images
Figure CN120746401A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data management, and in particular to an intelligent evaluation system for practical operation assessment based on digitization. Background Art
[0002] As an important part of the medical field, the practical skills of medical staff play a vital role in the treatment and care of patients. Practical assessment and evaluation can evaluate the ability and technical level of medical staff in actual operations, thereby improving the quality of medical care. Medical and nursing practical assessment and evaluation can help standardize the professional behavior and operating procedures of medical staff, improve the standardization and standardization of the diagnosis and treatment process, and can also discover and correct the irregular behavior and operational deviations of medical staff. In the current medical industry, there is a lack of uniformity in the standards and methods for evaluating the practical skills of medical staff, and there are certain subjectivity and limitations. One of the backgrounds for studying medical and nursing practical assessment and evaluation is to formulate unified evaluation standards and methods to improve the objectivity and accuracy of the evaluation.
[0003] Nowadays, there are still some deficiencies in the research on digital-based practical assessment intelligent evaluation systems. Specifically, traditional practical assessments often rely on the subjective judgment of examiners, manual assessment methods are time-consuming and inefficient, and it is difficult to systematically collect and analyze large amounts of educational data. They lack consistency and comparability. When faced with a large number of assessment tasks, manual assessment methods often cannot meet the needs, affecting the quality and efficiency of education and medical services. It is difficult to effectively analyze and mine the potential information and patterns of the data, limiting the in-depth understanding of the practical performance of students or medical staff and the formulation of improvement measures. Manual assessment methods are difficult to provide timely feedback and track the practical progress of students or medical staff, and are unable to identify problems and provide guidance in a timely manner. The lack of timely feedback and personalized guidance may affect learning and the improvement of professional skills. Summary of the Invention
[0004] In response to the deficiencies in the prior art, the present invention provides a digital-based intelligent evaluation system for practical assessment, which can effectively solve the problems involved in the above-mentioned background technology.
[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions: a digital-based practical assessment intelligent evaluation system, including a practical assessment process video upload judgment module, a practical assessment technical accuracy evaluation value acquisition module, a practical assessment completion evaluation value acquisition module and a practical assessment pass judgment module, wherein: the practical assessment process video upload judgment module obtains a user practical assessment process video upload data set, and judges whether the user practical assessment process video is successfully uploaded based on the obtained user practical assessment process video upload data set; the practical assessment technical accuracy evaluation value acquisition module obtains a user practical assessment process technical accuracy data set for the successfully uploaded user practical assessment process video, and obtains a practical assessment technical accuracy evaluation value based on the obtained user practical assessment process technical accuracy data set through comprehensive analysis; the practical assessment completion evaluation value acquisition module obtains a user practical assessment process completion data set, and obtains a practical assessment completion evaluation value based on the obtained user practical assessment process completion data set; the practical assessment pass judgment module judges whether the user practical assessment is qualified based on the obtained practical assessment technical accuracy evaluation value and the practical assessment completion evaluation value.
[0006] As a further solution, the user uploads a data set of videos during the practical assessment process, which specifically includes the network bandwidth for uploading videos during the practical assessment process, the packet loss rate for uploading videos during the practical assessment process, and the total transmission time for uploading videos during the practical assessment process.
[0007] As a further solution, based on the obtained user practical assessment process video upload data set, it is judged whether the user practical assessment process video is uploaded successfully. The specific analysis process is: based on the obtained user practical assessment process video upload data set, a comprehensive analysis is performed to obtain a video upload evaluation value, and the video upload evaluation value is used as an analysis basis for judging whether the user practical assessment process video is uploaded successfully; the video upload evaluation value is compared with the video upload reference evaluation value stored in the database; if the video upload evaluation value is higher than or equal to the video upload reference evaluation value, the user practical assessment process video corresponding to the video upload evaluation value is uploaded successfully; if the video upload evaluation value is lower than the video upload reference evaluation value, the user practical assessment process video corresponding to the video upload evaluation value is not uploaded successfully and needs to be uploaded again.
[0008] As a further solution, the technical accuracy data set of the user's practical assessment process specifically includes the straightness of the suture line during the practical assessment process, the number of intubation operation errors during the practical assessment process, and the number of dressing change step errors during the practical assessment process.
[0009] As a further solution, based on the obtained technical accuracy data set of the user's practical assessment process, a comprehensive analysis is performed to obtain the practical assessment technical accuracy evaluation value. The specific analysis process is: based on the obtained technical accuracy data set of the user's practical assessment process, a comprehensive analysis is performed to obtain the practical assessment technical accuracy evaluation value. The practical assessment technical accuracy evaluation value is used as the analysis basis for judging whether the user's practical assessment is qualified.
[0010] As a further solution, the technical accuracy evaluation value of the actual assessment is carried out. The specific analysis process is as follows: ; Where, To evaluate the technical accuracy of the practical assessment, To check the straightness of the suture line during the practical assessment process, The number of intubation operation errors during the practical assessment process, The number of errors in dressing change steps during the practical assessment process, The compensation factor for the straightness of the suture line in the practical assessment process is set. The compensation factor for the number of intubation operation errors in the practical assessment process is set. It is the compensation factor for the number of errors in the dressing change steps during the practical assessment process.
[0011] As a further solution, the user's practical assessment process completion data set specifically includes the actual completion time of the practical assessment process, the completion ratio within the specified time of the practical assessment process, the decision-making response time of the practical assessment process, and the completion rate of simulated cases in the practical assessment process.
[0012] As a further solution, based on the obtained user practical assessment process completion data set, a comprehensive analysis is performed to obtain a practical assessment completion evaluation value. The specific analysis process is: based on the obtained user practical assessment process completion data set, a comprehensive analysis is performed to obtain a practical assessment completion evaluation value. The practical assessment completion evaluation value is used as the analysis basis for judging whether the user's practical assessment is qualified.
[0013] As a further solution, the practical assessment completion evaluation value, the specific analysis process is as follows: ; Where, This is the completion evaluation value of the practical assessment. The actual completion time of the practical assessment process. The completion ratio of the practical assessment process within the specified time is For the decision-making reaction time of the practical assessment process, To simulate the completion of cases in the practical assessment process, It is the compensation factor for the actual completion time of the practical assessment process. The compensation factor for the completion ratio within the specified time of the practical assessment process is set. The compensation factor for the decision reaction time in the practical assessment process is set. is the compensation factor for the completion of simulated cases in the practical assessment process, and e is a natural constant.
[0014] As a further solution, based on the obtained practical assessment technical accuracy evaluation value and practical assessment completion evaluation value, judge whether the user's practical assessment is qualified. The specific analysis process is: based on the obtained practical assessment technical accuracy evaluation value and practical assessment completion evaluation value, a comprehensive analysis is performed to obtain the user's practical assessment evaluation value, and the user's practical assessment evaluation value is used as the analysis basis for judging whether the user's practical assessment is qualified; compare the user's practical assessment evaluation value with the user's practical assessment reference evaluation value stored in the database; if the user's practical assessment evaluation value is higher than or equal to the user's practical assessment reference evaluation value, then the user's practical assessment corresponding to the user's practical assessment evaluation value is qualified; if the user's practical assessment evaluation value is lower than the user's practical assessment reference evaluation value, then the user's practical assessment corresponding to the user's practical assessment evaluation value is unqualified.
[0015] Compared with the prior art, the embodiments of the present invention have at least the following advantages or beneficial effects: (1) The present invention provides a digital-based intelligent evaluation system for practical assessment. Through the video upload judgment module, it can objectively judge whether the user's practical assessment process video is uploaded successfully. With the help of the video upload judgment module, the system can immediately feedback the upload status of the user's practical assessment process video, and obtain the technical accuracy evaluation value through comprehensive analysis, which is helpful to evaluate the level of practical technology. The completion evaluation value acquisition module evaluates the completion of the practical assessment through comprehensive analysis data, providing students or medical staff with an opportunity to fully understand their own practical level. The practical assessment qualification judgment module judges whether the user's practical assessment is qualified based on the comprehensive analysis of the technical accuracy evaluation value and the completion evaluation value, providing a basis for the objective standard of the assessment results and promoting the standardization of the assessment; (2) The present invention obtains the data set of the user's practical assessment process video upload and determines whether the user's practical assessment process video has been successfully uploaded, thereby improving the automation level of the assessment, reducing the workload of human intervention and manual operation, and improving the efficiency of the assessment. It can instantly determine the upload status of the user's practical assessment process video, ensuring the timeliness and accuracy of the assessment process, and avoiding delays or errors caused by human factors or misoperation. The system digitizes the data set of the practical assessment process video upload, making the data easier to manage and analyze. The system can monitor the video upload status in real time, helping administrators or teachers to deal with problems in a timely manner, and ensuring the accuracy and completeness of the assessment; (3) The present invention determines whether the user's practical assessment is qualified through the practical assessment technical accuracy evaluation value and the practical assessment completion evaluation value, more objectively evaluates the level of the user's practical assessment, avoids subjective bias and single emphasis, and provides a more comprehensive and integrated evaluation standard. The technical accuracy evaluation value and the completion evaluation value are the results obtained based on data and indicators, and have high objectivity and authenticity. According to the evaluation results of technical accuracy and completion, the deficiencies and problems of the user in the practical assessment can be clearly identified, providing a more targeted direction for guidance and improvement, and can also establish objective evaluation standards, and help to achieve standardization and fairness of the assessment, ensuring that each user is treated fairly in the evaluation process. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The present invention is further described with reference to the accompanying drawings. However, the embodiments in the accompanying drawings do not limit the present invention in any way. A person skilled in the art can derive other drawings based on the following drawings without inventive effort. Figure 1 This is a schematic diagram of system module connections of the present invention; Figure 2 This is an image showing how the user's practical assessment evaluation value changes along with the practical assessment technical accuracy evaluation value. DETAILED DESCRIPTION
[0017] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.
[0018] See also Figure 1 The embodiment of the present invention provides a technical solution for a digital-based practical assessment intelligent evaluation system: a digital-based practical assessment intelligent evaluation system, including a practical assessment process video upload judgment module, a practical assessment technical accuracy evaluation value acquisition module, a practical assessment completion evaluation value acquisition module and a practical assessment pass judgment module.
[0019] The practical operation assessment process video upload judgment module obtains the user's practical operation assessment process video upload data set, and judges whether the user's practical operation assessment process video is uploaded successfully based on the obtained user's practical operation assessment process video upload data set.
[0020] Specifically, the dataset of user practical assessment process video upload includes network bandwidth, packet loss rate and total transmission time of video upload. The network bandwidth of video upload refers to the maximum speed at which data can be transmitted per unit time. The larger the network bandwidth, the faster the transmission speed during video upload. For video upload with high real-time requirements, the size of network bandwidth will directly affect the transmission efficiency and image quality. The packet loss rate of video upload during practical assessment process indicates the proportion of data packets lost during video upload, which reflects the proportion of data packets lost during data transmission. The lower the packet loss rate, the higher the network transmission stability and reliability, and the better the video upload quality. The total transmission time of video upload during practical assessment process indicates the length of the entire video upload process. In addition to being affected by network bandwidth and packet loss rate, the total transmission time is also affected by factors such as video file size and transmission distance. It is an important indicator for evaluating video upload efficiency and speed. The shorter the total transmission time, the faster the video upload process. It should be noted that the operation object in the uploaded video is not a real person, but a dummy.
[0021] It should be noted that the above-mentioned network bandwidth refers to the maximum rate of data transmission per unit time. The larger the network bandwidth, the faster the video upload transmission speed, and the total transmission time will be relatively reduced. The network bandwidth and the total transmission time are negatively correlated, that is, the larger the network bandwidth, the shorter the total transmission time. The size of the network bandwidth will also affect the stability of data transmission. If the network bandwidth is insufficient, it may cause data packets to be lost during transmission, increasing the packet loss rate. There is a certain negative correlation between network bandwidth and packet loss rate, that is, the smaller the network bandwidth, the more likely it is that the packet loss rate will increase. A high packet loss rate will lead to unstable data transmission, and the lost data packets may need to be retransmitted, thereby increasing the total transmission time. There is a positive correlation between the total transmission time and the packet loss rate, that is, the higher the packet loss rate, the more likely the total transmission time is to increase. Network performance monitoring equipment can be used to monitor network bandwidth, packet loss rate and transmission time in real time.
[0022] Furthermore, based on the obtained user practical assessment process video upload data set, determine whether the user practical assessment process video is uploaded successfully. The specific analysis process is: based on the obtained user practical assessment process video upload data set, a comprehensive analysis is performed to obtain a video upload evaluation value, and the video upload evaluation value is used as an analysis basis for determining whether the user practical assessment process video is uploaded successfully; the video upload evaluation value is compared with the video upload reference evaluation value stored in the database; if the video upload evaluation value is higher than or equal to the video upload reference evaluation value, the user practical assessment process video corresponding to the video upload evaluation value is uploaded successfully; if the video upload evaluation value is lower than the video upload reference evaluation value, the user practical assessment process video corresponding to the video upload evaluation value is not uploaded successfully and needs to be uploaded again.
[0023] In a specific embodiment, by comparing the evaluation video upload value with the reference evaluation value, videos that have failed to be uploaded can be discovered in time and re-uploaded, thereby improving the success rate of video upload, ensuring the normal entry and preservation of the user's practical assessment process video, re-uploading the video, avoiding missing or incomplete data, ensuring that all users' practical assessment process videos can be successfully uploaded and saved in the database, ensuring the integrity and accuracy of the data, discovering the failure of video upload in time and re-uploading it, reducing the time and inconvenience caused to users due to upload failure, improving user experience and satisfaction, avoiding errors and losses that may occur during data transmission, ensuring the accuracy and integrity of video data, and facilitating the accuracy and reliability of subsequent data analysis and application.
[0024] It should be noted that the above-mentioned method obtains the data set of the user's practical assessment process video upload and determines whether the user's practical assessment process video has been uploaded successfully, thereby improving the automation level of the assessment, reducing the workload of manual intervention and manual operation, and improving the efficiency of the assessment. It can instantly judge the upload status of the user's practical assessment process video, ensuring the timeliness and accuracy of the assessment process, and avoiding delays or errors caused by human factors or misoperation. The system digitizes the data set of the practical assessment process video upload, making the data easier to manage and analyze. The system can monitor the video upload status in real time, helping administrators or teachers to deal with problems in a timely manner, and ensuring the accuracy and completeness of the assessment.
[0025] It should be noted that the specific analysis process of the above video upload evaluation value is as follows: ; Where, Upload a rating for your video. Network bandwidth for uploading videos of the practical assessment process, This is the packet loss rate of the video upload during the practical assessment process. The total time of uploading and transmitting the video of the practical assessment process. The compensation factor for the network bandwidth used to upload the video during the practical assessment process. The compensation factor for the packet loss rate of video upload during the practical assessment process is set. is the compensation factor for the total transmission time of the video upload during the practical assessment process, and e is a natural constant.
[0026] It needs to be explained that the above-mentioned video upload evaluation value is calculated through the network bandwidth of video upload during the practical assessment process, the packet loss rate of video upload during the practical assessment process, and the total transmission time of video upload during the practical assessment process. The network bandwidth of video upload during the practical assessment process, the packet loss rate of video upload during the practical assessment process, and the total transmission time of video upload during the practical assessment process are normalized to evaluate the stability of the network during the practical assessment process. Network stability is an important factor in ensuring the quality of video upload, which helps to discover network problems in a timely manner and take corresponding measures to improve network stability, optimize the network environment of the video upload process, improve the stability and efficiency of video upload, and thus improve the effect and accuracy of the practical assessment. The analysis results of the evaluation value can help managers make targeted decisions, thereby improving the management level and performance of the practical assessment, monitoring indicators such as the network bandwidth, packet loss rate and transmission time of video upload during the practical assessment process, and understanding the network operation in real time. The operation status can be detected and solved in time, which helps to improve the efficiency of network management and ensure the stability and efficiency of video uploading. The compensation factors for the network bandwidth for uploading video of the practical operation assessment process, the packet loss rate for uploading video of the practical operation assessment process and the total transmission time of uploading video of the practical operation assessment process are obtained from the database. According to the historical data, a mapping set of the historically measured network bandwidth for uploading video of the practical operation assessment process, the packet loss rate for uploading video of the practical operation assessment process and the total transmission time of uploading video of the practical operation assessment process and the compensation factors for the network bandwidth for uploading video of the practical operation assessment process, the packet loss rate for uploading video of the practical operation assessment process and the total transmission time of uploading video of the practical assessment process are established to obtain the compensation factors for the network bandwidth for uploading video of the practical operation assessment process, the packet loss rate for uploading video of the practical operation assessment process and the total transmission time of uploading video of the practical assessment process corresponding to the current network bandwidth for uploading video of the practical operation assessment process, the packet loss rate for uploading video of the practical assessment process and the total transmission time of uploading video of the practical assessment process
[0027] The module for obtaining the technical accuracy evaluation value of the practical assessment is used to obtain the technical accuracy data set of the user's practical assessment process from the successfully uploaded user practical assessment process video. Based on the obtained technical accuracy data set of the user's practical assessment process, a comprehensive analysis is performed to obtain the technical accuracy evaluation value of the practical assessment.
[0028] Specifically, the technical accuracy data set of the user's practical assessment process includes the straightness of the suture line during the practical assessment process, the number of intubation operation errors during the practical assessment process, and the number of dressing change step errors during the practical assessment process. The straightness of the suture line during the practical assessment process refers to whether the suture line formed during the actual operation is straight. Straightness is an assessment of the straightness of the suture line. The straighter it is, the more accurate the suture technique is. Otherwise, there may be inaccurate suture technique or errors. The straightness is evaluated to judge the operator's suture technique level and operation accuracy. The number of intubation operation errors during the practical assessment process refers to the number of errors that occur during the actual intubation process. Intubation is a common medical operation that requires accuracy and meticulousness during operation. The procedure is carried out consistently. The number of intubation errors reflects the operator's level and proficiency in intubation technology. A lower number of errors indicates that the operator's intubation technology is more proficient and accurate, while a higher number of errors may mean that the operator needs to further improve his or her technical level. The number of dressing change step errors in the practical assessment process refers to the number of errors that occur during the dressing change steps in actual operation. Dressing change is an important treatment operation. The operator needs to be proficient in the steps and key points of dressing change to ensure the treatment effect and avoid infection and other problems. The number of errors reflects the operator's accuracy and familiarity in dressing change operations. A lower number of errors indicates that the operator performs better in dressing change operations, while a higher number of errors may require further training and guidance.
[0029] It should be noted that the straightness of the above-mentioned suture line reflects the operator's suturing technology level and accuracy. If the operator's suturing technology is more proficient and can maintain straightness, then the number of intubation operation errors will usually be less, because both suturing and intubation operations require meticulous and accurate operating skills. A higher technical level will be reflected in both operations. A higher suture line straightness may indicate that the operator is more technically proficient, and may show a trend of fewer dressing change step errors. However, the number of dressing change step errors still depends on the operator's familiarity and meticulousness with the dressing change steps. A higher number of intubation operation errors may also be accompanied by a higher number of dressing change step errors. The user's behavior is recorded by video and image through the boom and head-mounted integrated recording system, and automatically compared with the user reference video and image behavior stored in the database to obtain the straightness of the suture line during the practical assessment process, the number of intubation operation errors during the practical assessment process, and the number of dressing change step errors during the practical assessment process. Existing human posture estimation technology, computer vision technology, deep learning technology, and motion recognition technology can recognize specific and precise movements in the video.
[0030] Furthermore, based on the obtained technical accuracy data set of the user's practical assessment process, a comprehensive analysis is performed to obtain the practical assessment technical accuracy evaluation value. The specific analysis process is: based on the obtained technical accuracy data set of the user's practical assessment process, a comprehensive analysis is performed to obtain the practical assessment technical accuracy evaluation value. The practical assessment technical accuracy evaluation value is used as the analysis basis for judging whether the user's practical assessment is qualified.
[0031] It should be noted that the above-mentioned comprehensive analysis of various technical accuracy data can obtain a more comprehensive and objective evaluation result, rather than just looking at a single indicator. It helps the evaluator to have a more comprehensive understanding of the operator's actual technical level and overall performance. The technical accuracy evaluation value is based on the analysis of the data set, which is relatively objective and scientific, avoiding the bias and errors that may exist in subjective evaluation, and improving the objectivity and accuracy of the evaluation. The technical accuracy evaluation value can quantify the technical level, provide specific data support and basis, and make the evaluation more convincing and scientific, rather than subjective judgment. Setting a certain technical accuracy evaluation value as the standard for qualified judgment can provide users with a clear goal and requirement, making the evaluation process more standardized and fair. Through the technical accuracy evaluation value, personalized guidance and training programs can be provided for the technical level and performance of different users to help them improve their technical accuracy, thereby improving the overall operation level.
[0032] Specifically, the practical assessment technical accuracy evaluation value, the specific analysis process is as follows: ; Where, To evaluate the technical accuracy of the practical assessment, To check the straightness of the suture line during the practical assessment process, The number of intubation operation errors during the practical assessment process, The number of errors in dressing change steps during the practical assessment process, The compensation factor for the straightness of the suture line in the practical assessment process is set. The compensation factor for the number of intubation operation errors in the practical assessment process is set. It is the compensation factor for the number of errors in the dressing change steps during the practical assessment process.
[0033] It should be explained that the above-mentioned technical accuracy evaluation value of practical operation assessment is obtained by calculating the straightness of suture line, the number of intubation operation errors and the number of dressing change step errors during the practical operation assessment process. The straightness of suture line, the number of intubation operation errors and the number of dressing change step errors during the practical operation assessment process are normalized. The evaluation of indicators such as the straightness of suture line, the number of intubation operation errors and the number of dressing change step errors can reflect the accuracy of technical operation of operators in the practical operation assessment process, timely discover and correct errors in operation, and improve the accuracy and quality of technical operation. The calculation of technical accuracy evaluation value of practical operation assessment can quantitatively evaluate the quality of practical operation. Quantitative evaluation method can help evaluators evaluate the actual operation level of operators more objectively, thereby improving the accuracy and reliability of evaluation. Analysis of indicators such as the number of intubation operation errors and the number of dressing change step errors can discover problems and weak links in specific operation links of operators, formulate personalized training plans for operators, improve their operation skills and levels in a targeted manner, and provide operators with specific feedback and improvement suggestions to help them discover And correct the errors and deficiencies in the operation, continuously improve and enhance the accuracy of technical operation, promote technological progress, enhance the operation level of operators, and comprehensively evaluate the actual operation level and technical accuracy of operators. The evaluation results can provide an objective basis for the assessment results and training effects, help improve the effects of assessment and training, and enhance the overall quality of operators. The set compensation factors for the straightness of the suture line in the practical assessment process, the number of intubation operation errors in the practical assessment process, and the number of dressing change step errors in the practical assessment process are obtained from the database. According to historical data, a mapping set of the historically measured straightness of the suture line in the practical assessment process, the number of intubation operation errors in the practical assessment process, and the number of dressing change step errors in the practical assessment process and the compensation factors for the straightness of the suture line in the practical assessment process, the number of intubation operation errors in the practical assessment process, and the number of dressing change step errors in the practical assessment process are established to obtain the compensation factors for the straightness of the suture line in the practical assessment process, the number of intubation operation errors in the practical assessment process, and the number of dressing change step errors in the practical assessment process corresponding to the current straightness of the suture line in the practical assessment process, the number of intubation operation errors in the practical assessment process, and the number of dressing change step errors in the practical assessment process.
[0034] The module for obtaining the completion evaluation value of the practical assessment is used to obtain the completion data set of the user's practical assessment process, and to obtain the completion evaluation value of the practical assessment based on the obtained completion data set of the user's practical assessment process.
[0035] Specifically, the user's practical assessment process completion data set includes the actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making reaction time of the practical assessment process, and the completion rate of the simulated case of the practical assessment process. The actual completion time of the practical assessment process refers to the time required for participants to complete the actual operation tasks, calculated in minutes or hours. The completion ratio of the practical assessment process within the specified time refers to the proportion of practical tasks completed within the specified time, expressed as a percentage. The decision-making reaction time of the practical assessment process refers to the time required for participants to make decisions in the simulation scenario, including thinking, analysis, judgment and other processes. The completion rate of the simulated case of the practical assessment process refers to the proportion of tasks or steps completed by participants in the simulated case, expressed as a percentage.
[0036] It should be noted that there is a direct relationship between the actual completion time and the percentage completed within the specified time. If a participant completes a high percentage of the task within the specified time, the actual completion time will be relatively short. If a low percentage is completed within the specified time, the actual completion time may be longer. This can mutually verify the participant's operational efficiency and time management ability during the practical assessment. Decision-making reaction time may affect the completion of the simulated case. If the participant has a shorter reaction time when making decisions, they may make correct decisions more quickly, thereby improving the completion of the simulated case. Excessive reaction time may lead to a decrease in the completion of the simulated case, reflecting the participant's performance and decision-making ability in the actual situation. The percentage completed within the specified time may be related to the completion of the simulated case. If a participant completes a high percentage of the task within the specified time, they may have more time to improve the simulated case and improve the completion rate. If the percentage is low, the completion rate may be affected, reflecting the participant's performance and task completion ability under time pressure. Use a timer or timing software during the practical assessment process to record the actual completion time and the percentage completed within the specified time. Use a decision-making reaction time monitoring device or software to record the participant's reaction time during the decision-making process. Use a simulated case completion assessment tool to evaluate the tasks or steps completed by the participant in the simulated case, which can be specialized software or an assessment form.
[0037] Furthermore, based on the obtained user practical assessment process completion data set, a comprehensive analysis is performed to obtain a practical assessment completion evaluation value. The specific analysis process is: based on the obtained user practical assessment process completion data set, a comprehensive analysis is performed to obtain a practical assessment completion evaluation value. The practical assessment completion evaluation value is used as an analysis basis for judging whether the user's practical assessment is qualified.
[0038] It should be noted that the use of the practical assessment completion evaluation value as the basis for judgment can improve the objectivity of the evaluation. The evaluation value obtained by comprehensive analysis of the data can reduce the impact of subjective factors on the assessment results, make the evaluation more objective, and achieve a comprehensive evaluation of the user's ability. Analysis of the practical assessment completion evaluation value can accurately discover the user's shortcomings in the practical process, provide targeted training and feedback, help users know their own shortcomings, and improve and improve their skills in a targeted manner, thereby improving practical performance. The practical assessment completion evaluation value can be used as a basis for decision-making to help professionals judge whether the user has reached a qualified level, help improve the rationality and fairness of decision-making, and make the assessment results more objective and credible.
[0039] Specifically, the practical assessment completion evaluation value is analyzed as follows: ; Where, This is the completion evaluation value of the practical assessment. The actual completion time of the practical assessment process. The completion ratio of the practical assessment process within the specified time is For the decision-making reaction time of the practical assessment process, To simulate the completion of cases in the practical assessment process, It is the compensation factor for the actual completion time of the practical assessment process. The compensation factor for the completion ratio within the specified time of the practical assessment process is set. The compensation factor for the decision reaction time in the practical assessment process is set. is the compensation factor for the completion of simulated cases in the practical assessment process, and e is a natural constant.
[0040] It should be explained that the above-mentioned practical assessment completion evaluation value is calculated through the actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making reaction time of the practical assessment process, and the completion ratio of the simulated case in the practical assessment process. The actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making reaction time of the practical assessment process, and the completion ratio of the simulated case in the practical assessment process are normalized. Evaluating the actual completion time and the completion ratio within the specified time can evaluate the operating efficiency of the operator in the practical assessment process, help to discover time waste and inefficient operations in the operation process, promote operators to improve operating efficiency and improve work efficiency. The practical assessment completion evaluation value can quantitatively evaluate the completion of the practical operation, compare the actual completion time and the completion ratio within the specified time, evaluate the operator's ability to complete the task within the specified time, and thus evaluate the quality of the practical operation. Evaluating the decision-making reaction time can help the evaluator understand the operator's reaction speed and accuracy when facing decisions, prompt the operator to improve the decision-making reaction speed, and improve work efficiency and quality. Evaluating the completion of the simulated case can help the evaluator understand the operator's completion status in the simulated case operation, discover the problems and deficiencies of the operator in the simulated case operation, and help them Improve operating skills, improve operating levels, and provide an objective basis for assessment results and training effects through the calculation of practical assessment completion evaluation values, help assessors understand the performance of operators in the practical assessment process, help improve the effectiveness of assessment and training, promote the development of operators and improve overall quality. The actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making reaction time of the practical assessment process, and the compensation factor for the completion of simulated cases in the practical assessment process are obtained from the database. The actual completion time of the practical assessment process and the completion ratio of the practical assessment process within the specified time are established based on historical data. , the decision-making reaction time of the practical assessment process, the completion rate of the simulated cases in the practical assessment process and the actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making reaction time of the practical assessment process, and the compensation factors for the completion rate of the simulated cases in the practical assessment process are mapped together to obtain the actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making reaction time of the practical assessment process, and the compensation factors for the completion rate of the simulated cases in the practical assessment process corresponding to the current actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making reaction time of the practical assessment process, and the compensation factors for the completion rate of the simulated cases in the practical assessment process.
[0041] The practical assessment pass judgment module judges whether the user has passed the practical assessment based on the obtained practical assessment technical accuracy evaluation value and practical assessment completion evaluation value.
[0042] Specifically, based on the obtained practical assessment technical accuracy evaluation value and practical assessment completion evaluation value, determine whether the user's practical assessment is qualified. The specific analysis process is: based on the obtained practical assessment technical accuracy evaluation value and practical assessment completion evaluation value, a comprehensive analysis is performed to obtain the user's practical assessment evaluation value, and the user's practical assessment evaluation value is used as the analysis basis for determining whether the user's practical assessment is qualified; the user's practical assessment evaluation value is compared with the user's practical assessment reference evaluation value stored in the database; if the user's practical assessment evaluation value is higher than or equal to the user's practical assessment reference evaluation value, then the user's practical assessment corresponding to the user's practical assessment evaluation value is qualified; if the user's practical assessment evaluation value is lower than the user's practical assessment reference evaluation value, then the user's practical assessment corresponding to the user's practical assessment evaluation value is unqualified.
[0043] It should be noted that the above comprehensive consideration of the evaluation values of technical accuracy and completion can provide a more comprehensive and in-depth evaluation of the user's practical ability. The technical accuracy evaluation value can reflect the user's operational skill level, while the practical completion evaluation value can reflect the efficiency and comprehensiveness of the user in completing the task within the specified time. The combination of the two can more accurately evaluate the user's practical performance. The user's practical assessment evaluation value obtained after comprehensive analysis of the technical accuracy evaluation value and the practical completion evaluation value can be used as the basis for judgment, which can improve the accuracy and objectivity of the evaluation. The comprehensive consideration of indicators in different aspects avoids the one-sidedness and subjectivity brought about by the evaluation of a single indicator, and compares the user's practical assessment evaluation value with the indicators stored in the database. By comparing the stored user practical assessment values with the reference assessment values, the user's practical ability can be compared with the standard, which helps managers understand whether the user's practical level meets the standard requirements, evaluate the effectiveness of the practical assessment, and formulate targeted training and improvement plans. By comparing the user's practical assessment evaluation values with the reference assessment values, a qualified or unqualified judgment can be made quickly, which improves the efficiency and fairness of decision-making, reduces the subjective interference of the supervisor in the assessment results, and thus more objectively evaluates the user's practical ability. By comparing the user's practical assessment evaluation values with the reference assessment values, it is possible to determine whether the user is qualified, and also to discover the gap in practical performance, which encourages the user to make continuous improvements and enhance practical ability.
[0044] It should be noted that the specific analysis process of the above user practical assessment evaluation value is as follows: ; Where, Provides practical assessment values for users. To evaluate the technical accuracy of the practical assessment, This is the evaluation value for the completion of the practical assessment.
[0045] It should be noted that the above-mentioned practical assessment technical accuracy evaluation value and practical assessment completion evaluation value are used to calculate the user's practical assessment evaluation value, which comprehensively evaluates the user's practical ability. The technical accuracy evaluation value reflects the user's operational skill level, while the practical completion evaluation value reflects the user's efficiency and comprehensiveness in completing the task within the specified time. The comprehensive calculation of the two can provide a more comprehensive understanding of the user's practical performance, avoid the one-sidedness and subjectivity that may be brought about by a single indicator evaluation, and improve the accuracy and objectivity of the evaluation results. Quantifying the evaluation results helps managers understand the user's practical ability performance more clearly and provide guidance for further training and development.
[0046] like Figure 2 As shown, this is an image of the user's practical assessment evaluation value changing with the practical assessment technical accuracy evaluation value, where the x-axis represents the practical assessment technical accuracy evaluation value and the y-axis represents the user's practical assessment evaluation value. This can help intuitively understand how the practical assessment technical accuracy evaluation value affects the user's practical assessment evaluation value. The larger the practical assessment technical accuracy evaluation value, the larger the user's practical assessment evaluation value, indicating that the user's practical assessment status is better. As the practical assessment technical accuracy evaluation value increases, the influence of the practical assessment technical accuracy evaluation value on the user's practical assessment evaluation value gradually weakens. The practical assessment completion evaluation value is set to 5 and remains unchanged, and only the size of the practical assessment technical accuracy evaluation value is changed. Example values of the practical assessment technical accuracy evaluation value are as follows: Table 1: Example values of practical assessment technical accuracy evaluation values in user practical assessment evaluation values
[0047] It should be noted that the greater the practical assessment completion evaluation value, the greater the user's practical assessment evaluation value, indicating that the user's practical assessment status is better. As the practical assessment completion evaluation value increases, the influence of the practical assessment completion evaluation value on the user's practical assessment evaluation value gradually weakens. The practical assessment technical accuracy evaluation value is set to 2 and remains unchanged, only the size of the practical assessment completion evaluation value is changed. The example values of the practical assessment completion evaluation value are as follows: Table 2: Example values of the practical assessment completion evaluation value in the user practical assessment evaluation value
[0048] It should be noted that the above-mentioned practical assessment technical accuracy evaluation value and practical assessment completion evaluation value are used to judge whether the user's practical assessment is qualified, more objectively evaluate the level of the user's practical assessment, avoid subjective bias and one-sided emphasis, and provide a more comprehensive and integrated evaluation standard. The technical accuracy evaluation value and completion evaluation value are the results based on data and indicators, with high objectivity and authenticity. According to the evaluation results of technical accuracy and completion, the deficiencies and problems of the user in the practical assessment can be clarified, which provides a more targeted direction for guidance and improvement, and can also establish objective evaluation standards, and help to achieve standardization and fairness of the assessment, ensuring that each user is treated fairly during the evaluation process.
[0049] It should be noted that the above-mentioned intelligent evaluation system for practical assessment based on digitalization can objectively judge whether the video of the user's practical assessment process has been uploaded successfully through the video upload judgment module. With the help of the video upload judgment module, the system can provide instant feedback on the upload status of the user's practical assessment process video, and obtain the technical accuracy evaluation value through comprehensive analysis, which is helpful to evaluate the level of practical technology. The completion evaluation value acquisition module evaluates the completion of the practical assessment through comprehensive analysis of data, providing students or medical staff with an opportunity to fully understand their own practical level. The practical assessment pass judgment module judges whether the user's practical assessment is qualified based on a comprehensive analysis of the technical accuracy evaluation value and the completion evaluation value, which provides a basis for the objective standard of the assessment results and promotes the standardization of the assessment.
[0050] The above content is merely an example and explanation of the structure of the present invention. Those skilled in the art may make various modifications or additions to the described specific embodiments or replace them in a similar manner. As long as they do not deviate from the structure of the invention or exceed the scope defined by the claims, they should all fall within the scope of protection of the present invention.
Claims
1. Based on the digitalized practical assessment intelligent evaluation system, it is characterized by: It includes a module for judging the video upload of the practical assessment process, a module for obtaining the technical accuracy evaluation value of the practical assessment, a module for obtaining the completion evaluation value of the practical assessment, and a module for judging the pass of the practical assessment, among which: The practical assessment process video upload judgment module obtains a user's practical assessment process video upload data set, and judges whether the user's practical assessment process video is successfully uploaded based on the obtained user's practical assessment process video upload data set; The practical assessment technical accuracy evaluation value acquisition module obtains a user practical assessment process technical accuracy dataset from the successfully uploaded user practical assessment process video, and obtains a practical assessment technical accuracy evaluation value through comprehensive analysis based on the obtained user practical assessment process technical accuracy dataset; The practical assessment completion evaluation value acquisition module acquires a user practical assessment process completion data set, and obtains a practical assessment completion evaluation value based on a comprehensive analysis of the acquired user practical assessment process completion data set; The practical operation assessment pass judgment module judges whether the user's practical operation assessment is passed based on the obtained practical operation assessment technical accuracy evaluation value and practical operation assessment completion evaluation value.
2. The digital-based practical assessment intelligent evaluation system according to claim 1 is characterized by: The user's practical assessment process video upload data set specifically includes the practical assessment process video upload network bandwidth, the practical assessment process video upload packet loss rate, and the practical assessment process video upload transmission total time.
3. The digital-based intelligent evaluation system for practical assessment according to claim 2 is characterized by: Based on the obtained user practical operation assessment process video upload data set, it is determined whether the user practical operation assessment process video is uploaded successfully. The specific analysis process is as follows: Based on the obtained user practical assessment process video upload dataset, a comprehensive analysis is performed to obtain a video upload evaluation value, which is used as an analysis basis for judging whether the user practical assessment process video has been successfully uploaded; Comparing the video upload evaluation value with the video upload reference evaluation value stored in the database; If the video upload evaluation value is higher than or equal to the video upload reference evaluation value, the user's practical assessment process video corresponding to the video upload evaluation value is successfully uploaded; If the video upload evaluation value is lower than the video upload reference evaluation value, the user practical assessment process video corresponding to the video upload evaluation value has not been uploaded successfully and needs to be uploaded again.
4. The digital-based practical assessment intelligent evaluation system according to claim 1 is characterized by: The technical accuracy data set of the user's practical operation assessment process specifically includes the straightness of the suture line during the practical operation assessment process, the number of intubation operation errors during the practical operation assessment process, and the number of dressing change step errors during the practical operation assessment process.
5. The digital-based practical assessment intelligent evaluation system according to claim 4 is characterized by: The obtained data set of technical accuracy of the user's practical operation assessment process is comprehensively analyzed to obtain the practical operation assessment technical accuracy evaluation value. The specific analysis process is as follows: Based on the obtained technical accuracy data set of the user's practical assessment process, a comprehensive analysis is performed to obtain the practical assessment technical accuracy evaluation value, which is used as the analysis basis for judging whether the user's practical assessment is qualified.
6. The digital-based practical assessment intelligent evaluation system according to claim 5 is characterized by: The specific analysis process of the practical assessment technical accuracy evaluation value is as follows: ； Where, To evaluate the technical accuracy of the practical assessment, To check the straightness of the suture line during the practical assessment process, The number of intubation operation errors during the practical assessment process, The number of errors in dressing change steps during the practical assessment process, The compensation factor for the straightness of the suture line in the practical assessment process is set. The compensation factor for the number of intubation operation errors in the practical assessment process is set. It is the compensation factor for the number of errors in the dressing change steps during the practical assessment process.
7. The digital-based practical assessment intelligent evaluation system according to claim 1 is characterized by: The user's practical assessment process completion data set specifically includes the actual completion time of the practical assessment process, the completion ratio of the practical assessment process within the specified time, the decision-making response time of the practical assessment process, and the completion rate of the simulated cases in the practical assessment process.
8. The digital-based intelligent evaluation system for practical assessment according to claim 7 is characterized by: The obtained user practical assessment process completion data set is comprehensively analyzed to obtain the practical assessment completion evaluation value. The specific analysis process is as follows: Based on the obtained user practical assessment process completion data set, a comprehensive analysis is performed to obtain a practical assessment completion evaluation value, which is used as an analysis basis for judging whether the user's practical assessment is qualified.
9. The digital-based practical assessment intelligent evaluation system according to claim 8 is characterized by: The specific analysis process of the practical assessment completion evaluation value is as follows: ； Where, This is the completion evaluation value of the practical assessment. The actual completion time of the practical assessment process. The completion ratio of the practical assessment process within the specified time is For the decision-making reaction time of the practical assessment process, To simulate the completion of cases in the practical assessment process, It is the compensation factor for the actual completion time of the practical assessment process. The compensation factor for the completion ratio within the specified time of the practical assessment process is set. The compensation factor for the decision reaction time in the practical assessment process is set. is the compensation factor for the completion of simulated cases in the practical assessment process, and e is a natural constant.
10. The digital-based practical assessment intelligent evaluation system according to claim 1 is characterized by: The obtained practical assessment technical accuracy evaluation value and practical assessment completion evaluation value are used to determine whether the user's practical assessment is qualified. The specific analysis process is as follows: Based on the obtained practical assessment technical accuracy evaluation value and practical assessment completion evaluation value, a comprehensive analysis is performed to obtain the user's practical assessment evaluation value, which serves as the analysis basis for determining whether the user's practical assessment is qualified; Compare the user's practical operation assessment evaluation value with the user's practical operation assessment reference evaluation value stored in the database; If the user's practical assessment evaluation value is higher than or equal to the user's practical assessment reference evaluation value, the user's practical assessment corresponding to the user's practical assessment evaluation value is passed; If the user's practical operation assessment evaluation value is lower than the user's practical operation assessment reference evaluation value, the user's practical operation assessment corresponding to the user's practical operation assessment evaluation value fails.