A medical skills examination system

Through the automated scoring and manual review mechanism of the medical skills examination system, the problems of waste of resources and evaluation deviations in medical skills examinations are solved, the accuracy and fairness of the scoring are improved, and the effectiveness and accuracy of the medical skills examinations are ensured.

CN112418113BActive Publication Date: 2024-12-13THE FIRST AFFILIATED HOSPITAL OF ARMY MEDICAL UNIV
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202011353462.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-26
Publication Date
2024-12-13
Estimated Expiration
2040-11-26

AI Technical Summary

Technical Problem

The existing medical skills examination system cannot effectively reduce the waste of resources of medical personnel, and there is also deviation in automatic evaluation results, especially when evaluating medical practice details, especially in wound surface cleaning, suture tension, desktop neatness, etc., video analysis Unable to evaluate accurately.

Method used

Design a medical skills examination system, receive videos uploaded by the examination terminal through the server, divide them into practical branch videos of each practical project, and send the videos of the review project to the review terminal for manual review and scoring, combining machine evaluation and scoring The project review score generates the total score, and the abnormal score is judged by the difference between the historical score and the current score, and the score is updated and reminded.

Benefits of technology

It realizes automated scoring of medical skills exams, reduces resource waste and subjective factors of invigilators, improves the accuracy and fairness of scores, ensures the accuracy of the overall score, and reduces errors through reminders and supplementary scoring mechanisms. Evaluate probability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112418113B_ABST
    Figure CN112418113B_ABST
Patent Text Reader

Abstract

The present invention relates to the technical field of examination systems, specifically a medical skill examination system, including a server, the server is used to receive examination videos uploaded by examination terminals, the server is also used to divide the examination videos to obtain practical operation section videos of each practical operation project, screen out the practical operation section videos that need to be reviewed according to preset review items and send them to the review terminal, obtain the project review score fed back by the review terminal according to the practical operation section videos; generate a machine test score according to the screened practical operation section videos and the preset standard information of each practical operation project, and generate a total score according to the machine test score and the project review score. The use of this solution can solve the problem that the existing technology cannot realize the automatic evaluation of medical practical examinations while reducing the waste of medical personnel resources, and improve the accuracy of the evaluation results.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of examination systems, and in particular to a medical skills examination system. Background Art

[0002] Understanding the skills of medical students or doctors is a kind of responsibility to patients, so both schools and hospitals conduct skill assessments regularly. During the skill assessment process, especially the medical practical examination, a proctor is required to supervise and evaluate one-on-one. However, the gap between the number of medical students and the number of proctors is huge, which leads to the need to spend a lot of human resources and time resources to complete a skill assessment. At the same time, because medical students and doctors need to master a lot of medical skills, the number of medical skills they need to perform skill assessments is also very large, so the proctor is required to have very high medical literacy and medical ability. Therefore, the skill assessment will also occupy a large number of excellent medical personnel, resulting in a waste of human resources and time resources of medical personnel.

[0003] Therefore, existing technologies address the issue of wasted medical personnel resources by developing an examination system that captures videos of medical students' skill assessments. By comparing the students' test performance in these videos with standard procedures, the system automatically scores the students, effectively improving resource utilization among medical personnel. However, because practical medical examinations involve numerous tasks, some of which require detailed assessment of practical procedures, such as wound surface cleanliness, suture tension, and desk cleanliness, video analysis cannot accurately assess these details, resulting in a deviation between the final practical results and the students' actual conditions. Summary of the Invention

[0004] The present invention aims to provide a medical skills examination system to solve the problem in the prior art that it is impossible to achieve automatic evaluation of medical practical examinations while reducing the waste of medical personnel resources and to improve the accuracy of evaluation results.

[0005] The present invention provides the following basic scheme:

[0006] A medical skills examination system includes a server, which is used to receive examination videos uploaded by examination terminals. The server is also used to divide the examination videos to obtain practical operation section videos of each practical operation project, screen out the practical operation section videos that need to be reviewed according to preset review projects and send them to the review terminal, obtain the project review scores fed back by the review terminal based on the practical operation section videos; generate machine-tested scores based on the screened practical operation section videos and preset standard information of each practical operation project, and generate an overall score based on the machine-tested scores and the project review scores.

[0007] The basic solution has the following beneficial effects: Exam videos are uploaded to the exam terminal to automatically score each of the medical students' practical projects. Each medical skills exam includes multiple practical projects, so the exam videos are divided into practical segment videos, each corresponding to a practical project. By dividing the videos by practical project, it is easier to provide targeted scoring for each practical project and easier for medical students and teachers to fully understand the situation of each practical project. Medical students can subsequently strengthen weak projects, and teachers can adjust the focus of their lectures during the practical project training process, effectively improving the teaching quality of teachers and the learning outcomes of students.

[0008] The review items are practical items that have details that cannot be automatically judged, such as the cleanliness of the wound surface, whether there is residual tissue on the wound surface, etc. Since the camera equipment used to collect the test video has limited shooting angles and clarity, it is impossible to analyze the details of the operation. For example, the cleanliness of the desktop, the cleanliness of the utensils, etc., due to the presence of subjective evaluation content, the system cannot automatically judge. The practical section video corresponding to the review item is sent to the review terminal to obtain the corresponding project review score. First, through review, the accuracy of the review item evaluation is improved, thereby improving the accuracy of the overall test score; second, the review item is used as a sample, and the corresponding practical section video is used to understand the medical students' proficiency in practical operations, as well as to analyze the importance of different medical students to each link of practical operations, so as to carry out targeted teaching and improve teaching quality.

[0009] By collecting exam videos for automatic scoring, the requirements for both the skills and number of invigilators are reduced, effectively reducing the waste of medical personnel resources. Automatic scoring also reduces the influence of invigilators' subjective factors, and through review, improves the accuracy of exam scoring, thereby improving the accuracy of the final overall score and effectively reflecting the medical students' mastery of medical skills.

[0010] Furthermore, the server is also used to judge the machine test score and the project review score as the current score. When the difference between the score of any practical project and the rest of the practical projects is greater than a preset score threshold, the historical score of the corresponding practical project is called, and the judgment is made based on the historical score and the current score. When the difference between the historical score and the current score is greater than the preset score difference threshold, a score abnormality signal is generated. Beneficial effect: The difference in scores between practical projects is calculated, and the difference is used to judge whether the score of the practical project has been incorrectly evaluated, thereby reducing the probability of incorrect evaluation. The difference is used for judgment. The main reason is that there are commonalities between practical projects. Generally, the score gap between practical projects is not large. Therefore, when the difference is greater than the preset score threshold, it means that there may be an abnormality in the score of the practical project. At this time, the historical score of the medical student for the practical project is combined to make a judgment. When the difference between the historical score and the current score is too large, the probability of the corresponding current score being abnormal will also increase. In order to ensure the accuracy of the exam, the abnormal score signal is used to reflect and remind the situation.

[0011] Furthermore, when a score abnormality signal is generated, the server is further configured to retrieve the corresponding practical section video of the practical project and send it to the review terminal, obtain the score review information provided by the review terminal based on the practical section video, and update the overall evaluation score based on the score review information. Beneficial Effect: When the score of any practical project is abnormal, the score of the corresponding practical project is updated through review, thereby ensuring the accuracy of the overall evaluation score.

[0012] Furthermore, the server is also used to call the current operation item from a preset operation list according to the test video in real time, match the operation item and the test video, and generate a first occlusion signal when there is an unmatched item. Beneficial effect: There are corresponding processes and standards in the operation process of the practical project. For example, the debridement operation before suturing the wound has corresponding procedures and standards such as cleaning the skin, cleaning the wound, cleaning the skin, cleaning the tissue, cleaning special tissues, and cleaning again. The corresponding operation items are also different. For example, when cleaning the wound, the cleaning operation items include wounds, cleaning fluids, etc.; the operation items for removing foreign objects or blood clots include wounds, tweezers, etc.; the operation items for absorbing small dirt include wounds, cotton balls, etc. When there is an unmatched item during the corresponding operation, a first occlusion signal is generated. For example, if no wound appears during cleaning, it may be because the camera equipment used to collect the test video has a limited angle, causing the medical student's hand to block the wound, thereby generating a first occlusion signal for reminder.

[0013] Furthermore, the server is configured to obtain the corresponding examination terminal code when generating the first occlusion signal and transmit the first occlusion signal to the examination terminal based on the examination terminal code. Upon receiving the first occlusion signal, the examination terminal is configured to display the first occlusion signal. This advantageous effect is achieved by providing a unique examination terminal code to the examination terminal of the corresponding medical student. This first occlusion signal serves as a reminder to the medical student, preventing subsequent medical students from continuously obscuring operational details, thereby ensuring automatic grading.

[0014] Furthermore, the server is also used to start timing when the first occlusion signal is generated. During the timing process, if there is no unmatched item between the operation item and the test video, the timing is stopped and reset. Beneficial effect: The medical student's occlusion behavior is timed. When the medical student cancels the occlusion behavior in time after receiving the first occlusion signal, the timing is stopped and reset. The timing duration reflects the duration of the medical student's continuous occlusion behavior, so as to determine whether to perform other operations. For example, if the medical student continues to occlude for a long time after receiving the reminder, it means that the medical student is deliberately occluding, and corresponding disciplinary actions are taken to ensure the normal progress of the examination.

[0015] The system further includes an invigilator terminal. The server is further configured to generate an abnormal occlusion signal when the timer reaches a preset time, obtain the corresponding examination terminal code, and send the abnormal occlusion signal and the examination terminal code to the invigilator terminal. The invigilator terminal is configured to generate backup collection information based on the examination terminal code and a preset information template when receiving the abnormal occlusion signal, and display the backup collection information. The invigilator terminal is further configured to collect an invigilation video of the examinee corresponding to the examination terminal code after displaying the backup collection information, and upload the invigilation video to the server. The server is further configured to receive surveillance video and store the surveillance video as backup information. Beneficial effect: When a medical student obstructs the examination for a long time, the invigilator is reminded, thereby ensuring the normal progress of the examination. The invigilator terminal is used by the invigilator. When the invigilator terminal receives the abnormal occlusion signal, it generates and displays backup collection information to remind the invigilator. The invigilator terminal collects the practical process of the medical student with abnormal occlusion, thereby ensuring that the medical student's practical process can be collected. In the subsequent automatic grading, the surveillance video is used for supplementary grading to ensure the fairness of each medical student's overall score. At the same time, the data is collected through the invigilator's invigilation terminal, which gives the medical student a kind of psychological pressure. The monitoring video reflects the medical student's ability to withstand pressure, and further realizes the comprehensive evaluation of the medical student.

[0016] Furthermore, the standard information includes standard practical operations and standard operation times for each practical project. The server includes an operation evaluation module, and an operation comparison module is used to compare the filtered practical operation segment videos with the standard practical operations and standard operation times to generate an operation evaluation for each practical project. Beneficial Effect: By comparing with standard practical operations and standard operation times, for example, requiring blood collection to be completed within 5 minutes, it is possible to evaluate the standards and time of medical students' operations.

[0017] Furthermore, the standard information includes the standard procedures for each practical project. The server also includes a process evaluation module, which compares the practical video with the standard procedures to generate a process evaluation for the practical exam. Beneficial Effect: By comparing with the standard procedures for practical operations, such as cleaning, disinfection, cleaning, and re-disinfection, medical students can be evaluated for their procedures during the operation.

[0018] Furthermore, the standard information also includes the standardized practice results for each practical project. The server also includes a results evaluation module, which is used to compare the practical video segments with the standardized practice results to generate a result evaluation for each practical project. Beneficial Effect: By comparing the results with the standardized practice results, such as the suture effect of a wound, the results of the medical students' post-procedure evaluation can be evaluated. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is a logic block diagram of a first embodiment of a medical skills examination system according to the present invention. DETAILED DESCRIPTION

[0020] The following is further described in detail through specific implementation methods:

[0021] Example 1

[0022] A medical skills examination system, as shown in the attached Figure 1 As shown, it includes a server, an examination terminal, and a review terminal. The server includes a video splitting module, a database, a video extraction module, an operation evaluation module, a process evaluation module, a result evaluation module, and an overall evaluation module. The database pre-stores standard information, which includes standard practical operations, standard operation time, standard operation process, and standard practical results for each practical project. Standard practical operations refer to standard operations at different practical stages in a practical project. Standard operation time refers to the maximum time corresponding to each standard practical operation. Standard operation process refers to the operation process consisting of standard practical operations. Standard practical results refer to the final results after the operations.

[0023] The exam terminal is used to capture and upload videos of examinees taking practical exams to a server. Examinees are individuals taking the practical exam, and can be medical students or hospital staff conducting assessments. Each exam terminal corresponds to one examinee. Multiple exam terminals can simultaneously capture and upload videos of multiple examinees.

[0024] The video splitting module is used to receive the test video uploaded by the test terminal, and divide the test video to obtain the practical operation section video of each practical project. Specifically, the test includes multiple practical projects. At the end of each practical project, there is a corresponding identification action or identifier, such as cleaning the desktop or a record sheet for filling in experimental records. The test video is split according to the identification action or identifier. In this embodiment, a marker is used. When the examinee completes a practical project, the desktop is cleaned and the marker is placed on the operating table. The video splitting module is used to split the test video according to the marker to obtain the practical operation section video of different practical projects.

[0025] The database is used to store the practical operation videos according to the practical project. The practical project is stored as an index to facilitate the search and selection of the corresponding practical operation videos.

[0026] The video extraction module is pre-configured with review items. Review items are practical operations that the system cannot automatically score and require review. The video extraction module is used to filter the practical operation segment videos that require review from the database based on the review items and send the filtered practical operation segment videos to the review terminal. The video extraction module is also used to extract the practical operation segment videos remaining after screening from the database, that is, the practical operation segment videos corresponding to practical operations that do not require review, and send these practical operation segment videos to the operation evaluation module, process evaluation module, and result evaluation module.

[0027] The review terminal is used by graders. It receives and plays videos of the practical sections of the review project for graders to review. It also obtains graders' project review scores based on the practical sections and sends them to the server. The review terminal allows for scoring of practical projects that cannot be automatically graded, improving scoring accuracy.

[0028] The operation evaluation module is used to receive the practical operation segment video, retrieve the standard practical operation and standard operation time from the database according to the practical operation project corresponding to the practical operation segment video, compare the practical operation segment video with the standard practical operation and standard operation time, generate the operation evaluation of each practical operation project, and send the operation evaluation to the overall evaluation module. Specifically, based on video recognition, the operation in the practical operation segment video is identified, and the duration of each operation is recorded. Each standard practical operation is assigned a score, and each standard operation time is assigned a score. The operation and corresponding duration obtained based on video recognition are compared with the standard practical operation and standard operation time. When the operation corresponding to the practical operation segment video matches the standard practical operation, the corresponding score of the standard practical operation is obtained. If it is completed within the optimal time, the corresponding standard operation time score is full. After exceeding the optimal time, the longer the timeout, the lower the corresponding standard operation time score. The scores obtained by summarizing the standard practical operation and standard operation time are used to form the operation evaluation of the corresponding practical project, and the operation evaluation of each practical project is generated in sequence.

[0029] The process evaluation module is used to receive the practical section video, call the practical standard process from the database based on the practical project corresponding to the practical section video, compare the practical section video with the practical standard process, generate a process evaluation for the practical test, and send the process evaluation to the overall evaluation module. Specifically, based on video recognition, the operations in the practical section video are identified and the operation sequence is recorded. Each process in the practical standard process is assigned a score. The operation sequence obtained based on video recognition is matched with the practical standard process, and the matching items are recorded. The corresponding scores of the matching items are calculated to form the process evaluation of the corresponding practical project, and the process evaluation of each practical project is generated in sequence.

[0030] The result evaluation module is used to receive the practical segment videos, retrieve the standard practical results from the database based on the practical project corresponding to the practical segment videos, compare the practical segment videos with the standard practical results, generate result evaluations for each practical project, and send these result evaluations to the overall evaluation module. Specifically, the standard practical results include multiple standards, each with a corresponding score. The practical segment videos are identified based on the standard practical results. If the practical segment videos meet the corresponding standards, the corresponding scores are obtained. The scores corresponding to the multiple standards are calculated as the result evaluation, and the result evaluations for each practical project are generated in sequence.

[0031] The overall evaluation module receives operational evaluations, process evaluations, and outcome evaluations, and generates a machine-based evaluation score based on these scores. The overall evaluation module also receives project review scores and generates an overall evaluation score based on these scores.

[0032] This solution can automatically collect and evaluate medical examinees' practical skills during practical medical exams, effectively reducing the human and time resources required for one-on-one proctoring and improving the utilization of medical human resources. Automatic scoring also reduces the influence of proctors' subjective factors, while review improves the accuracy of exam scores, thereby improving the accuracy of the final overall score and effectively reflecting the examinee's mastery of medical skills.

[0033] Example 2

[0034] The difference between this embodiment and the first embodiment is that: since the examination terminal is affected by the shooting angle and clarity, the scoring of the practical items may be misjudged. Therefore, in order to ensure the accuracy of the examinee's overall score, the scoring of the practical items is analyzed, and in the case of abnormal scoring, the score is updated through review.

[0035] In this embodiment, the server further includes a project abnormality judgment module, a score abnormality judgment module and a score updating module.

[0036] The overall evaluation module is also used to generate project scores for each practical project based on operation evaluation, process evaluation and result evaluation. The machine-tested scores are generated by statistical project scores.

[0037] The project abnormality judgment module is preset with a scoring threshold, which is used to judge whether the difference in scores between the practical projects is too large, thereby judging whether the score of the practical project is abnormal. The project abnormality judgment module is used to judge the machine test score and the project review score as the current score. When the difference in score between any practical project and the rest of the practical projects is greater than the scoring threshold, the corresponding practical project is recorded as an abnormal project, and the abnormal project is sent to the abnormal score judgment module. In other embodiments, the practical projects are classified according to the association between the practical projects to obtain a project classification table. The practical projects under the same category have commonalities, that is, the score difference of the practical projects under the same category is small. The project abnormality judgment module is used to classify the practical projects according to the project classification table, judge the score of the practical projects under the same category, and when the difference in score between any practical project and the rest of the practical projects under the same category is greater than the preset scoring threshold, the corresponding practical project is recorded as an abnormal project, and the abnormal project is sent to the abnormal score judgment module.

[0038] The score abnormality judgment module is preset with a score difference threshold. The score difference threshold is used to determine whether the difference between the current score and the historical score of the same practical project of the same examinee is too large, thereby determining whether the score of the practical project is abnormal. The score abnormality judgment module is used to receive abnormal projects and call the examinee's historical scores based on the abnormal projects. The historical scores include the scores of the same practical project in previous periods, as well as the scores of the same practical project during practice. The score abnormality judgment module is also used to make judgments based on the historical scores and the current scores. When the difference between the historical scores and the current scores is greater than the score difference threshold, a score abnormality signal is generated and sent to the video extraction module.

[0039] The video extraction module is also used to call the practical section video of the corresponding practical project and send it to the review terminal when receiving an abnormal score signal, that is, call the practical section video of the abnormal project and send it to the review terminal, and send the practical section video to the review terminal.

[0040] The review terminal is also used to receive the practical section videos corresponding to the abnormal items and play them for review by the graders. The review terminal is also used to obtain the grader's feedback based on the practical section videos and send this feedback to the server. The review terminal allows for the scoring of abnormally scored practical items, improving scoring accuracy.

[0041] The score update module is used to receive score review information and update the overall score based on the score review information. Specifically, the score review information includes the scores of the practical sub-videos corresponding to the abnormal items reported by the scorers. Based on the score review information, the project scores corresponding to the abnormal items are updated. The updated project scores are used to update the computer-based test scores, and the updated computer-based test scores are used to update the overall score.

[0042] Example 3

[0043] The difference between this embodiment and embodiment 1 is that: since the examination terminal is affected by the shooting angle, the test person may be obstructed in the collected examination video. Therefore, a reminder is given of the obstruction during the examination process to ensure that subsequent scoring can be automatically performed based on the examination video.

[0044] In this embodiment, the database also pre-stores an operation list, which records the operation items of each process under each operation item. A monitoring terminal is also included, and the server also includes an occlusion judgment module and an occlusion timing module.

[0045] The examination terminal has a unique examination terminal code, and the examination terminal is also used to upload the examination terminal code while uploading the examination video.

[0046] The occlusion judgment module is used to receive the test video in real time, call the current corresponding operation item from the operation list based on the test video, match the operation item with the test video, and generate a first occlusion signal when there is an unmatched item, obtain the corresponding test terminal code, and send the first occlusion signal to the test terminal and the occlusion timing module according to the test terminal code. For example, the debridement operation before suturing a wound includes cleaning the skin, cleaning the wound, cleaning the skin, cleaning the tissue, cleaning special tissue, and cleaning again. The corresponding operation items are also different. For example, when cleaning a wound, the cleaning operation items include wound and cleaning fluid; the operation items for removing foreign matter or blood clots include wound and tweezers; the operation items for absorbing small dirt include wound and cotton balls. When there is an unmatched item in the corresponding operation, the first occlusion signal is generated. For example, if no wound appears during cleaning, the first occlusion signal is generated as a reminder.

[0047] The test terminal is further configured to display the first occlusion signal when receiving the first occlusion signal. Since the test terminal is used by the examinee, the display of the first occlusion signal can remind the examinee to avoid occlusion.

[0048] The occlusion judgment module is also used to generate an occlusion cancellation signal when there are no unmatched items between the operation item and the test video. Specifically, based on video recognition, when the unmatched items are matched, that is, when the examinee is no longer occluding, an occlusion cancellation signal is generated and sent to the occlusion timing module.

[0049] The occlusion timing module has a preset duration, which is used to determine whether the examinee's occlusion behavior has persisted for a long time. The occlusion timing module is used to receive the first occlusion signal and start timing upon receipt. During the timing process, if the occlusion cancellation signal is received, the timing is stopped and reset. When the timing reaches the preset duration, an abnormal occlusion signal is generated and sent to the invigilator terminal along with the test terminal code.

[0050] The monitoring terminal is used by invigilators and comes with a pre-set information template, which is used to generate and display backup information. Upon receiving an abnormal occlusion signal, the monitoring terminal generates and displays backup information based on the exam terminal code and the information template. After displaying the backup information, the invigilator terminal is also used to capture invigilation video of the examinee corresponding to the exam terminal code and upload it to the server. The database also receives and stores the surveillance video as backup information.

[0051] In other embodiments, the surveillance video is used as the test video to obtain an overall score. In another embodiment, the test video and the surveillance video are analyzed to generate the test taker's stress tolerance. The test taker's stress tolerance is analyzed by comparing the test video and the surveillance video for the same practical operation.

[0052] The invigilator's terminal captures the practical process of any examinee who is obscured, ensuring that the examinee's practical process can be captured. During the subsequent automatic scoring process, the surveillance video is used to supplement the scoring, ensuring fairness in the overall score for each examinee. Furthermore, the invigilator's terminal can be used to capture psychological pressure on the examinee, and the surveillance video can be used to reflect the examinee's ability to withstand pressure, further enabling a comprehensive evaluation of the examinee.

[0053] The above is only an embodiment of the present invention. Common knowledge such as the known specific structures and characteristics in the scheme is not described in detail here. Ordinary technicians in the field are aware of all common technical knowledge in the technical field of the invention before the application date or priority date, can obtain all existing technologies in the field, and have the ability to apply conventional experimental means before that date. Ordinary technicians in the field can improve and implement this scheme in combination with their own abilities under the inspiration given by this application. Some typical known structures or known methods should not become obstacles for ordinary technicians in the field to implement this application. It should be pointed out that for those skilled in the art, without departing from the structure of the present invention, several variations and improvements can be made, which should also be regarded as the scope of protection of the present invention. These will not affect the effect of the implementation of the present invention and the practicality of the patent. The scope of protection required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.

Claims

1. A medical skills examination system, comprising a server, the server being used to receive an examination video uploaded by an examination terminal, characterized in that: The server is also used to divide the test video into practical sections to obtain practical sections videos of each practical project, screen out practical sections videos that need to be reviewed according to preset review projects and send them to the review terminal, and obtain the project review scores fed back by the review terminal based on the practical sections videos; generate a machine test score based on the screened practical sections videos and preset standard information of each practical project, and generate a total score based on the machine test score and the project review score; The server is also used to judge the current score by using the computer test score and the project review score. When the difference between the score of any practical project and the other practical projects is greater than a preset score threshold, the historical score of the corresponding practical project is called, and the judgment is made based on the historical score and the current score. When the difference between the historical score and the current score is greater than the preset score difference threshold, a score abnormality signal is generated; The server is also used to, when generating an abnormal score signal, call the practical operation section video of the corresponding practical operation project and send it to the review terminal, obtain the score review information fed back by the review terminal based on the practical operation section video, and update the overall evaluation score based on the score review information; The server is also used to call the current operation item from the preset operation list in real time according to the test video, match the operation item and the test video, and generate a first occlusion signal when there is an unmatched item; The server is also used to obtain the corresponding test terminal code when generating the first occlusion signal, and send the first occlusion signal to the test terminal according to the test terminal code; the test terminal is used to display the first occlusion signal when receiving the first occlusion signal; The server is also used to start timing when the first occlusion signal is generated. During the timing process, when there are no unmatched items between the operation item and the test video, the timing is stopped and reset; It also includes an invigilation terminal, and the server is further used to generate an abnormal occlusion signal when the timing reaches a preset time, obtain the corresponding examination terminal code, and send the abnormal occlusion signal and the examination terminal code to the invigilation terminal; When the invigilation terminal receives an abnormal blocking signal, it generates backup collection information according to the test terminal code and a preset information template, and displays the backup collection information; the server is also used to store the monitoring video as backup information; The invigilation terminal collects the invigilation video of the examinee corresponding to the examination terminal code, and uploads the invigilation video to the server; The server is also used to receive surveillance video; The server is also used to generate the examinee's stress resistance ability based on the test video and the surveillance video, and analyze the examinee's stress resistance ability by comparing the operating posture and fluency under the same practical project in the test video and the surveillance video.

2. A medical skills examination system according to claim 1, characterized in that: The standard information includes standard practical operations and standard operation time of each practical project. The server includes an operation evaluation module. The operation evaluation module is used to compare the screened practical division video with the standard practical operations and standard operation time to generate an operation evaluation of each practical project.

3. A medical skills examination system according to claim 2, characterized in that: The standard information also includes the standard practical process of each practical project. The server also includes a process evaluation module. The process evaluation module is used to compare the practical section video with the practical standard process to generate a process evaluation for the practical examination.

4. A medical skills examination system according to claim 3, characterized in that: The standard information also includes standard practical results of each practical project. The server also includes a result evaluation module, which is used to compare the practical section video with the standard practical results to generate a result evaluation of each practical project.

Citation Information

Patent Citations

  • Video shielding detection method and video shielding detection device

    CN104038666A

  • General practitioner training examine system and method

    CN105225562A

  • Intelligent precise traditional Chinese medicine skill training assessment system

    CN107369352A

  • Special operation personnel actual operation examination control method and system

    CN108924082A

  • Network online test system and method used for practical operation problem tests

    CN109961665A