Operation safety check and process supervision system and method

Abstract

The invention provides an operation safety check and process supervision system. The system comprises a sign-in unit, a verification unit and an identity recognition unit. The sign-in unit obtains verification starting time according to the sign-in time of the surgical personnel. And the verification unit plays the checking audio according to the verification starting time and the verification operation information. The verification unit obtains verification response information corresponding to the verification audio. The identity recognition unit collects face videos, voiceprint information and identity certificates of current three-party confirmation persons. And obtaining the identity information of the current three-party confirmation person, and obtaining a verification result. According to the invention, the problems of checking operation and signature after disinfection of the hands of the surgeon are solved. And the coincidence rate and the execution rate of three-party verification are improved. The process record is complete and traceable, the application is simple and convenient, and delayed arrival is prevented. Meanwhile, the invention further provides a safety supervision and tracing management method for the operation process.

Description

Technical Field

[0001] The present invention relates to the field of information processing technology and specifically to a surgical safety verification and process supervision system and method. Background Art

[0002] In order to ensure the safety of surgery, surgical personnel need to implement a series of surgical safety management requirements and specifications, mainly including: ① Personnel behavior management requirements: surgical personnel enter the designated operating room according to the surgical arrangement, surgical personnel should be present throughout the operation, and unauthorized personnel cannot enter and leave the operating room at will; ② Standardized implementation of three-party safety verification during the operation: before the start of anesthesia, before the start of surgery, and before the patient leaves the room, the surgeon, anesthesiologist, and surgical nurse need to check and confirm the safety of the operation item by item in accordance with the safety verification content to ensure the safety of the operation; ③ Abnormal environment or equipment: temperature, humidity, cleanliness, etc. exceed the standard, key equipment failure; ④ Other abnormal operations: temporary shutdown, rescue, intraoperative specimen report feedback timeout and other abnormal events. However, in the specific implementation, due to the lack of effective information system support, the above management requirements are difficult to achieve supervision through informatization, and can only be manually inspected and recorded. The three-party safety verification information confirmation of the operation is mostly in the form of oral and paper confirmation, which cannot meet the needs of surgical safety management. Summary of the invention

[0003] The purpose of the present invention is to provide a surgical safety verification and process supervision system. Firstly, by recording and analyzing the image information of the entire surgical process, a standardized management method for the behavior of surgical personnel is provided; secondly, by combining audio confirmation with image recognition, the standardization of the three-party safety verification process for the operation, the integrity, real-time and correctness of the verification data are guaranteed, and the problems of information asynchrony and untimely recording during the existing three-party confirmation of the operation are solved; on the other hand, based on the system recording the business and behavior information of the surgical process throughout the entire process, it can support the management needs of surgical quality control, performance and the like.

[0004] To solve the above problems, one aspect of the present invention provides a surgical safety verification and process monitoring system, which includes:

[0005] A sign-in unit is configured to obtain the sign-in time of surgical personnel entering the operating room and obtain the verification start time according to the sign-in time of the surgical personnel.

[0006] A verification unit is configured to connect to the check-in unit. The verification unit can play a verification audio according to the start verification time and the verification operation information. The verification unit can obtain verification response information corresponding to the verification audio. And

[0007] An identity recognition unit is configured to connect to the verification unit. The identity recognition unit can collect the face video, voiceprint information and identity certificate of the current three-party confirmer. The identity recognition unit recognizes the face video, voiceprint information and identity certificate to obtain the identity information of the current three-party confirmer. The identity recognition unit obtains the verification result based on the identity certificate and / or the identity information of the current three-party confirmer.

[0008] A data processing unit is configured to connect to the verification unit; records process safety management related data, collects relevant indicator information and performance data, provides data query, statistical analysis and other services, and can provide real-time feedback to relevant parties.

[0009] a video analysis unit, configured to be connected to the identification unit, the video analysis unit being capable of collecting a video of the surgical process; the video analysis unit being capable of identifying behavior and event information that may affect surgical safety;

[0010] Another aspect of the present invention provides a method for surgical safety verification and process supervision, which includes: obtaining the check-in time of surgical personnel entering the operating room, and obtaining the verification start time according to the check-in time of the surgical personnel.

[0011] According to the start verification time and verification operation information, the verification audio is played. The verification unit can obtain the verification response information corresponding to the verification audio.

[0012] Collect the face video, voiceprint information and identity certificate of the current three-party confirmer. The identity recognition unit recognizes the face video, voiceprint information and identity certificate to obtain the identity information of the current three-party confirmer. The identity recognition unit obtains the verification result based on the identity certificate and / or the identity information of the current three-party confirmer.

[0013] The above-mentioned technical scheme of the present invention has the following beneficial technical effects: a surgical safety verification and process supervision system, which, through audio confirmation combined with image recognition, can non-contactly identify and operate the three-party safety verification business of the surgery, solve the problem of verification operation after the surgeon's hands are disinfected, reduce the risk of infection, and improve the compliance rate, accuracy and execution rate of the three-party verification.

[0014] The process is recorded without feeling and in real time. Second, through the video images of the surgical staff's behavior and the surgical event information, it automatically identifies events that affect surgical safety or violate management requirements, and promptly reminds and notifies the surgical management personnel to achieve real-time supervision of surgical safety; third, the surgical process records are complete and traceable, and the information can serve operational management, quality control supervision, performance management, etc. Overall, the system's operating procedures match the business process and are easy to use. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1It is a schematic diagram of the components of a surgical process safety management system in one embodiment of the present invention;

[0016] Figure 2 It is a data flow data diagram in a surgical process safety management system in one embodiment of the present invention.

[0017] Figure 3 It is a flowchart of the process of electronic signature by face recognition in one embodiment of the present invention.

[0018] Figure 4 It is a flowchart of a surgical procedure safety management method according to an embodiment of the present invention;

[0019] Figure 5 It is a flowchart of a method for safe management of surgical procedures in one embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present invention. In addition, in the following description, the description of well-known structures and technologies is omitted to avoid unnecessary confusion of the concept of the present invention.

[0021] One aspect of the present invention, as Figure 1 , 4 As shown, a surgical safety verification and process supervision system is provided, which can be implemented through the same control or scheduling platform, which can be configured on a server and can be implemented through a server operating platform control program. At the same time, a surgical doctor smart terminal can be configured for the surgeon. In one embodiment, the present invention comprehensively utilizes the camera, speaker, and microphone integrated in the smart terminal to realize the execution and process recording of the business related to the safety management of the surgical process.

[0022] The computers, interactive large-screen all-in-one machines and PDA terminals in the operating room can call up all kinds of data stored in the above-mentioned scheduling platform, collect data from the three parties involved in the on-site surgery, and calculate and display the verification results based on the collected data and the data called from the scheduling platform. Figure 2 FIG. 1 is a schematic diagram of data flow in the surgical safety verification and process monitoring system of the present invention.

[0023] like Figure 1 , 2 As shown, in one embodiment of the present invention, the surgical process safety management system includes a check-in unit 101, a verification unit 201 and an identity recognition unit 301.

[0024] The sign-in unit 101 is configured to obtain the sign-in time of the surgical staff entering the operating room, and obtain the verification start time according to the sign-in time of the surgical staff. The surgical staff includes the anesthesiologist, the surgeon and the surgical nurse (circulating nurse). A surgical process safety management application module can be deployed on the computer, the interactive large-screen all-in-one machine and the terminal PDA. This application module can be embedded in the running program of the sign-in unit 101.

[0025] In one embodiment of the present invention, after the patient enters the operating room, before anesthesia begins, before the operation begins, or before the patient leaves the room, the check-in time of the three surgical personnel entering the operating room is collected through the computer, interactive large-screen all-in-one machine, and terminal PDA used by the three surgical personnel. After the check-in time of the three surgical personnel is collected, a delay time is postponed according to the check-in time, or no delay is made to obtain the verification start time.

[0026] In one embodiment of the present invention, the method for obtaining and recording the surgeon's arrival at the operating room also includes: the time for collecting surgical gowns and shoes (connecting to an intelligent surgical gown and shoe machine to read the gown distribution time), access control swiping information (connecting to an access control device to obtain card swiping information for entering the operating room) or a clock-in machine at the door of the operating room (connecting to a door device to obtain clock-in information for entering the operating room).

[0027] The present invention implements the three-party safety verification process of surgery as follows:

[0028] The verification unit 201 is configured to connect to the check-in unit 101, and the function of the verification unit 201 is realized by a loader in the surgical process safety management application. The verification unit 201 can set a verification operation interface (button) according to the start verification time and the start control information of the verification operation collected by the check-in unit 101, for example, through the user interaction interface in the surgical process safety management application, so that the verifier can input the start control information of the verification operation as the verification operation information by triggering the button on the verification operation interface.

[0029] On the user interface of the surgical safety verification and process monitoring system, a verification audio is played, wherein the content of the verification audio is an inquiry audio for asking whether all three parties of the surgical operation are present. The verification unit 201 can obtain the verification response information corresponding to the verification audio.

[0030] For example, when all surgical personnel enter the operating room, after the time for the surgeon, anesthesiologist and surgical nurse to enter the operating room is confirmed, the anesthesiologist operates the tablet terminal PDA, verifies his or her identity information through the surgical process safety management application, and then plays the verification interface to the surgeon, surgical nurse and himself or herself in the operating room through the surgical safety verification and process supervision system, which can be supplemented by audio.

[0031] After playing the verification interface and audio, the pickup device configured on the terminal equipment running the surgical safety verification and process supervision system can receive responses (input information) or answer audio to the verification content from the surgeon, surgical nurse and the surgeon himself, that is, verification response information to the verification content.

[0032] Safety management of the surgical process is implemented in three stages: "before the start of anesthesia, before the start of surgery, and before the patient leaves the room."

[0033] The implementation can be carried out in any of the following ways.

[0034] Method (1): Before the verification of each link, the host (one of the anesthesiologist, surgeon, and surgical nurse) organizes the verification personnel (anesthesiologist, surgeon, and surgical nurse) to face the interactive large-screen all-in-one machine in the operating room and issue a voice command: "Surgical safety verification before anesthesia begins". The corresponding display interface can be retrieved and a voice command can be issued: Start verification. The system immediately responds with a voice reminder of "Ready to start verification" through the large-screen all-in-one machine loudspeaker, and counts down for a few seconds on the large screen. At the same time, the audio device and camera of the large screen or PDA are called to enter the audio and video acquisition state, and the panoramic camera deployed in the operating room is started to start recording. The host reads the verification items one by one, and the three parties jointly verify the displayed verification content item by item. When a certain item is verified, the participant can voice record the verification results. It can be selected whether to play the verification items and verification record results through the large-screen loudspeaker during the verification process.

[0035] Method (2) Before the start of the verification of each link, the host (one of the anesthesiologist, surgeon, and surgical nurse) organizes the verification personnel (anesthesiologist, surgeon, and surgical nurse) to start the verification, operate the PDA or PC terminal, and click the "start verification" command button. The system immediately issues a voice reminder of "ready to start verification" through the speaker of the PDA or PC terminal, and at the same time displays the verification interface on the interactive large-screen all-in-one machine, showing a countdown of several seconds. The system can simultaneously call the audio device and camera configured on the PDA, interactive large-screen all-in-one machine, or PC to enter the audio and video acquisition state, and start the panoramic camera deployed in the operating room to start recording and video recording. The host reads the verification items one by one, and the three parties jointly verify the displayed verification content one by one. When a certain item is verified, the operator fills in the verification confirmation result, and the system will also broadcast the information of the verification items and verification records through the audio device configured on the PDA, interactive large-screen all-in-one machine, or PC.

[0036] When checking in the above manner, after the verification of each link is completed, you can use the voice command "Mutual inspection season ends" or click the "Verification End" button, the system will automatically check whether the verification content has been confirmed item by item. If there are any missing items, you will be reminded by voice. If there are no missing items, it will automatically stop recording and save it to the database corresponding to the surgical record. At the same time as automatically stopping recording, the system will save the audio and video recorded by the camera and panoramic camera, and associate it with the surgery.

[0037] The identification unit 301 is configured to connect to the verification unit 201. The function of the identification unit 301 is realized by loading a program in the surgical process safety management application. The surgical process safety management application is used to connect to the camera device in the operating room.

[0038] Alternatively, the face video, voiceprint information and identity certificate of the current three-party confirmer can be collected by a camera device, such as a camera or other shooting device and an audio collection device of a terminal configured in the operating room. The information and image of the identity certificate can also be collected by a scanning device, so that the identity recognition unit 301 can collect the face video, voiceprint information and identity certificate of the current three-party confirmer.

[0039] The calling interface of the identity recognition unit 301 can complete the electronic signature. During the operation, the anesthesiologist can also use a dedicated PC business terminal, and the electronic signature of the anesthesiologist can also be completed through the universal UKEY method on the PC side. The present invention can merge the signatures completed in different ways into the same surgical safety checklist.

[0040] The identity recognition unit 301 obtains the identity information of the current three-party confirmer, such as name and ID card information, by face recognition, face video, voiceprint information and identity certificate. The identity recognition unit 301 obtains the verification result based on the identity certificate and / or the identity information of the current three-party confirmer. Thus, after the identities of the three-party confirmers are all verified, the identity recognition unit 301 obtains the result of verification. If one of the three-party confirmers is not verified, the result of not verification is obtained.

[0041] In one embodiment of the present invention, it also includes a data processing unit, which is configured to connect to the verification unit; record process safety management related data, collect relevant indicator information and performance data, provide data query, statistical analysis and other services, and provide real-time feedback to relevant parties.

[0042] The above-mentioned data processing unit is configured with process records, indicator library and performance factor table.

[0043] Record the process data of surgical process safety management, including the personnel information of the verification host and the verification information of the verification participants; the verification information, verification time and verification results of the verifier, verification content information, signatory information and signing time.

[0044] The data in the indicator database include the start time and end time of the operation, the time of each link of the process safety management, and the time of patient identity verification; the performance factor table includes correctness result information, surgical position information, operation name, level information, operation duration and anesthesia duration information.

[0045] It should be noted that in the above-mentioned surgical safety verification and process supervision system, the verification process of the check-in unit 101, the verification unit 201 and the identity recognition unit 301 is a three-party verification process. Under normal circumstances, after the operation is scheduled, the patient's operation schedule is in the operating room. After the surgeon arrives at the operating room, the anesthesiologist presides over the first surgical safety check: the three parties confirm the verification record with an electronic signature, and anesthesia begins. The surgeon presides over the second surgical safety check, and the three parties confirm the verification record with an electronic signature, and the operation begins. Until the end of the operation, the circulating nurse presides over the third surgical safety check, and the three parties confirm the verification record with an electronic signature, and the verification results are completed.

[0046] The hosts and contents of each link in the three-party safety review for surgery implemented by each medical institution will be different, and the system will dynamically adjust the business processes and elements according to the situation.

[0047] The present invention adopts a combination of multiple identity recognition methods in electronic signature. The identity recognition methods adopted by the present invention include: collecting face information through a camera and performing identity information through face recognition; collecting voiceprint information of personnel through a sound pickup device for identity recognition; verifying personnel identity information through a password or certificate; and manual confirmation.

[0048] In actual application scenarios, since medical staff wear masks when working, the accuracy of simply using face recognition or voiceprint recognition is not high, and simply using password input violates aseptic operation. For this reason, the present invention combines the above technologies for identity recognition.

[0049] At the same time, the surgical staff can also face the large screen and use gesture drawing, which is identity verification information. The system will compare and verify the recognized gesture trajectory with the graphics and graphic features (personal handwriting features) pre-existing in the personnel information database. The gesture trajectory can be the name of the signer or a specific pattern.

[0050] At the same time, the content displayed on the PDA can be shared synchronously on the PC terminal interface where the anesthesiologist works, or can be projected onto the large display screen in the operating room. Methods for synchronously displaying the content of the three-party safety verification or other surgical information on the large screen, PDA, and PC (three-party synchronization):

[0051] Communication code method: The large screen displays the QR code and text link information, the PDA scans the QR code to obtain the synchronization link, and the PC inputs the access link information to achieve synchronization.

[0052] PDA touch transmission method: Use the wireless communication device built into the PDA to read the device code of the large-screen device and establish a connection with the large screen. The content displayed on the PDA interface is instantly synchronized to the large screen. The PDA also sends access connection information to the PC. The PC inputs the access connection information to achieve the same screen for the three parties. After the three parties are on the same screen, each end can enter information and display it on the other two terminal screens.

[0053] like Figure 1 As shown, in one implementation of the surgical process safety management system of the present invention, the sign-in unit 101 is further configured with a sign-in device 10 .

[0054] The check-in time is obtained by recognizing the face, palm vein information or voice information of the surgical staff through the check-in device 10. The check-in device 10 can be set at the entrance of the operating room, and the face of the surgical staff can be recognized by the face recognition device, and the palm vein information of the staff entering the operating room can be collected by the palm vein infrared scanning imaging device. The voice information can be received by the audio and video acquisition device, so as to determine the check-in time of the three parties through the acquisition time of the above information.

[0055] The surgical process safety management system also includes an information push unit 401. The information push unit 401 can be implemented by loading it into the surgical safety verification and process supervision system application. The information push unit 401 communicates with the platform server through the terminal device, obtains the surgical arrangement record from the surgical database of the platform server, and pushes the surgical arrangement time to the surgical personnel based on the surgical personnel information in the surgical arrangement record. The information push unit 401 is connected to the patient identity verification unit and is also configured to push the patient arrival time to the surgeon end.

[0056] The present invention ensures timely message push according to the surgical arrangement business process, and sends corresponding message notifications to the surgeon at different times. No manual intervention is required. When the surgical arrangement information is released (the system connects to the scheduling system to obtain the scheduling information), the surgical arrangement notification is pushed to the surgeon through the SMS platform, including the operation time, operating room, operating table number, and cooperating personnel, so that the surgeon can understand the surgical arrangement in time.

[0057] After the previous operation is completed (the system connects to the anesthesia or nursing system to obtain the end of the operation information), the system automatically triggers the SMS platform to push a message notification to the surgeon that the previous operation has ended, thereby reminding him to prepare to go to the operating room.

[0058] After the patient arrives at the operating room, when the operating room nurse verifies the patient's identity (the system connects to the patient transfer or security management system to obtain verification information), the system automatically triggers the SMS platform to push a notification to the surgeon that the patient has arrived at the operating room, thereby reminding him to go to the operating room.

[0059] The patient's entry time into the operating room is obtained through the patient identity verification unit. When the operating room staff receives the patient, they determine whether the patient's identity information is correct through the scan information of the patient's wristband. If so, the patient's arrival information is sent to the operating staff through the information push unit 401.

[0060] In another embodiment of the surgical procedure safety management system of the present invention, the system further includes:

[0061] The check-in unit 101 is further configured to calculate the set check-in time of the surgeon arriving at the operating room according to the surgical gown distribution time. Verify the check-in time of the surgeon according to the set time of arrival at the operating room and confirm the check-in time of the surgeon.

[0062] The sign-in unit 101 is further configured to collect facial information of the three surgical personnel at the entrance position through a display screen or a built-in camera of a video acquisition device arranged at the entrance of the operating room, and collect audio information of the three surgical personnel at the entrance position through a microphone arranged at the entrance of the operating room.

[0063] The palm vein information image of the three surgical personnel at the entrance is collected through the palm vein information recognition device installed at the door of the operating room. The RFID radio frequency identification information of the three surgical personnel at the entrance is collected through the radio frequency identification device installed at the door of the operating room.

[0064] The doctor's check-in time is obtained based on the facial information, audio information, palm vein information image and / or RFID radio frequency identification information of the three surgical personnel at the entrance, thereby improving the readiness of information acquisition and identification.

[0065] In another embodiment of the surgical safety verification and process monitoring system of the present invention, the verification unit 201 is further configured to play the verification audio according to the paragraph of the voice command or instruction and along with the displayed content. The verification unit 201 can obtain multiple verification response information corresponding to multiple verification audio segments.

[0066] In another embodiment of the surgical safety verification and process monitoring system of the present invention, the verification unit 201 can be implemented in a mobile smart terminal and / or an interactive all-in-one machine.

[0067] The verification unit 201 is further configured to collect the current video and audio in the operating room through the interactive all-in-one machine or the mobile intelligent terminal, and receive verification operation information through the touch screen, input keyboard or sound pickup module of the interactive all-in-one machine or the mobile intelligent terminal.

[0068] The verification unit 201 is further configured to play the verification audio through the mobile intelligent terminal and / or the interactive all-in-one machine and save the current video and audio in the operating room collected by the interactive display screen.

[0069] The verification unit 201 is further configured to collect the current video and audio in the operating room through a camera device deployed in the operating room.

[0070] After receiving all the verification response information, the interactive all-in-one machine or the mobile smart terminal is driven to stop collecting the current video and audio in the operating room, and the current video and audio in the operating room collected by the mobile smart terminal are saved, thereby improving the accuracy of information collection.

[0071] In one embodiment of the present invention, after the surgical personnel passes the identity verification before verification, a security check will be started on the interactive all-in-one machine, the security check content will be displayed, and a QR code will be generated on the large screen. The QR code is a communication code. After the surgical nurse scans the QR code through the PDA or the anesthesiologist scans the QR code through a scanner connected to the PC, an instant connection can be established between the interactive large screen and the PDA and PC, and content consistent with the interactive all-in-one machine interface can be displayed synchronously, and the information recorded on the PDA can be synchronously transmitted to the interactive all-in-one machine.

[0072] In another embodiment of the surgical safety verification and process supervision system of the present invention, it also includes: a surgical scheduling unit, in which surgical scheduling information, an indicator library and a performance factor table are configured. The surgical scheduling information includes multiple surgical records. Each surgical record includes the operating room number, the surgeon's work number information, the surgeon's name, the anesthesiologist's work number information, the anesthesiologist's name, the surgical nurse's work number information and the surgical nurse's name.

[0073] The present invention implements the surgical personnel behavior management process:

[0074] In one embodiment of the present invention, the surgical safety verification and process supervision system of the present invention also includes obtaining surgical arrangement information from the surgical scheduling unit: the surgical arrangement information includes the surgical arrangements for each operation to be performed. Each surgical arrangement includes the operating room number, the name of the operation, the surgical patient information (name, gender, age, hospitalization ID, ward), the surgeon's (main surgeon, assistant) work number information, the surgeon's (main surgeon, assistant) name, the anesthesiologist's (main anesthesia, assistant) work number information, the anesthesiologist's name, the surgical nurse's (circulating nurse, hand-washing / instrument nurse) work number information and the surgical nurse's (circulating nurse, hand-washing / instrument nurse) name.

[0075] The surgical safety verification and process supervision system can obtain the personnel information of people who are allowed to enter the operating room and the non-surgical arrangement information table from the "External Personnel Entry into the Operating Room Approval System", including name, identity information (including face), access time period, and these people usually include interns, assistants, etc.

[0076] When the sign-in unit is linked to the surgery scheduling unit, when surgical personnel enter the operating room or the operating room, if the sign-in information is inconsistent with the information provided by the surgery scheduling unit and the approval system for outsiders entering the operating room, the system will warn with sound and pop-up windows on the sign-in terminal. After the operating room manager confirms the operation, the warning will not be stopped. Otherwise, the warning information will be displayed all the time and the associated electronic access control will not be opened. In order to avoid operations by non-operating room managers, when eliminating the warning, the system will require the operating room manager to perform identity recognition (face, palm vein, voice command, etc.) and record the relevant operations.

[0077] During the operation, the panoramic camera and interactive large-screen camera in the operating room will collect images of the entire surgical process and analyze them in real time.

[0078] When someone leaves the operating room door in the collected video footage, the system first analyzes whether the number of people in the image is consistent with the total number of people who signed in during the surgery. If the number is consistent, the system will not take any action. If it is recognized that the number of existing people in the operating room is less than the total number of people who signed in, the surgeon, anesthesiologist, and surgical nurse will be reminded on the large screen to verify their identities. When all the above surgical personnel are present after identity verification, the verification is completed. If one of the above personnel is not present during the verification, a message will be immediately sent to the surgical personnel and surgical management personnel who left to remind them to return to the operating room to ensure that the surgical personnel are present throughout the entire process.

[0079] The system will automatically record this process information on the background server, including the recognition of someone leaving the operating room, the time when someone left the operating room, the reminder time for identity verification, the verification result, the content of the information sent, the time when the information was sent, the information recipient information, etc.

[0080] The system obtains the access time period of the outsider information from the "outsider entry into the operating room approval system" and other similar systems. At the time when the outsider should leave the operating room, the system analyzes whether the number of people in the image is consistent with the total number of people in the surgery check-in link. If the number is consistent, the outsider is prompted to leave on the large screen in the operating room. After an interval of 5 minutes, the process will be repeated. If the number of people in the image is -1, all personnel will be reminded to authenticate their identities to confirm that the person has left.

[0081] The present invention implements the surgical safety event monitoring and management process:

[0082] During the operation, if any surgical event occurs that may affect the safety of the operation, the system will identify it and send warnings and information.

[0083] The system runs distributedly on large-screen interactive terminals, surgical nursing PDA terminals, and anesthesia workstation terminals, and can identify abnormal information recorded by each terminal and process it synchronously. For example, it can synchronize in real time the adverse reaction information of blood transfusion recorded by the nursing PDA, the abnormal vital signs information of patients collected by the anesthesia workstation, and the rescue information issued by the nursing PDA or anesthesia workstation. This information will be shared on the interactive large screen to ensure that all surgical personnel in the operating room are informed in time. The system will further handle it according to different categories of abnormal information. For example, the rescue information will be synchronized instantly to the rescue team members' work terminals and mobile phones, and the drug library terminal (or smart drug cart); the adverse reaction information of blood transfusion will be automatically synchronized to the blood bank terminal and the quality control management system database; the abnormal vital signs information of patients will be automatically sent to the anesthesia director, operating room head nurse and other management personnel outside the operating room.

[0084] The data processing and data service unit of the present invention will record and preserve various data of the whole process of safety management of the surgical procedure.

[0085] The present invention establishes an index library, and the index data of the index library include: the execution rate of surgical process safety management (the total number of surgeries that implement surgical process safety management / the number of surgeries×100%), the timely rate of three-party surgical safety inspection (the total number of surgeries that implement one three-party surgical safety inspection before anesthesia begins / the total number of surgeries that implement surgical process safety management×100%), the standardization rate of three-party surgical safety inspection documents (the number of surgeries that have completely filled out the three-party surgical safety inspection form / the total number of surgeries that implement the three-party surgical safety inspection×100%), the compliance rate of surgical personnel (the number of surgeries in which the personnel implementing the three-party surgical safety inspection are consistent with the planned surgical personnel / the total number of surgeries that implement the three-party surgical safety inspection×100%), The rate of full presence of surgical personnel throughout the process (the number of personnel implementing the three-party safety review throughout the operation / the total number of operations subject to the three-party safety review × 100%), the implementation rate of the three-party safety review of the operation (the archived surgical process safety management form / the total number of operations subject to the three-party safety review × 100%), etc.; the rate of timely departure of outside personnel; when calculating the indicators, the recorded data includes the start time, end time, time of each link of the process safety management, patient identity verification information (verification time, verification result), personnel identity verification information (verification time, verification result), electronic signature information (signature time, signature), archiving information (whether it has been archived, archiving time), and full video or audio recording information.

[0086] The present invention establishes a performance factor library, including surgical personnel information, surgical information (surgical position, surgical name, surgical level, CMI value), surgical duration and anesthesia duration, shift delay (the difference between the last surgical time of each surgical personnel and the off-duty time specified by their shift), surgical volume, etc. Based on the performance factor library information, the performance data of individuals and departments can be calculated and counted according to the performance data calculation method.

[0087] In order to ensure the standardized execution of the three-party safety verification business of surgery, the present invention designs the constraints for process advancement. According to the three-party safety verification business process of surgery, constraints for entering the next link are set in each link, including:

[0088] (1) Identity verification conditions: Identity verification is required at the beginning of each stage, and no one can enter the next stage without passing identity verification;

[0089] (2) Check and confirm the completeness conditions. If the verification content filled in each link is incomplete or there are options that have not passed the verification, you cannot proceed to the next link;

[0090] (3) Signature confirmation condition: if the electronic signature is not completed in the link, the next link cannot be entered;

[0091] (4) Sequence conditions: Set the order of each link. Links cannot be skipped. That is, after completing the first link, you cannot directly enter the third link. You must complete the second link before entering the third link.

[0092] In another embodiment of the surgical safety verification and process monitoring system of the present invention, the identity recognition unit 301 is further configured to collect facial videos through a mobile smart terminal or an interactive all-in-one machine.

[0093] The identity recognition unit 301 is further configured to obtain face video or voiceprint information from a sound pickup device provided in a video acquisition device of a mobile intelligent terminal or an interactive all-in-one machine.

[0094] The identity recognition unit 301 is also configured to collect and obtain the palm vein information and fingerprint information of the current three-party confirmation person.

[0095] The identity recognition unit 301 is also configured to connect to the surgery arrangement unit. The identity recognition unit 301 recognizes the face video and obtains the names and work numbers of the three parties currently recognized by the face. The identity recognition unit 301 recognizes the voiceprint information and obtains the names and work numbers of the three parties currently recognized by the voiceprint.

[0096] The identity recognition unit 301 is also configured to determine whether the name and work number of the face recognition and the name and work number of the voiceprint recognition of the current three parties match, and if so, output identity authentication success information.

[0097] If not, determine whether the palm vein information and fingerprint information of the current three parties and their recognition results match the identity certificate. If so, output identity authentication success information.

[0098] Or determine whether one of the name and work number of the current three parties' face recognition or voiceprint recognition matches the identity certificate. If so, output the identity authentication success information.

[0099] If not, it is determined whether one of the name and work number of the face recognition or the name and work number of the voiceprint recognition of the current three parties matches the information in the operation record. If so, the identity verification success message is output. If not, the identity verification failure message is output. This improves the accuracy of recognition. The identity recognition unit 301 is also configured to archive the verification results.

[0100] By embedding a combined identity recognition algorithm for intelligent enhancement processing, the video and audio collected individually or simultaneously are processed separately to identify the identity of the person: if the information identified by the two methods is consistent, the recognition result is deemed available.

[0101] If the user identity information identified by the two methods is inconsistent or no result is found, the work number information of the medical staff of this operation will be retrieved in combination with the surgery scheduling information and compared. If the user information recognized by face or voiceprint can be matched with the work number, the identity recognition will be judged to be successful.

[0102] If the facial recognition, voiceprint recognition, and work number verification methods are inconsistent, the system will list and display the recognition results of various methods on the system interface, and the on-site medical staff will select the correct option. To meet aseptic operation requirements, the confirmation of the correct option can be performed through voice commands.

[0103] In another embodiment of the surgical safety verification and process monitoring system of the present invention, the identity recognition unit 301 is further configured to obtain the name and work number information of the current three parties if the output is identity authentication success information.

[0104] Determine whether the names and work numbers of the three parties are in the emergency personnel information database. If so, dynamically collect and update the biometric features of the corresponding names in the emergency personnel information database. Train and improve the face recognition model used to identify the three parties based on the biometric features of the corresponding names in the updated emergency personnel information database.

[0105] In another embodiment of the surgical process safety management system of the present invention, the identity recognition unit 301 is also configured to display the current surgical record, the current name and work number recognized by face, the name and work number recognized by voiceprint, and the surgical scheduling information on the smart mobile terminal if the identity authentication information is output.

[0106] The identity recognition unit 301 is also configured to receive the audio correction voice of the current operator. The identity recognition unit 301 recognizes the audio correction voice to obtain verification content, and verifies the current surgical record, the current name and work number of face recognition, the name and work number of voiceprint recognition, and the surgical scheduling information according to the verification content, and obtains the verified current surgical record, the current name and work number of face recognition, the name and work number of voiceprint recognition, and the surgical scheduling information.

[0107] Based on the verified current surgical record, the current name and work number of face recognition, the name, work number and surgical schedule information of voiceprint recognition, the identity information of the current three-party confirmer is verified again.

[0108] In another embodiment of the surgical process safety management system of the present invention, the identity recognition unit 301 is also configured to send the current surgeon's password verification information to the smart mobile terminal if the identity authentication information is output, and can receive password verification audio, verify the current surgeon's identity information based on the password verification audio, and exit the system if the verification fails.

[0109] In extreme cases, if the face recognition, voiceprint recognition, and work number verification methods are inconsistent, and the information listed and displayed on the system interface is not the on-site medical staff, the system will call up the password input interface. In order to adapt to the sterile operation scenario, the surgeon can enter the password by voice. Since there is a risk of password leakage when entering the password by voice, after completing the password input, the system will prompt the user to modify the password and send a reminder message to his mobile phone.

[0110] When identity recognition is completed through work number-assisted verification, manual confirmation or ultimately the use of a password, the system will record the result information and use it as a basis for optimizing the face recognition and voiceprint recognition algorithms. When the system performs face or voiceprint recognition on the identified object again, the recognition accuracy will gradually improve.

[0111] After the identity is recognized, the system calls the CA interface to complete the electronic signature. During the operation, the anesthesiologist has a dedicated PC business terminal, and the anesthesiologist's electronic signature can also be completed through the universal UKEY method on the PC.

[0112] The present invention can combine signatures completed in different ways into the same surgical safety checklist.

[0113] The process of implementing electronic signature through facial recognition is as follows: Figure 3As shown. After the front-end program drives the camera to start, it first performs live face recognition, then extracts the feature code from the face information, and transmits the feature code and the list of surgical personnel who perform the surgical safety verification business to the background program. The background program matches the feature code and combines other auxiliary identification methods of surgical personnel (fingerprints, voiceprints, etc.) as needed, and feeds back the recognition result to the front-end program. If the system recognizes > 1 person, the recognition process is restarted and the recognition methods that were not added in the first time are added. Until the feedback result is not 1 person, the front-end program completes the CA electronic signature according to the business process.

[0114] In another embodiment of the surgical safety verification and process supervision system of the present invention, the identity recognition unit 301 is also configured to push a signature interface to the display interface of the smart mobile terminal if the identity certificate and / or the identity information of the current three-party confirmer are passed.

[0115] The identity recognition unit 301 is also configured to synchronize the local smart mobile terminals of the three parties through the built-in communication code, so that the local smart mobile terminals of the three parties synchronously receive the responded signature images according to the signature interface.

[0116] The communication verification information of the smart mobile terminal set locally by the three parties includes the built-in communication code. The local identity information record includes the built-in communication code. The local identity information storage record includes the built-in communication code.

[0117] In another embodiment of the surgical safety verification and process monitoring system of the present invention, the verification unit 201 is further configured to obtain identity recognition results of all persons in the current video from the video and audio in the current operating room.

[0118] Determine whether there is any information of outsiders other than the current three-party confirmation persons in the face recognition results of all people. If so, determine whether the outsider information is in the set outsider database information. If so, establish the outsider registration information based on the corresponding outsider information and generate record information in the temporary outsider database.

[0119] The system can automatically generate a signed surgical process safety management form based on the information recorded during the operation, and archive it by connecting to the electronic medical record. When archiving, the audio and video information of the process safety management will be synchronized. The system will mark the archived text information, audio and video information with the "archive" label. The text and audio and video information with the "archive" label are not allowed to be modified or edited.

[0120] In another embodiment of the surgical safety verification and process supervision system of the present invention, a video analysis unit is further included, which is configured to record and identify in real time abnormal behavior information and abnormal event information that affect surgical safety. Abnormal behavior information includes information about sudden abnormal movements and abnormal physical states of personnel in the operating room, such as fainting or other abnormal body positions. The above-mentioned abnormal event information includes event information such as earthquakes and collapses.

[0121] The abnormal behavior information and abnormal event information are compared with the abnormal information database or abnormal indicator threshold to generate warning information, thereby improving the safety of the surgical process and surgical personnel.

[0122] like Figure 5 As shown, the second aspect of the present invention provides a method for safety management of surgical procedures, which comprises:

[0123] Step S101, obtaining the check-in time of the surgical staff entering the operating room, and obtaining the verification start time according to the check-in time of the surgical staff.

[0124] Step S102: Play the verification audio according to the verification start time and verification operation information. Obtain verification response information corresponding to the verification audio. And

[0125] Step S103, collect the face video, voiceprint information and identity certificate of the current three-party confirmer. Identify the face video, voiceprint information and identity certificate to obtain the identity information of the current three-party confirmer. Obtain the verification result according to the identity certificate and / or the identity information of the current three-party confirmer.

[0126] This method can be implemented through the surgical process safety management system of the present invention. The method of the present invention may not be implemented in a server platform, but may also be implemented through a program set in a mobile terminal.

[0127] In one embodiment of the surgical safety verification and process supervision method of the present invention, the method further includes:

[0128] Recognize the face, palm vein information or voice information of the surgeon to obtain the check-in time. Push the surgery schedule time to the surgeon based on the surgeon information in the surgery schedule record. Push the patient arrival time to the surgeon.

[0129] The time when the patient enters the operating room is obtained. When the operating room staff receives the patient, they determine whether the patient's identity information is correct through the scanning information of the patient's wristband. If so, the patient's arrival information is sent to the operating staff through the information push unit 401.

[0130] In one embodiment of the surgical safety verification and process supervision method of the present invention, the method further includes:

[0131] According to the time of surgical gown distribution, calculate the set doctor check-in time when the surgeon arrives at the operating room. Verify the doctor check-in time according to the set arrival time in the operating room and confirm the doctor check-in time. Or

[0132] The face information of the three surgical personnel at the entrance is collected by the display screen or the built-in camera of the video acquisition device installed at the entrance of the operating room. The audio information of the three surgical personnel at the entrance is collected by the microphone installed at the entrance of the operating room.

[0133] The palm vein information image of the three surgical personnel at the entrance is collected through the palm vein information recognition device installed at the door of the operating room. The RFID radio frequency identification information of the three surgical personnel at the entrance is collected through the radio frequency identification device installed at the door of the operating room. The doctor's check-in time is obtained based on the facial information, audio information, palm vein information image and / or RFID radio frequency identification information of the three surgical personnel at the entrance.

[0134] In another embodiment of the surgical safety verification and process supervision method of the present invention, the method includes playing verification audio along with the displayed content according to the paragraph of the voice command or instruction, and obtaining multiple verification response information corresponding to the multiple verification audio segments.

[0135] In another embodiment of the surgical safety verification and process supervision method of the present invention, the current video and audio in the operating room are collected through an interactive all-in-one machine or a mobile smart terminal, and verification operation information is received through a touch screen, input keyboard or sound pickup module of the interactive all-in-one machine or the mobile smart terminal.

[0136] The audio is played and verified through the mobile smart terminal and / or the interactive all-in-one machine, and the current video and audio in the operating room captured by the interactive display screen are saved. Or the current video and audio in the operating room are captured by the camera device deployed by the security system in the operating room.

[0137] After receiving all the verification response information, the interactive all-in-one machine or the mobile smart terminal is driven to stop collecting the current video and audio in the operating room, and the current video and audio in the operating room collected by the mobile smart terminal are saved.

[0138] In another embodiment of the surgical safety verification and process supervision method of the present invention, it also includes: being able to push the surgical schedule time to the surgical personnel based on the surgical personnel information in the surgical schedule record; the information push unit is connected to the patient identity verification unit and is also configured to push the patient arrival time to the surgeon end; the information push unit is connected to the video analysis unit and is configured to push the abnormal information to the surgical management personnel.

[0139] In another embodiment of the surgical safety verification and process supervision method of the present invention, it includes using a mobile smart terminal or an interactive all-in-one machine and collecting facial videos.

[0140] Acquire face video or voiceprint information from the sound pickup device set in the video acquisition device of the mobile intelligent terminal or the interactive all-in-one machine. Acquire the palm vein information and fingerprint information of the current three-party confirmation person.

[0141] Face recognition face video, get the name and work number of the current three parties' face recognition. Voiceprint recognition voiceprint information, get the name and work number of the current three parties' voiceprint recognition.

[0142] Determine whether the name and work number of the current three parties' face recognition and voiceprint recognition match. If so, output the identity authentication success information.

[0143] If not, determine whether the palm vein information and fingerprint information of the current three parties and their recognition results match the identity certificate. If so, output identity authentication success information.

[0144] Or determine whether one of the name and work number of the current three parties' face recognition or voiceprint recognition matches the identity certificate. If so, output the identity authentication success information.

[0145] If not, determine whether one of the name and work number of the current three parties' face recognition or voiceprint recognition matches the information in the surgical record. If so, output the identity verification success message. Otherwise, output the identity verification failure message. Archive the verification results.

[0146] In another implementation of the surgical safety verification and process supervision of the present invention, it includes: if the output is identity authentication success information, the name and work number information of the current three parties are obtained.

[0147] Determine whether the names and work numbers of the three parties are in the emergency personnel information database. If so, dynamically collect and update the biometric features of the corresponding names in the emergency personnel information database. Train and improve the face recognition model used to identify the three parties based on the biometric features of the corresponding names in the updated emergency personnel information database.

[0148] In another embodiment of the surgical safety verification and process supervision method of the present invention, the method comprises:

[0149] If the identity authentication information is output, the current surgical record, the current name and work number of the face recognition, the name and work number of the voiceprint recognition and the surgical schedule information will be displayed on the smart mobile terminal.

[0150] Receive the audio correction voice of the current operator. Recognize the audio correction voice to obtain verification content, verify the current surgical record, the current name and work number of face recognition, the name and work number of voiceprint recognition, and the surgical schedule information according to the verification content, and obtain the verified current surgical record, the current name and work number of face recognition, the name and work number of voiceprint recognition, and the surgical schedule information.

[0151] Based on the verified current surgical record, the current name and work number of face recognition, the name, work number and surgical schedule information of voiceprint recognition, the identity information of the current three-party confirmer is verified again.

[0152] In another embodiment of the surgical safety verification and process supervision method of the present invention, if the identity authentication information is output, the current surgeon's password verification information is sent to the smart mobile terminal, and the password verification audio can be received. The current surgeon's identity information is verified based on the password verification audio. If the verification fails, the system is exited.

[0153] In another implementation of the surgical process safety management method of the present invention, if the identity certificate and / or the identity information of the current three-party confirmer are passed, the signature interface is pushed to the display interface of the smart mobile terminal.

[0154] The smart mobile terminals set up locally by the three parties are synchronized by the set built-in communication code, so that the smart mobile terminals set up locally by the three parties synchronously receive the signature images responded to according to the signature interface. The communication verification information of the smart mobile terminals set up locally by the three parties includes the built-in communication code. The local identity information record includes the built-in communication code. The local identity information storage record includes the built-in communication code.

[0155] In another embodiment of the surgical safety verification and process supervision method of the present invention, identity recognition results of all persons in the current video are obtained from the video and audio in the current operating room.

[0156] Determine whether there is any information of outsiders other than the current three-party confirmation persons in the face recognition results of all people. If so, determine whether the outsider information is in the set outsider database information. If so, establish the outsider registration information based on the corresponding outsider information and generate record information in the temporary outsider database.

[0157] The surgical safety verification and process supervision method of the present invention can effectively ensure the effectiveness of surgical safety verification. It reduces the risk of infection, non-contact identification and operation, and solves the problem of verification operation and signature after the surgeon's hand disinfection. It can implement medical quality control requirements as required and improve the compliance rate and execution rate of the three-party verification. The process is recorded without feeling, and no additional burden is added to medical staff.

[0158] The process records are complete and traceable, meeting the legal requirements for evidence. The system's operating procedures are closely aligned with the business process, making it easy and convenient to use. The surgeon is informed of relevant information in a timely manner to prevent delays in arrival.

Claims

1. A surgical safety verification and process monitoring system, characterized in that: It includes: A sign-in unit configured to obtain a sign-in time of a surgical staff member entering the operating room, and obtain a verification start time according to the sign-in time of the surgical staff member; a verification unit configured to be connected to the check-in unit; the verification unit can play a verification audio according to the start verification time and the verification operation information; the verification unit can obtain verification response information corresponding to the verification audio; An identity recognition unit, which is configured to be connected to the verification unit; the identity recognition unit can collect the face video, voiceprint information and identity information of the current three-party confirmation person; and a video analysis unit, configured to be connected to the identification unit, the video analysis unit being capable of collecting a video of the surgical process; the video analysis unit being capable of identifying behavioral information that affects surgical safety; The identity recognition unit recognizes the facial video, voiceprint information and identity certificate to obtain the identity information of the current three-party confirmer; the identity recognition unit obtains the verification result based on the identity certificate and / or the identity information of the current three-party confirmer.

2. The surgical safety verification and process monitoring system according to claim 1, characterized in that: The surgical safety verification and process supervision system also includes an information push unit, which is configured to push the surgical schedule time to the surgical personnel based on the surgical personnel information in the surgical schedule record; the information push unit is connected to the patient identity verification unit and is also configured to push the patient arrival time to the surgeon end; the information push unit is connected to the video analysis unit and is configured to push the abnormal information to the surgical management personnel.

3. The surgical procedure safety management system according to claim 2, characterized in that: The sign-in unit is also equipped with a sign-in device; The check-in time is obtained by recognizing the face, palm vein information or voice information of the surgical staff through the check-in device; The patient's entry time into the operating room is obtained through the patient identity verification unit. When the operating room staff receives the patient, they determine whether the patient's identity information is correct by scanning the information on the patient's wristband. If so, the patient's arrival information is sent to the operating staff through the information push unit.

4. The surgical safety verification and process monitoring system according to claim 1 or 2, characterized in that: Also includes: The sign-in unit is further configured to calculate the set sign-in time of the surgeon arriving at the operating room according to the surgical gown distribution time; verify the sign-in time of the surgeon according to the set time of arriving at the operating room, and confirm the sign-in time of the surgeon; or The sign-in unit is further configured to collect facial information of the three surgical personnel at the entrance position according to the display screen or the built-in camera of the video acquisition device arranged at the entrance of the operating room; The microphone installed at the door of the operating room collects the audio information of the three parties of the operation at the door; The palm vein information recognition device installed at the door of the operating room collects the palm vein information images of the three surgical personnel at the door; The RFID information of the three surgical personnel at the entrance is collected through the RFID device installed at the door of the operating room; The doctor's sign-in time is obtained based on the facial information, audio information, palm vein information image and / or RFID radio frequency identification information of the three surgical personnel at the entrance.

5. The surgical safety verification and process monitoring system according to claim 1, characterized in that: The verification unit is further configured to perform one or more verifications based on the paragraphs of voice commands or instructions and playing verification audio along with the displayed content; the verification unit can obtain multiple verification response information corresponding to the multiple verification audio segments.

6. The surgical safety verification and process monitoring system according to claim 1 or 5, characterized in that: The verification unit can be implemented in a mobile smart terminal and / or an interactive all-in-one machine; The verification unit is further configured to collect the current video and audio in the operating room through the interactive all-in-one machine or the mobile intelligent terminal; receive the verification operation information through the touch screen, input keyboard or sound pickup module of the interactive all-in-one machine or the mobile intelligent terminal; The verification unit is further configured to play the verification audio through the mobile smart terminal and / or the interactive all-in-one machine and save the current video and audio in the operating room collected by the interactive display screen; or The verification unit is further configured to collect the current video and audio in the operating room through a camera device deployed in the operating room; After receiving all the verification response information, the interactive all-in-one machine or the mobile smart terminal is driven to stop collecting the current video and audio in the operating room, and the current video and audio in the operating room collected by the mobile smart terminal are saved.

7. The surgical safety verification and process monitoring system according to claim 2, characterized in that: The video analysis unit is also equipped with a video analysis device; The video analysis unit analyzes and collects video information of the entire surgical process, including image information from the high-definition camera in the operating room, information displayed on the interactive large screen in the operating room, and image information captured by the PDA camera; The video analysis unit analyzes the acquired video information to determine whether there is any behavior of surgical staff or surgical event that has an impact on surgical safety. If it is determined that there is an impact, a warning message is sent to the surgical management personnel through the information push unit.

8. The surgical safety verification and process monitoring system according to claim 6, characterized in that: Also includes: A surgery scheduling unit is provided, wherein surgery scheduling information is configured, and the surgery scheduling information includes multiple surgery records; each surgery record includes the operating room number, the surgeon's work number information, the surgeon's name, the anesthesiologist's work number information, the anesthesiologist's name, the surgical nurse's work number information and the surgical nurse's name.

9. The surgical safety verification and process monitoring system according to claim 8, characterized in that: The identity recognition unit is further configured to collect the face video through the mobile intelligent terminal or the interactive all-in-one machine; The identity recognition unit is further configured to obtain the face video or the voiceprint information from a sound pickup device provided in the video acquisition device of the mobile intelligent terminal or the interactive all-in-one machine; The identity recognition unit is further configured to collect and obtain the palm vein information and fingerprint information of the current three-party confirmation person; The identity recognition unit is further configured to be connected to the surgery arrangement unit; the identity recognition unit performs face recognition on the face video to obtain the names and work numbers of the three parties currently recognized by the face; the identity recognition unit performs voiceprint recognition on the voiceprint information to obtain the names and work numbers of the three parties currently recognized by the voiceprint; The identity recognition unit is further configured to determine whether the name and work number of the face recognition and the name and work number of the voiceprint recognition of the current three parties match, and if so, output identity authentication success information; If not, determine whether the palm vein information and fingerprint information of the three parties and their identification results match the identity certificate, and if so, output identity authentication success information; or determining whether one of the name and work number of the face recognition or the name and work number of the voiceprint recognition of the current three parties matches the identity certificate, and if so, outputting identity authentication success information; If not, determine whether the name and work number of the face recognition or the name and work number of the voiceprint recognition of the current three parties matches the information in the operation record. If so, output identity authentication success information; otherwise, output identity authentication failure information; The identity recognition unit is also configured to archive the verification result.

10. The surgical safety verification and process monitoring system according to claim 6, characterized in that: The identity recognition unit is further configured to obtain the names and work numbers of the three parties if the output is identity verification success information; Determine whether the name and work number information of the current three parties are in the emergency personnel information database. If so, dynamically collect and update the biometric features of the corresponding names in the emergency personnel information database; train and improve the face recognition model used to identify the current three parties based on the updated biometric features of the corresponding names in the emergency personnel information database.

11. The surgical procedure safety management system according to claim 1, characterized in that: Also included is a video analysis unit configured to record and identify in real time abnormal behavior information and abnormal event information that affect surgical safety; The abnormal behavior information and abnormal event information are compared with the abnormal information database or abnormal indicator threshold to generate warning information.

12. The surgical safety verification and process monitoring system according to claim 5, characterized in that: The identity recognition unit is configured to push a signature interface to the display interface of the smart mobile terminal if the identity certificate and / or the identity information of the current three-party confirmer are passed; The identity recognition unit is also configured to synchronize the smart mobile terminals locally set up by the three parties through the built-in communication code, so that the smart mobile terminals locally set up by the three parties synchronously receive the responded signature image according to the signature interface; The communication verification information of the smart mobile terminal locally set by the three parties includes the built-in communication code; the local identity information record includes the built-in communication code; and the local identity information storage record includes the built-in communication code.

13. A surgical safety verification and process supervision method, characterized in that: It includes: Obtain the check-in time of the surgical staff entering the operating room, and obtain the verification start time according to the check-in time of the surgical staff; Play the verification audio according to the verification start time and verification operation information; the verification unit can obtain the verification response information corresponding to the verification audio; and Collect the facial video, voiceprint information and identity certificate of the current three-party confirmer; identify the facial video, voiceprint information and identity certificate to obtain the identity information of the current three-party confirmer; obtain the verification result based on the identity certificate and / or the identity information of the current three-party confirmer.

Images