System and method for remote teaching consultation of vascular interventional operation

Abstract

The invention relates to the technical field of medical assistance, in particular to a vascular interventional operation remote teaching consultation system and method, and the system mainly comprises a consultation teaching module, an operation simulation module, a data storage module and an intelligent assistance module. In the operation process, the consultation teaching module is used for recording operation images of different visual angles in real time, generating operation image records and transmitting the operation image records to the data storage module; the operation images of different visual angles are transmitted to a display end of a consultant in real time, and the consultant carries out consultation through the operation images of different visual angles; during teaching, the consultation teaching module transmits operation images of different visual angles to display terminals of students in real time, and the students learn through the operation images of different visual angles; the system is complete in logic, can effectively assist doctors in remote teaching and consultation, and improves the teaching and medical level.

Description

Technical Field

[0001] The present invention relates to the field of medical assistance technologies, and particularly to a system and method for remote teaching and consultation of vascular intervention surgeries. Background Art

[0002] Vascular intervention surgery is a minimally invasive method that punctures blood vessels and inserts instruments such as catheters and guidewires into the blood vessels to diagnose and treat vascular lesions. Doctors will formulate surgical plans based on the specific conditions of patients and conduct necessary pre-operative examinations and evaluations. During the surgery, under the guidance of imaging equipment, doctors send instruments such as catheters and guidewires to the lesion site for treatments such as dilation, embolization, and thrombectomy. Common vascular intervention surgery methods include vascular dilation surgery, vascular stent surgery, endovascular thrombectomy surgery, and vascular embolization surgery, etc.

[0003] However, these surgeries are quite difficult, and due to underdeveloped medical technologies and poor medical education levels in some areas, the success rate of such surgeries is relatively low. Existing technologies conduct teaching for students and joint consultations for patients through remote teaching or consultation methods to improve the medical education level and the success rate of surgeries; however, the remote teaching or consultation methods in existing technologies often only involve voice calls or video calls, lacking other aids for teaching or consultation, resulting in poor teaching and consultation effects.

[0004] In summary, how to solve the problem that the remote teaching or consultation methods in existing technologies often only involve voice calls or video calls, lacking other aids for teaching or consultation, resulting in poor teaching and consultation effects has become a difficult problem that urgently needs to be solved in the current field. Therefore, it is necessary to propose a system and method for remote teaching and consultation of vascular intervention surgeries that can improve the teaching and consultation effects. Summary of the Invention

[0005] To solve the above problems, the present invention provides a system and method for remote teaching and consultation of vascular intervention surgeries. When conducting remote teaching or consultation, through the design of the consultation module, methods such as text communication, voice call, video call, and data interaction can be selected for consultation or teaching, and participants can more comprehensively and three-dimensionally understand the specific situation of the surgery through surgical images from different perspectives. While conducting consultation or teaching, a patient vascular model and a surgical operation model can also be constructed using the surgical simulation module, thereby improving the consultation level and teaching level.

[0006] To achieve the above object, the technical solution of the present invention is as follows: A system for remote teaching and consultation of vascular intervention surgeries includes a consultation and teaching module, a surgical simulation module, a data storage module, and an intelligent assistance module.

[0007] The consultation and teaching module is used to conduct consultations and teaching through text communication, voice calls, video calls, and data interaction, and generate text communication records, voice call records, video call records, and data interaction records for transmission to the data storage module; during the operation, the consultation and teaching module is used to record the surgical images from different perspectives in real time, generate surgical image records for transmission to the data storage module; and transmit the surgical images from different perspectives to the display terminals of the consultants in real time, and the consultants conduct consultations through the surgical images from different perspectives; during teaching, the consultation and teaching module transmits the surgical images from different perspectives to the display terminals of the students in real time, and the students learn through the surgical images from different perspectives.

[0008] The surgical simulation module is used to identify the patient's vascular characteristics based on the surgical images from different perspectives, construct a patient vascular model according to the patient's vascular characteristics using a 3D modeling program, analyze the lesion location and the optimal surgical site of the vascular intervention surgery, and perform simulation marking in the patient vascular model to mark the lesion location and the optimal surgical site; the surgical simulation module is also used to collect the hand characteristics of the surgeon and the patient's vascular characteristics after the operation based on the surgical images from different perspectives, and construct a surgical operation model according to the hand characteristics of the surgeon and the patient's vascular characteristics after the operation using a 3D modeling program; during the consultation, the surgical simulation module also transmits the patient vascular model to the display terminal of the consultant for the consultant to perform simulated surgery, and generates a simulated surgery record for feedback to the display terminal of the surgeon; during teaching, the surgical simulation module also transmits the patient vascular model to the display terminal of the student for the student to perform simulated surgery training, and generates a training record for transmission to the intelligent assistance module.

[0009] The data storage module is used to receive and store the text communication records, voice call records, video call records, and data interaction records collected by the consultation and teaching module to generate communication data; the data storage module is also used to receive and store the patient vascular model, surgical operation model, and simulated surgery record constructed by the surgical simulation module to generate operation data; the data storage module is also used to input the patient's treatment information and the doctor's medical practice information to generate basic data; and summarize the communication data, operation data, and basic data to generate a database for doctors to query.

[0010] An intelligent assistance module, which is used to automatically retrieve relevant communication data, operation data, and basic data from the database for consultation and teaching according to the keywords that appear in consultations and teaching; the correct hand features and correct postoperative blood vessel features during surgery are pre-entered in the intelligent assistance module to generate comparison features; the intelligent assistance module is also used to compare the hand features of the surgeon and the postoperative blood vessel features of the patient during the operation with the comparison features, and conduct surgical evaluation according to the matching degree; the intelligent assistance module is also used to identify the hand features of the student and the postoperative blood vessel features of the patient according to the training records of the student, and compare them with the comparison features, and conduct learning evaluation according to the matching degree.

[0011] Furthermore, the consultation and teaching module includes a text communication unit, a voice call unit, a video call unit, and a data interaction unit.

[0012] The text communication unit is used for input, output, and recognition of text; the text communication unit is also used to recognize keywords and mark the keywords.

[0013] The voice call unit is used for input, output, and recognition of voice; the voice call unit is also used to convert the input and output voice into text.

[0014] The video call unit is used for simultaneous input, output, and recognition of images, voice, and text.

[0015] The data interaction unit is used for input, output, and recognition of files.

[0016] Furthermore, different perspectives include the perspective of the surgeon in charge, the assistant perspective, the nurse perspective, and the monitoring perspective; during teaching, students can independently adjust the perspective according to their own needs and adjust the perspective of their own student display terminal; teachers can uniformly adjust the perspective of all student display terminals according to teaching needs, and the priority of uniform adjustment is higher than that of independent adjustment; during consultation, the consulters can independently adjust the perspective according to their own needs.

[0017] Furthermore, during teaching, the consultation and teaching module is also used to retrieve historical surgical images from the database according to teaching needs and transmit them to the display terminals of students, and students can learn according to the historical surgical images.

[0018] Furthermore, the patient's blood vessel features include the shape and size of blood vessels, the type of blood vessel diseases, and the shape and size of blood vessel lesions; the hand features include the type of handheld instruments, the handheld posture, and the usage situation.

[0019] Furthermore, the data storage module is also used to classify and store the communication data, operation data, and basic data according to the type of blood vessel diseases, and the consultation and teaching module and the surgical simulation module are also used to retrieve the communication data, operation data, and basic data according to the type of blood vessel diseases.

[0020] Further, during teaching, the surgical simulation module is also used to retrieve historical patient blood vessel models and their corresponding surgical operation models from the database according to teaching needs for students to learn, and construct a training question bank using the historical patient blood vessel models for students to perform simulated surgical training.

[0021] Further, the patient blood vessel characteristics include blood vessel shape and size, blood vessel disease type, and blood vessel lesion shape and size; the hand characteristics include the type of handheld instrument, handheld posture, and usage.

[0022] Further, the data storage module is also used to classify and store communication data, operation data, and basic data according to the type of blood vessel disease, and the consultation teaching module and the surgical simulation module are used to retrieve communication data, operation data, and basic data according to the type of blood vessel disease.

[0023] Further, during teaching, the surgical simulation module is also used to retrieve historical patient blood vessel models and their corresponding surgical operation models from the database according to teaching needs for students to learn, and construct a training question bank using the historical patient blood vessel models for students to perform simulated surgical training.

[0024] Further, the intelligent assistance module is also used to compare the postoperative patient blood vessel characteristics stored in the database, identify the optimal postoperative patient blood vessel characteristics, retrieve the corresponding surgical operation model, and optimize the control characteristics according to the postoperative patient blood vessel characteristics and the surgical operation model.

[0025] The technical principle of the above solution is as follows:

[0026] Through the consultation teaching module, methods such as text communication, voice call, video call, and data interaction are selected for consultation and teaching. During the surgical process, the consultation teaching module records surgical images from different perspectives in real time and transmits the surgical images from different perspectives to the display terminal of the consultant in real time. The consultant conducts consultation through the surgical images from different perspectives, and the consultant can independently adjust the perspective. During teaching, the consultation teaching module transmits the surgical images from different perspectives to the display terminal of the students in real time. The students learn through the surgical images from different perspectives. During this process, the students can independently adjust the perspective, and the teacher can uniformly control the perspectives of all students.

[0027] Through the surgical simulation module, using 3D modeling software, a patient blood vessel model is constructed based on surgical images from different perspectives. The surgeon and the consultant perform simulated surgery in the 3D modeling software using the patient blood vessel model, construct a surgical operation model, and observe the patient blood vessel conditions after the simulated surgery to optimize the surgical plan; after confirming the plan, the surgeon performs actual operation on the patient.

[0028] The data storage module will store the communication data, operation data and basic data during the entire operation and use them for subsequent retrieval. The intelligent assistance module will use the correct hand features and correct postoperative vascular features to generate control features, use the control features to determine whether the operator's operation is correct, and evaluate the operator's surgical skills based on the operator's operation and the postoperative condition of the patient's blood vessels.

[0029] The above scheme has the following beneficial effects:

[0030] 1. The present invention, through the design of the consultation and teaching module, can selectively conduct text communication, voice calls, video calls and data interaction, providing a variety of means of remote teaching or consultation; combined with the keyword recognition function, the intelligent auxiliary module can retrieve relevant communication data, operation data and basic data for consultation and teaching when the user conducts remote teaching or consultation, so that the user can understand the information related to the current communication content more quickly; and then use the functions of voice-to-text, data transmission and graphic transmission to make remote teaching and consultation more intuitive and efficient.

[0031] 2. The present invention, through the design of the consultation teaching module, conducts remote teaching or consultation through video calls. Unlike the prior art, the video calls in the prior art can only realize one-to-one communication between the surgeon and the consultant, or one-to-one communication between the teacher and the student. The perspective is single, and it is impossible to fully understand the surgical situation, and the diagnosis content is not comprehensive enough. The present invention constructs a full range of surgical images by real-time acquisition of the actual surgical situation observed from different perspectives, and uses the perspectives of the surgeon, the assistant, and the nurse to construct perspectives from various angles. These perspectives are then combined with the monitoring perspective to construct the overall perspective of the operating room, thereby constructing local images and overall images of various positions of the entire operation; and then through remote transmission technology, the user can freely switch between different perspectives through the display end, and can observe and understand each part and the whole of the operation.

[0032] 3. The present invention, through the design of a surgical simulation module, utilizes surgical images from different perspectives collected by a consultation teaching module to identify the patient's vascular characteristics, surgical environment, and surgical operation conditions, and utilizes a three-dimensional modeling program to construct a patient's vascular model according to the patient's vascular characteristics, and to construct a surgical operation model according to the surgical environment and surgical operation conditions. Different from the three-dimensional modeling in the prior art, the present invention constructs a patient's vascular model and a surgical operation model by collecting surgical images from different perspectives in real time, so that the established patient's vascular model and surgical operation model are more in line with reality, thereby conducting more efficient remote teaching and consultation, and improving the level of remote teaching and consultation.

[0033] 4. In the prior art, teaching and consultation are only carried out through voice calls or video calls. The communication method is single, and during the communication process, one party may not understand the technical terms input by the other party, or there is a lack of specific examples to deepen the user's understanding, resulting in low communication efficiency. Through the design of the intelligent assistance module, the present invention automatically retrieves relevant communication data, operation data, and basic data from the database for teaching and consultation according to the keywords that appear during teaching and consultation, explains technical terms for the user, and provides corresponding specific examples according to the keywords that appear, enabling the user to quickly understand the content of the communication between the two parties, thereby improving the communication efficiency and the level of remote teaching and consultation.

[0034] Furthermore, a method for remote teaching and consultation of vascular intervention surgery is based on a system for remote teaching and consultation of vascular intervention surgery. The remote teaching method includes the following steps:

[0035] S1. Select the meeting type: Send a course invitation to students by selecting one of the meeting types of voice meeting, video meeting, and material meeting.

[0036] S2. Course reception: After receiving the course invitation, the student confirms it. After the confirmation is completed, the course starts.

[0037] S3. Surgical analysis: Analyze the surgical site according to the course content, and construct a patient vascular model and an operating room environment; or retrieve a historical patient vascular model and an operating room environment from the database.

[0038] S4. Surgical simulation: According to the patient vascular model and the operating room environment, the student performs a simulated operation, observes the postoperative situation of the patient vascular model after the simulated operation, and the student and the teacher discuss the simulated operation and the postoperative situation to optimize the surgical plan; perform a simulated operation again according to the optimized surgical plan.

[0039] S5. Operation evaluation: Use the intelligent assistance module to evaluate the student's two simulated operations and the postoperative situation, and the teacher makes subjective adjustments according to the evaluation results to obtain the student's final evaluation result.

[0040] Beneficial effects: Through the analysis of the surgical site and the construction of the patient vascular model, students can perform simulated operations in a virtual environment, which not only provides a highly realistic surgical experience but also helps students to more deeply understand the surgical procedures and possible risks. At the same time, retrieving historical patient data from the database also enriches the teaching content, enabling students to come into contact with more diverse cases.

[0041] Evaluating simulated surgeries using an intelligent assistance module can ensure the objectivity and fairness of the evaluation results. At the same time, the subjective adjustment by teachers also takes into account the individual differences and special circumstances of students, making the evaluation results more comprehensive and accurate. This evaluation method not only helps students understand their progress and deficiencies but also provides targeted teaching feedback for teachers.

[0042] Furthermore, the remote consultation method includes the following steps:

[0043] S1, Select the meeting type: Select one of the meeting types of voice conference, video conference, and data conference to send a consultation invitation to the consultees.

[0044] S2, Consultation reception: After receiving the consultation invitation, the consultees confirm, and after the confirmation is completed, the consultation begins.

[0045] S3, Surgical analysis: Analyze the surgical site according to the consultation content to construct a patient blood vessel model and an operating room environment; at the same time, retrieve the communication data, operation data, and basic data of the patient with the highest historical matching degree and who has recovered from the database. The consultees and the surgeons discuss based on the retrieved communication data, operation data, and basic data to construct a simulated surgical plan.

[0046] S4, Surgical simulation: According to the patient blood vessel model and the operating room environment, the consultees perform a simulated surgery according to the simulated surgical plan, observe the postoperative situation of the patient blood vessel model after the simulated surgery, and the consultees and the surgeons discuss the simulated surgery and the postoperative situation to optimize the surgical plan.

[0047] S5, Surgical practice: The surgeon performs surgical operations according to the optimized surgical plan.

[0048] Beneficial effects: In the surgical analysis stage, not only a patient blood vessel model and an operating room environment are constructed, but also the communication data, operation data, and basic data of the patient with the highest historical matching degree and who has recovered are retrieved from the database, providing accurate reference information for users, helping users understand the patient's condition more deeply, and formulating a more reasonable surgical plan.

[0049] Through simulated surgeries, users can intuitively observe the surgical effects and discover potential problems. At the same time, the discussion between the consultees and the surgeons helps to further optimize the surgical plan, ensuring the safety and effectiveness of the surgery. This way of combining simulation and practice helps to improve the skill level of surgeons and reduce surgical risks.

[0050] Additional aspects and advantages of the present invention will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 This is a schematic structural diagram of a system for remote teaching and consultation of vascular intervention surgery according to the present invention.

[0052] Figure 2 This is a schematic diagram of the remote teaching method in the method for remote teaching and consultation of vascular intervention surgery according to the present invention.

[0053] Figure 3 This is a schematic diagram of the remote consultation method in the method for remote teaching and consultation of vascular intervention surgery according to the present invention. Detailed implementation manners

[0054] The following is a further detailed description through specific implementation manners:

[0055] Example 1:

[0056] As Figure 1 shown, a system for remote teaching and consultation of vascular intervention surgery includes a consultation and teaching module for initiating a meeting, a surgical simulation module for constructing a simulated surgical site, a data storage module for storing various types of data, and an intelligent assistance module for evaluating the surgical situation; each module is connected by signals to each other.

[0057] The specific functions of each module are as follows:

[0058] The consultation and teaching module is used for consultation and teaching through text communication, voice calls, video calls, and data interaction, and generates text communication records, voice call records, video call records, and data interaction records and transmits them to the data storage module.

[0059] The consultation and teaching module includes a text communication unit, a voice call unit, a video call unit, and a data interaction unit. Among them, the text communication unit is used for input, output, and recognition of text; the text communication unit is also used for recognizing keywords and marking the keywords. In this embodiment, the front end uses <input> and <textarea>Elements are used to create the input box and display area; the backend uses WebSocket and HTTP protocols to handle text transmission; NLP libraries such as NLTK and SpaCy are used to implement the keyword recognition function. < / textarea>

[0060] The voice call unit is used for input, output, and recognition of voice; the voice call unit is also used for converting the input and output voice into text. In this embodiment, transmission devices such as microphones and headphones are used to achieve the output and output of voice, and voice recognition technology, optical character recognition (OCR) technology, and voice recognition to text technology are used to recognize the voice and convert the voice into text.

[0061] The video call unit is used to input, output and recognize images, voices and texts at the same time. In this embodiment, an image acquisition device is used to acquire surgical images in real time, such as a camera; a display device is then used as an image output device to realize real-time playback of surgical images. In this embodiment, a display is selected as a display terminal to display surgical images.

[0062] The data interaction unit is used for inputting, outputting and identifying files. In this embodiment, data interaction is realized by data transmission technology, such as WebRTC, Tencent Conference and Dingding Conference, etc. In this embodiment, WebRTC is selected for data interaction.

[0063] During the operation, the consultation teaching module is used to record the surgical images from different perspectives in real time, generate surgical image records and transmit them to the data storage module. The different perspectives include the surgeon's perspective, assistant's perspective, nurse's perspective and monitoring perspective.

[0064] During the consultation, the consultation teaching module transmits surgical images from different perspectives to the consultant's display terminal in real time, and the consultant conducts the consultation through surgical images from different perspectives; during this process, the consultant can adjust the perspective independently according to his or her own needs.

[0065] For example, before the operation, user A initiated a conference with user B in the form of a video call. After user B accepted the consultation invitation, the two parties conducted a video call. At this time, the display terminal of user B would display the surgeon's perspective, assistant's perspective, nurse's perspective and monitoring perspective in the form of several evenly distributed rectangular frames. User B could choose different perspectives to observe the situation in the operating room and the patient's current condition based on the content of the voice communication with user A, so as to have a comprehensive understanding before the operation.

[0066] During teaching, the consultation teaching module transmits surgical images from different perspectives to the students' display terminals in real time, and students learn through surgical images from different perspectives. In this process, students can adjust the perspective of their own student display terminals according to their own needs; teachers can also uniformly adjust the perspective of all student display terminals according to teaching needs, and the priority of unified adjustment is higher than the priority of autonomous adjustment.

[0067] For example, a teacher initiates a conference to all students via video call. After the students receive the conference call, the teacher and students have a video call. At this time, the surgeon's perspective, assistant's perspective, nurse's perspective and monitoring perspective will be displayed in the form of several evenly distributed rectangular frames on the display terminals of all students. Students can choose different perspectives to observe the conditions in the operating room and the patient's condition according to their own needs, so as to have a comprehensive understanding before the operation. The teacher can also uniformly adjust the perspectives of all student displays according to teaching needs to facilitate teaching.

[0068] The surgical simulation module is used to identify the patient's vascular characteristics based on surgical images from different perspectives, construct a patient vascular model according to the patient's vascular characteristics using a 3D modeling program, analyze the lesion location and the optimal surgical site of the vascular intervention surgery, and perform simulation marking in the patient vascular model to mark the lesion location and the optimal surgical site. Among them, the patient's vascular characteristics include the shape and size of blood vessels, the type of vascular disease, and the shape and size of vascular lesions. The surgical simulation module is also used to collect the hand characteristics of the surgeon and the patient's vascular characteristics after surgery based on surgical images from different perspectives, and construct a surgical operation model according to the hand characteristics of the surgeon and the patient's vascular characteristics after surgery using a 3D modeling program. Among them, the hand characteristics include the type of handheld instrument, the handheld posture, and the usage situation. In this embodiment, the vascular characteristics of the patient are mainly identified by an image recognition device, the hand characteristics of the surgeon are collected by a high-precision motion sensor, and then the construction of the patient vascular model and the surgical operation model is realized based on 3D modeling software such as 3ds Max, Maya, 3DSlicer, or MRIcron. During 3D modeling, the lesion location and the optimal surgical site are marked by different-color markings.

[0069] During the consultation, the surgical simulation module also transmits the patient vascular model to the display terminal of the consultant for the consultant to perform a simulated operation, generates a simulated operation record, and feeds it back to the display terminal of the surgeon for reference.

[0070] Taking the above user A and user B as an example, since the medical education level in user A's area is poor and user A's surgical level is poor, while user B has excellent surgical skills, user A sends a consultation invitation to user B, requesting user B to provide surgical guidance. During this process, after the surgical simulation module establishes the patient vascular model, user B uses 3D modeling software to perform a simulated operation on the patient vascular model. At the same time, the simulated operation process of user B will be transmitted to the display terminal of user A in real time for user A to learn. User A can adjust the surgical plan according to user B's surgical operation and the on-site situation, and then perform better surgical treatment on the patient.

[0071] During teaching, the surgical simulation module also transmits the patient vascular model to the display terminal of the student for the student to perform simulated surgical training, generates a training record, and transmits it to the intelligent assistance module.

[0072] The data storage module is used to receive and store the text communication records, voice call records, video call records, and data interaction records collected by the consultation and teaching module, and generate communication data. The data storage module is also used to receive and store the patient vascular model, surgical operation model, and simulated surgical records constructed by the surgical simulation module, and generate operation data; the data storage module is also used to input the patient's treatment information and the doctor's medical practice information, and generate basic data; and summarize the communication data, operation data, and basic data to generate a database for doctors to query. The data storage module is also used to classify and store the communication data, operation data, and basic data according to the type of vascular disease. The consultation and teaching module and the surgical simulation module are also used to retrieve the communication data, operation data, and basic data according to the type of vascular disease. In this embodiment, the data storage module is mainly constructed based on storage elements. In this embodiment, a memory is used to store various types of data.

[0073] During teaching, the surgical simulation module is also used to retrieve the historical patient vascular model and its corresponding surgical operation model in the database according to the teaching requirements for students to learn, and use the historical patient vascular model to construct a training question bank for students to perform simulated surgical training.

[0074] The intelligent assistance module is used to automatically retrieve relevant communication data, operation data, and basic data from the database for consultation and teaching according to the keywords that appear during consultation and teaching; the correct hand features and correct postoperative vascular features during surgery are pre-entered in the intelligent assistance module to generate comparison features; the intelligent assistance module is also used to compare the hand features of the surgeon and the postoperative vascular features of the patient with the comparison features during the surgical process, and perform surgical evaluation according to the matching degree. In this embodiment, the intelligent assistance module mainly uses natural language processing technology to extract keywords, and uses intelligent retrieval algorithms to retrieve relevant data in the database according to the extracted keywords.

[0075] Taking the above user A and user B as an example, when the two communicate, user B mentions "arteriosclerosis obliterans" many times. The intelligent assistance module will pop up the relevant information of "arteriosclerosis obliterans" in the form of a small pop-up window at the lower left corner of the display terminals of user A and user B, and at the same time retrieve the communication data and operation data of the recovered patients with "arteriosclerosis obliterans" in history and the basic information most similar to the current patient from the database, so that user A can quickly understand the situation of the current patient and the required surgical situation, and then quickly improve user A's understanding and cognition of "arteriosclerosis obliterans", improve the communication efficiency, and the success rate of subsequent surgeries.

[0076] The intelligent assistance module is also used to identify the student's hand features and the patient's postoperative vascular features based on the student's training records, and compare them with the control features, and perform learning evaluation based on the matching degree. In this embodiment, the surgical simulation module uses machine vision technology to extract the operator's hand features and the patient's postoperative vascular features. The intelligent assistance module compares the extracted features with the control features and calculates the matching degree, thereby realizing the evaluation of the operator's surgical level.

[0077] The intelligent assistance module is also used to compare the postoperative patient vascular characteristics stored in the database, compare the optimal postoperative patient vascular characteristics, and retrieve the corresponding surgical operation model, and optimize the control characteristics according to the postoperative patient vascular characteristics and the surgical operation model.

[0078] The present invention, through the design of the consultation teaching module, conducts remote teaching or consultation through video calls. Unlike the prior art, the video calls in the prior art can only realize one-to-one communication between the surgeon and the consultant, or one-to-one communication between the teacher and the student. The perspective is single, and it is impossible to fully understand the surgical situation, and the diagnosis content is not comprehensive enough. The present invention constructs a full range of surgical images by real-time acquisition of the actual surgical situation observed from different perspectives, and uses the perspectives of the surgeon, the assistant and the nurse to construct perspectives of various angles, and then combines these perspectives with the monitoring perspective to construct the overall perspective of the operating room, thereby constructing local images and overall images of various positions of the entire operation; and then through remote transmission technology, the user can freely switch between different perspectives through the display end, and can observe and understand each part and the whole of the operation.

[0079] The present invention, through the design of a surgical simulation module, utilizes surgical images from different perspectives acquired by a consultation teaching module to identify the patient's vascular characteristics, surgical environment, and surgical operation conditions, and utilizes a three-dimensional modeling program to construct a patient's vascular model according to the patient's vascular characteristics, and to construct a surgical operation model according to the surgical environment and surgical operation conditions. Different from the three-dimensional modeling in the prior art, the present invention constructs a patient's vascular model and a surgical operation model by acquiring surgical images from different perspectives in real time, so that the established patient's vascular model and surgical operation model are more in line with reality, thereby conducting more efficient remote teaching and consultation, and improving the level of remote teaching and consultation.

[0080] The prior art only conducts teaching and consultation through voice calls or video calls. The communication method is single, and during the communication process, one party may not understand the technical terms input by the other party, or there is a lack of specific examples to deepen the user's understanding, resulting in low communication efficiency. Through the design of the intelligent assistance module, the present invention automatically retrieves relevant communication data, operation data, and basic data from the database for use in consultation and teaching according to the keywords that appear in consultation and teaching, explains the technical terms for the user, and provides corresponding specific examples according to the keywords that appear, enabling the user to quickly understand the content of the communication between the two parties, thereby improving the communication efficiency and the level of remote teaching and consultation.

[0081] Embodiment 2:

[0082] As Figure 2 shown, the difference from the above embodiment is that a method for remote teaching and consultation of vascular intervention surgery is based on a system for remote teaching and consultation of vascular intervention surgery. The remote teaching method includes the following steps:

[0083] S1. Select the meeting type: Select one of the meeting types of voice meeting, video meeting, and material meeting to send a course invitation to the students.

[0084] S2. Course reception: After the students receive the course invitation, they confirm it. After the confirmation is completed, the course starts.

[0085] S3. Surgical analysis: Analyze the surgical site according to the course content, and construct a patient vascular model and an operating room environment; or retrieve a historical patient vascular model and an operating room environment from the database.

[0086] S4. Surgical simulation: According to the patient vascular model and the operating room environment, the students perform a simulated operation, observe the postoperative situation of the patient vascular model after the simulated operation, and the students and the teacher discuss the simulated operation and the postoperative situation to optimize the surgical plan; perform a simulated operation again according to the optimized surgical plan.

[0087] S5. Operation evaluation: Use the intelligent assistance module to evaluate the students' two simulated operations and the postoperative situation, and the teacher makes subjective adjustments according to the evaluation results to obtain the final evaluation results of the students.

[0088] The specific implementation process is as follows: During teaching, the teacher and students observe and analyze the surgical site and the patient vascular model, enabling the students to truly and quickly understand the patient's vascular condition and the surgical site situation, and at the same time be able to perform a simulated operation in a virtual environment. This not only provides a highly realistic surgical experience but also helps the students to more deeply understand the surgical steps and possible risks. At the same time, retrieving historical patient data from the database also enriches the teaching content, enabling the students to come into contact with more diverse cases.

[0089] Evaluating the simulated surgery of students using the intelligent assistance module can ensure the objectivity and fairness of the evaluation results. At the same time, the subjective adjustment of teachers also takes into account the individual differences and special circumstances of students, making the evaluation results more comprehensive and accurate. This evaluation method not only helps students understand their progress and deficiencies, but also provides targeted teaching feedback for teachers.

[0090] Example 3:

[0091] As Figure 3 shown, the difference from the above embodiment is that the remote consultation method includes the following steps:

[0092] S1, Select the meeting type: Select one of the voice meeting, video meeting, and data meeting to send a consultation invitation to the consultants.

[0093] S2, Consultation reception: After receiving the consultation invitation, the consultant confirms it. After the confirmation is completed, the consultation begins.

[0094] S3, Surgical analysis: Analyze the surgical site according to the consultation content, and construct a patient blood vessel model and an operating room environment; at the same time, retrieve the communication data, operation data, and basic data of the patient with the highest historical matching degree and who has recovered from the database. The consultant and the surgeon discuss according to the retrieved communication data, operation data, and basic data to construct a simulated surgical plan.

[0095] S4, Surgical simulation: According to the patient blood vessel model and the operating room environment, the consultant performs a simulated surgery according to the simulated surgical plan, observes the postoperative situation of the patient blood vessel model after the simulated surgery, and the consultant and the surgeon discuss the simulated surgery and the postoperative situation to optimize the surgical plan.

[0096] S5, Surgical practice: The surgeon performs surgical operations according to the optimized surgical plan.

[0097] The specific implementation process is as follows: In the surgical analysis stage, not only a patient blood vessel model and an operating room environment are constructed, but also the communication data, operation data, and basic data of the patient with the highest historical matching degree and who has recovered are retrieved from the database, providing accurate reference information for users, helping users to more deeply understand the patient's condition, and formulating a more reasonable surgical plan.

[0098] Through the simulated surgery, users can intuitively observe the surgical effect and discover potential problems. At the same time, the discussion between the consultant and the surgeon helps to further optimize the surgical plan, ensuring the safety and effectiveness of the surgery. This way of combining simulation and practice helps to improve the skill level of the surgeon and reduce the surgical risk.

[0099] Obviously, the above embodiments are merely examples given for clear illustration and are not limitations on the implementation manners. For those of ordinary skill in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to enumerate all implementation manners here. And the obvious changes or modifications derived therefrom still fall within the protection scope of the present invention.

Claims

1. A system for remote teaching and consultation of vascular intervention surgery, characterized in that: It includes consultation teaching module, surgery simulation module, data storage module and intelligent assistance module; The consultation and teaching module is used to conduct consultation and teaching through text communication, voice call, video call and data interaction, and generate text communication records, voice call records, video call records and data interaction records to be transmitted to the data storage module; During the operation, the consultation teaching module is used to record the surgical images from different perspectives in real time, generate surgical image records and transmit them to the data storage module; and transmit the surgical images from different perspectives to the display terminal of the consultant in real time, so that the consultant can consult through the surgical images from different perspectives; During teaching, the consultation teaching module transmits surgical images from different perspectives to the student's display terminal in real time, and students learn through surgical images from different perspectives; The surgical simulation module is used to identify the patient's vascular characteristics based on surgical images from different perspectives, build a patient's vascular model based on the patient's vascular characteristics using a 3D modeling program, and analyze the lesion location and optimal surgical site for vascular interventional surgery; simulate and annotate the patient's vascular model to mark the lesion location and optimal surgical site; The surgical simulation module is also used to collect the operator's hand features and the patient's postoperative vascular features based on surgical images from different viewing angles, and to construct a surgical operation model based on the operator's hand features and the patient's postoperative vascular features using a three-dimensional modeling program; During the consultation, the surgical simulation module also transmits the patient's vascular model to the consultant's display terminal for the consultant to perform simulated surgery, and generates simulated surgery records, which are fed back to the surgeon's display terminal; During teaching, the surgical simulation module also transmits the patient's vascular model to the student's display terminal for students to perform simulated surgical training, and generates training records, which are transmitted to the intelligent assistance module; A data storage module, used to receive and store text communication records, voice call records, video call records and data interaction records collected by the consultation teaching module, and generate communication data; The data storage module is also used to receive and store the patient blood vessel model, surgical operation model and simulated surgery record constructed by the surgical simulation module, and generate operation data; The data storage module is also used to input the patient's treatment information and the doctor's medical practice information to generate basic data; The communication data, operation data and basic data are summarized to generate a database for doctors to query; The intelligent assistance module is used to automatically retrieve relevant communication data, operation data and basic data from the database for consultation and teaching based on the keywords that appear in the consultation and teaching. The correct hand features during surgery and correct postoperative vascular features are pre-entered in the intelligent assistance module to generate control features. The intelligent assistance module is also used to compare the operator's hand features during surgery and the patient's postoperative vascular features with control features and conduct surgical evaluation based on the degree of match; The intelligent assistance module is also used to identify students' hand features and patients' postoperative vascular features based on their training records, and compare them with control features to conduct learning assessment based on the degree of match.

2. The system for remote teaching and consultation of vascular intervention surgery according to claim 1, characterized in that: The consultation teaching module includes a text communication unit, a voice call unit, a video call unit, and a data interaction unit; A text communication unit, used for text input, output and recognition; The text communication unit is also used to identify keywords and mark them; The voice communication unit is used for voice input, output and recognition; the voice communication unit is also used for converting the input and output voice into text; Video call unit, used for simultaneous input, output and recognition of images, voice and text; The data interaction unit is used for input, output and recognition of files.

3. The system for remote teaching and consultation of vascular intervention surgery according to claim 2, characterized in that: Different perspectives include the surgeon’s perspective, assistant’s perspective, nurse’s perspective, and monitoring perspective; During teaching, students adjust the viewing angle autonomously according to their own needs, and adjust the viewing angle of their own student display end; teachers uniformly adjust the viewing angle of all students' display ends according to teaching needs, and the priority of unified adjustment is higher than the priority of autonomous adjustment; During the consultation, the client independently adjusts his or her perspective according to his or her own needs.

4. The system for remote teaching and consultation of vascular intervention surgery according to claim 3, characterized in that: During teaching, the consultation teaching module is also used to retrieve historical surgical images from the database according to teaching needs and transmit them to the student's display terminal, so that students can learn according to the historical surgical images.

5. The system for remote teaching and consultation of vascular intervention surgery according to claim 4, characterized in that: Patients' vascular characteristics include vascular shape and size, vascular disease type, and vascular lesion shape and size; Hand characteristics include handheld instrument type, holding posture, and usage.

6. The system for remote teaching and consultation of vascular intervention surgery according to claim 5, characterized in that: The data storage module is also used to classify and store the communication data, operation data and basic data according to the type of vascular disease; The consultation teaching module and the surgery simulation module are also used to retrieve communication data, operation data, and basic data according to the type of vascular disease.

7. The system for remote teaching and consultation of vascular intervention surgery according to claim 6, characterized in that: During teaching, the surgical simulation module is also used to retrieve historical patient vascular models and their corresponding surgical operation models in the database for students to learn according to teaching needs, and use historical patient vascular models to build a training question bank for students to conduct simulated surgical training.

8. The system for remote teaching or consultation of vascular intervention surgery according to claim 7, characterized in that: The intelligent assistance module is also used to compare the postoperative patient vascular characteristics stored in the database, compare the optimal postoperative patient vascular characteristics, and retrieve the corresponding surgical operation model, and optimize the control characteristics according to the postoperative patient vascular characteristics and the surgical operation model.

9. A method for remote teaching and consultation of vascular intervention surgery, based on the system for remote teaching and consultation of vascular intervention surgery according to any one of claims 1 to 8, characterized in that: The distance learning method includes the following steps: S1, select the conference type: select one of the conference types of voice conference, video conference and data conference to send a course invitation to students; S2, course acceptance: students confirm after receiving the course invitation. After confirmation, the course starts; S3, surgical analysis: Analyze the surgical site according to the course content, build the patient's vascular model and operating room environment; or retrieve the historical patient's vascular model and operating room environment from the database; S4, surgical simulation: Based on the patient's vascular model and the operating room environment, students perform simulated surgery and observe the postoperative condition of the patient's vascular model after the simulated surgery. Students and teachers discuss the simulated surgery and postoperative condition and optimize the surgical plan; simulated surgery is performed again according to the optimized surgical plan; S5, Operational evaluation: The intelligent assistance module is used to evaluate the students’ two simulated surgeries and postoperative conditions. The teacher makes subjective adjustments based on the evaluation results to obtain the final evaluation results of the students.

10. The method for remote teaching and consultation of vascular intervention surgery according to claim 9, characterized in that: The teleconsultation method includes the following steps: S1, select the conference type: select one of the conference types of voice conference, video conference and data conference to send a consultation invitation to the consultant; S2, consultation reception: the consultant confirms the consultation invitation after receiving it. After confirmation, the consultation begins; S3, surgical analysis: Analyze the surgical site based on the consultation content and construct the patient's vascular model and operating room environment; At the same time, the communication data, operation data and basic data of the patients with the highest historical matching degree and who have recovered are retrieved from the database. The consultant and the surgeon discuss and construct a simulated surgery plan based on the retrieved communication data, operation data and basic data. S4, surgical simulation: Based on the patient's vascular model and the operating room environment, the consultant performs a simulated surgery according to the simulated surgical plan, observes the postoperative condition of the patient's vascular model after the simulated surgery, and the consultant and the surgeon discuss the simulated surgery and postoperative condition to optimize the surgical plan; S5, surgical practice: The surgeon performs the surgery according to the optimized surgical plan.

Images