Abdomen physical examination virtual teaching system and method based on viscera perspective

Abstract

The invention belongs to the technical field of virtual simulation of medical education, and discloses an abdominal physical examination virtual teaching system and method based on a perspective viscera visual angle, which can comprehensively collect learning data of students through a multi-module architecture design, perform real-time analysis and evaluation, and improve the teaching efficiency. And personalized learning suggestions and feedback are provided according to the specific condition of each user, so that the learning efficiency of the user can be improved, the precision and personalization of the teaching process can be realized according to the learning condition of the user, the viscera perspective technology is realized, the internal and external association can be visually displayed, the dynamic observation of the lesion process is supported, and the multi-angle observation view angle is provided. A standardized training system is established, a multi-level training scheme is set, a progressive learning path is provided, real-time operation evaluation is achieved, multi-dimensional ability evaluation is provided, personalized improvement suggestions are generated, a user can be helped to establish systematic clinical thinking, and the operation skill level is remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of medical education virtual simulation, and in particular to a virtual teaching system and method for abdominal physical examination based on a perspective of visceral view. Background Art

[0002] At present, there are many technical means in the field of abdominal physical examination teaching. For example, the use of physical examination teaching robots, integrated operation robots, manipulators and stethoscopes, can simulate the complete physical examination process; highly simulated intelligent fully automatic chest four-diagnosis examination computer manipulators, can accurately simulate chest examinations; AI-based virtual standard patient simulation systems, can randomly generate diseases and simulate consultations and course of disease; virtual standard patient-based diagnostic process simulation systems, complete simulation of the entire diagnostic process; clinical thinking ability training and assessment systems, with both teaching and assessment modes; electronic standardized patient simulation systems for physical examination training and assessment, integrating a variety of abdominal examination items; ultra-simulated virtual standardized patient construction systems and diagnostic methods, providing highly simulated visual experience and interactive functions; multifunctional abdominal physical examination simple models, with cleaning and indication functions; AR physical examination auxiliary systems based on big data models, using AR to assist teaching and generate reports; clinical skills training simulation systems, can simulate symptoms and signs and evaluation feedback.

[0003] However, these technologies still have many shortcomings. They lack a perspective on visceral diseases, making it difficult to intuitively present the relationship between abdominal organ lesions and surface operations, which is not conducive to students' understanding of the pathological mechanisms. Some technologies lack the diversity, in-depth analysis and integration of clinical cases, and are unable to fully demonstrate the complexity and diversity of abdominal diseases, which is not conducive to cultivating students' clinical thinking. Many technologies do not emphasize doctor-patient communication training, and are insufficient in improving students' communication skills with patients and their awareness of humanistic care. Some technical operation instructions are not detailed enough, and lack precise feedback and error correction mechanisms, which have limited help in students' standardized operations and skill improvement. Some technologies lack innovative teaching methods, making it difficult to stimulate students' interest and initiative in learning.

[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present invention is to provide a virtual teaching system and method for abdominal physical examination based on a perspective of visceral examination, aiming to solve the technical problems that the current teaching system is not conducive to students' understanding of the pathological mechanism, is not conducive to cultivating students' clinical thinking, lacks a multi-dimensional real-time evaluation and feedback mechanism, and is difficult to provide accurate teaching guidance.

[0006] To achieve the above-mentioned object, the present invention provides a virtual teaching system for abdominal physical examination based on a perspective of visceral view, the system comprising: an abdominal visual examination module, an abdominal auscultation module, an abdominal percussion module, a sitting examination module and an evaluation and analysis module;

[0007] The abdominal visual diagnosis module is used to show the user the appearance changes of the abdomen so that the user can perform visual diagnosis training, record the operation trajectory data input by the user based on the appearance changes, and send the operation trajectory data to the evaluation and analysis module;

[0008] The abdominal auscultation module is used to simulate a variety of abdominal auscultation sounds for the user to perform auscultation training, record the auscultation position, sequence and duration fed back by the user during the auscultation training, and send the auscultation position, sequence and duration to the evaluation and analysis module;

[0009] The abdominal percussion module is used to display the audio and tactile feedback of different percussion sounds for users to identify and learn;

[0010] The seat inspection module is used to simulate the seat inspection process for the user to perform the inspection operation, identify the completeness and accuracy of the user operation, and send the identification result to the evaluation and analysis module;

[0011] The evaluation and analysis module is used to perform real-time analysis and evaluation based on the operation trajectory data, the auscultation position, the sequence, the duration and the recognition result, and output user-personalized teaching feedback information based on the analysis and evaluation results.

[0012] In some embodiments, the abdominal visual diagnosis module is used to provide users with visual diagnosis training through three-dimensional animation demonstration and real-time feedback mechanism in posture selection training, and to provide users with visual diagnosis training through dynamic graphic guidance and intelligent error correction mechanism in abdominal zoning training.

[0013] In some embodiments, the abdominal visual examination module is used to achieve intelligent dialogue interaction with the user through a preset standardized question and answer library during the doctor-patient dialogue session, and in measurement training, through virtual scale tools and numerical displays, so that users can perform measurement operations.

[0014] In some embodiments, the abdominal auscultation module has a built-in clinical audio library, which contains a number of sound samples. The abdominal auscultation module is used to simulate the characteristics of sound conduction in a real auscultation environment through a sound localization algorithm and an attenuation model, and dynamically adjust the sound characteristics and intensity of the abdominal auscultation sound according to the position and pressure of the stethoscope when the user performs auscultation at different positions.

[0015] In some embodiments, the sitting examination module is used to simulate the percussion response under different pathological conditions through an accurate mechanical model, and to display the anatomical relationship between the costal spine point, the costal waist point and the internal organs in a three-dimensional perspective view, and to set up a virtual case at the same time, so that the user can perform examination operations under different pathological conditions.

[0016] In addition, to achieve the above-mentioned purpose, the present invention also proposes a virtual teaching method for abdominal physical examination based on a perspective of visceral perspective, and the virtual teaching method for abdominal physical examination based on a perspective of visceral perspective is applied to the virtual teaching system for abdominal physical examination based on a perspective of visceral perspective as described above, and the method comprises:

[0017] The abdominal visual diagnosis module displays the appearance changes of the abdomen to the user for the user to perform visual diagnosis training, records the operation track data input by the user based on the appearance changes, and sends the operation track data to the evaluation and analysis module;

[0018] The abdominal auscultation module simulates a variety of abdominal auscultation sounds for the user to perform auscultation training, records the auscultation position, sequence and duration fed back by the user during the auscultation training, and sends the auscultation position, sequence and duration to the evaluation and analysis module;

[0019] The abdominal percussion module displays audio and tactile feedback of different percussion sounds for users to learn how to identify them;

[0020] The seat inspection module simulates the seat inspection process to allow the user to perform inspection operations, identifies the completeness and accuracy of the user's operations, and sends the identification results to the evaluation and analysis module;

[0021] The evaluation and analysis module performs real-time analysis and evaluation based on the operation trajectory data, the auscultation position, the sequence, the duration, and the recognition result, and outputs user-personalized teaching feedback information based on the analysis and evaluation results.

[0022] In some embodiments, the method further comprises:

[0023] The abdominal visual diagnosis module provides users with visual diagnosis training through three-dimensional animation demonstration and real-time feedback mechanism in body position selection training, and provides users with visual diagnosis training through dynamic graphic guidance and intelligent error correction mechanism in abdominal zoning training.

[0024] In some embodiments, the method further comprises:

[0025] The abdominal visual examination module realizes intelligent dialogue interaction with the user through a preset standardized question and answer library during the doctor-patient dialogue session, and provides users with measurement operations through virtual scale tools and numerical displays during measurement training.

[0026] In some embodiments, the abdominal auscultation module has a built-in clinical audio library, the clinical audio library includes a number of sound samples, and the method further includes:

[0027] The abdominal auscultation module simulates the characteristics of sound conduction in a real auscultation environment through a sound localization algorithm and an attenuation model, and dynamically adjusts the sound characteristics and intensity of the abdominal auscultation sound according to the position and pressure of the stethoscope when the user performs auscultation at different positions.

[0028] In some embodiments, the method further comprises:

[0029] The sitting examination module simulates the tapping response under different pathological conditions through a precise mechanical model, and displays the anatomical relationship between the costal spine point, the costal waist point and the internal organs in a three-dimensional perspective view, and simultaneously sets up a virtual case for the user to perform examination operations under different pathological conditions.

[0030] The abdominal visual examination module of the present invention displays the appearance changes of the abdomen to the user for the user to perform visual examination training, records the operation trajectory data input by the user based on the appearance changes, and sends the operation trajectory data to the evaluation and analysis module; the abdominal auscultation module simulates a variety of abdominal auscultation sounds for the user to perform auscultation training, records the auscultation position, sequence and duration fed back by the user during the auscultation training, and sends the auscultation position, the sequence and the duration to the evaluation and analysis module; the abdominal percussion module displays the audio and tactile feedback of different percussion sounds for the user to recognize and learn; the sitting inspection module simulates the sitting inspection process for the user to perform inspection operations, identifies the completeness and accuracy of the user's operations, and sends the recognition results to the evaluation and analysis module; the evaluation and analysis module generates a plurality of abdominal auscultation sounds based on the operation trajectory data, the auscultation position, the sequence and the duration The sequence, duration and recognition result are analyzed and evaluated in real time, and personalized teaching feedback information for users is output according to the analysis and evaluation results. Through the multi-module architecture design, students' learning data can be comprehensively collected, real-time analysis and evaluation can be carried out, and personalized learning suggestions and feedback can be provided according to the specific situation of each user. It can not only improve the learning efficiency of users, but also realize the precision and personalization of the teaching process according to the learning situation of users, realize the technology of perspective viscera, can intuitively display the internal and external connection, support dynamic observation of the pathological process, provide multi-angle observation perspectives, establish a standardized training system, set up multi-level training plans, provide a step-by-step learning path, real-time operation evaluation, provide multi-dimensional ability evaluation, generate personalized improvement suggestions, and help users establish a systematic clinical thinking and significantly improve their operational skills. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1It is a structural block diagram of a first embodiment of a virtual teaching system for abdominal physical examination based on a perspective view of internal organs of the present invention;

[0032] Figure 2 It is a schematic diagram of the overall system development framework in the virtual teaching system for abdominal physical examination based on the perspective of visceral view of the present invention;

[0033] Figure 3 It is a schematic diagram of the overall system architecture of the virtual teaching system for abdominal physical examination based on the perspective of visceral view of the present invention;

[0034] Figure 4 It is a flowchart of the first embodiment of the virtual teaching method for abdominal physical examination based on the perspective of visceral perspective of the present invention.

[0035] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0036] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0037] The embodiment of the present invention provides a virtual teaching system for abdominal physical examination based on a perspective view of internal organs. Figure 1 , Figure 1 This is a structural block diagram of a first embodiment of a virtual teaching system for abdominal physical examination based on a perspective of visceral view according to the present invention.

[0038] In this embodiment, the abdominal physical examination virtual teaching system based on the perspective of visceral perspective includes an abdominal visual examination module 10, an abdominal auscultation module 20, an abdominal percussion module 30, a sitting examination module 40 and an evaluation and analysis module 50, wherein the abdominal visual examination module 10 is used to show the user the appearance changes of the abdomen for the user to perform visual examination training, record the operation trajectory data input by the user based on the appearance changes, and send the operation trajectory data to the evaluation and analysis module 50; the abdominal auscultation module 20 is used to simulate a variety of abdominal auscultation sounds for the user to perform auscultation training, record the auscultation position, sequence and duration fed back by the user during the auscultation training, and send the operation trajectory data to the evaluation and analysis module 50. The auscultation position, the sequence and the duration are sent to the evaluation and analysis module 50; the abdominal percussion module 30 is used to display the audio and tactile feedback of different percussion sounds for the user to identify and learn; the sitting inspection module 40 is used to simulate the sitting inspection process for the user to perform inspection operations, identify the completeness and accuracy of the user's operations, and send the identification results to the evaluation and analysis module 50; the evaluation and analysis module 50 is used to perform real-time analysis and evaluation based on the operation trajectory data, the auscultation position, the sequence, the duration and the identification results, and output user-personalized teaching feedback information based on the analysis and evaluation results.

[0039] It should be noted that the virtual teaching system for abdominal physical examination based on visceral perspective in this embodiment includes three basic architecture layers, namely, the basic layer, the software layer and the application layer. The overall system development framework and system architecture can be referred to Figure 2 and Figure 3As shown in the figure, in terms of the basic layer implementation, a complete communication and data processing architecture is designed for the abdominal physical examination virtual teaching system based on the perspective of visceral perspective. This layer adopts a design mode of multiple clients connected to one server, in which the client is mainly responsible for the user interface display and the collection and transmission of user interaction data. The server is equipped with a high-performance computing processing unit, which is responsible for receiving and processing data from each client. The key advantages of this architectural design are: first, it realizes the centralized management of computing resources, and the server can uniformly handle complex physical calculations and data analysis tasks; second, it ensures data consistency and effectively prevents users from cheating during operation; finally, it can synchronously maintain the physical performance and interaction status between different users to ensure the fairness and consistency of the teaching experience. In terms of the security mechanism of the basic layer, the abdominal physical examination virtual teaching system based on the perspective of visceral perspective implements a comprehensive data protection strategy. In the data transmission link, the SSL encryption protocol is used for communication encryption to ensure the security of user operation data during transmission. In terms of user authentication, a unified identity authentication system is implemented, including user login verification, authority management, and behavior tracking. The system has also established a complete data backup mechanism, which ensures the security of user learning data and system configuration information by combining scheduled backup and incremental backup. In addition, the system has also implemented a real-time monitoring mechanism, which can timely detect and handle abnormal operation behaviors and maintain teaching order. In terms of the technical implementation of the software layer, the virtual teaching system of abdominal physical examination based on the perspective of visceral perspective adopts a series of advanced software development tools and technical frameworks. First, in the selection of virtual reality development engine, the system adopts the current mainstream engine technology, and realizes a highly realistic virtual teaching environment through the powerful three-dimensional rendering capability and physical engine support of the engine. Secondly, in terms of data management, the system uses MySQL database as the underlying data storage and management tool. The database design adopts a standardized data structure and establishes a complete data table system including user information table, learning record table, evaluation data table, case resource table, etc. The reasonable association relationship between these data tables realizes efficient management and rapid retrieval of data. In terms of three-dimensional model construction, the virtual teaching system of abdominal physical examination based on the perspective of visceral perspective adopts a professional-level three-dimensional modeling tool chain. First, high-definition camera equipment is used to collect photos and video materials of real medical scenes as the basic reference for modeling. Then, a team of experienced modelers will use professional 3D modeling software such as 3ds Max or Maya to carry out detailed modeling. In the modeling process, special attention is paid to the accuracy of the anatomical structure and the true restoration of pathological characteristics. In order to optimize the operating efficiency of the model, the system appropriately simplifies and optimizes the model while ensuring the visual effect, including the control of the number of model faces, the optimization of UV mapping, and the fine adjustment of skeletal animation.In terms of human-computer interaction interface design, the system uses Adobe's professional design tool suite. The interface design team uses Photoshop to design interface elements and process images, and uses Illustrator to create vector icons and interface decoration elements. In the interactive design process, special attention is paid to the professional needs of medical teaching, and an interactive method that conforms to medical operation habits is designed.

[0040] In the specific implementation, in the specific implementation of the application layer, the abdominal physical examination virtual teaching system based on the perspective of the visceral perspective is designed with five closely related functional modules, the abdominal visual diagnosis module 10, which is used for visual diagnosis training for users through three-dimensional animation demonstration and real-time feedback mechanism in the body position selection training, and for visual diagnosis training for users through dynamic graphic guidance and intelligent error correction mechanism in the abdominal partition training. For example, the abdominal visual diagnosis module 10 is designed around the basics of doctor-patient communication and physical examination. In the doctor-patient dialogue link, the system realizes intelligent dialogue interaction through a preset standardized question and answer library. In the body position selection training, the system guides students to master the standard examination body position through three-dimensional animation demonstration and real-time feedback mechanism. In particular, in the abdominal partition method training, the system helps students accurately grasp the key points of the nine-point method and the four-point method through dynamic graphic guidance and intelligent error correction mechanism. At the same time, in specific operations such as abdominal circumference measurement, the system realizes accurate measurement training through virtual scale tools and numerical display.

[0041] The abdominal auscultation module 20 has a built-in clinical audio library, which contains several sound samples. The abdominal auscultation module 20 is used to simulate the characteristics of sound conduction in a real auscultation environment through a sound localization algorithm and an attenuation model, and dynamically adjust the sound characteristics and intensity of the abdominal auscultation sound according to the position and pressure of the stethoscope when the user performs auscultation at different positions. For example, the abdominal auscultation module 20 uses advanced audio processing technology to achieve a highly realistic auscultation experience. The system has a rich built-in clinical audio library, including sound samples such as normal bowel sounds, hyperactive bowel sounds, and various vascular murmurs. These sound samples are all collected from real clinical cases, and after professional post-processing, the accuracy of the sound characteristics is ensured. In actual operation, the system simulates the characteristics of sound conduction in a real auscultation environment through a sound localization algorithm and an attenuation model. When students perform auscultation at different positions, the system dynamically adjusts the characteristics and intensity of the sound according to factors such as the position and pressure of the stethoscope, thereby providing a real auscultation experience.

[0042] The Abdominal Percussion Module 30 uses a sophisticated physics engine to simulate the percussion process. The system has established a detailed sound response model based on the physical properties of different organs and tissues. When percussing the upper and lower boundaries of the liver, the system helps students accurately identify the characteristics of different percussion sounds through the dynamic changes in sound characteristics. Especially in the training of mobile dullness percussion, the system simulates the flow characteristics of ascites in different body positions through a fluid mechanics model, and changes the characteristics of the percussion sound accordingly. At the same time, the system is also equipped with a real-time three-dimensional perspective function, so that students can intuitively understand the correspondence between the percussion position and the internal organs.

[0043] The sitting inspection module 40 is used to simulate the tapping reaction under different pathological conditions through an accurate mechanical model, and to display the anatomical relationship between the costal spine point, the costal waist point and the internal organs in a three-dimensional perspective view, and to set up virtual cases at the same time, so that users can perform inspection operations under different pathological conditions. For example, the sitting inspection module 40 integrates a variety of inspection techniques, focusing on the inspection training of the costal spine. In the costal spine angle tapping training, the system simulates the tapping reaction under different pathological conditions through an accurate mechanical model. The system also clearly displays the anatomical relationship between the costal spine point, the costal waist point and the internal organs in a three-dimensional perspective view, helping students understand the clinical significance of tender points. At the same time, through the setting of virtual cases, the system allows students to perform inspection training under different pathological conditions and deepen their understanding of clinical signs.

[0044] In terms of the specific implementation of the evaluation feedback system, the virtual teaching system for abdominal physical examination based on the perspective of visceral perspective adopts a multi-dimensional intelligent evaluation mechanism. The system uses the data acquisition module to record the various indicators of students during the operation in real time, including operation timing, technique standardization, force control, diagnostic accuracy, etc. These data are analyzed through the preset evaluation algorithm to generate a comprehensive evaluation report. In terms of operation proficiency evaluation, the system evaluates the time efficiency and fluency of students in completing various inspection operations through intelligent timing and operation trajectory analysis.

[0045] The evaluation of doctor-patient communication ability uses natural language processing technology. The system can analyze whether the language used by students during the consultation process is professional and appropriate, whether it complies with the basic principles of doctor-patient communication, whether the key information of the patient is accurately obtained, whether important consultation content is omitted, and give corresponding improvement suggestions. At the same time, the system will also evaluate the students' awareness of humanistic care during the communication process.

[0046] In terms of clinical thinking training, the system has designed a complete thinking training evaluation system. By analyzing students' inspection operation sequence, key focus areas, supplementary inspection selection and other behaviors, the system evaluates whether students' clinical thinking logic is clear and whether they have a systematic inspection awareness. The system also examines students' analytical and judgment abilities when facing complex conditions by setting clinical cases of different difficulty levels. The evaluation system will record students' decision-making process when handling various cases and analyze whether they have accurate disease judgment abilities and reasonable diagnosis and treatment ideas.

[0047] The data management module of the virtual teaching system for abdominal physical examination based on the perspective of visceral examination adopts a distributed storage architecture to achieve efficient management of massive teaching data. The system stores students' learning process data, evaluation result data, case resource data, etc. in categories, and establishes a complete data indexing mechanism. Through data mining algorithms, the system can extract valuable teaching information from these data and provide data support for teaching management and teaching improvement. At the same time, the system also establishes a data sharing mechanism to support resource sharing and teaching experience exchange between different teaching units.

[0048] In terms of system maintenance and update, the virtual teaching system of abdominal physical examination based on the perspective of visceral view adopts a modular design concept, which is convenient for functional expansion and content update. The system provides a convenient resource update interface, so that teaching management personnel can easily add new teaching content and update case library resources. At the same time, the system also has an automated performance monitoring mechanism, which can timely discover and handle potential problems in system operation to ensure the stable operation of the system.

[0049] Through the implementation of the above technical solutions, the abdominal physical examination virtual teaching system based on the perspective of visceral perspective has successfully built a comprehensive abdominal physical examination virtual teaching platform. The system can not only provide medical students with high-quality practical training opportunities, but also help students to continuously improve and enhance through intelligent evaluation and feedback mechanisms. At the same time, the open architecture design of the system also provides a good foundation for future functional expansion and optimization and upgrading.

[0050] In this embodiment, the abdominal visual diagnosis module displays the appearance changes of the abdomen to the user for the user to perform visual diagnosis training, records the operation trajectory data input by the user based on the appearance changes, and sends the operation trajectory data to the evaluation and analysis module; the abdominal auscultation module simulates a variety of abdominal auscultation sounds for the user to perform auscultation training, records the auscultation position, sequence and duration fed back by the user during the auscultation training, and sends the auscultation position, the sequence and the duration to the evaluation and analysis module; the abdominal percussion module displays the audio and tactile feedback of different percussion sounds for the user to recognize and learn; the sitting inspection module simulates the sitting inspection process for the user to perform inspection operations, identifies the completeness and accuracy of the user's operations, and sends the recognition results to the evaluation and analysis module; the evaluation and analysis module generates a set of information based on the operation trajectory data, the auscultation position, the sequence and the duration. The sequence, the duration and the recognition result are analyzed and evaluated in real time, and personalized teaching feedback information for users is output according to the analysis and evaluation results. Through the multi-module architecture design, the students' learning data can be comprehensively collected, real-time analysis and evaluation can be performed, and personalized learning suggestions and feedback can be provided according to the specific situation of each user. This can not only improve the user's learning efficiency, but also realize the precision and personalization of the teaching process according to the user's learning situation, realize the visceral perspective technology, can intuitively display the internal and external connection, support dynamic observation of the pathological process, provide multi-angle observation perspectives, establish a standardized training system, set up multi-level training plans, provide a step-by-step learning path, real-time operation evaluation, provide multi-dimensional ability evaluation, generate personalized improvement suggestions, and help users establish a systematic clinical thinking and significantly improve their operational skills.

[0051] Reference Figure 4 , Figure 4 It is a flowchart of the first embodiment of the virtual teaching method for abdominal physical examination based on the perspective of visceral perspective of the present invention.

[0052] like Figure 4 As shown, the virtual teaching method for abdominal physical examination based on the perspective of visceral examination proposed in the embodiment of the present invention includes:

[0053] Step S10: The abdominal visual diagnosis module displays the appearance changes of the abdomen to the user for visual diagnosis training, records the operation trajectory data input by the user based on the appearance changes, and sends the operation trajectory data to the evaluation and analysis module.

[0054] Step S20: The abdominal auscultation module simulates a variety of abdominal auscultation sounds for the user to perform auscultation training, records the auscultation position, sequence and duration feedback from the user during the auscultation training, and sends the auscultation position, sequence and duration to the evaluation and analysis module.

[0055] Step S30: The abdominal percussion module displays the audio and tactile feedback of different percussion sounds for the user to identify and learn.

[0056] Step S40: The seat inspection module simulates the seat inspection process to allow the user to perform inspection operations, identifies the completeness and accuracy of the user's operations, and sends the identification results to the evaluation and analysis module.

[0057] Step S50: The evaluation and analysis module performs real-time analysis and evaluation based on the operation trajectory data, the auscultation position, the sequence, the duration and the recognition result, and outputs user-personalized teaching feedback information based on the analysis and evaluation results.

[0058] In this embodiment, the abdominal visual diagnosis module displays the appearance changes of the abdomen to the user for the user to perform visual diagnosis training, records the operation trajectory data input by the user based on the appearance changes, and sends the operation trajectory data to the evaluation and analysis module; the abdominal auscultation module simulates a variety of abdominal auscultation sounds for the user to perform auscultation training, records the auscultation position, sequence and duration fed back by the user during the auscultation training, and sends the auscultation position, the sequence and the duration to the evaluation and analysis module; the abdominal percussion module displays the audio and tactile feedback of different percussion sounds for the user to recognize and learn; the sitting inspection module simulates the sitting inspection process for the user to perform inspection operations, identifies the completeness and accuracy of the user's operations, and sends the recognition results to the evaluation and analysis module; the evaluation and analysis module generates a set of information based on the operation trajectory data, the auscultation position, the sequence and the duration. The sequence, the duration and the recognition result are analyzed and evaluated in real time, and personalized teaching feedback information for users is output according to the analysis and evaluation results. Through the multi-module architecture design, the students' learning data can be comprehensively collected, real-time analysis and evaluation can be performed, and personalized learning suggestions and feedback can be provided according to the specific situation of each user. This can not only improve the user's learning efficiency, but also realize the precision and personalization of the teaching process according to the user's learning situation, realize the visceral perspective technology, can intuitively display the internal and external connection, support dynamic observation of the pathological process, provide multi-angle observation perspectives, establish a standardized training system, set up multi-level training plans, provide a step-by-step learning path, real-time operation evaluation, provide multi-dimensional ability evaluation, generate personalized improvement suggestions, and help users establish a systematic clinical thinking and significantly improve their operational skills.

[0059] In some embodiments, the method further comprises:

[0060] The abdominal visual diagnosis module provides users with visual diagnosis training through three-dimensional animation demonstration and real-time feedback mechanism in body position selection training, and provides users with visual diagnosis training through dynamic graphic guidance and intelligent error correction mechanism in abdominal zoning training.

[0061] In some embodiments, the method further comprises:

[0062] The abdominal visual examination module realizes intelligent dialogue interaction with the user through a preset standardized question and answer library during the doctor-patient dialogue session, and provides users with measurement operations through virtual scale tools and numerical displays during measurement training.

[0063] In some embodiments, the method further comprises:

[0064] The sitting examination module simulates the tapping response under different pathological conditions through a precise mechanical model, and displays the anatomical relationship between the costal spine point, the costal waist point and the internal organs in a three-dimensional perspective view, and simultaneously sets up a virtual case for the user to perform examination operations under different pathological conditions.

[0065] In some embodiments, the abdominal auscultation module has a built-in clinical audio library, the clinical audio library includes a number of sound samples, and the method further includes:

[0066] The abdominal auscultation module simulates the characteristics of sound conduction in a real auscultation environment through a sound localization algorithm and an attenuation model, and dynamically adjusts the sound characteristics and intensity of the abdominal auscultation sound according to the position and pressure of the stethoscope when the user performs auscultation at different positions.

[0067] An embodiment of the present application also provides a virtual teaching device for abdominal physical examination based on a perspective of visceral perspective, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus, and the memory is used to store a virtual teaching program for abdominal physical examination based on a perspective of visceral perspective; the processor is used to implement the above-mentioned virtual teaching method for abdominal physical examination based on a perspective of visceral perspective when executing the program stored in the memory.

[0068] The communication bus mentioned in the above-mentioned abdominal physical examination virtual teaching device based on the perspective visceral perspective can be a peripheral component interconnect standard (English: Peripheral Component Interconnect, referred to as: PCI) bus or an extended industry standard architecture (English: Extended Industry Standard Architecture, referred to as: EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc.

[0069] The communication interface is used for communication between the above-mentioned abdominal physical examination virtual teaching device based on perspective visceral view and other devices.

[0070] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0071] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, and discrete hardware components.

[0072] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.

[0073] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0074] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0075] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

[0076] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.

[0077] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.

[0078] In addition, for technical details not fully described in this embodiment, reference can be made to the virtual teaching system and method for abdominal physical examination based on a perspective of visceral examination provided in any embodiment of the present invention, which will not be described in detail here.

[0079] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0080] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0081] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0082] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

[0083] It is understandable that the system provided by the embodiment of the present invention corresponds to the method provided by the embodiment of the present invention, and the explanation, examples and beneficial effects of the relevant contents can refer to the corresponding parts in the above method.

Claims

1. A virtual teaching system for abdominal physical examination based on visceral perspective, characterized in that: The system includes: an abdominal visual examination module, an abdominal auscultation module, an abdominal percussion module, a sitting examination module and an evaluation and analysis module; The abdominal visual diagnosis module is used to show the user the appearance changes of the abdomen so that the user can perform visual diagnosis training, record the operation trajectory data input by the user based on the appearance changes, and send the operation trajectory data to the evaluation and analysis module; The abdominal auscultation module is used to simulate a variety of abdominal auscultation sounds for the user to perform auscultation training, record the auscultation position, sequence and duration fed back by the user during the auscultation training, and send the auscultation position, sequence and duration to the evaluation and analysis module; The abdominal percussion module is used to display the audio and tactile feedback of different percussion sounds for users to identify and learn; The seat inspection module is used to simulate the seat inspection process for the user to perform the inspection operation, identify the completeness and accuracy of the user operation, and send the identification result to the evaluation and analysis module; The evaluation and analysis module is used to perform real-time analysis and evaluation based on the operation trajectory data, the auscultation position, the sequence, the duration and the recognition result, and output user-personalized teaching feedback information based on the analysis and evaluation results.

2. The system according to claim 1, characterized in that The abdominal visual diagnosis module is used to provide users with visual diagnosis training through three-dimensional animation demonstration and real-time feedback mechanism in body position selection training, and to provide users with visual diagnosis training through dynamic graphic guidance and intelligent error correction mechanism in abdominal zoning training.

3. The system according to claim 2, characterized in that The abdominal visual examination module is used to realize intelligent dialogue interaction with users through a preset standardized question and answer library during the doctor-patient dialogue, and to provide users with measurement operations through virtual scale tools and numerical display during measurement training.

4. The system according to claim 1, characterized in that The abdominal auscultation module has a built-in clinical audio library, which contains a number of sound samples. The abdominal auscultation module is used to simulate the characteristics of sound conduction in a real auscultation environment through a sound localization algorithm and an attenuation model, and dynamically adjust the sound characteristics and intensity of the abdominal auscultation sound according to the position and pressure of the stethoscope when the user performs auscultation at different positions.

5. The system according to claim 1, wherein: The sitting examination module is used to simulate the percussion response under different pathological conditions through an accurate mechanical model, and to display the anatomical relationship between the costal spine point, the costal waist point and the internal organs in a three-dimensional perspective view, and to set up a virtual case at the same time, so that the user can perform examination operations under different pathological conditions.

6. A virtual teaching method for abdominal physical examination based on a perspective of visceral perspective, the virtual teaching method for abdominal physical examination based on a perspective of visceral perspective is applied to a virtual teaching system for abdominal physical examination based on a perspective of visceral perspective as described in any one of claims 1 to 5, characterized in that: The method comprises: The abdominal visual diagnosis module displays the appearance changes of the abdomen to the user for the user to perform visual diagnosis training, records the operation track data input by the user based on the appearance changes, and sends the operation track data to the evaluation and analysis module; The abdominal auscultation module simulates a variety of abdominal auscultation sounds for the user to perform auscultation training, records the auscultation position, sequence and duration fed back by the user during the auscultation training, and sends the auscultation position, sequence and duration to the evaluation and analysis module; The abdominal percussion module displays audio and tactile feedback of different percussion sounds for users to learn how to identify them; The seat inspection module simulates the seat inspection process to allow the user to perform inspection operations, identifies the completeness and accuracy of the user's operations, and sends the identification results to the evaluation and analysis module; The evaluation and analysis module performs real-time analysis and evaluation based on the operation trajectory data, the auscultation position, the sequence, the duration, and the recognition result, and outputs user-personalized teaching feedback information based on the analysis and evaluation results.

7. The method according to claim 6, characterized in that The method further comprises: The abdominal visual diagnosis module provides users with visual diagnosis training through three-dimensional animation demonstration and real-time feedback mechanism in body position selection training, and provides users with visual diagnosis training through dynamic graphic guidance and intelligent error correction mechanism in abdominal zoning training.

8. The method according to claim 7, characterized in that The method further comprises: The abdominal visual examination module realizes intelligent dialogue interaction with the user through a preset standardized question and answer library during the doctor-patient dialogue session, and provides users with measurement operations through virtual scale tools and numerical displays during measurement training.

9. The method according to claim 6, characterized in that The abdominal auscultation module has a built-in clinical audio library, and the clinical audio library contains a number of sound samples. The method also includes: The abdominal auscultation module simulates the characteristics of sound conduction in a real auscultation environment through a sound localization algorithm and an attenuation model, and dynamically adjusts the sound characteristics and intensity of the abdominal auscultation sound according to the position and pressure of the stethoscope when the user performs auscultation at different positions.

10. The method according to claim 6, characterized in that The method further comprises: The sitting examination module simulates the tapping response under different pathological conditions through a precise mechanical model, and displays the anatomical relationship between the costal spine point, the costal waist point and the internal organs in a three-dimensional perspective view, and simultaneously sets up a virtual case for the user to perform examination operations under different pathological conditions.

Images