Midwifery teaching device, man-machine interaction midwifery system and midwifery quality assessment system

Through mixed reality technology combining the abdominal and fetal models of pregnant women, the visual and tactile combination of midwifery teaching is achieved, solving the problems of insufficient immersion and high maintenance costs in the existing technology, providing comprehensive midwifery simulation and evaluation functions, and improving the Teaching effectiveness and safety.

CN118982941APending Publication Date: 2024-11-19CAPITAL UNIVERSITY OF MEDICAL SCIENCES
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411382943.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-03-09
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

In the midwifery teaching, the existing technology has problems such as insufficient immersion, high maintenance costs, large material losses, and the inability to fully simulate the midwifery process. It also lacks the comprehensive application of vision, hearing, and touch and synchronous training functions.

Method used

Using a midwifery simulation system based on mixed reality technology, combining the abdominal model and fetal model of pregnant women, real-time positioning and body posture adjustment are performed through sensing modules and modeling modules, providing three-dimensional model and feedback simulation, realizing the combination of vision and touch, which is divided into Demonstration, practice, and assessment mode, using teachers' intuitive assessment and evaluation system.

Benefits of technology

It improves students' practical operation ability and spatial imagination ability, reduces teaching costs, realizes comprehensive simulation and multiple reuses of the midwifery process, and enhances teaching effect and safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118982941A_ABST
    Figure CN118982941A_ABST
Patent Text Reader

Abstract

The invention relates to a midwifery teaching device, a man-machine interaction midwifery system and a midwifery quality assessment system.In the midwifery teaching device, a sensing module comprises a plurality of positioning sensors arranged at all parts of a fetus model and an angle sensor of a rotating mechanism arranged in a pregnant woman abdomen model; confirming the posture characteristics of the current fetal model according to the horizontal rotation angle of the fetal model and the horizontal rotation angle; the modeling module is used for modeling a geometric three-dimensional model based on posture characteristics of a fetus model, and the guiding module is used for displaying a standard hand model matched with the spatial position of a fetus and displaying correct operation steps; and the standard hand model is a physical model which is established by the modeling module through grid segmentation, model replacement and feedback model processing through a geometric three-dimensional model and conforms to a normal hand standard. According to the invention, while a more real simulated midwifery environment is provided, a standard operation scheme is provided, and clinical teaching is more beneficial to improvement of technical operability.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The original basis of this divisional application is the patent application with application number (2022102454022), application date 2022.03.09, and invention name “A midwifery simulation system and method based on mixed reality technology”. Technical Field

[0002] The present invention relates to the field of mixed reality technology, and in particular to a midwifery teaching device, a human-computer interactive midwifery system and a midwifery quality assessment system. Background Art

[0003] Midwifery is an important subject in undergraduate clinical nursing. It is highly operational and has abstract content, which makes it difficult for students to understand and master it in a short period of time. In recent years, due to the increase in the number of students, the limited number of teaching hospitals and the constraints of medical ethics, clinical practice teaching resources are relatively scarce, which makes it difficult for students to learn various clinical skills and operations multiple times and completely during practice. Mixed reality (MR) technology is becoming increasingly mature, with attributes such as immersion, interactivity, imagination, and multi-sensory. It is not restricted by "time" and "space", which helps to strengthen students' understanding and mastery of theoretical knowledge, and helps students to perform various midwifery operations in a combination of virtual and real situations. It also enables students to basically master the necessary operation skills before entering the clinic, and be familiar with the operation process and teamwork, which is conducive to the cultivation of OBE-oriented midwifery talents. Therefore, applying mixed reality technology to midwifery practice teaching is an important measure to optimize midwifery practice teaching.

[0004] Chinese patent CN106781798A discloses a fetal four-step palpation simulation system and method based on VR technology. The system includes a palpation simulation human body device, a control and sensing unit, a host computer, and a VR virtual helmet; the palpation simulation human body device includes a palpation platform, a shell that imitates the upper body shape of a pregnant woman and is arranged on the palpation platform, and an artificial simulated abdominal skin covering the abdomen of the shell; a simulated fetal platform and a simulated uterus arranged on the simulated fetal platform are arranged in the abdominal cavity of the shell, and a simulated fetus is arranged in the simulated uterus, and a liquid is filled to serve as amniotic fluid; a servo is arranged at a corresponding position of the shell abdomen on the palpation platform, and the servo drives the simulated fetal platform to rotate horizontally through a servo turntable connected to its output shaft, thereby adjusting the direction of the simulated fetal head in the simulated uterus; the control and sensing unit includes a controller and a distance sensor and a gesture sensor connected to the controller. This patent realizes the intuitive four-step palpation experience and training of the operator through the simulation of highly simulated virtual four-step palpation, which has great application value for the four-step palpation training of medical students and corresponding nursing staff.

[0005] The defects of this patent are: first, VR virtual reality technology is used. Although VR virtual reality technology has developed rapidly and has a strong sense of immersion, the limitations of current science and technology determine the upper limit of VR virtual reality technology. While it has multi-sensory and interactive features, it also brings about a reduction in return stability and visual experience. The inability to ensure smooth operation of resolutions above 4K causes serious discomfort to the user's brain, such as dizziness and vomiting. VR technology cannot become mainstream, cannot "cheat" the user's brain, and whether the discomfort causes harm to the user's body will inevitably affect the development and application of VR technology; second, the main architecture of this patent is not VR technology, but a simulated fetus. VR value is less reflected and is only used to view specific operations. If the simulated fetus is used alone, its technical effect can also be achieved. Third, the filling of liquid leads to high maintenance costs for the simulated fetus, and it is impossible to avoid material loss and automatic corresponding evaluation standards. It is less practical and costly, and its body position can only be adjusted in a small range, and it is impossible to fully simulate all fetal-related body positions.

[0006] Chinese patent CN106991887A discloses a simulated fetus and a simulated pregnant woman for teaching a four-step palpation method, belonging to the field of medical teaching. The simulated fetus includes a fetal model, a horizontal rotation device for driving the fetal model to rotate horizontally, a longitudinal flipping device for driving the fetal model to flip longitudinally, and a supporting device for supporting the fetal model. The fetal model is rotatably arranged on the top of the supporting device through the flipping device. The simulated pregnant woman is provided with a simulated sacrum at the uterine opening below the abdomen of the simulated pregnant woman. The fetal model is arranged in the abdomen of the simulated pregnant woman through the simulated sacrum. The simulated fetus is driven to rotate horizontally by a horizontal rotation device, and the fetus is flipped in pitch by a longitudinal flipping device. Therefore, the fetus can be rotated to any position according to the specific needs of the training to carry out four-step palpation teaching, thereby improving the quality of teaching.

[0007] The defects of this patent are that the actual operation of the user cannot be improved only by using a physical fetus, the user cannot realize multiple functions such as perspective, standard hand viewing and automatic scoring through mixed reality technology, the loss of materials cannot be avoided, the cost is high, and its internal structure is complex, resulting in a short service life. It is also unable to fully simulate all situations in the midwifery process, and the time cost of repeated use is high, and there are many problems, so it is not likely to be widely used.

[0008] Chinese patent CN106991887A discloses a clinical palpation and fetal heart auscultation teaching system and method with interactive tactile feedback, including a 3D model processing module, a display module, a question bank management module, a teaching module, an assessment module, a control module and a system setting module; the patent is easy to use and the teaching process is vivid and vivid, so that students can learn through observation, touch and other methods. Compared with the traditional teaching method, students can learn the corresponding operation skills through practical operation, which greatly improves the teaching effect of four-part palpation and fetal heart auscultation. Moreover, after practice, students can take the assessment of the learning content, answer the corresponding knowledge points during the assessment, and record and score the students' scores according to the correctness of the answers, so as to improve the students' mastery of knowledge.

[0009] The defect of this patent is that it focuses on teaching, such as question bank management, test paper assessment, and grade management, etc., which contains a lot of theoretical knowledge. In fact, the above teaching can still be carried out without using the system, and it does not improve spatial imagination and practical operation capabilities. The interactive tactile feedback included is relatively simple, which is only a simple position judgment and sound judgment and selection. For the midwifery simulation system that requires synchronous comprehensive training of vision, hearing, and touch, it does not have a high application value.

[0010] The present invention is based on MR mixed reality technology, and combines the virtual and the real for teaching, so that vision, hearing, and touch can be used comprehensively and trained synchronously. The user can touch the position of the "real" fetus, and see the projection of the virtual image on the real object through his own eyes from the mixed reality helmet, and see the actual posture of the fetus in the uterus of the palpation model, the fetal heart beat, the position of the placenta, the umbilical cord and the amniotic fluid of the corresponding fetus. At the same time, other people who are not wearing helmets can see through the display screen, the projection of the first or third person mixed virtual images and real objects on the mixed reality device, in addition to seeing the position of the fetus in the mother's body, the fetal heart, placenta, amniotic fluid and umbilical cord virtual images, and even blood flow, they can also see the operator's actions. The four-part palpation physical model is visualized, and vision and touch are combined. Through repeated practice, not only the standardized operation of the four-part palpation is mastered, but also judgments can be made quickly through visualized touch.

[0011] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the inventor studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the invention

[0012] In view of the deficiencies of the prior art, the technical solution of the present invention is to provide a midwifery simulation system based on mixed reality technology, including a mixed reality device for displaying a three-dimensional model of a fetus and simulating midwifery operations for transmitting data, and also including: a pregnant woman's abdomen model, the pregnant woman's abdomen model including a pregnant woman's cavity and a fetus model, the fetus model is located inside the pregnant woman's cavity and based on the sensing module, the body characteristics of the fetus model are located and the modeling module performs geometric three-dimensional modeling; wherein, the present invention is based on mixed reality technology to simulate midwifery teaching, which is more practical than the traditional teaching method based on theoretical knowledge, and multiple clinical operations make teaching simple, while real-time guidance makes practical operation ability improve rapidly. And the fetus model can change its body characteristics in the pregnant woman's cavity under the action of a rotating mechanism to meet various situations that may occur in reality.

[0013] According to a preferred embodiment, the system is provided with a sensor module for positioning the posture of the fetus, and the sensor module is provided with positioning sensors on the head, buttocks and back of the fetal model respectively and transmits data to the modeling module for modeling based on the body posture of the fetal model, and the sensor module is also provided with an angle sensor on the rotating mechanism, which confirms the body posture of the fetal model based on the horizontal rotation angle and horizontal rotation angle of the fetal model and verifies the data with the detection data of the positioning sensor. Through the combination of the pregnant woman's abdomen model and mixed reality technology, the site is arranged quickly, and teaching work can be carried out quickly, and the positioning is performed by the sensor module, and its position is standard, so that the virtual scene is restored one-to-one with the reality, which enhances the connection between teaching and practice and the teaching effect.

[0014] According to a preferred embodiment, a rotating mechanism for adjusting the body shape characteristics of the fetal model is provided in the pregnant woman's cavity, and the rotating mechanism adjusts the body shape characteristics based on adjusting the horizontal rotation angle and the horizontal rotation angle of the fetal model. The rotating mechanism includes an axis support device, a rotating device and a rotating platform, wherein the axis support device is arranged inside the fetal model and passes through the head of the fetal model to the buttocks to support the fetal model; the rotating device is arranged vertically and its vertical upper end is connected to the axis support device, and its connection is located at the neck of the fetal model so that the axis support device can drive the fetal model to rotate around itself as the axis; the rotating platform is connected to the vertical lower end of the rotating device and drives the rotating device to rotate around the center of the rotating platform as the rotation point; the rotating device and the rotating platform are connected to the angle sensor to transmit the horizontal rotation angle and the horizontal rotation angle of the fetal model.

[0015] According to a preferred embodiment, the rotating device is connected to the shaft support device at the neck position of the fetal model, and the head of the fetal model is separated from the rest of the fetal model so that the fetal model can rotate with the neck as the rotation point under the drive of the rotating device. The rotating device includes a housing, a worm gear, a worm and a motor, wherein the housing is rotationally connected to the shaft support device so that the fetal model can rotate with the housing as the rotation point. The rotating platform is composed of a servo motor, a servo driver and a platform. The servo driver accurately controls the servo motor to rotate and regulate according to the required fetal model vital sign control amount, thereby realizing the regulation of the platform rotation. Before the servo driver sends a control signal, the servo motor is stationary; when the servo driver sends a control signal, the servo motor rotates immediately; when the servo driver stops sending a control signal, the servo motor stops immediately.

[0016] According to a preferred embodiment, the system further includes: a modeling module for modeling a geometric three-dimensional model of the fetus; a feedback module for performing simulated operations using a force feedback device, combining the deformation of the geometric three-dimensional model with the user's hand operation, and providing feedback based on a preset plan; and a guidance module for displaying a standard hand model adapted to the fetal spatial position and displaying the correct operation steps to help the user train. The cooperation of the feedback module and the guidance module provides the user with a more realistic simulated midwifery environment while providing a standard operation plan, and clinical teaching is more conducive to improving technical operability.

[0017] According to a preferred embodiment, the modeling module includes: a fetal model unit, which is used to load a fetal geometric three-dimensional model for modeling, and the geometric three-dimensional model has several models based on different physical signs of the fetus; a physical unit, which is used to provide physical properties for the user's two-hand operation and the fetal model, add the effect of deformation of the geometric three-dimensional model when subjected to external force, and output feedback force to the fetal model.

[0018] According to a preferred embodiment, the system also includes a projection module for projecting a fetal model and fetal condition based on mixed reality technology onto an extended screen for image viewing. Other students who are not wearing helmets can see a projection of a mixture of virtual images and real objects from the first-person or third-person perspective on the mixed reality device through the extended screen. In addition to seeing the position of the fetus in the mother's body, the fetal heart, placenta, amniotic fluid and umbilical cord virtual images, they can also see the user's movements. The four-part palpation model is visualized through the above-mentioned device, combining vision and touch. Through repeated practice, not only can the standardized operation of the four-part palpation be mastered, but judgments can be made quickly through visualized touch.

[0019] According to a preferred embodiment, the midwifery simulation system based on mixed reality technology can be divided into three modes: demonstration, practice, and assessment. In the demonstration mode, the guidance module displays a standard hand model that matches the fetal spatial position, and the correct hand movements are demonstrated. The user can learn the operation process, reduce operation errors, and standardize the movements by overlapping his own hand with the standard hand model. The practice mode can hide the standard hand model, and the user can practice repeatedly on his own. In the assessment mode, the teacher presets the fetal model, and the assessment is conducted intuitively from a third-person perspective, or the system can score it through an evaluation system. The evaluation system gives a corresponding score by comparing the degree of standardization of the user's movements with the standard hand model. It should be noted that the evaluation system analyzes the user's palpation site and the degree of pressure on the model, and obtains the degree of matching between the user's movements and the standard hand model, thereby measuring whether the user's movements are in compliance with the standard. The teacher's intuitive assessment and the evaluation system scoring method are used to evaluate the performance, and feedback can be given after review, which reduces human errors and intuitively displays the assessment results. After the assessment, the user can find out his own shortcomings by watching the review images, and improve the teaching quality.

[0020] The present invention also provides a midwifery simulation method based on mixed reality technology, the method comprising: locating the body features of the fetus; modeling a geometric three-dimensional model of the fetus, performing grid segmentation, model replacement and feedback model processing on the geometric three-dimensional model to establish a fetal model; adjusting the body features based on adjusting the horizontal rotation angle and the horizontal rotation angle of the fetal model.

[0021] According to a preferred embodiment, the method also includes: additional touch detection and feedback force calculation for the user's two-hand operation and the fetus model; using a force feedback device to perform simulated operation, combining the deformation of the fetus model with the user's hand operation, and providing feedback based on a preset scheme; displaying a standard hand model that is adapted to the fetus's spatial position, and displaying the correct operation steps to help the user train.

[0022] According to a preferred embodiment, the processing of the geometric three-dimensional model includes: meshing the geometric three-dimensional model of the fetus, replacing the segmented mesh nodes by simulating blood vessels and / or simulating human body parts, and adding a feedback model to the mesh to establish a fetal physical model, wherein the feedback model includes a spring and a damper.

[0023] According to a preferred embodiment, the user's two-hand operation and the fetus model are additionally subjected to touch detection and feedback force calculation, including: when the user's two hands move, whether they touch the body is detected based on a touch detection algorithm; if no touch occurs, the output feedback force is zero; if touch occurs, the current touch space position is recorded, and the user's two hands continue to move, and a three-dimensional vector is constructed with the recorded current touch space position as the base point and the current position as the anchor point, and the feedback force is calculated as follows: the external force applied to the base point is subtracted, and the product of the difference between the base point and the anchor point position vectors and the damping coefficient of the feedback model damper is multiplied by the difference between the base point and the anchor point position vectors and the stiffness coefficient of the feedback model spring, and finally the product of the difference between the base point and the anchor point position vectors, the original length of the spring before deformation and the stiffness coefficient of the feedback model spring is added, and the external force includes the force applied by the user and gravity.

[0024] According to a preferred embodiment, the preset plan includes the placental condition, umbilical cord condition and fetal heart rate. The placental condition includes position, abruption and placenta previa. The umbilical cord condition includes length, arterial and venous blood vessels, knotting, torsion and neck wrapping.

[0025] Beneficial technical effects of the present invention:

[0026] (1) In the prior art, students are required to master midwifery operations such as normal delivery, difficult labor treatment, neonatal resuscitation, and nursing care for common obstetric diseases. The theoretical knowledge is relatively abstract, clinical operations are not easy to implement, and there is a lack of effective teaching tools to help students improve their spatial imagination and practical operation capabilities. The present invention uses mixed reality technology to simulate midwifery teaching, which is more practical than the traditional teaching method based on theoretical knowledge. Multiple clinical operations make teaching simpler, and real-time guidance can rapidly improve practical operation capabilities.

[0027] (2) By combining the pregnant woman's abdomen model with mixed reality technology, the venue can be quickly arranged and teaching can be carried out quickly. The sensor module can also be used for positioning, and its position is standard, so that the virtual scene is restored one-to-one with the reality, which enhances the connection between teaching and reality and the teaching effect.

[0028] (3) Modeling, touch detection, and feedback calculation are performed through the modeling module, and the corresponding visual standard operation of midwifery is given through the guidance module. While providing a more realistic simulated midwifery environment, a standard operation plan is given, which is more conducive to improving the technical operability of clinical teaching;

[0029] (4) Specific fetal signs are simulated through the modeling module, and the user can visually see the actual posture of the fetus in the corresponding situation in the uterus of the palpation model, such as fetal heart rate, placental position, umbilical cord and amniotic fluid. At the same time, other students who are not wearing helmets can see the projection of a mixture of virtual images and real objects from the first-person or third-person perspective on the mixed reality device through the extended screen. In addition to seeing the position of the fetus in the mother's body, the virtual images of the fetal heart, placenta, amniotic fluid and umbilical cord, they can also see the user's movements. The four-part palpation model is visualized through the above device, combining vision and touch. Through repeated practice, not only can the standardized operation of the four-part palpation be mastered, but judgments can be made quickly through visualized touch;

[0030] (5) The midwifery simulation system is divided into three modes: demonstration, practice, and assessment, so as to accommodate students with different learning levels. In the demonstration mode, the guidance module displays a standard hand model that matches the fetal spatial position, and demonstrates the correct hand movements. Users can learn the operation process, reduce operation errors, and standardize movements by overlapping their own hands with the standard hand model. The practice mode can hide the standard hand model, and the user can practice repeatedly on his own. In the assessment mode, the teacher presets the fetal model and conducts the assessment intuitively from a third-person perspective, or the system can score the students through the evaluation system.

[0031] (6) The teacher uses an intuitive assessment and evaluation system to score students, and can provide feedback on the results, which reduces human errors and displays the assessment results intuitively. After the assessment, students can find out their own shortcomings by watching the review video, thereby improving the teaching quality;

[0032] (7) The present invention has high economic value and low implementation cost, and provides comprehensive use and synchronous training of vision, hearing and touch. It improves students' spatial imagination and practical operation ability, can be used repeatedly, and fully simulates all situations in the midwifery process, and avoids the loss of physical materials caused by traditional technology, and has the potential for wide use. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 is an application schematic diagram of a preferred embodiment of a midwifery simulation system based on mixed reality technology of the present invention;

[0034] Figure 2 It is a structural schematic diagram of the rotating mechanism of the present invention;

[0035] Figure 3 is a flow chart of the evaluation system of the present invention.

[0036] Reference numerals list

[0037] 1: pregnant woman's cavity; 2: fetus model; 3: shaft support device; 4: rotating device; 5: rotating platform; 401: housing; 402: worm gear; 403: worm; 404: motor. DETAILED DESCRIPTION

[0038] The following is a detailed description with reference to the accompanying drawings.

[0039] Example 1

[0040] The present application relates to a midwifery simulation system based on mixed reality technology, including a mixed reality device for displaying a three-dimensional model of a fetus and a simulated midwifery operation transmitted therefrom, and also including: a sensing module for locating the position of the fetus; a modeling module for modeling a geometric three-dimensional model of the fetus; a pregnant woman's abdomen model, the pregnant woman's abdomen model including a pregnant woman's cavity 1 and a fetus model 2, the fetus model 2 is located inside the pregnant woman's cavity 1 and the body characteristics of the fetus model 2 are located based on the sensing module to perform geometric three-dimensional modeling in the modeling module; wherein the pregnant woman's cavity 1 is provided with a rotating mechanism for adjusting the body characteristics of the fetus model 2, the rotating mechanism is based on adjusting the horizontal rotation angle and the horizontal rotation angle of the fetus model 2 to adjust the body characteristics. The geometric three-dimensional model responds to the user's midwifery operation to perform micro-movement and / or body characteristic changes and responds to the pregnant woman's abdomen model in real time to synchronously change the fetus model 2, and the geometric three-dimensional model is displayed in front of the user through the mixed reality device. Preferably, the pregnant woman's cavity 1 and the fetus model 2 are covered with bionic skin, and the fetus model 2 is filled with elastic material under the bionic skin to conform to the actual touch.

[0041] It should be noted that the horizontal rotation angle and the horizontal rotation angle in the present invention belong to different posture characteristics of the fetal model 2. The horizontal rotation angle refers to the angle of the zero angle line when the fetal model 2 is rotated circumferentially with the vertical downward direction as the axis and the foot to the head of the pregnant woman as the zero angle line. The horizontal rotation angle refers to the angle of the zero angle when the foot to the head of the fetal model 2 is rotated circumferentially with the axis and the face of the fetal model 2 facing vertically upwards as the zero angle.

[0042] According to a preferred embodiment, the sensing module is respectively provided with positioning sensors on the head, buttocks and back of the fetal model 2 and transmits data to the modeling module for modeling based on the body shape of the fetal model 2. The sensing module is also provided with an angle sensor on the rotating mechanism to confirm the body shape of the fetal model 2 based on the horizontal rotation angle and horizontal rotation angle of the fetal model 2 and calibrate the data with the detection data of the positioning sensor.

[0043] According to a preferred embodiment, the rotating mechanism includes an axial support device 3, a rotating device 4 and a rotating platform 5, wherein the axial support device 3 is arranged inside the fetal model 2 and passes through the head of the fetal model 2 to the buttocks to support the fetal model 2; the rotating device 4 is vertically arranged and its vertical upper end is connected to the axial support device 3, and its connection point is located at the neck of the fetal model 2 so that the axial support device 3 can drive the fetal model 2 to rotate around itself as the axis; the rotating platform 5 is connected to the vertical lower end of the rotating device 4 and drives the rotating device 4 to rotate with the center of the rotating platform 5 as the rotation point; the rotating device 4 and the rotating platform 5 are connected to the angle sensor to transmit the horizontal rotation angle and the horizontal rotation angle of the fetal model 2.

[0044] According to a preferred embodiment, the shaft support device 3 supports the overall frame of the fetal model 2 and provides a rotation axis along the direction from the head to the buttocks of the fetal model 2 to achieve rotation at any angle.

[0045] According to a preferred embodiment, the rotating device 4 is connected to the shaft support device 3, and the connection is located at the neck of the fetal model 2. The head of the fetal model 2 is separated from the rest of the fetal model 2 so that the fetal model 2 can rotate with the neck as the rotation point under the drive of the rotating device 4. The rotating device 4 includes a housing 401, a worm wheel 402, a worm 403 and a motor 404, wherein the housing 401 is rotationally connected to the shaft support device 3, so that the fetal model 2 can rotate with the housing 401 as the rotation point. The worm wheel 402, the worm 403 and the motor 404 are all arranged in the housing 401. The worm wheel 402 is fixedly connected to the shaft support device 3, the worm 403 and the worm wheel 402 are meshed with each other, the worm 403 is connected to the output shaft of the motor 404, and the worm 403 is used as an active member to drive the worm wheel 402 to rotate. Because the teeth of the worm 403 are continuous and uninterrupted spiral teeth, they are continuously meshed with the teeth of the worm wheel 402, and the teeth of the worm 403 do not enter and exit the meshing process, so that the fetal model 2 has low noise and stable rotation when rotating. In addition, the worm 403 and the worm wheel 402 are self-locking, and the worm 403 can only drive the worm wheel 402 to transmit, while the worm wheel 402 cannot drive the worm 403 to rotate, that is, the self-gravity of the fetal model 2 will not cause the rotation of the worm wheel 402, but will remain in the current posture to prevent the fetal model 2 from shifting during use. The housing 401 extends downward and is fixedly connected to the rotating platform 5. The rotating platform 5 is composed of a servo motor 404, a servo driver and a platform. The servo driver accurately controls the servo motor 404 to follow the required fetal model 2 physical sign control amount for rotation regulation, thereby realizing the regulation of the platform rotation. Before the servo driver sends a control signal, the servo motor 404 is stationary; when the servo driver sends a control signal, the servo motor 404 rotates immediately; when the servo driver stops sending a control signal, the servo motor 404 stops immediately. The servo motor 404 converts the electrical signal into the angular displacement or angular velocity of the rotating shaft and sends it to the angle sensor to confirm the horizontal rotation angle of the fetus, thereby confirming the body characteristics of the fetal model 2. Preferably, the rotating device 4 can confirm the horizontal rotation angle through an angle sensor, wherein the angle sensor can be detected by a grating ruler displacement sensor. The horizontal rotation angle of the fetal model 2 is calculated by coaxially connecting the grating ruler sensor with the worm gear 402 of the rotating device 4 or with the rotating shaft of the shaft support device 3. The angle sensor can also use a capacitive angular displacement sensor. The rotation angle between the fixed component (rotating device 4) and the rotating component (shaft support device 3) is detected by a capacitive angular displacement sensor, thereby realizing the detection of the horizontal rotation angle of the fetal model 2. The rotating device 4 and the rotating platform 5 are both controlled by a mixed reality device or other computing unit to achieve the adjustment of the body shape of the fetal model 2 and data transmission.

[0046] The above-mentioned devices cooperate with the positioning sensor to confirm and model based on the posture data, so that the modeled fetal virtual model is consistent with the posture of the real fetal model 2, so as to understand the overall situation of the fetal position and adjust the fetal model 2 to the required posture to meet the variability of the fetal posture in reality. At the same time, the coordination effect of the above-mentioned shaft support device 3, the rotating device 4 and the rotating platform 5 enables the fetal model 2 to adjust various postures including supine, protruding or sideways, which is convenient for teaching.

[0047] According to a preferred embodiment, the modeling module includes: a fetal model unit, which is used to model a geometric three-dimensional model of the fetus, and the geometric three-dimensional model has several models based on different physical signs of the fetus; a physical unit, which is used to provide physical properties for the user's two-hand operation and the fetal model, add the effect of deformation of the geometric three-dimensional model when subjected to external force, and output the feedback force to the fetal model. Preferably, the feedback module plays a human-computer interaction role, such as fetal movement, etc.; it is linked with the mixed reality device to adjust the position of the fetus mechanically and synchronize with the mixed reality virtual image. The feedback module can also give the correct fetal heart audio according to the position where the user places the fetal heart Doppler. If the placement position is inaccurate, such as placement at the placenta position, vascular murmurs will occur. The remaining positions include uterine murmurs, abdominal aortic murmurs, umbilical cord murmurs, and gastrointestinal peristalsis murmurs.

[0048] According to a preferred embodiment, the feedback module can be connected to an external feedback device. The feedback device is, for example, a hand-worn mixed reality device. When the user performs actions that require tactile sensations, such as placing the hand on the ventral side or measuring the uterus with the hand, the feedback device can vibrate or give force feedback according to the feedback force calculated by the modeling module, thereby playing a role in human-computer interaction.

[0049] According to a preferred embodiment, the system further comprises a projection module for projecting the fetal model 2 and fetal conditions based on mixed reality technology onto an extended screen for image viewing. Preferably, the image can be projected in a manner combining the user's first-person perspective and third-person perspective, and learning can be carried out simultaneously, with one person operating and multiple people learning, to ensure the homogeneity and efficiency of teaching.

[0050] Example 2

[0051] This embodiment is a further improvement on the above-mentioned embodiment, and the repeated contents will not be repeated here.

[0052] In the above embodiment, the user touches the geometric three-dimensional model, and through the coordinated action of the physical unit and the feedback module, the fetus model 2 undergoes synchronous changes in body features based on the changes in the touch of the geometric three-dimensional model, and the changed geometric three-dimensional model is displayed in front of the user.

[0053] According to a preferred embodiment, the user can also touch the fetal model 2 with his hand, and the fetal model 2 changes in body characteristics in response to the user's midwifery operation, and is synchronized in real time in the geometric three-dimensional model, so that the user can observe the change by observing the geometric three-dimensional model. That is, a pressure sensor is set inside the fetal model 2 to feedback the changes in body characteristics of the fetal model 2 caused by the force when the user performs the midwifery operation, and the change is reflected by the rotating mechanism. The modeling module confirms the body characteristics of the current fetal model 2 through the horizontal rotation angle and horizontal rotation angle of the fetal model 2 detected by the positioning sensor and the angle sensor, and corresponds to the geometric three-dimensional model in real time.

[0054] Example 3

[0055] The present invention also provides a midwifery simulation method based on mixed reality technology, the method comprising: locating the body features of the fetal model 2 based on a sensing module and modeling a geometric three-dimensional model using a modeling module; wherein the geometric three-dimensional model performs micro-movements and / or changes in body features in response to midwifery operations and responds to and synchronously changes the fetal model 2 in real time, and the geometric three-dimensional model is displayed in front of the user.

[0056] According to a preferred embodiment, the method also includes: locating the body features of the fetus; modeling the geometric three-dimensional model of the fetus, and performing grid segmentation, model replacement and feedback model processing on the geometric three-dimensional model to establish a fetal model; adjusting the body features based on adjusting the horizontal rotation angle and horizontal rotation angle of the fetal model; additional touch detection and feedback force calculation for the user's two-hand operation and the fetal model; using a force feedback device to perform simulated operations, combining the deformation of the geometric three-dimensional model with the user's hand operation, and providing feedback based on a preset plan; displaying a standard hand model that is adapted to the spatial position of the fetus, and displaying the correct operation steps to help the user train.

[0057] According to a preferred embodiment, the processing of the geometric three-dimensional model includes: meshing the geometric three-dimensional model of the fetus, replacing the segmented mesh nodes by simulating blood vessels and / or simulating human body parts, and adding a feedback model to the mesh to establish a fetal physical model, wherein the feedback model includes a spring and a damper.

[0058] According to a preferred embodiment, the user's two-hand operation and the fetus model are additionally subjected to touch detection and feedback force calculation, including: when the user's two hands move, whether they touch the body is detected based on a touch detection algorithm; if no touch occurs, the output feedback force is zero; if touch occurs, the current touch space position is recorded, and the user's two hands continue to move, and a three-dimensional vector is constructed with the recorded current touch space position as the base point and the current position as the anchor point, and the feedback force is calculated as follows: the external force applied to the base point is subtracted, and the product of the difference between the base point and the anchor point position vectors and the damping coefficient of the feedback model damper is multiplied by the difference between the base point and the anchor point position vectors and the stiffness coefficient of the feedback model spring, and finally the product of the difference between the base point and the anchor point position vectors, the original length of the spring before deformation and the stiffness coefficient of the feedback model spring is added, and the external force includes the force applied by the user and gravity.

[0059] According to a preferred embodiment, the preset plan includes the placental condition, umbilical cord condition and fetal heart rate. The placental condition includes position, abruption and placenta previa. The umbilical cord condition includes length, arterial and venous blood vessels, knotting, torsion and neck wrapping.

[0060] Example 4

[0061] This embodiment is a further improvement on the above-mentioned embodiment, and the repeated contents will not be repeated here.

[0062] According to a preferred embodiment, the guidance module is used to display a standard hand model that is adapted to the spatial position of the fetus and to display the correct operation steps. The standard hand model is constructed in the same way as the fetal model, that is, a physical model that meets the hand standards of ordinary people is established by performing grid segmentation, model substitution and feedback model processing on a geometric three-dimensional model. According to the physical signs of the fetal model and the abdominal characteristics of the pregnant woman, the standard hand model is operated to simulate the standard process according to the four-step palpation standard, which is used as a demonstration and judgment standard. Preferably, the abdominal characteristics of the pregnant woman include stretch marks, surgical scars, abdominal fat accumulation, and a small abdomen.

[0063] According to a preferred embodiment, the midwifery simulation system based on mixed reality technology can be divided into three modes: demonstration, practice, and assessment. In the demonstration mode, the guidance module displays a standard hand model that matches the spatial position of the fetus, and the correct hand movements are demonstrated. The user can learn the operation process, reduce operation errors, and standardize the movements by overlapping his own hand with the standard hand model. The practice mode can hide the standard hand model, and the user can practice repeatedly on his own. In the assessment mode, the teacher presets the fetal model, and the assessment is conducted intuitively from a third-person perspective, or it can be scored through the evaluation system provided by the system. The evaluation system gives a corresponding score by comparing the degree of standardization of the user's movements with the standard hand model. It should be noted that the evaluation system analyzes the user's palpation site and the degree of pressure on the model to obtain the degree of matching between the user and the standard hand model, thereby measuring whether the user's movements are in compliance with the standard.

[0064] The evaluation system obtains the spatial position information of the user's hand, compares it with the spatial position information of the standard hand model frame by frame in real time, and outputs the user's matching degree. Preferably, the spatial position information is based on the human hand skin and bone nodes. The inter-finger joints, palm and wrist, fingertips and fetal model must form an angle, and all angle features are combined into a vector space. The evaluation system calculates the matching degree of the user's hand and the standard hand model frame by frame respectively through the cosine similarity principle. The reason why the cosine similarity principle is adopted and the cosine value of the vector angle is used as a measure of the difference between the user's hand and the standard hand model instead of using the distance metric for difference evaluation is that the distance metric is more focused on the difference in distance or length between two vectors than the difference in direction compared with the cosine similarity principle. That is, when the length and / or size and / or posture of the user's hand changes, the difference between the user's hand and the standard hand model cannot be objectively measured by the distance metric, but will be affected by the different distance metrics caused by different user hands. Specifically, the steps of the evaluation system are:

[0065] A1: Obtain the current spatial position information of the user's hand and use it as the starting point;

[0066] A2: Obtain the spatial position information of the user's hand and the standard hand model respectively, and calculate the cosine value of the formed angle;

[0067] A3: Based on the starting point position, the cosine value of the angle between the user's hand and the standard hand model is calculated for each frame.

[0068] A4: Calculate all the data of the user's hand and the standard hand model during the entire midwifery process, and obtain all the data of the user's hand and the standard hand model respectively through weighted summation and averaging;

[0069] A5: Calculate the absolute value of the difference between all data values ​​of the user's hand and the standard hand model;

[0070] A6: If the absolute value obtained in step A5 is less than or equal to the matching threshold, it is determined that the movements of the user's hand and the standard hand model match each other.

[0071] If the absolute value obtained in step A5 is greater than the matching threshold, it is determined that the movements of the user's hand and the standard hand model do not match each other;

[0072] A7: The user's hand movement deviation from the standard hand model movement is obtained by linear normalization to the matching threshold interval, and the measurement value is used as the final score.

[0073] According to a preferred embodiment, the evaluation system can give different final scores based on different preset schemes of the processed fetal model. Since the difficulty of the user performing the four-part palpation is also affected by the preset scheme of the fetal model, the user's real score cannot be accurately reflected by directly monitoring the user's hand operation. In this regard, the present invention calibrates the standard process through the differences in the preset schemes when the user operates, and is also used to correct the user's final score. The preset scheme includes the placenta condition, the umbilical cord condition and the fetal heart beat, the placenta condition includes the position, abruption, and placenta previa, and the umbilical cord condition includes the length, the arterial and static blood vessels, knotting, twisting, and neck. Different preset schemes have different standard processes simulated by the standard hand model. After viewing the standard process simulated by the standard hand model, the medical staff can correct its shortcomings, and the evaluation system records its corrections and applies them to other preset schemes. The correction of the user's final score is based on the difficulty of the preset scheme. The placenta condition, umbilical cord condition and fetal heart beat of the preset scheme have different difficulty coefficients. For example, when the placenta condition in the preset scheme is abruption, the difficulty coefficient of the placenta condition is 70; when the umbilical cord condition is around the neck, the difficulty coefficient of the umbilical cord condition is 100; when the fetal heart beat is normal, the difficulty coefficient of the fetal heart beat is 50. The difficulty coefficient / 50 is multiplied into the user's final score as a coefficient to obtain the corrected final score, thereby effectively eliminating the difference in difficulty caused by different preset schemes. The formula is:

[0074] Corrected final score = final score × (placenta difficulty coefficient / 50) × (umbilical cord difficulty coefficient / 50) × (fetal heart rate difficulty coefficient / 50)

[0075] According to a preferred embodiment, the assessment mode can also conduct review and feedback. The assessment mode is conducted by the teacher through a third-person perspective to visually conduct the assessment or evaluation system scoring, which reduces human errors and intuitively displays the assessment results. The third-person perspective image and the user's two-hand spatial data are stored in the storage unit and can be played back through the timeline. Specifically, based on the set of user-operated two-hand spatial data formed in the time period from the current moment to the corresponding moment or any moment earlier than the current moment, a corresponding user two-hand model is given and output in a visual manner to the mixed reality device or other projection devices.

[0076] Throughout the text, the features referred to as “preferably” are merely optional and should not be understood as having to be set. Therefore, the applicant reserves the right to abandon or delete the relevant preferred features at any time.

[0077] It should be noted that the above specific embodiments are exemplary, and those skilled in the art can come up with various solutions inspired by the disclosure of the present invention, and these solutions also belong to the disclosure scope of the present invention and fall within the protection scope of the present invention. Those skilled in the art should understand that the present invention description and its drawings are illustrative and do not constitute a limitation of the claims. The protection scope of the present invention is defined by the claims and their equivalents.

Claims

1. A midwifery teaching device, comprising a mixed reality device and a fetus model, characterized in that: include: The sensing module includes a plurality of positioning sensors arranged at various parts of the fetal model and an angle sensor arranged in the rotating mechanism of the pregnant woman's abdomen model, so as to confirm the current body characteristics of the fetal model according to the horizontal rotation angle and the horizontal rotation angle of the fetal model; A modeling module is used to model a geometric three-dimensional model based on the body characteristics of the fetus model. The guidance module displays a standard hand model adapted to the spatial position of the fetus and displays the correct operation steps. The standard hand model is a physical model that meets the standards of a normal person's hand and is established by the modeling module through mesh segmentation, model replacement and feedback model processing of the geometric three-dimensional model.

2. The midwifery teaching device according to claim 1, characterized in that: When the user performs an action requiring tactile sensation, the modeling module calculates the feedback force of the fetus model; The feedback device connected to the modeling module vibrates or gives force feedback to the user according to the magnitude of the feedback force.

3. The midwifery teaching device according to claim 2, characterized in that: The modeling module calculates the feedback force according to the user's two-hand operation and the fetus model's additional touch detection.

4. The midwifery teaching device according to any one of claims 1 to 3, characterized in that: It also includes a feedback module, which is used to use a force feedback device to perform simulation operations, combine the deformation of the geometric three-dimensional model with the user's hand operation, and provide feedback based on a preset solution.

5. A human-computer interactive midwifery system, characterized in that: include: The sensing module includes a plurality of positioning sensors arranged at various parts of the fetal model and an angle sensor arranged in the rotating mechanism of the pregnant woman's abdomen model, so as to confirm the current body characteristics of the fetal model according to the horizontal rotation angle and the horizontal rotation angle of the fetal model; A modeling module is used to model a geometric three-dimensional model based on the body shape characteristics of the fetus model. When the user performs an action requiring tactile sensation, the modeling module calculates the feedback force of the fetus model. A feedback device vibrates or gives force feedback to the user according to the magnitude of the feedback force; Among them, a rotating mechanism for adjusting the body characteristics of the fetal model is provided in the pregnant woman's abdomen model, and the rotating mechanism is connected to the modeling module. The modeling module calculates the micro-movements and / or changes in body characteristics of the fetal model in response to the user's midwifery operation. The rotating mechanism adjusts the horizontal rotation angle and horizontal rotation angle of the fetal model to synchronously change the fetal model.

6. The human-computer interactive midwifery system according to claim 5, characterized in that: It also includes a feedback module, which is used to use a force feedback device to perform simulation operations, combine the deformation of the geometric three-dimensional model with the user's hand operation, and provide feedback based on a preset solution.

7. The human-computer interactive midwifery system according to claim 6, characterized in that: Also includes a projection module, The actual posture of the fetus in the uterus of the palpation model is displayed on the user's mixed reality device. The projection of the first-person or third-person mixed virtual image and real object on the mixed reality device is displayed on the extended screen.

8. The human-computer interactive midwifery system according to any one of claims 5 to 7, characterized in that: The modeling module calculates the feedback force according to the user's two-hand operation and the fetus model's additional touch detection; When the user's hands move, the touch detection algorithm is used to detect whether they touch the body; If no touch occurs, the output feedback force is zero; If a touch occurs, the current touch space position is recorded, and when the user's hands continue to move, the magnitude of the feedback force is output.

9. A midwifery quality assessment system, characterized in that: The system comprises: a sensing module, including a plurality of positioning sensors arranged at various parts of the fetal model and an angle sensor of a rotating mechanism arranged in the pregnant woman's abdomen model, so as to confirm the body characteristics of the current fetal model according to the horizontal rotation angle and the horizontal rotation angle of the fetal model; A modeling module is used to model a geometric three-dimensional model based on the body characteristics of the fetus model. An evaluation module displays a standard hand model adapted to the fetus's spatial position and displays correct operation steps, wherein the standard hand model is a physical model that meets the standard of a normal person's hand established by the modeling module through mesh segmentation, model substitution and feedback model processing of the geometric three-dimensional model; The evaluation system module compares the spatial position information of the user's hand with the spatial position information of the standard hand model in real time frame by frame, and outputs the user's matching degree.

10. The midwifery quality assessment system according to claim 9, characterized in that: It also includes a feedback module, which is used to use the force feedback device to perform simulation operations, combine the deformation of the geometric three-dimensional model with the user's hand operation, and provide feedback based on a preset solution; The evaluation system module gives different final scores based on different preset schemes of the processed fetal model.

Citation Information

Cited By

  • Umbilical cord torsion simulation method based on bicubic Hermite and Cossseerat rods

    CN122117427A

  • Twisting simulation method for umbilical based on bicubic hermite and cosserat rod

    CN122117427B