Anatomy training platform combining virtual reality and augmented reality technology

Abstract

The invention discloses a dissection training platform combining virtual reality and augmented reality technologies, and relates to the field of dissection training platforms. The anatomy training platform combining the virtual reality and augmented reality technology comprises a simulation operation mechanism in a supporting base, an anatomy training table is fixedly connected to the supporting base, two sets of fixing rods are fixedly connected to the anatomy training table, and a high-definition display screen is installed between the fixing rods. The anatomy training platform combining the virtual reality and augmented reality technology carries the high-definition display screen capable of being adjusted in multiple directions, before teaching demonstration, the height of the high-definition display screen is adjusted through the first driving mechanism, and then the inclination angle of the high-definition display screen is adjusted through the adjusting mechanism; after adjustment is completed, it is ensured that the students can clearly watch the high-definition display screen, multiple students can learn by watching the high-definition display screen at the same time, and the learning efficiency is effectively improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of dissection training platform, in particular to a dissection training platform combining virtual reality and augmented reality technology. BACKGROUND

[0002] Under the wave of medical education digitization, the dissection training platform combining VR and AR has become a trend. It relies on 3D modeling to restore human structure, solves the pain points of traditional dissection specimen scarcity and high operation risk, realizes repeated operation and accurate learning, and helps medical personnel to efficiently master dissection knowledge.

[0003] The existing dissection training platform combining virtual reality and augmented reality technology mostly relies on 3D modeling to restore human structure. VR can enable learners to immerse in organ levels, and AR can superimpose virtual annotations on physical models. By constructing a highly realistic virtual environment or superimposing virtual information on the real scene, it provides medical students, medical personnel and anatomy enthusiasts with immersive and interactive learning experience. However, when the dissection training platform combining virtual reality and augmented reality technology is used as a teaching and testing tool, on the one hand, students need to learn around the dissection training platform during teaching, which has visual dead angles, resulting in poor teaching quality. On the other hand, when testing students, teachers need to be present to grade, which is a heavy workload for teachers, and the grading of teachers is subjective, resulting in unfair grading. SUMMARY

[0004] The present application aims to provide a dissection training platform combining virtual reality and augmented reality technology to solve the problems in the background art.

[0005] To achieve the above-mentioned purpose, the present application provides the following technical solution: a dissection training platform combining virtual reality and augmented reality technology, comprising a simulation operation mechanism in a support base, the support base is fixedly connected with a dissection training platform, the dissection training platform is fixedly connected with two groups of fixed rods, the fixed rods are installed with a high-definition display screen between them, the dissection training platform is provided with a monitoring and recording mechanism, the monitoring and recording mechanism is used for monitoring and recording the operation process, and the monitoring and recording mechanism comprises: A first camera located directly above the center of the dissection training platform, the first camera is electrically connected with the high-definition display screen; Two groups of second cameras located on both sides of the first camera, the gesture operation track recorded by the second camera is compared with the standard gesture operation track; The first driving mechanism is used for adjusting the height of the high-definition display screen, and the adjusting mechanism is used for adjusting the inclination angle of the high-definition display screen.

[0006] The first track body and the second track body are arranged in the fixed rod.

[0007] The first driving mechanism comprises: A first servo motor is arranged at the upper end of the fixed rod; A first threaded rod is fixedly connected to the bottom of the output end of the first servo motor and rotationally connected to the fixed rod; A first track block is slidingly connected to the first threaded rod in the first track body and threadedly connected to the first track block.

[0008] The adjusting mechanism comprises: A second track block is slidingly connected to the second track body; A U-shaped connecting plate is fixedly connected to the back of the second track block at both ends; An electric push rod is fixedly connected to the U-shaped connecting plate.

[0009] The high-definition display screen is fixedly connected with a first connecting piece at both ends, the first connecting piece is rotationally connected to the first track block, the back of the high-definition display screen is fixedly connected with a second connecting piece, and the output end of the electric push rod is hingedly connected to the second connecting piece.

[0010] The first support rod and the second support rod are fixedly connected to the dissection training table, the third support rod and the fourth support rod are fixedly connected to the bottom of the dissection training table, and the first camera is installed at the bottom of the first support rod.

[0011] The simulation operation mechanism is used for dissection simulation operation, and comprises: A head-mounted display is clamped to the fourth support rod; A force feedback glove is clamped to the third support rod.

[0012] The second driving mechanism is arranged in the second support rod and used for adjusting the position of the second camera, and comprises: A second servo motor is installed on the second support rod; A second threaded rod is fixedly connected to the output end of the second servo motor and rotationally connected to the second support rod; The third track block is slidably connected in the second support rod, the second threaded rod is threadedly connected in the third track block, and the second camera is mounted at the bottom of the third track block.

[0013] The head-mounted display is used for virtual scene presentation and information marking, and the force feedback glove is used for force perception and feedback.

[0014] The rotating door is hinged on the support base and used for protecting the simulation operation mechanism in the support base.

[0015] The technical effect and advantages of the present application are as follows: the dissection training platform combined with virtual reality and augmented reality technology is provided with a high-definition display screen capable of multidirectional adjustment; before teaching demonstration, the height of the high-definition display screen is adjusted through the first driving mechanism, and then the inclination angle of the high-definition display screen is adjusted through the adjusting mechanism; after adjustment, the student can clearly watch the high-definition display screen, and multiple students can simultaneously learn by watching the high-definition display screen, thereby effectively improving the learning efficiency.

[0016] The first camera in the monitoring recording mechanism is convenient for recording, storing and releasing the teaching operation, and the second camera is convenient for recording the operation gesture of the student in the operation process when the student is tested in stages; the second camera is focused through the body during recording, so that the operation gesture is located at the imaging center; the student gesture operation track is compared with the standard gesture operation track, a corresponding score coefficient is assigned to the student according to the gesture similarity, so that the examination score of the student is more accurate and fair. BRIEF DESCRIPTION OF DRAWINGS

[0017] Figure 1 It is a whole structure schematic view of the present application; Figure 2 It is a rotating door structure schematic view of the present application; Figure 3 It is a simulation operation mechanism structure schematic view of the present application; Figure 4 It is a first driving mechanism structure schematic view of the present application; Figure 5 It is a second driving mechanism structure schematic view of the present application; Figure 6 It is a high-definition display screen structure schematic view of the present application; Figure 7 It is a flow chart of two use modes of the present application.

[0018] In the figure: 1, dissection training table; 11, support base; 111, rotating door; 12, first support rod; 13, second support rod; 14, third support rod; 15, fourth support rod; 2, high-definition display screen; 21, first connecting piece; 22, second connecting piece; 3, fixed rod; 31, first track main body; 32, second track main body; 4, first driving mechanism; 41, first servo motor; 42, first threaded rod; 43, first track block; 5, adjusting mechanism; 51, second track block; 52, U-shaped connecting plate; 53, electric push rod; 6, simulation operation mechanism; 61, head-mounted display; 62, force feedback glove; 7, monitoring recording mechanism; 71, first camera; 72, second camera; 8, second driving mechanism; 81, second servo motor; 82, second threaded rod; 83, third track block. DETAILED DESCRIPTION

[0019] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0020] The present application provides a dissection training platform combining virtual reality and augmented reality technology, as shown in the figure. Figure 1 - Figure 7 The dissection training platform combining virtual reality and augmented reality technology comprises a simulation operation mechanism 6 in a support base 11, a dissection training table 1 fixedly connected to the support base 11, and two groups of fixed rods 3 fixedly connected to the dissection training table 1. The support base 11 serves as a support base of the entire dissection training platform and provides stable mounting positions for other components. The dissection training table 1 is a main platform for dissection training operation and is provided with a high-definition display screen 2, a fixed rod 3, a monitoring recording mechanism 7 and other components, and provides certain support and mounting space for the simulation operation mechanism 6.

[0021] The fixed rod 3 is used for mounting the high-definition display screen 2 and is internally provided with a first track main body 31 and a second track main body 32 to provide movement tracks for a first driving mechanism 4 and an adjusting mechanism 5. The high-definition display screen 2 is mounted between the fixed rods 3. The dissection training table 1 is provided with the monitoring recording mechanism 7. The monitoring recording mechanism 7 is used for monitoring and recording the operation process. The monitoring recording mechanism 7 comprises: A first camera 71 located directly above the center of the dissection training table 1. The first camera 71 is electrically connected to the high-definition display screen 2, which is convenient for recording, storing and playing the teaching operation and for students to watch the teaching operation process. Two second cameras 72 are respectively located on both sides of the first camera 71, and the gesture operation track recorded by the second camera 72 is compared with the standard gesture operation track. The second camera 72 is used to record the operation gesture of the student during the operation process. During the recording process, the second camera 72 focuses through the body to ensure that the operation gesture is located in the imaging center. The student gesture operation track is compared with the standard gesture operation track. Through the gesture similarity, the student is assigned a corresponding score coefficient, so that the examination score of the student is more accurate and fair.

[0022] The first driving mechanism 4 and the adjusting mechanism 5 are arranged between the high-definition display screen 2 and the fixed rod 3. The high-definition display screen 2 is used to display the virtual scene, operation information and other content related to the dissection training, so as to facilitate the student to watch and learn. The first driving mechanism 4 is used to adjust the height of the high-definition display screen 2. The adjusting mechanism 5 is used to adjust the inclination angle of the high-definition display screen 2. The first driving mechanism 4 and the adjusting mechanism 5 cooperate to adjust the position of the high-definition display screen 2.

[0023] The first track body 31 and the second track body 32 are arranged in the fixed rod 3.

[0024] The first driving mechanism 4 comprises: The first servo motor 41 is arranged at the upper end of the fixed rod 3. The first servo motor 41 provides rotary power as a power source. The first threaded rod 42 is fixedly connected to the bottom of the output end of the first servo motor 41. The first threaded rod 42 is rotatably connected to the fixed rod 3. The first threaded rod 42 can convert the rotary motion of the first servo motor 41 into linear motion. The first track block 43 is slidably connected in the first track body 31. The first threaded rod 42 is threadedly connected with the first track block 43. The rotation of the first threaded rod 42 drives the first track block 43 to slide up and down in the first track body 31, so as to adjust the height of the high-definition display screen 2.

[0025] The adjusting mechanism 5 comprises: The second track block 51 is slidably connected in the second track body 32. The second track block 51 provides a motion basis for the adjusting mechanism 5. The U-shaped connecting plate 52 is fixedly connected to the back of the second track block 51 at both ends. The U-shaped connecting plate 52 is used to connect the electric push rod 53. The electric push rod 53 is fixedly connected to the U-shaped connecting plate 52. The extension and retraction movement of the electric push rod 53 drives the high-definition display screen 2 to rotate around the first connecting piece 21, so as to adjust the inclination angle.

[0026] The high-definition display screen 2 is fixedly connected with first connecting pieces 21 at both ends, the first connecting pieces 21 are rotationally connected in first track blocks 43, the high-definition display screen 2 is fixedly connected with second connecting pieces 22 at the back, and the output end of the electric push rod 53 is hingedly connected in the second connecting pieces 22.

[0027] The first support rod 12 and the second support rod 13 are fixedly connected on the dissection training platform 1, the third support rod 14 and the fourth support rod 15 are fixedly connected at the bottom of the dissection training platform 1, and the first camera 71 is installed at the bottom of the first support rod 12.

[0028] The simulation operation mechanism 6 is used for dissection simulation operation, and the simulation operation mechanism 6 comprises: A head-mounted display 61 is clamped on the fourth support rod 15; A force feedback glove 62 is clamped on the third support rod 14.

[0029] The second support rod 13 is provided with a second driving mechanism 8, the second driving mechanism 8 is used for adjusting the position of the second camera 72, and the second driving mechanism 8 comprises: A second servo motor 81 is installed on the second support rod 13, and the second servo motor 81 provides rotary power as a power source; A second threaded rod 82 is fixedly connected on the output end of the second servo motor 81, the second threaded rod 82 is rotationally connected in the second support rod 13, and the second threaded rod 82 can convert the rotary motion of the second servo motor 81 into linear motion; A third track block 83 is slidingly connected in the second support rod 13, the second threaded rod 82 is screwedly connected in the third track block 83, the second camera 72 is installed at the bottom of the third track block 83, the third track block 83 is driven to slide in the second support rod 13 through the rotation of the second threaded rod 82, so that the position of the second camera 72 is adjusted, and the second driving mechanism 8 is used for assisting the second camera 72 in focusing.

[0030] The head-mounted display 61 is used for virtual scene presentation and information marking, the head-mounted display 61 magnifies and projects the image of a micro screen to the retina of a user through precise optical systems and display technology, forms immersive virtual visual experience, the force feedback glove 62 is used for force perception and feedback, and the force feedback glove 62 cooperates with sensors, actuators and algorithms to simulate the tactile feeling and force feedback when the user interacts with virtual objects.

[0031] The rotary door 111 is hingedly connected on the support base 11, and the rotary door 111 is used for protecting the simulation operation mechanism 6 in the support base 11, preventing dust from entering or accidentally colliding with and damaging internal equipment.

[0032] Embodiment one: when the dissection training platform combined with virtual reality and augmented reality technology is used for teacher end teaching, open the revolving door 111, take out the head-mounted display 61 and the force feedback glove 62, and wear them correctly. The teacher adjusts the height, angle and other parameters of the high-definition display screen 2 according to the number of students and the position of the platform, and ensures that all students can clearly watch by cooperating with the first driving mechanism 4 and the adjusting mechanism 5. Start the first camera 71, and the head-mounted display 61 starts imaging. The first camera 71 records and saves the teaching operation process, and simultaneously projects it on the high-definition display screen 2 in real time, clearly showing the dissection operation process to the students.

[0033] The process of adjusting the high-definition display screen 2 is as follows: the first servo motor 41 provides rotary power as a power source, the first threaded rod 42 can convert the rotary motion of the first servo motor 41 into linear motion, the first threaded rod 42 drives the first track block 43 to slide up and down in the first track main body 31, the first track block 43 is rotationally connected with the first connecting piece 21 fixedly connected with the back of the high-definition display screen 2, so as to adjust the height of the high-definition display screen 2. Then, the extension and retraction of the electric push rod 53 drives the high-definition display screen 2 to rotate around the first connecting piece 21. The output end of the electric push rod 53 is hinged in the second connecting piece 22. When the electric push rod 53 extends and retracts, the second track block 51 provides a motion basis for the adjusting mechanism 5, so as to adjust the inclination angle. After the adjustment is completed, the students can clearly watch the high-definition display screen 2, and multiple students can simultaneously learn by watching the high-definition display screen 2, effectively improving the learning efficiency.

[0034] Embodiment two: when the dissection training platform combined with virtual reality and augmented reality technology is used for student end stage test, open the revolving door 111, take out the head-mounted display 61 and the force feedback glove 62, and wear them correctly. The second camera 72 starts, and then the head-mounted display 61 images. The second camera 72 records the operation gestures in the operation process. During the recording process, the second camera 72 focuses through the body and the second driving mechanism 8, so as to ensure that the operation gestures are located in the imaging center. The student gesture operation track is compared with the standard gesture operation track, and the gesture similarity is used to assign a corresponding score coefficient to the student.

[0035] The focusing process is as follows: the body of the second camera 72 can be inclined up and down by a certain angle. The process of adjusting the second camera 72 by the second driving mechanism 8 is as follows: the second servo motor 81 provides rotary power as a power source to drive the second threaded rod 82 to rotate. The second threaded rod 82 can convert the rotary motion of the second servo motor 81 into linear motion. The rotation of the second threaded rod 82 drives the third track block 83 to slide in the second support rod 13, so as to adjust the position of the second camera 72. The second driving mechanism 8 is used to assist the second camera 72 to focus.

[0036] The scoring principle and standard; the data acquisition is through the second camera 72 real-time acquisition gesture data in the process of student operation, these data include gesture position, direction, motion speed, acceleration and finger bending degree and other information, using Kalman filtering algorithm to smooth the position data, reduce measurement error, from the processed data to extract key features to describe gesture trajectory, the position coordinates of gesture at different time points form a position sequence.

[0037] Similarity calculation; the speed of student and standard gesture operation may be different, resulting in the trajectory not aligned on the time axis, using DTW algorithm can dynamically adjust the time axis of two trajectories, make them aligned in time, then calculate the distance sum between corresponding points, find the longest common subsequence in student gesture trajectory and standard gesture trajectory, the subsequence reflects the similar part of two trajectories, the longer the LCSS length, the more similar the two trajectories, according to the teaching requirements and evaluation standard, set different similarity threshold, and map the similarity range to the corresponding score interval, the similarity between 90%-100% corresponds to excellent, 80%-89% corresponds to good, and so on, through gesture similarity to allocate the corresponding score coefficient for students, make the student's evaluation score more accurate and fair.

[0038] Finally, it should be noted that: the above only for the preferred embodiments of the present application, and not for limiting the present application, although the foregoing detailed description of the present application is made with reference to the foregoing embodiments, for those skilled in the art, it still can be modified, or part of the technical features of the equivalent replacement, within the spirit and principles of the present application, any modification, equivalent replacement, improvement, etc., should be included in the scope of protection of the present application.

Claims

1. An anatomical training platform combining virtual reality and augmented reality technology, comprising a simulated operating mechanism (6) within a support base (11), characterized in that, The support base (11) is fixedly connected with an anatomical training table (1), the anatomical training table (1) is fixedly connected with two groups of fixed rods (3), the fixed rods (3) are provided with high-definition display screens (2), the anatomical training table (1) is provided with a monitoring recording mechanism (7), the monitoring recording mechanism (7) is used for monitoring and recording the operation process, and the monitoring recording mechanism (7) comprises: A first camera (71) is located directly above the center of the anatomical training table (1), and the first camera (71) is electrically connected with the high-definition display screen (2); Two groups of second cameras (72) are located on the two sides of the first camera (71) respectively, and the gesture operation track recorded by the second camera (72) is compared with the standard gesture operation track; The high-definition display screen (2) is provided with a first driving mechanism (4) and an adjusting mechanism (5) between the fixed rod (3), the first driving mechanism (4) is used for adjusting the height of the high-definition display screen (2), the adjusting mechanism (5) is used for adjusting the inclination angle of the high-definition display screen (2), and the first driving mechanism (4) and the adjusting mechanism (5) are cooperated to adjust the position of the high-definition display screen (2).

2. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 1, wherein, The fixed rod (3) is provided with a first track main body (31) and a second track main body (32).

3. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 2, wherein, The first driving mechanism (4) comprises: A first servo motor (41) is arranged on the upper end of the fixed rod (3); A first threaded rod (42) is fixedly connected to the bottom of the output end of the first servo motor (41) and rotationally connected to the fixed rod (3); A first track block (43) is slidably connected to the first threaded rod (42) in the first track main body (31), and the first threaded rod (42) is threadedly connected with the first track block (43).

4. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 3, wherein, The adjusting mechanism (5) comprises: A second track block (51) is slidably connected to the second track main body (32); A U-shaped connecting plate (52) is fixedly connected to the back of the second track block (51) at both ends; An electric push rod (53) is fixedly connected to the U-shaped connecting plate (52).

5. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 4, wherein, The high-definition display screen (2) is fixedly connected with a first connecting piece (21) at both ends, the first connecting piece (21) is rotationally connected to the first track block (43), the back of the high-definition display screen (2) is fixedly connected with a second connecting piece (22), and the output end of the electric push rod (53) is hingedly connected to the second connecting piece (22).

6. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 1, wherein, The anatomical training table (1) is fixedly connected with a first support rod (12) and a second support rod (13), the bottom of the anatomical training table (1) is fixedly connected with a third support rod (14) and a fourth support rod (15), and the first camera (71) is installed at the bottom of the first support rod (12).

7. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 1, wherein, The simulation operation mechanism (6) is used for anatomical simulation operation, and the simulation operation mechanism (6) comprises: A head-mounted display (61) is clamped on the fourth support rod (15); A force feedback glove (62) is clamped on the third support rod (14).

8. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 6, wherein, The second support rod (13) is internally provided with a second driving mechanism (8) for adjusting the position of the second camera (72), the second driving mechanism (8) comprises: A second servo motor (81) is mounted on the second support rod (13); A second threaded rod (82) is fixedly connected to the output end of the second servo motor (81), and is rotationally connected to the second support rod (13); A third track block (83) is slidingly connected to the second support rod (13), the second threaded rod (82) is threadedly connected to the third track block (83), and the second camera (72) is mounted on the bottom of the third track block (83).

9. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 7, wherein, The head-mounted display (61) is used for virtual scene presentation and information marking, and the force feedback glove (62) is used for force perception and feedback.

10. The dissection training platform incorporating virtual reality and augmented reality technologies of claim 1, wherein, A rotating door (111) is hinged to the support base (11), and the rotating door (111) is used to protect the simulation operating mechanism (6) in the support base (11).

Images