A 3D display system for virtual surgery training
By adopting a three-dimensional display system for virtual surgical training in medical teaching, and using rear projection and mirror technology combined with dual-machine image projection and polarized glasses, the poor experience and understanding problems caused by traditional two-dimensional image learning methods are solved, and more efficient medical teaching effects are achieved.
Patent Information
- Application Number
- CN202010701921.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-21
- Publication Date
- 2025-05-30
- Estimated Expiration
- 2040-07-21
AI Technical Summary
In the prior art, medical staff mainly study and study by viewing traditional two-dimensional image materials, resulting in poor experience and difficulty in understanding in the teaching process, which is not conducive to improving the efficiency of medical teaching.
A three-dimensional display system for virtual surgical training is adopted. The system includes a virtual simulation display module, a training operation module, a main case, an upper support table, a lower support table and polarized glasses. Through the combination of rear projection and a plane reflector, the visual depth of three-dimensional observation is achieved, and the image and polarized glasses are projected by dual-machine images to achieve good 3D immersion effect.
It improves the intuitive observation and operational understanding of the internal structure of the operating room by medical staff and students, reduces the visual fatigue and dizziness of the observer, and enhances the efficiency and practical use value of medical teaching.
Smart Images

Figure CN111741288B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of medical devices, and particularly relates to a three-dimensional display system for virtual surgery training. Background Art
[0002] Virtual reality technology constructs a simulated scene through VR technology and can be applied to aspects such as games, social networking, science education, office work, medical treatment, sightseeing, driving, entertainment, leisure, sports, and video playback. The scenes and characters seen in virtual reality are all virtual, and it immerses people's consciousness into a virtual world. With the continuous development of the informatization of medical technology, virtual reality technology has gradually been applied to the medical field. The technical levels of medical staff and students need to be further improved, and medical staff and students need to continuously study academic knowledge, including the use and instructions of medical devices, the diagnosis and treatment of various diseases, the study and research of various anatomical surgeries on the human body, etc. However, in the prior art, medical staff mostly learn and research by watching traditional two-dimensional image materials, and this method is not intuitive, the students have a poor experience during the teaching process, it is difficult to understand, and it is not conducive to improving the efficiency of medical teaching. There is an urgent need for a three-dimensional display system for virtual surgery training with good display effects.
[0003] Chinese Patent (CN110376922A) discloses an operating room scene simulation system, including: a scene modeling module and a scene interaction module; the scene modeling module is used to construct an operating room simulation scene and import the operating room simulation scene into the scene interaction module. The operating room simulation scene includes a plurality of interactive objects, and the interactive objects include an operating table, a shadowless lamp, an X-ray film viewer, a monitor, and a multifunctional anesthesia machine; the scene interaction module is used to receive each control instruction sent by the user and simulate the human-machine interaction between the human body and each of the interactive objects in the operating room simulation scene according to the control operation corresponding to each control instruction. It can be seen that by applying this system, users can observe the internal structure of the operating room in an intuitive form and simulate the operation process of the human body performing various control operations in the operating room through various control instructions.
[0004] Chinese invention patent (CN110335516A) discloses a VR cardiac surgery simulation system, including a simulation server, a surgical operation device, a medication operation device, a virtual database, and a real-scene data generation unit. The virtual database is connected with a communication interface. An operation data acquisition device and an operation data communication module are sequentially connected between the surgical operation device and the real-scene data generation unit. A medication flow acquisition device and a medication flow communication module are sequentially connected between the medication operation device and the real-scene data generation unit. The invention also discloses a VR cardiac surgery simulation method. It can be seen that in this invention, a virtual-real hybrid simulation scenario is obtained by using the medication operation model, surgical operation model, and cardiac simulation data stored in the virtual database to respond to the acquisition data of the myocardial pressure detection module and the action state data of the surgical operation device. Summary of the Invention
[0005] The technical problem to be solved by the present invention is to provide a three-dimensional display system for virtual surgery training in view of the deficiencies of the prior art.
[0006] The technical problem to be solved by the present invention is achieved through the following technical solutions. A three-dimensional display system for virtual surgery training includes a virtual simulation display module, a training operation module, a main chassis, an upper support platform, a lower support platform, and polarized light glasses. The upper support platform is fixedly connected to the upper part of the lower support platform. The upper support platform and the lower support platform form an I-shaped support structure. The virtual simulation display module is placed on the upper part of the upper support platform. The training operation module is placed at the front end of the upper part of the lower support platform. The virtual simulation display module and the training operation module are arranged opposite to each other vertically in sequence. Both the virtual simulation display module and the training operation module are electrically connected to the main chassis. The polarized light glasses are placed on the tabletop of the upper support platform.
[0007] Furthermore, the virtual simulation display module includes a first projection device, a second projection device, a rear projection screen device, a reflector device, a mounting bracket, and adjusting legs. The mounting bracket is a four-bar parallel square frame structure. The first projection device and the second projection device are both installed at the upper end of the mounting bracket. The rear projection screen device is installed in the middle of the mounting bracket. The reflector device is installed at the lower part of the mounting bracket. The rear projection screen device and the reflector device are vertically opposite to each other. The adjusting legs are hinged to the rear part of the mounting bracket.
[0008] Furthermore, both the first projection device and the second projection device include a projector, a deflection adjustment frame, and a polarizing plate. The projector is fixedly installed on the leg of the mounting bracket. The deflection adjustment frame is installed on the leg of the mounting bracket through a rotary fixing component. The polarizing plate is fixedly installed at the outer end of the deflection adjustment frame. The first projection device and the second projection device are installed symmetrically in parallel on the mounting bracket.
[0009] Further, the rotation fixing assembly of the deflection adjustment frame includes two deflection mounting plates that are opposite to each other up and down. A semi-circular turntable is provided on the outer side of the deflection mounting plate. An arc-shaped slot hole is provided on the semi-circular turntable. A threaded compression post is installed in the arc-shaped slot hole. The deflection mounting plate is fixedly pressed on the leg of the mounting bracket through the threaded pressing action of the threaded compression post, and the synchronous deflection angle adjustment of the two deflection mounting plates that are opposite to each other up and down is realized.
[0010] Further, a threaded part extrusion fixing device is provided on the side edge of the rear projection screen device. The rear projection screen device is fixedly pressed on the mounting bracket through the threaded part extrusion fixing device.
[0011] Further, the adjusting leg includes an adjusting hinge, a first locking assembly, and a second locking assembly. The adjusting hinge is a series-connected link structure. Both ends of the adjusting hinge are respectively connected to the mounting bracket and the adjusting leg through the first locking assembly. The mounting bracket and the adjusting leg are both provided with chutes that cooperate with the first locking assembly. A second locking assembly is provided on the series-connected joint of the adjusting hinge. The second locking assembly can lock the relative rotation angle of two adjacent rods.
[0012] Further, the front end of the reflector device is rotatably mounted on the mounting bracket. A reflection angle adjustment component is provided at the rear end of the reflector device. A chute that cooperates with the reflection angle adjustment component is provided on the mounting bracket. The reflector device realizes the angle adjustment process through the sliding fit of the reflection angle adjustment component in the chute.
[0013] Further, the training operation module includes a first force feedback operation device and a second force feedback operation device. The first force feedback operation device and the second force feedback operation device are arranged opposite to each other at intervals. The training operation module is used to execute the force feedback operation process.
[0014] The present invention has the following advantages compared with the prior art:
[0015] By adopting the rear projection method and cooperating with the reflection effect of the plane mirror, the present invention makes the image position deviate, increases the visual depth of the three-dimensional observation of the observer, and at the same time registers with the hand operation to achieve a good display effect; this system avoids the conventional single way of watching 3D images, uses a dual-projector to project images, installs polarizing sheets on the projectors to form polarized light to divide the images into left and right images, and at the same time uses stereoscopic glasses to achieve the 3D immersion effect of the virtual reality environment, solves the problem of non-registration, and at the same time reduces the visual fatigue and dizziness of the observer; in addition, this system is small and convenient, can be configured in a desktop manner, is easy to carry and store, has good usability, and has high practical use value. Description of the Drawings
[0016] Figure 1It is a schematic structural diagram of the whole of the present invention;
[0017] Figure 2 It is a schematic structural diagram of the first projection device 11 of the present invention;
[0018] 1 - Virtual simulation display module, 11 - First projection device, 111 - Projector, 112 - Deflection adjustment frame, 113 - Polarizer, 12 - Second projection device, 13 - Rear projection screen device, 14 - Reflector device, 141 - Reflection angle adjustment component, 15 - Mounting bracket, 16 - Adjusting leg, 161 - Adjusting hinge, 162 - First locking component, 163 - Second locking component, 2 - Training operation module, 21 - First force feedback operation device, 22 - Second force feedback operation device, 3 - Main chassis, 4 - Upper support platform, 5 - Lower support platform, 6 - Polarized light glasses. Specific embodiments
[0019] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.
[0020] Such as Figure 1-2As shown in the figure, the present invention discloses a three-dimensional display system for virtual surgery training, which includes a virtual simulation display module 1, a training operation module 2, a main chassis 3, an upper support platform 4, a lower support platform 5, and polarized light glasses 6. The polarized light glasses 6 include 3D stereoscopic glasses for observing the rear projection reflection image. The upper support platform 4 is fixedly connected to the upper part of the lower support platform 5. The upper support platform 4 and the lower support platform 5 form an I-shaped support structure. The virtual simulation display module 1 is placed on the upper part of the upper support platform 4. The training operation module 2 is placed at the front end of the upper part of the lower support platform 5. The virtual simulation display module 1 and the training operation module 2 are arranged opposite to each other vertically in sequence. Both the virtual simulation display module 1 and the training operation module 2 are electrically connected to the main chassis 3. The polarized light glasses 6 are placed on the tabletop of the upper support platform 4. The virtual simulation display module 1 includes a first projection device 11, a second projection device 12, a rear projection screen device 13, a reflector device 14, a mounting bracket 15, and an adjusting leg 16. The mounting bracket 15 is a four-bar parallel square frame structure. The first projection device 11 and the second projection device 12 are both installed at the upper end of the mounting bracket 15. The rear projection screen device 13 is installed in the middle of the mounting bracket 15. The reflector device 14 is installed at the lower part of the mounting bracket 15. The rear projection screen device 13 and the reflector device 14 are opposite to each other vertically. The adjusting leg 16 is hinged to the rear part of the mounting bracket 15. Both the first projection device 11 and the second projection device 12 include a projector 111, a deflection adjustment frame 112, and a polarizer 113. The projector 111 is fixedly installed on the leg of the mounting bracket 15. The deflection adjustment frame 112 is installed on the leg of the mounting bracket 15 through a rotation fixing component. The outer end of the deflection adjustment frame 112 is fixedly installed with the polarizer 113. The first projection device 11 and the second projection device 12 are installed symmetrically in parallel on the mounting bracket 15. The rotation fixing component of the deflection adjustment frame 112 includes two vertically opposite deflection mounting plates. A semi-circular turntable is provided on the outer side of the deflection mounting plate. An arc-shaped slot is provided on the semi-circular turntable. A threaded compression post is installed in the arc-shaped slot. The deflection mounting plate is fixedly pressed on the leg of the mounting bracket 15 through the threaded compression of the threaded compression post and realizes the synchronous deflection angle adjustment of the two vertically opposite deflection mounting plates. A threaded part extrusion fixing device is provided on the side edge of the rear projection screen device 13. The rear projection screen device 13 is fixedly pressed on the mounting bracket 15 through the threaded part extrusion fixing device.The adjusting outrigger 16 includes an adjusting hinge 161, a first locking assembly 162 and a second locking assembly 163. The adjusting hinge 161 is a series-connected link structure. Both ends of the adjusting hinge 161 are respectively connected to the mounting bracket 15 and the adjusting outrigger 16 through the first locking assembly 162. The mounting bracket 15 and the adjusting outrigger 16 are both provided with chutes that cooperate with the first locking assembly 162. A second locking assembly 163 is provided on the series-connected joint of the adjusting hinge 161, and the second locking assembly 163 can lock the relative rotation angle of two adjacent rods.
[0021] The front end of the rearview mirror device 14 is rotatably mounted on the mounting bracket 15. A reflection angle adjustment component 141 is provided at the rear end of the rearview mirror device 14. The mounting bracket 15 is provided with a chute that cooperates with the reflection angle adjustment component 141. The rearview mirror device 14 realizes the angle adjustment process through the sliding fit of the reflection angle adjustment component 141 in the chute. The training operation module 2 includes a first force feedback operation device 21 and a second force feedback operation device 22. The first force feedback operation device 21 and the second force feedback operation device 22 are arranged opposite to each other at intervals. The training operation module 2 is used to execute the force feedback operation process.
[0022] This system uses a dual-projection to form a polarized light stereoscopic projection. Dual-projector screening can greatly make up for the deficiencies at both ends of the single-projector 3D picture. While obtaining higher image quality, it ensures that the picture is smoother and more fluent, avoids screen bright spots or uneven light reflection, eliminates the visual fatigue and dizziness caused by long-term viewing of the single-projector 3D system, and the system always maintains high picture quality during transmission, achieving high fidelity of image quality. In terms of the hardware technology of the stereoscopic display technology, by adjusting the hardware to control the parallax within an appropriate range, the requirements of stereoscopic display can be completed.
[0023] In specific use, the device of the present invention can establish a stereoscopic display system according to the time-sharing display technology. The stereoscopic display system often adopts the beam splitting technology, using two identical projection devices to project images simultaneously, and respectively installing two polarizing films 113 with a phase difference of 90 degrees on the lenses of the two projection devices to form double images on the screen. Users can choose stereoscopic glasses with the same angle as the lens polarizing film 113. When there is a light source, the left and right lenses of the stereoscopic glasses utilize the filtered polarized light to achieve the graphic stereoscopic effect. The use of this system requires the configuration of a graphics workstation. After the graphics workstation outputs the graphic signal and the hardware of the stereoscopic display device is connected properly, the software part of the graphics workstation needs to be adjusted. First, adjust the display part of the graphics workstation. To achieve dual-projection display, the projection system needs to be synchronized with the monitor of the workstation. Therefore, set the display mode of the graphics workstation to the extended mode, that is, the two projections are equivalent to two monitors, respectively displaying different images for the left and right eyes. Through the combination of the polarizing film and the polarized glasses, the user's left eye can only see the left-eye image, and the right eye can only see the right-eye image. After importing the model, it is necessary to adjust the three-dimensional stereoscopic display effect in the virtual reality software. Use the two projectors 111 to project images. Install polarizing films 113 on the projectors 111 to form polarized light to divide the image into left and right images, and at the same time use stereoscopic glasses to achieve the 3D immersion effect of the virtual reality environment.
[0024] In addition, it should be noted that passive stereoscopic projection is a projection method based on the principle of polarized light. Two projectors 111 project two images of the same scene with binocular parallax onto a screen overlappingly. At this time, when observing the screen with the naked eye, a three-dimensional entity with double images is seen. In order to enable the left and right eyes of a person to see the corresponding images in the stereoscopic image group respectively, it is necessary to use the polarizing film 113 as a polarizer to make the polarized directions of the light beams projected by the two projectors 111 orthogonal after polarization. After being reflected by the screen, the left and right light beams are respectively received by the analyzer in the form of stereoscopic glasses. Specifically, when light propagates through two polarizing films 113 with the same polarization direction, it can transmit light; when passing through two polarizing lenses with perpendicular polarization directions, it cannot transmit light. Superimpose and display the two projectors 111, and install polarizing lenses with perpendicular polarization directions in front of the lenses respectively; and the lenses of the polarized glasses are also of perpendicular polarization directions. In this way, the left and right eyes of the observer can only see the images projected by one of the projectors 111 respectively. After the stereoscopic images are analyzed by the polarized glasses, they are respectively projected onto the retinas of the two eyes, so that the left and right eyes of a person can respectively observe two images with parallax, achieving the display effect.
[0025] The passive stereoscopic projection system based on the superposition of two machines of the present system can be composed of a graphics workstation, two engineering DLP projectors 111, polarizers 113, a metal curtain, and 3D stereoscopic glasses. First, the user generates a 3D model through the graphics workstation and inputs two video signals to the two projectors 111 through two interfaces of the high-end professional graphics card on the graphics workstation. The light of the projectors 111 outputs two polarized light sources through the polarizers 113 with polarization effects and projects them onto the metal curtain. The user can then observe the high-quality 3D image effect through the 3D glasses. At the same time, this method can also be conveniently used for multi-channel splicing to achieve a wide-field stereoscopic display effect, which will not be elaborated here.
[0026] The above are only the preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention can have various changes and modifications. Any modifications, equivalent replacements, and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.
Claims
1. A three-dimensional display system for virtual surgery training, characterized in that: It includes a virtual simulation display module, a training operation module, a main chassis, an upper support platform, a lower support platform and polarized light glasses. The upper support platform is fixedly connected to the upper part of the lower support platform. The upper support platform and the lower support platform form an I-shaped support structure. The virtual simulation display module is placed on the upper part of the upper support platform. The virtual simulation display module includes a first projection device, a second projection device, a rear projection screen device, a reflector device, a mounting bracket and an adjusting leg. The mounting bracket is a four-bar parallel square frame structure. The first projection device and the second projection device are both installed at the upper end of the mounting bracket. The rear projection screen device is installed in the middle of the mounting bracket. The reflector device is installed at the lower part of the mounting bracket. The rear projection screen device and the reflector device are opposite to each other up and down. The adjusting leg is hinged to the rear of the mounting bracket. The training operation module is placed at the front end of the upper part of the lower support platform. The virtual simulation display module and the training operation module are arranged opposite to each other up and down in sequence. The virtual simulation display module and the training operation module are both electrically connected to the main chassis. The polarized light glasses are placed on the tabletop of the upper support platform.
2. A three-dimensional display system for virtual surgery training according to claim 1, characterized in that: Both the first projection device and the second projection device include a projector, a deflection adjustment frame and a polarizing plate. The projector is fixedly installed on the leg of the mounting bracket. The deflection adjustment frame is installed on the leg of the mounting bracket through a rotation fixing component. The polarizing plate is fixedly installed at the outer end of the deflection adjustment frame. The first projection device and the second projection device are installed symmetrically in parallel on the mounting bracket.
3. A three-dimensional display system for virtual surgery training according to claim 2, characterized in that: The rotation fixing component of the deflection adjustment frame includes two deflection mounting plates opposite to each other up and down. A semi-circular turntable is provided on the outer side of the deflection mounting plate. An arc-shaped slot is provided on the semi-circular turntable. A threaded compression column is installed in the arc-shaped slot. The deflection mounting plate is fixedly pressed on the leg of the mounting bracket through the threaded pressing action of the threaded compression column and realizes the synchronous deflection angle adjustment of the two deflection mounting plates opposite to each other up and down.
4. A three-dimensional display system for virtual surgery training according to claim 1, characterized in that: A threaded part extrusion fixing device is provided on the side edge of the rear projection screen device. The rear projection screen device is fixedly pressed on the mounting bracket through the threaded part extrusion fixing device.
5. A three-dimensional display system for virtual surgery training according to claim 1, characterized in that: The adjusting leg includes an adjusting hinge, a first locking component and a second locking component. The adjusting hinge is a series-connected link structure. Both ends of the adjusting hinge are respectively connected to the mounting bracket and the adjusting leg through the first locking component. The mounting bracket and the adjusting leg are both provided with sliding grooves that cooperate with the first locking component. A second locking component is provided on the series-connected joint of the adjusting hinge. The second locking component can lock the relative rotation angle of two adjacent rods.
6. A three-dimensional display system for virtual surgery training according to claim 1, characterized in that: The front end of the reflector device is rotatably installed on the mounting bracket, a reflection angle adjustment component is provided at the rear end of the reflector device, a chute cooperating with the reflection angle adjustment component is provided on the mounting bracket, and the reflector device realizes the angle adjustment process through the sliding cooperation of the reflection angle adjustment component in the chute.
7. A three-dimensional display system for virtual surgery training according to claim 1, characterized in that: The training operation module includes a first force feedback operation device and a second force feedback operation device, the first force feedback operation device and the second force feedback operation device are arranged opposite to each other at intervals, and the training operation module is used to execute the force feedback operation process.
Citation Information
Patent Citations
VR cardiac surgery simulation system and simulation method thereof
CN110335516A
Operating room scene simulation system
CN110376922A
Three-dimensional display system for virtual operation training
CN212463399U
Method and system for rendering a medical simulation in an operating room in virtual reality or augmented reality environment
US20180098813A1