A virtual simulation platform for botulinum toxin muscle injection based on force feedback technology
Through the virtual simulation platform of botulinum toxin intramuscular injection based on force feedback technology, combined with VR hardware equipment and force feedback handle, the force feedback during the injection process is simulated, and the problems of high risks and long training cycles in botulinum toxin injection training are solved, real Operating experience and standardized training improve the accuracy and safety of injection technology.
Patent Information
- Application Number
- CN202210306195.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-25
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-03-25
AI Technical Summary
The prior art has problems such as high risks, long training cycles, lack of real experience and standardization in the training and operation of botulinum toxin injection, especially in the accuracy of injection points and doses and the learning of operation processes. Traditional virtual reality technology It is impossible to effectively simulate real force feedback and puncture feelings.
Botox intramuscular injection virtual simulation platform based on force feedback technology, combining VR hardware equipment and force feedback handles, realizes real-time simulation calculation and virtual puncture process interaction by simulating the skin's hexagonal honeycomb structure and puncture needle force, providing Theoretical learning, abnormal spasm pattern analysis, injection process module and force feedback operation module to enhance learning experience and operation capabilities.
It effectively solves the risks and long cycle problems of traditional training, provides real force feedback and operational experience, improves students' operating ability and standardization of injection technology, and reduces discomfort and wrong operations during injection.
Abstract
Description
Technical Field
[0001] The invention belongs to the technical fields of tactile interaction, virtual reality system and network communication, and in particular relates to a botulinum toxin muscle injection virtual simulation platform based on force feedback technology. Background Art
[0002] Botulinum toxin is a neurotoxin that can block the information transmission between nerve-muscle junctions, relax over-contracted or spasmodic muscles, and thus relieve local muscle spasms, improve posture and gait, and enhance limb movement function. It has important application value in clinical treatment of rehabilitation medicine. However, botulinum toxin is one of the most toxic toxins known in the world. Improper injection sites or injection doses can cause death. Therefore, reasonable learning of the application scope and precautions of botulinum toxin injections, as well as targeted learning of botulinum toxin injection sites, doses, and operation procedures, is not only conducive to the clinical popularization of botulinum toxin injection treatments, but also helps to avoid the huge risks that may exist during botulinum toxin injections.
[0003] Virtual reality technology can be applied to design, manufacturing and vocational skills training to a large extent. It has the advantages of creating an immersive learning environment and visualizing abstract knowledge. Compared with traditional two-dimensional flat display devices, virtual reality experience is more immersive, interactive and imaginative. In a virtual environment, by constructing scenes that are highly similar to the real thing, medical students can feel as if they are in the scene, which enhances their experience and thus improves their learning effect.
[0004] In a virtual environment, creating a virtual situation and feeling the real world experience immersively has always been the highest goal pursued by virtual reality technology. The traditional virtual reality experience only provides a handle or bare-handed operation in terms of touch, and no further research is done on contact force feedback. The present invention applies force feedback technology to the medical education and training industry, and proposes a new solution to the problem of enhanced perception training in the medical field.
[0005] Due to the large variations in abnormal spasm patterns and obvious differences in injection sites during clinical practice, there are corresponding requirements for injection doses and guidance methods. In addition, there is no unified training and assessment system for botulinum toxin injections at home and abroad, which also leads to uneven learning and clinical operation of botulinum toxin.
[0006] In the process of force rendering, force feedback technology needs to give corresponding feedback on how objects collide or how force tactile reactions are generated. This requires simulating the appearance of force tactile sensations. The simulation here is not a physics-based simulation but a simulation based on actual perception consistency, just like the image rendering algorithm in graphics. Therefore, the present invention proposes to perform force rendering on the skin injection link. Through the combination of virtual reality technology and force simulation technology, the sense of operation that cannot be achieved by general virtual simulation teaching is achieved to obtain a sense of reality and presence, thereby achieving better learning and training requirements.
[0007] Botulinum toxin injection not only requires injecting the drug into the corresponding muscle, but also requires injecting the drug into the point with the richest neuromuscular junctions in the muscle with obvious spasm. The commonly used ultrasound guidance method can accurately locate the corresponding muscle under visualization, and the electromyography guidance method can accurately locate the position of the neuromuscular junction under the guidance of electrophysiology. Superficial muscles or large muscles can simply use electromyography guidance, while deep muscles and small muscles often require ultrasound to explore the muscle position to reduce the patient's discomfort caused by repeated needle sticks during injection. Summary of the invention
[0008] The purpose of the present invention is to provide a botulinum toxin muscle injection virtual simulation platform based on force feedback technology in view of the deficiencies of the prior art.
[0009] The virtual simulation platform for botulinum toxin muscle injection based on force feedback technology includes VR hardware equipment, force feedback handle, and botulinum toxin muscle injection virtual simulation system;
[0010] The botulinum toxin muscle injection virtual simulation system includes a botulinum toxin theory learning template module, a botulinum toxin commonly used injection muscle module, a common abnormal spasm pattern learning module, a botulinum toxin injection process module, and a botulinum toxin injection force feedback operation module;
[0011] The botulinum toxin theory learning template module is used to provide users with botulinum toxin theory learning;
[0012] The botulinum toxin commonly injected muscle module is used to provide users with learning of limb movement-related muscles of the upper and lower limbs of the human body, as well as botulinum toxin injection sites and dosages of muscles;
[0013] The common abnormal spasm pattern learning module is used to provide users with learning of abnormal movement pattern analysis and spasm assessment of common limb spasms;
[0014] The botulinum toxin injection process module is used to provide users with a standard botulinum toxin injection operation process for learning common limb muscles;
[0015] The botulinum toxin injection force feedback operation module is used to receive the action signal fed back by the force feedback handle, and then perform real-time simulation calculation according to the received signal, obtain the force of the puncture needle and transmit it to the force interaction device for the user to feel, and at the same time generate a real-time virtual puncture process interface on the display device according to the simulation calculation result, thereby realizing lumbar puncture virtual simulation and training; specifically:
[0016] The structure of the skin is simplified into a hexagonal honeycomb structure, which is a mesh structure composed of particles and connecting lines. The force between the particles in the mesh structure is inversely proportional to the square. The puncture point always appears at the exact center of the above hexagonal honeycomb structure, recorded as the coordinates (x, y, z); by applying the puncture needle force between the maximum and minimum values of the slightly raised skin surface, the deformation state of the hexagonal honeycomb structure is smoothly calculated; the deformation state of the hexagonal honeycomb structure is positively correlated with the puncture needle force, and inversely correlated with the distance between the two particles, and finally multiplied by the deformation factor multiplier.
[0017] The beneficial effects of the present invention are:
[0018] 1) Combining force feedback interaction and VR virtual reality in the field of medical training can solve the pain points of high risk and long training cycle of traditional hospital training. It also solves the problem that traditional virtual scenes can only be interacted through handles, lacking real experience and unable to truly simulate the real patient posture and injection force and depth. Integrating force feedback devices into the virtual environment largely solves the problem that standardized virtual reality handles cannot be effectively learned.
[0019] 2) Extension and expansion of traditional teaching:
[0020] Traditional clinical botulinum toxin injection teaching methods mostly rely solely on theoretical teaching, supplemented by corresponding video and other multimedia content. The fragmented and theoretical knowledge training system is difficult to carry out the teaching and training of botulinum toxin injection technology with high practical operation requirements. With the help of information technology that combines virtual and real and software and hardware, the standardized and normalized training and assessment of botulinum toxin injection technology have effectively strengthened students' operational capabilities. DETAILED DESCRIPTION
[0021] The present invention is further analyzed below in conjunction with specific embodiments.
[0022] The virtual simulation platform for botulinum toxin muscle injection based on force feedback technology includes VR hardware equipment, force feedback handle, and botulinum toxin muscle injection virtual simulation system;
[0023] The botulinum toxin muscle injection virtual simulation system includes a botulinum toxin theory learning template module, a botulinum toxin commonly used injection muscle module, a common abnormal spasm pattern learning module, a botulinum toxin injection process module, and a botulinum toxin injection force feedback operation module;
[0024] The botulinum toxin theory learning template module is used to provide users with botulinum toxin theory learning;
[0025] The botulinum toxin commonly injected muscle module is used to provide users with learning of limb movement-related muscles of the upper and lower limbs of the human body, as well as botulinum toxin injection sites and dosages of muscles;
[0026] The common abnormal spasm pattern learning module is used to provide users with learning of abnormal movement pattern analysis and spasm assessment of common limb spasms;
[0027] The botulinum toxin injection process module is used to provide users with a standard botulinum toxin injection operation process for learning common limb muscles;
[0028] The botulinum toxin injection force feedback operation module is used to receive the action signal fed back by the force feedback handle, and then perform real-time simulation calculation according to the received signal, obtain the force of the puncture needle and transmit it to the force interaction device for the user to feel, and at the same time generate a real-time virtual puncture process interface on the display device according to the simulation calculation result, thereby realizing lumbar puncture virtual simulation and training; specifically:
[0029] The structure of the skin is simplified into a hexagonal honeycomb structure, which is a mesh structure composed of particles and connecting lines. The force between the particles in the mesh structure is inversely proportional to the square. The puncture point always appears at the exact center of the above hexagonal honeycomb structure, recorded as the coordinates (x, y, z); by applying the puncture needle force between the maximum and minimum values of the slightly raised skin surface, the deformation state of the hexagonal honeycomb structure is smoothly calculated; the deformation state of the hexagonal honeycomb structure is positively correlated with the puncture needle force, and inversely correlated with the distance between the two particles, and finally multiplied by the deformation factor multiplier.
[0030] The invention requires a computer with a graphics processing card, and the accessories include an HTC Vive pro head-mounted display and a corresponding base station and handle, a TouchX desktop pen-type force feedback handle, and the corresponding SDK and driver are configured.
[0031] 1. Scene simulation production (using Photoshop for mapping, normal texture, etc., using 3dsMax software for scene modeling and scene construction as well as human body model simulation. Performance optimization, baking lightmaps for static objects, direct sampling of lightmaps when online to reduce real-time lighting overhead, etc.).
[0032] 2. Abnormal muscle movement pattern recognition and diagnosis methods. It is necessary to build a database based on the expert database of medical knowledge.
[0033] The abnormal movement patterns of the trunk and limbs as well as the abnormal muscle states are modeled and simulated respectively, and the corresponding action teaching video files are used to construct a database.
[0034] 3. Physical simulation. Control the tactile sensation of the force feedback device at different injection depths, different injection positions and injection feedback of different muscles in the scene. Muscle disassembly VR program and pen-type force feedback device program production, disassemble two problems that need to be solved in the virtual reality environment during muscle injection, and produce training content provided by the program.
[0035] 4. Data processing and analysis (recording training data each time, training users based on errors such as mistakes, mis-touch, too deep / too shallow operations that may occur during the actual training process, analyzing and judging the results, and thus providing users with a mechanism for learning feedback) The present invention requires the configuration of a Unity environment. In the Unity environment, 3DMAX is first used to build models and scenes as well as character muscle models. A total of 4 types of scenes need to be built, including a multimedia interactive learning scene for botulinum toxin injection configuration, a muscle identification and disassembly scene, and a muscle injection scene.
[0036] Each type of scene contains different levels. In the level design and model making stage, the scenes and models need to be designed in advance. Since different character models are required, in terms of animation, the characters are modeled using 3DMAX and MAYA to produce corresponding K-frame character animations. For the human body model, iClone modeling is used to produce the character skin model. It should be noted that when making the character model, the bone information needs to be saved, which will be called in Unity later.
[0037] Botulinum toxin injection not only requires injecting the drug into the corresponding muscle, but also requires injecting the drug into the point with the richest neuromuscular junctions in the muscle with obvious spasm. The commonly used ultrasound guidance method can accurately locate the corresponding muscle under visualization, and the electromyography guidance method can accurately locate the position of the neuromuscular junction under the guidance of electrophysiology. Superficial muscles or large muscles can simply use electromyography guidance, while deep muscles and small muscles often require ultrasound to explore the muscle position to reduce the patient's discomfort caused by repeated needle sticks during injection.
[0038] For the common limb spasticity dysfunction in the rehabilitation medicine department, the common abnormal movement patterns and the muscle groups that cause the abnormal movement patterns are analyzed to determine the degree of spasticity of the relevant abnormal muscle groups. After combining clinical analysis, botulinum toxin injections are used according to the operating procedures and specifications, and the common complications of botulinum toxin injections are understood.
[0039] The execution process of botulinum toxin injection mainly involves standardized process learning of botulinum toxin injection and repeated learning and consolidation of botulinum toxin injection points for each muscle group, and tactile feedback of the correct injection point through force feedback to obtain a better learning experience. The assessment module is based on the completion of learning in the above modules, and conducts motion analysis without step prompts, botulinum toxin injection muscle selection, injection point selection and corresponding theoretical questions, and gives the corresponding injection operation assessment results through assessment.
[0040] The above embodiments are not limitations of the present invention, and the present invention is not limited to the above embodiments. As long as the requirements of the present invention are met, they belong to the protection scope of the present invention.
Claims
1. Botulinum toxin muscle injection virtual simulation platform based on force feedback technology, Features Including VR hardware equipment, force feedback handles, and botulinum toxin muscle injection virtual simulation system; The botulinum toxin muscle injection virtual simulation system includes a botulinum toxin theory learning template module, a botulinum toxin commonly used injection muscle module, a common abnormal spasm pattern learning module, a botulinum toxin injection process module, and a botulinum toxin injection force feedback operation module; The botulinum toxin theory learning template module is used to provide users with botulinum toxin theory learning; The botulinum toxin commonly injected muscle module is used to provide users with learning of limb movement-related muscles of the upper and lower limbs of the human body, as well as botulinum toxin injection sites and dosages of muscles; The common abnormal spasm pattern learning module is used to provide users with learning of abnormal movement pattern analysis and spasm assessment of common limb spasms; The botulinum toxin injection process module is used to provide users with a standard botulinum toxin injection operation process for learning common limb muscles; The botulinum toxin injection force feedback operation module is used to receive the action signal fed back by the force feedback handle, and then perform real-time simulation calculation according to the received signal, obtain the force of the puncture needle and transmit it to the force interaction device for the user to feel, and at the same time generate a real-time virtual puncture process interface on the display device according to the simulation calculation result, thereby realizing lumbar puncture virtual simulation and training; The botulinum toxin injection force feedback operation module is used to receive the action signal fed back by the force feedback handle, and then perform real-time simulation calculation according to the received signal. Specifically: The structure of the skin is simplified into a hexagonal honeycomb structure, which is a mesh structure composed of particles and connecting lines. The force between the particles in the mesh structure is inversely proportional to the square. The puncture point always appears at the exact center of the above hexagonal honeycomb structure, recorded as the coordinates (x, y, z); by applying the puncture needle force between the maximum and minimum values of the slight protrusion on the skin surface, the deformation of the hexagonal honeycomb structure is smoothly calculated; The deformation state of the hexagonal honeycomb structure is positively correlated with the force of the puncture needle, negatively correlated with the distance between the two particles, and finally multiplied by the deformation multiplier.
