Drilling training assistance system
The cutting training assistance system uses a wearable display and a pseudo cutting instrument with a 6-axis sensor and vibrating vibrator to simulate cutting techniques, addressing the high cost of traditional training tools and providing an affordable, effective training solution for cutting techniques.
Patent Information
- Application Number
- PCT/JP2024/020119
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-05-31
- Publication Date
- 2024-12-05
AI Technical Summary
Robots and simulators for training cutting techniques, such as tooth cutting, are expensive, making it difficult to provide access to all students, as the issue is common across various cutting targets.
A cutting training assistance system comprising a wearable display, a pseudo cutting instrument with a 6-axis sensor and vibrating vibrator, and a control device that detects and simulates the position and angle of the cutting tool, allowing for cost-effective training by displaying cutting tools on a mold and providing tactile feedback.
Enables cost-effective training of cutting techniques by providing a tactile and visual simulation of cutting, allowing users to practice safely and effectively, with the system being portable and accessible for individual use.
Smart Images

Figure JP2024020119_05122024_PF_FP_ABST
Abstract
Description
Cutting training support system
[0001] This application claims priority to Japanese Patent Application No. 2023-090468, filed May 31, 2023, the contents of which are incorporated herein by reference.
[0002] Since dental treatment targets delicate affected areas, training in tooth cutting is important when mastering the technique. For this reason, simulators using robots and VR technology have been developed for the purpose of training tooth cutting (for example, Non-Patent Documents 1 and 2).
[0003] Al‐Saud, Loulwa M., F. Mushtaq, MJ Allsop, PC Culmer, I. Mirghani, E. Yates, A. Keeling, MA Mon‐Williams and M. Manogue. "Feedback and motor skill acquisition using a haptic dental simulator."European Journal of Dental Education" 21.4 (2017): 240-247.Serrano, Carlos M., Paul R. Wesselink, and Johanna M. Vervoorn. "First experiences with patient-centered training in virtual reality." Journal of dental education 84.5 (2020): 607-614. Kato, Kunihiro, Kaori Ikematsu, and Yoshihiro Kawahara. "CAPath: 3D-Printed Interfaces with Conductive Points in Grid Layout to Extend Capacitive Touch Inputs." Proceedings of the ACM on Human-Computer Interaction 4.ISS (2020): 1-17.
[0004] However, robots and simulators for training in tooth cutting are expensive. Therefore, it is difficult to lend a robot or simulator to every student in a dental school, for example. This problem is not limited to tooth cutting, but is a common problem for various cutting objects. An object of the present invention is to provide a cutting training assistance system that allows training in cutting of cutting objects at a lower cost.
[0005] One aspect of the present invention is a cutting training assistance system comprising a wearable display, a simulated cutting instrument, a position detection device, and a control device, wherein the simulated cutting instrument comprises a six-axis sensor that measures acceleration and angular velocity in three dimensions, and a vibrating oscillator, the position detection device detects the position of the simulated cutting instrument and the angle of the simulated cutting instrument relative to the position detection device, the control device controls the vibration of the oscillator based on the position of the position detection device, the angle of the simulated cutting instrument relative to the position detection device, and the acceleration and angular velocity of the simulated cutting instrument in three dimensions, and causes the wearable display to display the cutting instrument based on the position of the position detection device, the angle of the simulated cutting instrument relative to the position detection device, and the acceleration and angular velocity of the simulated cutting instrument in three dimensions.
[0006] According to the present invention, it is possible to train cutting of a cutting object at a lower cost.
[0007] It is a diagram showing an example of use of the cutting training assistance system. It is a diagram showing the configuration of a pseudo cutting tool. It is a diagram showing the relationship between the components of the cutting training assistance system. It is a table showing an example of information related to teeth.
[0008] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. <Overall Configuration> Fig. 1 is a diagram showing an example of use of a cutting training assistance system 1. An overview of the cutting training assistance system 1 will be described using Fig. 1. The cutting training assistance system 1 assists a user U in cutting training. The cutting training assistance system 1 includes an HMD (head-mounted display) 11, a simulated cutting tool 12, a digitizer 15, a control device 16, and a physical prop 17. For the sake of explanation, it is assumed below that the digitizer 15 is located on the XY plane and perpendicular to the Z axis.
[0009] The user U wears the HMD 11 on his / her head. The HMD 11 is worn so as to cover the eyes of the user U. An image of a cutting object being cut using a cutting tool is displayed on the display of the HMD 11. In this embodiment, the cutting object is, for example, a tooth, but is not limited to this. For example, the cutting object may be anything that can be cut, such as bone or wood. The HMD 11 may be a wearable display such as smart glasses.
[0010] The user U simulates cutting by using the simulated cutting tool 12. FIG. 2 is a diagram showing the configuration of the simulated cutting tool 12. The simulated cutting tool 12 is configured in a shape that mimics, for example, a tooth cutting tool. The simulated cutting tool 12 has a structure in which the head 13 and handle portion 14 are integrated. The user U grasps the handle portion and brings the core body 120 provided in the position indication unit 131 of the head 13 into contact with the physical prop 17. The core body 120 of the position indication unit 131 of the simulated cutting tool 12 corresponds to the portion of the tooth cutting tool that is equipped with a cutting blade. When the tip of the cutting tool is held perpendicular to the ground, the handle portion is not perpendicular to the ground but forms an acute angle with the ground. Similarly, when the position indication unit 131 is held perpendicular to the ground, the head 13 of the simulated cutting tool 12 is parallel to the ground. Furthermore, when the head 13 is held horizontally to the ground, the handle portion 14 is not horizontal to the ground but forms an acute angle with the ground.
[0011] The pseudo cutting tool 12 includes a position indicator 131 , a six-axis sensor 122 , a sensor circuit 123 , a vibrator 124 , a control circuit 125 , and an interface 126 .
[0012] The position indication unit 131 is provided at the tip of the simulated cutting tool 12. The position indication unit 131 includes a core body 120 and a coil 121. The user U uses the simulated cutting tool 12 to perform simulated cutting by bringing the tip of the core body 120 into contact with a physical prop.
[0013] The core body 120 is provided parallel to the axis of the coil 121. The core body 120 transmits pressure applied along the axis of the coil 121 to the pressure sensor.
[0014] The coil 121 generates a magnetic field. The coil 121 is provided so as to be vertical when the head 13 is placed horizontally relative to the ground. The magnetic field generated by the coil 121 is detected by a digitizer 15 (described later), and the position of the pseudo cutting tool 12, its inclination relative to the Z axis, and the writing pressure of the pseudo cutting tool 12 are calculated. The writing pressure of the pseudo cutting tool 12 may be calculated by transmitting the pressure applied to the core body 120 to a pressure sensor.
[0015] The six-axis sensor 122 is provided in the head 13 of the pseudo cutting tool 12. The six-axis sensor 122 measures acceleration and angular velocity in three-dimensional directions. The sensor circuit 123 acquires the measurement results from the pressure sensor and the six-axis sensor 122.
[0016] The vibrator 124 vibrates under the control of the control device 16. The vibrator 124 is preferably provided in the handle portion 14 of the pseudo cutting tool 12. The vibrator 124 changes the vibration magnitude and frequency under the control of the control device 16. The control circuit 125 converts instructions from the control device 16 into electrical signals that control the vibrator 124, and controls the vibrator 124. The control circuit 125 also acquires measurement results from the sensor circuit 123 and converts them into electrical signals to be sent to the control circuit 125.
[0017] The interface 126 connects the simulated cutting tool 12 and the control device 16. The interface 126 is, for example, a USB terminal. The simulated cutting tool 12 and the control device 16 transmit and receive electrical signals via the interface 126. The simulated cutting tool 12 may be equipped with a wireless device to transmit and receive electrical signals to and from the control device 16.
[0018] The digitizer 15 generates an electromagnetic signal on its surface. The digitizer 15 detects the magnetic field generated by the coil 121 to calculate the position of the pseudo cutting instrument 12, its inclination relative to the Z-axis, and the magnitude of the writing pressure of the pseudo cutting instrument 12. When the pseudo cutting instrument 12 is inclined relative to the Z-axis, the digitizer 15 detects the main peak and side lobes of the magnetic field generated by the coil 121 to calculate the inclination of the pseudo cutting instrument 12 relative to the Z-axis. The magnitude of the writing pressure of the pseudo cutting instrument 12 is the magnitude of the pressure applied by the pseudo cutting instrument 12 to the physical prop 17. The digitizer 15 may be fixed and installed at a specific position. For example, the digitizer 15 is placed at a specific position on a horizontal table. A reference positional relationship is set between the pseudo cutting instrument 12 and the digitizer 15. The digitizer 15 functions as a position detection device that detects the position information of the pseudo cutting tool 12, an inclination detection device that detects the inclination information of the pseudo cutting tool 12, and a writing pressure detection device that detects the magnitude of the writing pressure of the pseudo cutting tool 12.
[0019] The control device 16 acquires position information of the HMD 11 from the HMD 11. The control device 16 acquires acceleration and angular velocity in three-dimensional directions measured by the six-axis sensor 122 from the pseudo cutting tool 12. The control device 16 acquires position information of the pseudo cutting tool 12 from the digitizer 15. The control device 16 acquires the position and inclination of the pseudo cutting tool 12 with respect to the Z axis from the digitizer 15. The control device 16 acquires the magnitude of the force to be applied to the physical prop 17 from the digitizer 15. The control device 16 stores the shapes of the cutting tool and cutting object to be displayed on the HMD 11, the correspondence between the shapes of the cutting tool and pseudo cutting tool 12, the correspondence between the shapes of the cutting object and the physical prop 17, and position information of the physical prop 17.
[0020] The control device 16 can calculate the amount of rotation of the pseudo cutting tool 12 around the position indication unit 131 by acquiring the acceleration and angular velocity in three dimensions from the six-axis sensor 122 provided on the head 13. This allows the control device 16 to accurately calculate the position of the pseudo cutting tool 12 even when the pseudo cutting tool 12 is nearly perpendicular to the Z axis and the digitizer 15 does not detect side lobes of the magnetic field.
[0021] The control device 16 controls the HMD 11 to display an image model of the cutting object based on the installation position of the physical prop 17, and to display an image model of the cutting tool based on the position of the pseudo cutting tool 12. The control device 16 performs control so that the positional relationship between the physical prop 17 and the pseudo cutting tool 12 matches the positional relationship between the image model of the cutting object and the image model of the cutting tool. The control device 16 controls the pseudo cutting tool 12 to vibrate the oscillator 124 based on the position of the pseudo cutting tool 12 and the magnitude of the writing pressure. The method of controlling the oscillator 124 by the control device 16 will be described in detail below.
[0022] The physical prop 17 has a shape similar to the cutting target. The physical prop 17 has a shape similar to a tooth, for example. The physical prop 17 may have a hardness similar to that of the cutting target. When the physical prop 17 has a shape similar to a tooth, the physical prop 17 may have a hardness similar to that of the tooth. The physical prop 17 is placed at a predetermined position on the digitizer 15. The physical prop 17 may be placed and fixed on the digitizer 15.
[0023] The pseudo cutting tool 12 is an electromagnetic induction type stylus, in which the coil 121 generates a magnetic field and the digitizer 15 detects the generated magnetic field to detect the position of the pseudo cutting tool 12, and detects changes in the magnetic field to detect the writing pressure of the pseudo cutting tool 12. As a result, even when the core body 120 of the position indicating unit 131 of the pseudo cutting tool 12 is in contact with the physical prop 17 and is not in contact with the digitizer 15, the position and writing pressure of the pseudo cutting tool 12 can be detected.
[0024] 3 is a diagram showing the relationship between the components of the cutting training assistance system 1. The control device 16 acquires position information of the HMD 11 from the HMD 11. The control device 16 controls the display of the HMD 11. The control device 16 acquires measurement results from the 6-axis sensor 122 from the simulated cutting tool 12. The control device 16 controls the vibration of the oscillator 124 of the simulated cutting tool 12. The control device 16 acquires position information of the simulated cutting tool 12 from the digitizer 15.
[0025] The user U practices cutting the cutting target by moving the simulated cutting tool 12 around the physical prop 17. The control device 16 may be any information processing device, and may be configured as a device integrated with the HMD 11, for example, or may be realized by cloud computing.
[0026] The control device 16 may include a storage device that stores information about the cutting object. The information about the cutting object is, for example, physical parameters of the cutting object, including information about the shape of the cutting object, the hardness of the cutting object, and the fiber direction of the cutting object. If the cutting object is a tooth, the information about the cutting object includes, for example, information about the tooth shape, the hardness of the tooth, the fiber direction of the tooth, and the location of the tooth nerve. The tooth shape, hardness, fiber direction, and location of the tooth nerve vary depending on the type of tooth and the location within the tooth. FIG. 4 is a table showing information about teeth, which is an example of information about the cutting object. The tooth position is expressed using the FDI notation, for example, 11 is the upper right upper central incisor. The tooth position corresponds to the tooth shape. Each tooth is divided into multiple regions. The hardness and fiber direction are set for each region.
[0027] Information about a plurality of teeth may be stored in the storage device included in the control device 16. For example, information about adult teeth and information about baby teeth may be stored in the storage device included in the control device 16. For example, information about teeth of different individuals may be stored in the storage device included in the control device 16. Physical parameters of the teeth included in the information about each tooth, such as tooth shape, tooth hardness, direction of tooth fibers, and position of tooth nerve, may be different.
[0028] The control device 16 may perform control based on the information about the cutting target to display it on the screen of the HMD 11. In other words, the control device 16 may perform control based on the information about different cutting targets to display different cutting targets on the screen of the HMD 11.
[0029] The control device 16 may store information about the cutting tool. The information about the cutting tool may be, for example, physical parameters of the cutting tool, such as the shape of the cutting tool, the vibration frequency of the cutting tool motor, and the hardness of the tip burr of the cutting tool. The control device 16 may store information about a plurality of different cutting tools, and the physical parameters of each cutting tool may be different. The control device 16 may control the display on the screen of the HMD 11 based on the information about the cutting tool. In other words, the control device 16 may control the display of different cutting tools on the screen of the HMD 11 based on the information about the different cutting tools.
[0030] The control device 16 calculates the magnitude and frequency of vibration of the oscillator 124 based on the positional relationship between the pseudo cutting tool 12 and the physical prop 17 and the magnitude of the writing pressure. The control device 16 vibrates the oscillator 124 when it determines that the core body 120 of the position indication unit 131 of the pseudo cutting tool 12 is in contact with the physical prop 17. The control device 16 also vibrates the oscillator 124 when the magnitude of the writing pressure is equal to or greater than a predetermined value. The control device 16 also increases the amplitude of the vibration generated by the oscillator 124 when the writing pressure of the pseudo cutting tool 12 increases, and decreases the amplitude of the vibration generated by the oscillator 124 when the writing pressure of the pseudo cutting tool 12 decreases.
[0031] Furthermore, the magnitude and frequency of vibration of the vibrator 124 may be calculated based on information about the cutting object and the cutting tool. For example, when cutting a harder cutting object, the magnitude of vibration of the vibrator 124 may be increased. For example, when the burr at the tip of the cutting tool is harder, the magnitude of vibration of the vibrator 124 may be increased.
[0032] The control device 16 may control the HMD 11 to emit a sound when it determines that the core 120 of the position indication unit 131 of the pseudo cutting tool 12 has come into contact with the physical prop 17. The control device 16 may control the HMD 11 to emit a sound that occurs when cutting a cutting target when it determines that the core 120 of the position indication unit 131 of the pseudo cutting tool 12 has come into contact with the physical prop 17. The control device 16 may control the HMD 11 to emit a sound that occurs when cutting a cutting target, without necessarily controlling the HMD 11 to emit the sound. The control device 16 may also control another speaker to emit the sound, for example. The control device 16 may change the sound emitted by the HMD 11 based on the writing pressure of the pseudo cutting tool 12 or the positional relationship between the pseudo cutting tool 12 and the physical prop 17. The control device 16 may change the sound emitted by the HMD 11 based on information related to the cutting target. The control device 16 may change the sound emitted by the HMD 11 depending on the type of cutting tool that is set. For example, the control device 16 includes a storage device that stores information about sounds that are the same as or similar to the sounds generated during cutting, in association with the pressure applied to the cutting tool during the cutting, the position of the cutting tool relative to the cutting target, and the type of cutting tool used, and controls the HMD 11 to emit a sound based on the information stored in the storage device. Furthermore, when the cutting target 21 is a tooth, the control device 16 may control the HMD 11 to emit a sound if it determines that the distance between the location of the tooth nerve and the cutting tool is short. If it determines that the distance between the location of the tooth nerve and the cutting tool is short, the control device 16 controls the HMD 11 to emit an alert sound, for example, to warn the user U.
[0033] The control device 16 controls the HMD 11 to display the shape of the cutting target to be cut. The amount of the cutting target to be cut that is displayed on the HMD 11 is determined based on information about the cutting target and the writing pressure and position of the pseudo cutting tool 12. The amount of the cutting target to be cut that is displayed on the HMD 11 may also be determined by the type of cutting tool that is set. For example, the control device 16 includes a storage device that stores information about the amount of the cutting target to be cut by cutting per unit time in association with the pressure applied to the cutting tool, the position of the cutting tool relative to the cutting target, and the type of cutting tool used, and determines the amount of the cutting target to be cut based on the information stored in the storage device.
[0034] The control device 16 may store data on the determined shape of the cutting object to be cut in a storage device such as a memory. By referring to the data on the shape of the cutting object over time stored in the storage device, the user can review the simulation of the cutting work that was performed. The user can also refer to the data on the shape of the cutting object that has been cut and stored in the storage device.
[0035] The physical prop 17 is a model that mimics the shape of the cutting target. By bringing the core body 120 of the position indicating portion 131 of the pseudo cutting tool 12 into contact with the physical prop 17, the user can get the sensation of the cutting tool being in contact with the cutting target, just like when cutting an actual cutting target. The position where the physical prop 17 is to be placed is a predetermined position on the digitizer 15. If the digitizer 15 has a display, the position where the physical prop 17 is to be placed may be indicated on the digitizer 15.
[0036] <<Actions and Effects>> As described above, according to this embodiment, the cutting training assistance system 1 includes the HMD 11, the simulated cutting tool 12, the digitizer 15, the control device 16, and the physical prop 17. The cutting training assistance system 1 according to this embodiment is small as a simulator for training cutting of a cutting object. This makes it easy to transport, and allows, for example, a student to take it home from school and practice cutting at home.
[0037] Furthermore, when a user U of the cutting training assistance system 1 brings the simulated cutting tool 12 into contact with the physical prop 17, the simulated cutting tool 12 vibrates, and the user U feels the vibration in the handle of the simulated cutting tool 12. In this way, the cutting training assistance system 1 can provide the user U with the tactile experience of cutting a cutting object. The vibration of the simulated cutting tool 12 can be changed based on information about the cutting object and the writing pressure and position of the simulated cutting tool 12, and in this way the cutting training assistance system 1 can reproduce the hardness of the cutting object and provide the user with a tactile experience that corresponds to the hardness of the cutting object.
[0038] Furthermore, the user of cutting training assistance system 1 can see on the screen of HMD 11 the cutting tool corresponding to simulated cutting tool 12 and the cutting object corresponding to physical prop 17, and can also see the shape of the cutting object being cut by the cutting tool. This allows cutting training assistance system 1 to provide the user with the visual experience of cutting the cutting object.
[0039] In actual cutting work on a cutting object, space is created by the amount of cutting of the cutting object, which increases the range of motion of the cutting tool. However, in this embodiment, the physical prop 17 is not actually cut, so the range of motion of the simulated cutting tool 12 does not increase. As described above, the cutting training assistance system 1 of this embodiment can give the user a visual sense of cutting the cutting object by displaying an image of the cutting object being cut to the user using the HMD 11.
[0040] Other Embodiments One embodiment of the present invention has been described in detail above with reference to the drawings, but the specific configuration is not limited to the above, and various design changes and the like are possible within the scope of the gist of the present invention. There are no particular limitations on the communication method between the HMD 11, simulated cutting tool 12, digitizer 15, and control device 16 of the cutting training assistance system 1. For example, the control device 16, simulated cutting tool 12, and digitizer 15 may be connected and communicated by wire, or may be provided with a wireless communication unit and perform wireless communication.
[0041] According to the present invention, it is possible to train cutting of a cutting object at a lower cost.
[0042] 1 Cutting training assistance system, 11 Head-mounted display, 12 Simulated cutting tool, 121 Coil, 122 Six-axis sensor, 123 Sensor circuit, 124 Vibrator, 125 Control circuit, 126 Interface, 13 Head, 14 Handle portion, 15 Digitizer, 16 Control device, 17 Physical prop
Claims
1. A cutting training assistance system comprising a wearable display, a simulated cutting instrument, a position detection device and a control device, wherein the simulated cutting instrument comprises: a position indication unit at its tip; a six-axis sensor for measuring acceleration and angular velocity in three dimensional directions; and a vibrating oscillator, wherein the position detection device detects the position of the simulated cutting instrument and the angle of the simulated cutting instrument relative to the position detection device by detecting the position indication unit, and the control device controls the vibration of the oscillator based on the position of the position detection device, the position and angle of the simulated cutting instrument relative to the position detection device and the three dimensional acceleration and angular velocity of the simulated cutting instrument, and causes the wearable display to display the cutting instrument based on the position of the position detection device, the position and angle of the simulated cutting instrument relative to the position detection device, and the three dimensional acceleration and angular velocity of the simulated cutting instrument.
2. The cutting training assistance system of claim 1, wherein the simulated cutting tool comprises a head and a handle portion, the handle portion being positioned so as to form an acute angle with the ground when the head is held horizontal to the ground, the head comprising the position indication unit and a six-axis sensor, the handle portion comprising a transducer, and the position indication unit comprising a coil and a core body that transmits pressure to a pressure sensor along the axis of the coil.
3. The cutting training assistance system according to claim 1 or 2, wherein the position detection device is centered on the tip of the pseudo cutting tool and detects the azimuth angle of the pseudo cutting tool relative to the position detection device.
4. The cutting training assistance system according to claim 2, wherein an object to be cut is placed on the position detection device, and the control device vibrates the oscillator based on the pressure applied to the core body detected by the pseudo cutting tool.
5. The cutting training assistance system according to claim 4, wherein the object to be cut is a tooth mold.
6. The cutting training assistance system according to claim 1, wherein the control device controls the wearable display to display an image model of the object to be cut and an image model of the simulated cutting tool, and controls the positional relationship between the object to be cut and the simulated cutting tool to match the positional relationship between the image model of the object to be cut displayed on the wearable display and the image model of the simulated cutting tool.
7. The cutting training assistance system according to claim 4, wherein the wearable display or the control device has an audio generating unit, and when the core body comes into contact with the object to be cut, the vibrator vibrates and the audio generating unit outputs sound.
8. The cutting training assistance system according to claim 7, wherein the sound generating unit changes the sound to be output based on the pressure applied to the core body of the simulated cutting tool, or based on any change in the angle, rotation angle, acceleration, or angular velocity of the simulated cutting tool.
9. The cutting training assistance system according to claim 1, wherein the simulated cutting tool is provided with a wireless communication unit and is connected to the control device.
Citation Information
Patent Citations
Tool-mediating type inner force sense presenting system
JP2000259074A
Virtual reality training device and method for dentistry
JP2003532144A
Interaction with 3D object datasets
JP2015506002A
Apparatus and method for motion tracking and simulation
JP2019512299A
Marker mounting device, and mounting method of marker mounting device
JP2020199021A
