A magnetic force-tactile reproduction system and method based on an omnidirectional rotating structure
By using a magnetic force-tactile reproduction system with an omnidirectional rotating structure, combined with a three-dimensional background electromagnet and a fingertip magnet module, the limitations of accuracy and degree of freedom in force-tactile feedback in existing technologies have been solved, achieving precise force-tactile feedback in multiple directions and improving the user experience.
Patent Information
- Application Number
- CN202411040473.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-30
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2044-07-30
AI Technical Summary
Existing force-tactile reproduction technologies are limited in terms of accuracy and freedom, making it difficult to provide fine, multi-dimensional non-contact force-tactile feedback, especially in two-dimensional planar operations or situations where the distance of movement is limited.
The magnetic force tactile reproduction system adopts an omnidirectional rotating structure, which combines a three-dimensional background electromagnet module, an omnidirectional rotating structure, a fingertip magnet module, and a central control module. The mapping relationship between the virtual space and the operating space is established through finite element analysis, and multi-directional electromagnetic force tactile feedback is achieved by using a three-dimensional controllable background electromagnetic field and a fingertip magnet module.
It achieves precise force and tactile feedback in multiple directions, improving operational efficiency and user immersion, and enhancing the realism and naturalness of the interactive experience.
Smart Images

Figure CN119248105B_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of force and tactile reproduction technology in human-computer interaction, and particularly relates to a magnetic force and tactile reproduction method with an omnidirectional rotating structure. Background Technology
[0002] Currently, tactile reproduction technology is mainly divided into several types: mechanical tactile reproduction, vibration tactile reproduction, electrostatic tactile reproduction, and the airbag and pneumatic jet tactile reproduction methods that have emerged in recent years. Among them, electromagnetic tactile reproduction technology has a promising future and a wide range of applications.
[0003] Researchers at South China University of Technology, including He Ziping, used magnetic force as the feedback force, and electromagnets and magnetic induction gloves as the force generation and sensing devices. Through electromagnetic theory and finite element analysis, they analyzed and calculated the magnetic field distribution of the electromagnet and the magnitude of the force on the magnetic induction gloves. A three-dimensional platform movement tracking algorithm was used to calculate the direction of the feedback force. However, the accuracy was low due to limitations in the movement distance.
[0004] Nikolas Kastor et al. proposed an electromagnetic actuator that drives one or more permanent magnets via electromagnetic force. They calculated the forces generated by the permanent magnets and electromagnetic coils, and how these forces interact with ferrofluids to produce mechanical motion, thereby stimulating the skin. This actuator can accurately reproduce high dynamic range tactile vibrations across the entire tactilely perceptible frequency range.
[0005] Hwan Kim et al. designed the HAPmini, which features low mechanical complexity and a minimal number of actuators while providing both force and haptic feedback. By changing the polarity of the current flowing through the solenoid, the direction of the electromagnetic field can be altered, thereby generating pulling or pushing forces on the permanent magnet. However, it can only operate in a two-dimensional plane.
[0006] The flexible three-dimensional force tactile sensor proposed by Jiangsu University is a capacitive fingertip three-dimensional force tactile sensor. Through multi-electrode design and the construction of a signal acquisition and control system, it can measure three-dimensional force to calculate a more accurate grip force, providing a scientific grasping strategy for robotic arms.
[0007] Abler et al. designed Hedgehog, a single-drive spherical pin array device that uses a spherical omnidirectional electromagnet to control the extension and retraction of 86 movable pins made of permanent magnets, achieving a force of 200 mN under maximum load. This device restricts hand movement; the hand can only feel the force when gripping the device.
[0008] A multi-finger rope force tactile feedback device and its feedback method based on an ultrasonic phased array (patent number CN201910246962.8) are proposed. The device provides high degree of freedom, high precision and strong force tactile feedback by driving the rope force unit with a line.
[0009] Southeast University has proposed a wearable flexible force feedback device for fingers (patent number CN201811301176.5), which provides force feedback information to the fingers through internal and external transmission rods and drivers. It is lightweight, easy to wear, allows for flexible finger movement, and provides natural interaction.
[0010] Methods based on air pressure and acoustic radiation can achieve truly natural interaction, offering advantages such as low cost, low power consumption, and controllable force. However, they typically provide only coarse force feedback with low resolution and accuracy, and perform poorly in obstructed environments. This invention presents a force-haptic reproduction method based on electromagnetic force, a promising non-contact approach that provides fine, multi-dimensional, and unconstrained multi-point force-haptic reproduction. Summary of the Invention
[0011] To address the aforementioned technical problems, the present invention aims to provide a novel force-tactile reproduction device and an electromagnetic field control method.
[0012] A magnetic force-based tactile feedback reproduction system based on an omnidirectional rotating structure includes a three-dimensional background electromagnet module, an omnidirectional rotating structure, a fingertip magnet module, a central system control module, and a position detection module.
[0013] The omnidirectional rotating structure comprises three ring frames: an inner layer, a middle layer, and an outer layer, and mutually perpendicular rotation axes. The inner ring frame rotates around the rotation axis fixed to the middle ring frame, and the middle ring frame rotates around the rotation axis fixed to the outer ring frame. A fingertip magnet module is placed on the inner ring frame of the omnidirectional rotating structure, allowing the fingertip magnet module to rotate at any angle.
[0014] The three-dimensional background electromagnet module consists of multiple coils, which generate the required three-dimensional controllable background electromagnetic field through the current excitation signal sent by the system's central control module.
[0015] The fingertip magnet module consists of a permanent magnet or an electromagnet.
[0016] When a permanent magnet is used as a fingertip magnet, the fingertip magnet has a fixed magnetic moment; when an electromagnet is used as a fingertip magnet, the magnetic moment of the fingertip magnet is adjustable, and the strength and direction of the magnetic field are adjusted by changing the current passing through the coil.
[0017] Based on the above-mentioned magnetic force tactile reproduction system based on a universal rotating structure, this application also provides a corresponding reproduction method, which includes the following steps:
[0018] Step one: Establish the mapping relationship between the operating space and the virtual space. First, using the finite element method, simulate the distribution of the three-dimensional controllable background electromagnetic field generated by the three-dimensional background electromagnet in the operating space under various excitations, and determine the optimal excitation scheme data for each point. Establish a virtual scene including virtual hand and virtual object models, and establish the spatial mapping relationship between the real operating space inside the background electromagnet module and the virtual scene, as well as the three-dimensional position mapping relationship between the human hand and the virtual hand. Establish a multi-point force tactile reproduction model of the virtual object and multiple fingertip proxy points in the virtual reality environment.
[0019] The excitation scheme is as follows: A three-dimensional background electromagnet simulation model is established. Based on accuracy requirements, the spatial finite element simulation step size is set, and the magnitude of the magnetic force in space is determined by traversing each group of excitation currents. The magnetic force at any position (x, y, z) in space is... The specific relationship with the excitation current is as follows:
[0020] ;
[0021] ;
[0022] in It is the ratio of force to current generated by each coil at a given location. It is the coil driving current vector.
[0023] Through calculation: ;
[0024] The vector of the coil driving current required to generate the corresponding magnetic field force can be determined by determining the virtual interactive force. .
[0025] Real-time acquisition of the three-dimensional position information of the human hand, and transmission of the three-dimensional position information of the human hand to the virtual hand in the virtual scene in (1);
[0026] The control strategy is as follows:
[0027] The camera module acquires the three-dimensional position information of the human hand in real time, converts it into hand coordinates in the virtual environment, and when the operator's fingertips interact with the virtual object, the spatial discrete point closest to the current interaction point among n points of the excitation scheme is selected using interpolation. And determine the coil drive current vector of the optimal excitation scheme based on the magnitude of the interaction force. ;
[0028] Ultimately, electromagnetic force is realized. The omnidirectional rotating structure causes the permanent magnet to rotate, maximizing the electromagnetic force and completing the force-tactile feedback.
[0029] Step 2: Obtain the current fingertip pose information P through the camera module. , , , α, β, γ), where , and α represents the three-dimensional coordinates of the fingertip electromagnet, and α, β, and γ represent the rotation angles of the fingertip electromagnet.
[0030] Step 3: Based on the force-tactile reproduction model, calculate and generate the force exerted by the operator's fingertip on the virtual object at the current moment, which serves as the target force in the control method. The calculation of the magnetic torque of the fingertip electromagnet is specifically as follows:
[0031] ;
[0032] in, This indicates the magnetic torque experienced by the fingertip electromagnet. This represents the magnetic moment experienced by the entire fingertip electromagnet. This represents the magnetic flux density generated by the background magnetic field at the location of the fingertip electromagnet. The magnetic torque on the fingertip electromagnet is minimized when the direction of the magnetic flux density of the background magnetic field is consistent with the direction of the equivalent magnetic moment of the fingertip magnet.
[0033] The calculation of the magnetic moment of the fingertip electromagnet is as follows:
[0034] ;
[0035] in, This indicates the first [unclear] on the fingertip electromagnet with the central axis in the X direction. The area enclosed by each coil, This indicates the first [unclear] on the fingertip electromagnet with the central axis in the Y direction. The area enclosed by each coil, This indicates the first [unclear] on the fingertip electromagnet with the central axis in the Z direction. The area enclosed by each coil, , , These represent the number of coils on the fingertip electromagnet along the X, Y, and Z directions, respectively, representing the number of coils on the central axis of the fingertip electromagnet. , , These represent the magnitudes of the excitation currents of the coils on the fingertip electromagnet along the X, Y, and Z directions, respectively. This indicates the direction of the magnetic moment generated by the coil with its central axis X, relative to the current. The flow direction follows the right-hand screw rule, and the same applies to the Y and Z directions. The overall magnetic moment of the fingertip electromagnet is formed by the superposition of vectors in three orthogonal directions.
[0036] The magnetic field generated by the background electromagnet is specifically as follows:
[0037] ;
[0038] The magnetic field strength generated by each coil unit at the fingertip position along the X, Y and Z axes is calculated according to the Biot-Savart law. The magnetic field strength generated by each coil unit is vector-superimposed to obtain the magnitude and direction of the magnetic field strength at the fingertip position.
[0039] The calculation of the electromagnetic force on the fingertip electromagnet is as follows:
[0040] ;
[0041] in, The electromagnetic force experienced by the fingertip electromagnet. As a gradient operator, for the background electromagnet, there is no current flowing inside the fingertip magnet. According to Maxwell's equations, we have... Therefore, the electromagnetic force experienced by the fingertip electromagnet is:
[0042] ;
[0043] That is, for an ideal magnetic dipole moment, the force it experiences in an external magnetic field is determined by the magnetic flux density gradient and the magnetic moment at its location.
[0044] The force is transmitted to the central control module of the system. After the control strategy selects the optimal current excitation scheme, it drives the three-dimensional background electromagnet to generate electromagnetic force on the fingertip electromagnet, realizing force tactile feedback.
[0045] Repeat until step two or until the end.
[0046] Compared with the prior art, the present invention, employing the above technical solution, has the following technical effects:
[0047] (1) The omnidirectional rotating structure can rotate at any angle, eliminating the possible influence of magnetic field torque, so that the magnetic moment of the electromagnet always coincides with the direction of the magnetic field to provide electromagnetic attraction, and can provide multi-directional non-contact force tactile feedback, realize precise control of force tactile feedback, improve the user's operating efficiency, and enhance the user's immersion and interactive experience.
[0048] (2) The three-dimensional background electromagnetic field finite element simulation can obtain an adjustable magnetic field strength, and the algorithm for obtaining the excitation scheme is simple. It can provide large-space, continuously adjustable force tactile feedback.
[0049] (3) The force-tactile device designed by this method can achieve more refined, multi-point force-tactile perception, enhancing the realism and immersion of the user. Attached Figure Description
[0050] Figure (1) is a system diagram of the magnetic force tactile reproduction method based on the universal rotating mechanism;
[0051] Figure (2) is a structural diagram of the omnidirectional rotating mechanism for the magnetic force tactile reproduction method based on the omnidirectional rotating mechanism;
[0052] Figure (3) is a diagram of the fingertip force tactile feedback structure of the magnetic force tactile reproduction method based on the universal rotation mechanism. Detailed Implementation
[0053] This invention provides a magnetic force tactile reproduction method based on a universal rotating mechanism. To make the objectives, control methods, and effects easy to understand, the invention will be further described in detail below with reference to the accompanying drawings and examples.
[0054] The flowchart of the magnetic force tactile reproduction system and method based on an omnidirectional rotating structure involved in this invention is as follows: Figure 2 As shown, Example 1 is as follows Figure 3 As shown.
[0055] Example 1:
[0056] This embodiment is a magnetic force-based tactile feedback reproduction system based on a omnidirectional rotating structure. The system includes a three-dimensional background electromagnet module, an omnidirectional rotating structure, a fingertip magnet module, a central system control module, and a position detection module.
[0057] The omnidirectional rotating structure comprises three ring frames: an inner layer, a middle layer, and an outer layer, and mutually perpendicular rotation axes. The inner ring frame rotates around the rotation axis fixed to the middle ring frame, and the middle ring frame rotates around the rotation axis fixed to the outer ring frame. A fingertip magnet module is placed on the inner ring frame of the omnidirectional rotating structure, allowing the fingertip magnet module to rotate at any angle.
[0058] The three-dimensional background electromagnet module consists of multiple coils, which generate the required three-dimensional controllable background electromagnetic field through the current excitation signal sent by the system's central control module.
[0059] The fingertip magnet module is composed of permanent magnets or electromagnets.
[0060] When a permanent magnet is used as a fingertip magnet, the fingertip magnet has a fixed magnetic moment; when an electromagnet is used as a fingertip magnet, the magnetic moment of the fingertip magnet is adjustable, and the strength and direction of the magnetic field are adjusted by changing the current passing through the coil.
[0061] Example 2:
[0062] Based on the above-mentioned magnetic force tactile reproduction system based on a universal rotating structure, this application also provides a corresponding reproduction method, which includes the following steps:
[0063] To establish the mapping relationship between the operational space and the virtual space, the finite element method is first used to simulate the distribution of a three-dimensional controllable background electromagnetic field generated by a three-dimensional background electromagnet in the operational space under various excitations, and to determine the optimal excitation scheme data for each point. A virtual scene including virtual hand and virtual object models is then established, along with the spatial mapping relationship between the real operational space within the background electromagnet module and the virtual scene, as well as the three-dimensional positional mapping relationship between the human hand and the virtual hand. A multi-point force-tactile reproduction model of the virtual object and multiple fingertip proxy points in the virtual reality environment are also established.
[0064] The excitation scheme is as follows: A three-dimensional background electromagnet simulation model is established. Based on accuracy requirements, the spatial finite element simulation step size is set, and the magnitude of the magnetic force in space is determined by traversing each group of excitation currents. The magnetic force at any position (x, y, z) in space is... The specific relationship with the excitation current is as follows:
[0065]
[0066] ;
[0067] in It is the ratio of force to current generated by each coil at a given location. It is the coil driving current vector.
[0068] Through calculation: ;
[0069] The current excitation I required to generate the corresponding magnetic field force can be determined by the virtual interactive force.
[0070] Real-time acquisition of the three-dimensional position information of the human hand, and transmission of the three-dimensional position information of the human hand to the virtual hand in the virtual scene in (1);
[0071] The control strategy is as follows:
[0072] The camera module acquires the three-dimensional position information of the human hand in real time, converts it into hand coordinates in the virtual environment, and when the operator's fingertips interact with the virtual object, the spatial discrete point closest to the current interaction point among n points of the excitation scheme is selected using interpolation. And determine the optimal excitation scheme current combination values (I1, I2, I3…I) based on the magnitude of the interaction force. m ).
[0073] Ultimately, electromagnetic force is realized. The omnidirectional rotating structure causes the permanent magnet to rotate, maximizing the electromagnetic force and completing the force-tactile feedback.
[0074] The current fingertip pose information P is obtained through the camera module. , , , α, β, γ), where , and α represents the three-dimensional coordinates of the fingertip electromagnet, and α, β, and γ represent the rotation angles of the fingertip electromagnet.
[0075] Based on the force-tactile reproduction model, the force exerted by the operator's fingertip on the virtual object at the current moment is calculated and generated, serving as the target force in the control method. The calculation of the magnetic torque of the fingertip electromagnet is specifically as follows:
[0076] ;
[0077] in, This indicates the magnetic torque experienced by the fingertip electromagnet. This represents the magnetic moment experienced by the entire fingertip electromagnet. This represents the magnetic flux density generated by the background magnetic field at the location of the fingertip electromagnet. The magnetic torque on the fingertip electromagnet is minimized when the direction of the magnetic flux density of the background magnetic field is consistent with the direction of the equivalent magnetic moment of the fingertip magnet.
[0078] The calculation of the magnetic moment of the fingertip electromagnet is as follows:
[0079] ;
[0080] in, This indicates the first [unclear] on the fingertip electromagnet with the central axis in the X direction. The area enclosed by each coil, This indicates the first [unclear] on the fingertip electromagnet with the central axis in the Y direction. The area enclosed by each coil, This indicates the first [unclear] on the fingertip electromagnet with the central axis in the Z direction. The area enclosed by each coil, , , These represent the number of coils on the fingertip electromagnet along the X, Y, and Z directions, respectively, representing the number of coils on the central axis of the fingertip electromagnet. , , These represent the magnitudes of the excitation currents of the coils on the fingertip electromagnet along the X, Y, and Z directions, respectively. This indicates the direction of the magnetic moment generated by the coil with its central axis X, relative to the current. The flow direction follows the right-hand screw rule, and the same applies to the Y and Z directions. The overall magnetic moment of the fingertip electromagnet is formed by the superposition of vectors in three orthogonal directions.
[0081] The magnetic field generated by the background electromagnet is specifically as follows:
[0082] ;
[0083] The magnetic field strength generated by each coil unit at the fingertip position along the X, Y and Z axes is calculated according to the Biot-Savart law. The magnetic field strength generated by each coil unit is vector-superimposed to obtain the magnitude and direction of the magnetic field strength at the fingertip position.
[0084] The calculation of the electromagnetic force on the fingertip electromagnet is as follows:
[0085] ;
[0086] in, The electromagnetic force experienced by the fingertip electromagnet. As a gradient operator, for the background electromagnet, there is no current flowing inside the fingertip magnet. According to Maxwell's equations, we have... Therefore, the electromagnetic force experienced by the fingertip electromagnet is:
[0087] ;
[0088] That is, for an ideal magnetic dipole moment, the force it experiences in an external magnetic field is determined by the magnetic flux density gradient and the magnetic moment at its location.
[0089] The force is transmitted to the central control module of the system. After the control strategy selects the optimal current excitation scheme, it drives the three-dimensional background electromagnet to generate an electromagnetic attraction to the fingertip electromagnet, realizing force tactile feedback.
[0090] Repeat the above steps until finished.
[0091] The magnetic force-tactile reproduction method of the omnidirectional rotating mechanism involved in this invention constructs a fingertip magnet module based on the omnidirectional rotating structure. By adjusting the excitation of the three-dimensional background electromagnet, the intensity and direction of the three-dimensional controllable background electromagnetic field are controlled, thereby controlling the electromagnetic force of the electromagnet at the omnidirectional rotating structure. The three-dimensional controllable background electromagnet is composed of multiple coils that can generate the required three-dimensional controllable background electromagnetic field. The optimal electromagnetic excitation scheme is determined based on the current finger posture detection results. The magnetic force-tactile reproduction method based on the omnidirectional rotating structure has a simple algorithm implementation, provides non-contact multi-point force-tactile feedback that is continuously adjustable and has a significant effect, and can provide a more complex and realistic human-computer interaction experience, effectively improving the quality of human-computer interaction.
Claims
1. A magnetic force tactile reproduction system based on an omnidirectional rotating structure, characterized in that, The system includes a three-dimensional background electromagnet module, a omnidirectional rotating structure, a fingertip magnet module, a central control module, and a position detection module; among which... The omnidirectional rotating structure comprises three ring frames: an inner layer, a middle layer, and an outer layer, and mutually perpendicular rotation axes. The inner ring frame rotates around the rotation axis fixed to the middle ring frame, and the middle ring frame rotates around the rotation axis fixed to the outer ring frame. A fingertip magnet module is placed on the inner ring frame of the omnidirectional rotating structure, allowing the fingertip magnet module to rotate at any angle. The three-dimensional background electromagnet module consists of multiple coils, which generate the required three-dimensional controllable background electromagnetic field through the current excitation signal sent by the system's central control module. The fingertip magnet module consists of a permanent magnet or an electromagnet.
2. The magnetic force tactile reproduction system based on an omnidirectional rotating structure according to claim 1, characterized in that, When a permanent magnet is used as a fingertip magnet, the fingertip magnet has a fixed magnetic moment; when an electromagnet is used as a fingertip magnet, the magnetic moment of the fingertip magnet is adjustable, and the strength and direction of the magnetic field are adjusted by changing the current passing through the coil.
3. The reproduction method of the magnetic force tactile reproduction system based on an omnidirectional rotating structure according to claim 1, characterized in that, The method includes the following steps: S1. The magnetic field distribution of the three-dimensional controllable background electromagnetic field generated by the three-dimensional background electromagnet in the operating space under various excitations is simulated by the finite element method to obtain the optimal excitation scheme data for each point; a virtual scene including virtual hand and virtual object models is established, and the spatial mapping relationship between the real operating space inside the background electromagnet module and the virtual scene is established, as well as the three-dimensional position mapping relationship between the human hand and the virtual hand. A multi-point force tactile reproduction model of the virtual object and multiple fingertip proxy points in the virtual reality environment are established. S2 acquires the three-dimensional position information of the human hand in real time, converts it into the coordinates of the human hand in the virtual environment, and transmits the three-dimensional position information of the human hand to the virtual hand in the virtual scene in S1; S3, based on the force-tactile reproduction model, calculates and generates the force exerted by the operator's fingertips when interacting with the virtual object at the current moment, which serves as the target force in the control method; S4, the target force is transmitted to the central control module of the system to determine the current three-dimensional position of the human hand. According to the control strategy, the optimal current excitation scheme formed in S1 is selected to drive the three-dimensional background electromagnet to generate an electromagnetic attraction to the fingertip electromagnet. The omnidirectional rotating structure makes the magnetic moment of the electromagnet always coincide with the direction of the magnetic field, realizing force tactile feedback. Repeat step S2.
4. The reproduction method according to claim 3, characterized in that, The incentive scheme includes: A three-dimensional background electromagnet simulation model is established. Based on accuracy requirements, the spatial finite element simulation step size is set, and the magnitude of the magnetic force in space is determined by traversing each group of excitation currents. The magnetic force at any position (x, y, z) in space is calculated. The specific relationship with the excitation current is as follows: ; ; Among them, the activation matrix = It is the ratio of force to current generated by each coil at a given location, and its components They are respectively , , The ratio of force to current in a given direction; Indicates the coil number, with a value of =1,2,…,n, where n is the number of coils contained in the three-dimensional background electromagnet; It is the coil driving current vector.
5. The reproduction method according to claim 3, characterized in that, The control strategy is as follows: The camera module acquires the three-dimensional position information of the human hand in real time, converts it into the coordinates of the human hand in the virtual environment, and when the operator's fingertip interacts with the virtual object, the spatial discrete point closest to the current interaction point among n points of the excitation scheme is selected using interpolation. ), and determine the optimal excitation scheme current combination value based on the magnitude of the interaction force ( Ultimately, electromagnetic force is realized. The omnidirectional rotating structure causes the permanent magnet to rotate, ensuring that the electromagnet's magnetic moment always coincides with the direction of the magnetic field, thus achieving force-tactile feedback. The background is the magnetic induction intensity generated by the electromagnet at the fingertip position.
Citation Information
Patent Citations
A finger-wearable flexible force tactile feedback device
CN109521876A
Multi-finger rope force tactile feedback device based on ultrasonic phased array and feedback method thereof
CN110147161A
Three-dimensional local excitation type haptic representation system and method based on combined electromagnet
CN115510699A
Novel magneto-sensitive tactile multidimensional force sensor
CN117419846A
