Writing tactile representation method and device based on combined driving of motor and air pressure film screen

By combining a motor and an air-pressed screen for joint driving, along with Fourier transform and similarity comparison algorithms, the joint driving of the stylus and the air-pressed screen was achieved. This solves the problem of existing styluses lacking tactile feedback and improves the tactile reproduction effect of writing and the user experience.

CN119045665APending Publication Date: 2024-11-29JILIN UNIVERSITY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411170014.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-24
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

Existing stylus products lack tactile feedback, making it difficult to achieve a natural, accurate, and immersive writing experience similar to writing on paper. Traditional vibration tactile feedback devices are not precise enough in terms of frequency and force control, resulting in less refined and realistic tactile feedback when writing.

Method used

By employing a method that combines a motor and an air-pressed screen for driving, and through the combined vibration feedback of the piezoelectric motor and the pen motor, combined with Fourier transform and similarity comparison algorithms, the writing effects of different papers and pens are rendered in real time to achieve tactile reproduction.

Benefits of technology

It enhances the tactile experience of writing, improves the realism and detailed rendering of the writing process, and can provide a variety of tactile feedback based on user selection to suit different user preferences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119045665A_ABST
    Figure CN119045665A_ABST
Patent Text Reader

Abstract

The invention relates to a writing tactile representation method and device based on combined driving of a motor and an air pressure film screen, and belongs to the technical field of man-machine interaction. And rendering the air pressure film screen, collecting interactive data, processing the interactive data, taking the cycle length of the interactive data and storing the cycle length into a memory, and performing combined driving of the two motors to present a writing tactile representation effect. The touch pen has the advantages that the motor on the touch pen can render the writing touch effect of different types of pens, the piezoelectric motor on the flat plate can render the touch effect of different types of paper, the two motors cooperate with each other, the touch feedback during writing is enhanced, the rendering effect when a user writes on a smooth surface is improved, and the writing effect is improved in the display writing application. A user can adjust different types of paper-pen combinations according to personal preferences, so that the tactile feedback device of the mobile terminal can provide different tactile effects for different users.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of human-computer interaction, and in particular to a writing tactile reproduction method and device jointly driven by a motor and an air pressure film screen. Background Art

[0002] The stylus is one of the important input devices for mobile terminals. Compared with fingers, it can write and draw more naturally, accurately and smoothly. However, the current stylus products lack tactile feedback, making it difficult to achieve the same feeling as interacting with real paper, which affects the accuracy and immersion of the interaction. Most of the pen-type tactile reproduction devices designed focus on generating tactile feedback with user actions such as clicking, dragging, and detecting edges, thereby improving the accuracy of action operations, but ignore the application of paper-like writing.

[0003] The 2018 paper "RealPen: Providing Realism in Handwriting Tasks on TouchSurfaces using Auditory-Tactile Feedback" invented an enhanced stylus for capacitive tablet screens by reproducing the friction-induced oscillations and sounds of a real writing tool in contact with paper. The 2016 paper "EV-pen: an electrovibration haptic feedback pen for touchscreens" proposed an EV-Pen based on electric vibration. When the pen slides on the surface of the panel, the signal generator generates various signals with sufficient amplitude to affect the pen, and an electrostatic force of attraction is generated between the pen and the underlying electrodes. This friction can be controlled by modulating the waveform, amplitude and frequency of the driving signal. The author then proposed the EV 2 -Pen, users can feel continuous tactile feedback when the pen is in motion or at rest.

[0004] The 2016 paper Texture rendering strategies with a high fidelity-capacitive visual-haptic friction control device introduced the air squeeze film effect terminal prototype they made and proposed two texture rendering methods SHO and SHT based on the terminal prototype. The 2017 paper Localized haptic texture: A rendering technique based on taxels for high density tactile feedback achieves local texture tactile reproduction by applying different driving signals in different areas. The 2020 paper Tactile Reproducing Device and Rendering Method Combining Electrostatic Force, Squeeze Film Effect and Mechanical Vibration uses a formula to obtain the relationship between the driving signal voltage and the tangential friction force between the contact object and the screen.

[0005] The piezoelectric motor drives the air pressure film screen to vibrate at high frequency under the action of the driving signal, producing intermittent contact at the micron level between the contact object and the screen and forming an air film, thereby generating extrusion force.

[0006]

[0007] Among them, F S is the extrusion force, S is the contact area between the contact object and the glass screen, P o is the atmospheric pressure, ε is the offset ratio, which determines the size of the extrusion pressure, and the range is 0≤ε≤1.

[0008]

[0009] Among them, h e is the average amplitude of the contact object texture, h r is the surface roughness of the glass screen.

[0010]

[0011] Among them, h vib is the vibration amplitude of the glass screen, Q m is the mechanical quality factor of the piezoelectric ceramic, d 31 is the piezoelectric constant, V is the driving signal voltage, h p is the resonator thickness, is the length of the piezoelectric motor, z0 is the length of the plate in the Z-axis direction due to compression and tension.

[0012] The existence of the extrusion force S causes the normal force on the contact object to decrease, and the tangential friction force generated at this time is:

[0013] f=μ(F n -F s )=μ(F n -x(V)

[0014] Where f is the tangential friction between the contact object and the screen, F n is the pressure applied to the contact object, μ is the friction coefficient, V is the ultrasonic vibration driving signal voltage, and the relationship between the friction coefficient μ and the ultrasonic vibration driving signal voltage V is derived as follows:

[0015]

[0016] It can be inferred from the formula that when the driving signal voltage V is larger, the screen vibration amplitude h vib The larger the value, the larger the offset ratio ε becomes, resulting in an increase in the extrusion force, which in turn reduces the tangential friction between the contact object and the screen.

[0017] Vibration tactile feedback is a common form of tactile feedback in human-computer interaction. Pen-type tactile feedback devices use different mechanical structures and vibration motor combinations to achieve vibration tactile feedback. However, due to the inaccurate control of the motor frequency and force, traditional vibration tactile feedback is difficult to perform precise operations with a pen, resulting in the pen-type writing tactile feedback not being fine and realistic. The air pressure film effect tactile feedback technology enables people to feel the shape, texture and softness of the displayed object on an ordinary touch screen, achieving a more delicate tactile perception and natural and realistic tactile reproduction. It has always been one of the research hotspots in the field of human-computer interaction. At present, the research on air pressure film effect tactile feedback technology mainly focuses on the production of tactile feedback experimental prototypes, tactile force modeling and analysis, and tactile rendering methods. The research on the friction tactile reproduction system of the air pressure film effect in China is still in its infancy, and there is still a blank in practical products.

[0018] Therefore, if a method of reproducing the writing tactile sensation by jointly driving a stylus pen and an air pressure film screen can be realized, the joint action of the two will make the paper-like writing effect more delicate and realistic, and enhance the realism of the writing effect, which will be of certain help and improvement to the reproduction of the paper-like writing tactile sensation and the enhancement of the human-computer interaction perception experience. Summary of the invention

[0019] The present invention provides a writing tactile reproduction method and device based on the joint drive of a motor and an air pressure film screen, which utilizes the joint drive of a piezoelectric motor on a tablet and a motor on a pen to generate vibration feedback, so that when a user uses a stylus to write on a touch screen, he or she can independently select the type of paper and the type of pen, thereby generating a variety of writing effects on the same feedback device, thereby enhancing the user's tactile feeling when writing on a rigid surface.

[0020] The technical solution adopted by the present invention comprises the following steps:

[0021] Step 1. Render the air film screen;

[0022] Step 2. Collect interaction data acceleration a1 and acceleration a2;

[0023] Step 3. Process the interaction data and take its cycle length and store it in the memory;

[0024] (1) Segment the filtered acceleration data a1 and a2, and determine the waveform sequence segments a'1 and a'2 that best represent the acceleration characteristics under each interaction condition through a similarity comparison algorithm;

[0025] (2) The waveforms of a'1 and a'2 are processed by Fourier transform and inverse transform to obtain new waveform segments by processing the frequency domain signal differences. The cycle length is taken and stored in the stylus memory to complete the rendering of the linear motor;

[0026] Step 4. The two motors are driven together to reproduce the writing tactile effect.

[0027] (1) Displaying a writing application on the touch screen of the tablet, and obtaining the type of paper and pen selected by the user in the display of the writing application;

[0028] (2) During the writing process, the writing pressure F2 and writing speed v2 are collected in real time, and the nearest (F2, v2) is queried. i , V j ) represents the acceleration of the segment The air film screen and the motor on the stylus are driven to vibrate to produce the tactile effect of the selected pen writing on the selected paper.

[0029] The method for rendering the air film screen in step 1 of the present invention is as follows:

[0030] (1) Collect the friction data of the real paper-pen interaction through the robotic arm, record the pressure F0 and tangential friction f0 applied by the pen tip, and calculate the friction factor μ0 of the measured paper through F0 and f0;

[0031] (2) Set the initial drive signal voltage V0. Under the initial voltage V0, measure the tangential friction force f1 and the pressure F1 applied by the pen tip, calculate the friction coefficient μ1, increase or decrease the drive signal voltage V0 as needed, re-measure the tangential friction force f1 and the pressure F1 applied by the pen tip, calculate the new friction coefficient μ1, repeat the above adjustment and measurement steps until the required friction coefficient μ1=μ0 is obtained, record the ultrasonic vibration drive signal voltage value V1 at this moment, and complete the rendering of the air pressure film screen.

[0032] The interactive data collection in step 2 of the present invention is as follows:

[0033] (1) Collect interactive data of different types of paper and pen combinations through the robotic arm. During the interaction, writing is performed with different combinations of pre-set pressure F1 and speed v1. The interactive data is acceleration a1;

[0034] (2) Collecting interactive data of the stylus writing on the air pressure film screen simulating different paper effects. The interaction is also written with different combinations of pressure F1 and speed v1. The interactive data is acceleration a2;

[0035] The acceleration a1 and the acceleration a2 are respectively acquired in real time by a three-axis accelerometer fixed on the pen claw of the mechanical arm;

[0036] The normal force F1 is controlled by adjusting parameters using a multifunctional robotic arm;

[0037] The speed v1 is controlled by adjusting parameters using a multifunctional robotic arm.

[0038] The method for rendering a linear motor on a stylus pen in step 3 of the present invention is specifically as follows:

[0039] Convert the waveforms of a'1 and a'2 to the frequency domain through Fourier transform:

[0040] A1(f)=F{a'1(t)}

[0041] A2(f)=F{a'2(t)}

[0042] According to the superposition principle of waveforms, a'1 minus a'2 gives the difference spectrum signal:

[0043] ΔA(f)=A1(f)-A2(f)

[0044] The difference spectrum signal is then converted back to the time domain by inverse Fourier transform to obtain a new waveform segment

[0045]

[0046] Finally, By waveform segmentation and similarity comparison, the representative segment with the most acceleration characteristics is found, and its waveform period length is taken and stored in the stylus memory.

[0047] In step 4 of the present invention: the writing pressure F2 is obtained in real time by a pressure sensor fixed on the stylus; the writing speed v2 is calculated by the position where the stylus contacts the air pressure film screen, and the calculation formula is:

[0048]

[0049] Where (x, y) is the coordinate of the stylus at the previous moment, (x', y') is the coordinate of the stylus at the current moment, and T is the time interval;

[0050] The query is the closest (F2, v2) to (F2, v2). i , V j ), (F2, v2) and (F i , V j ) is calculated as:

[0051]

[0052] Where (F2, v2) is the normal force applied to the pen and the writing speed in the current state;

[0053] (F i , V j ) is the normal force and writing speed applied to the pen during the data acquisition phase.

[0054] A mobile terminal tactile feedback device that implements a writing tactile reproduction method based on a joint drive of a motor and an air film screen comprises a stylus pen and an air film screen, wherein the stylus pen comprises an on-pen vibration motor, a pressure sensor, a short-range communication unit, a memory and a processor, and the air film screen comprises a tablet, an air film screen, an infrared positioning device, a piezoelectric motor, a transceiver, a processor and a memory.

[0055] The mobile terminal tactile feedback device, wherein the vibration motor is attached to the pen to render the tactile effect of the selected pen writing, and the piezoelectric motor is embedded in the air pressure film screen on the tablet side by side to render the tactile effect of the selected paper.

[0056] The mobile terminal tactile feedback device, wherein:

[0057] The pressure sensor is used to collect the pressure of the user when writing in real time;

[0058] The short-range communication unit is used to receive the type of paper and pen, writing speed information and send the collected pressure signal to the tablet;

[0059] The memory is used to store the processed tactile data

[0060] The processor is used to read the corresponding tactile data in the memory according to the received paper and pen type, writing speed and writing pressure information to output a waveform for driving the motor on the pen.

[0061] The mobile terminal tactile feedback device, wherein:

[0062] The tablet is used to display a writing application and receive information about a paper type and a pen type selected in the displayed writing application;

[0063] The air pressure film screen is used to stick a piezoelectric motor to produce an air pressure film tactile effect;

[0064] The infrared positioning device is used to obtain the position of the pen tip on the touch screen;

[0065] The transceiver is used to receive the pressure of the stylus pen when writing and send the type of selected paper and pen, and writing speed information;

[0066] The processor is used for processing to output a waveform for driving the piezoelectric motor;

[0067] The memory is used to store tactile data for rendering real paper.

[0068] The mobile terminal tactile feedback device, wherein the writing application includes the following menus: a progress bar for selecting the strength of the vibration amplitude, a progress bar for selecting the thickness of the handwriting, a submenu for selecting the combination of paper type and pen type, a submenu for returning to the previous writing step, a submenu for restoring the previous writing step, a submenu for selecting the handwriting color, and a submenu for clearing the canvas.

[0069] The advantages of the present invention are:

[0070] (1) The motor on the stylus can render the writing tactile effects of different types of pens, and the piezoelectric motor on the tablet can render the tactile effects of different types of paper. Through the division of labor and cooperation between the two motors, the tactile feedback during writing is enhanced, and the rendering effect when the user writes on a smooth surface is improved.

[0071] (2) The stylus pen can provide different vibration effects in real time according to the pressure and speed of the user when writing, thereby enhancing the sense of reality during the writing process.

[0072] (3) The air pressure film effect tactile reproduction device can achieve a more delicate tactile perception and a more refined rendering effect.

[0073] (4) In display writing applications, users can adjust different types of paper and pen combinations according to personal preferences, so the mobile terminal tactile feedback device can provide different tactile effects for different users. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] Figure 1 It is a schematic diagram of a writing tactile feedback device for a mobile terminal based on the combined drive of a motor and an air pressure film screen of the present invention;

[0075] Figure 2 is a schematic diagram of a writing application displayed in the writing application;

[0076] Figure 3 is a schematic diagram showing the type of paper and pen selected in a writing application;

[0077] Figure 4 It is a block diagram of the rendering method of the present invention. DETAILED DESCRIPTION

[0078] In order to make the purpose, features and principles of the present invention more clearly understood, the following is a detailed description with reference to the accompanying drawings and examples.

[0079] Figure 1 The present invention is a schematic diagram of a mobile terminal writing tactile feedback device based on the joint drive of a motor and an air film screen, including a stylus 101 and an air film screen 102. The stylus 101 includes a vibration motor 103 on the pen, a pressure sensor 104, a short-range communication unit 105, a memory 106, and a processor 107. The air film screen 102 includes a tablet 108, an air film screen 109, an infrared positioning device 110, a piezoelectric motor 111, a transceiver 112, a processor 113, and a memory 114.

[0080] The vibration motor 103 uses a DRV260x linear motor of model 0619, and the piezoelectric motor 111 uses a SM111 piezoelectric motor SMPL26W16T0711 produced by Steiner and Martin.

[0081] The short-range communication unit 105 is used to receive the type of paper and pen, writing speed information and send the collected pressure signal to the tablet. The memory 106 is used to store the processed tactile data The processor 107 is used to read the corresponding tactile data in the memory according to the received paper and pen type, writing speed and writing pressure information to output a waveform for driving the motor on the pen;

[0082] Tablet 108: used to display writing applications and receive information on the type of paper and pen selected in the displayed writing application. Air film screen 109: used to attach a piezoelectric motor to produce an air film tactile effect. Infrared positioning device 110: used to obtain the position of the pen tip on the touch screen. Transceiver 112: used to receive the pressure of the stylus when writing and send the selected paper and pen type, writing speed information. Processor 113: used to process and output a waveform to drive the piezoelectric motor. Memory 114: used to store tactile data for rendering real paper. Pressure sensor 104, used to collect the pressure of the user when writing in real time.

[0083] Figure 2 , Figure 3 A diagram showing a writing application and the type of paper and pen selected.

[0084] refer to Figure 3 , the writing application is on a screen 210 for writing, including a menu bar that provides various functions, the menu bar including a slider 211 for sliding to adjust the vibration intensity, a slider 212 for sliding to adjust the thickness of the handwriting, a submenu 213 for selecting the paper and pen type, a submenu 214 for selecting the color type, a submenu 215 for clearing the canvas, a submenu 216 for returning to the previous writing step, a submenu 217 for restoring the previous writing step, and a submenu 218 for displaying when the stylus clicks on the submenu 213 Figure 3 A window 218 is shown showing the selection of paper and pen type.

[0085] Figure 4 is a flow chart of the rendering method of the present invention, comprising the following steps:

[0086] Step 1. Render the air film screen;

[0087] Step 2. Collect interaction data acceleration a1 and acceleration a2;

[0088] Step 3. Process the interaction data and take its cycle length and store it in the memory;

[0089] (1) Segment the filtered acceleration data a1 and a2, and determine the waveform sequence segments a'1 and a'2 that best represent the acceleration characteristics under each interaction condition through a similarity comparison algorithm;

[0090] (2) The waveforms of a'1 and a'2 are processed by Fourier transform and inverse transform to obtain new waveform segments by processing the frequency domain signal differences. The cycle length is taken and stored in the stylus memory to complete the rendering of the linear motor;

[0091] Step 4. The two motors are driven together to reproduce the writing tactile effect.

[0092] (1) Displaying a writing application on the touch screen of the tablet, and obtaining the type of paper and pen selected by the user in the display of the writing application;

[0093] (2) During the writing process, the writing pressure F2 and writing speed v2 are collected in real time, and the nearest (F2, v2) is queried. i , V j ) represents the acceleration of the segment The air film screen and the motor on the stylus are driven to vibrate to produce the tactile effect of the selected pen writing on the selected paper.

[0094] The method for rendering the air film screen in step 1 of the present invention is as follows:

[0095] (1) Collect the friction data of the real paper-pen interaction through the robotic arm, record the pressure F0 and tangential friction f0 applied by the pen tip, and calculate the friction factor μ0 of the measured paper through F0 and f0;

[0096] (2) Set the initial drive signal voltage V0. Under the initial voltage V0, measure the tangential friction force f1 and the pressure F1 applied by the pen tip, calculate the friction coefficient μ1, increase or decrease the drive signal voltage V0 as needed, re-measure the tangential friction force f1 and the pressure F1 applied by the pen tip, calculate the new friction coefficient μ1, repeat the above adjustment and measurement steps until the required friction coefficient μ1=μ0 is obtained, record the ultrasonic vibration drive signal voltage value V1 at this moment, and complete the rendering of the air pressure film screen.

[0097] The interactive data collection in step 2 of the present invention is as follows:

[0098] (1) Collect interactive data of different types of paper and pen combinations through the robotic arm. During the interaction, writing is performed with different combinations of pre-set pressure F1 and speed v1. The interactive data is acceleration a1;

[0099] (2) Collecting interactive data of the stylus writing on the air pressure film screen simulating different paper effects. The interaction is also written with different combinations of pressure F1 and speed v1. The interactive data is acceleration a2;

[0100] The acceleration a1 and the acceleration a2 are respectively acquired in real time by a three-axis accelerometer fixed on the pen claw of the mechanical arm.

[0101] The normal force F1 is controlled by adjusting parameters using a multifunctional robotic arm;

[0102] The speed v1 is controlled by adjusting parameters using a multifunctional robotic arm.

[0103] The method for rendering a linear motor on a stylus pen in step 3 of the present invention is specifically as follows:

[0104] Convert the waveforms of a'1 and a'2 to the frequency domain through Fourier transform:

[0105] A1(f)=F{a'1(t)}

[0106] A2(f)=F{a'2(t)}

[0107] According to the superposition principle of waveforms, a'1 minus a'2 gives the difference spectrum signal:

[0108] ΔA(f)=A1(f)-A2(f)

[0109] The difference spectrum signal is then converted back to the time domain by inverse Fourier transform to obtain a new waveform segment

[0110]

[0111] Finally, By waveform segmentation and similarity comparison, the representative segment with the most acceleration characteristics is found, and its waveform period length is taken and stored in the stylus memory.

[0112] In step 4 of the present invention: the writing pressure F2 is obtained in real time by a pressure sensor fixed on the stylus; the writing speed v2 is calculated by the position where the stylus contacts the air pressure film screen, and the calculation formula is:

[0113]

[0114] Where (x, y) is the coordinate of the stylus at the previous moment, (x', y') is the coordinate of the stylus at the current moment, and T is the time interval;

[0115] The query is the closest (F2, v2) to (F2, v2). i , V j ), (F2, v2) and (F i , V j ) is calculated as:

[0116]

[0117] Where (F2, v2) is the normal force applied to the pen and the writing speed in the current state;

[0118] (F i , V j ) is the normal force and writing speed applied to the pen during the data acquisition phase.

[0119] like Figure 1As shown, a mobile terminal tactile feedback device that implements a writing tactile reproduction method based on a joint drive of a motor and an air film screen includes a stylus 101 and an air film screen 102, wherein the stylus 101 includes a pen-mounted vibration motor 103, a pressure sensor 104, a short-range communication unit 105, a memory 106 and a processor 107, and the air film screen 102 includes a tablet 108, an air film screen 109, an infrared positioning device 110, a piezoelectric motor 111, a transceiver 112, a processor 113 and a memory 114.

[0120] The mobile terminal tactile feedback device, wherein the vibration motor 103 is attached to the pen to render the tactile effect of the selected pen writing, and the piezoelectric motor 111 is embedded in the air pressure film screen on the tablet side by side to render the tactile effect of the selected paper.

[0121] The mobile terminal tactile feedback device, wherein:

[0122] The pressure sensor 104 is used to collect the pressure of the user when writing in real time;

[0123] The short-range communication unit 105 is used to receive the type of paper and pen, writing speed information and send the collected pressure signal to the tablet;

[0124] The memory 106 is used to store the processed tactile data

[0125] The processor 107 is used to read the corresponding tactile data in the memory according to the received paper and pen type, writing speed and writing pressure information to output a waveform for driving the motor on the pen.

[0126] The mobile terminal tactile feedback device, wherein:

[0127] The tablet 108 is used to display a writing application and receive information about the type of paper and the type of pen selected in the displayed writing application;

[0128] The air pressure film screen 109 is used to stick a piezoelectric motor to produce an air pressure film tactile effect;

[0129] The infrared positioning device 110 is used to obtain the position of the pen tip on the touch screen;

[0130] The transceiver 112 is used to receive the pressure of the stylus pen when writing and send the selected paper and pen type and writing speed information;

[0131] The processor 113 is used for processing to output a waveform for driving the piezoelectric motor;

[0132] The memory 114 is used to store tactile data for rendering real paper.

[0133] The mobile terminal tactile feedback device, wherein the writing application includes the following menus: a progress bar for selecting the strength of the vibration amplitude, a progress bar for selecting the thickness of the handwriting, a submenu for selecting the combination of paper type and pen type, a submenu for returning to the previous writing step, a submenu for restoring the previous writing step, a submenu for selecting the handwriting color, and a submenu for clearing the canvas.

[0134] The present invention will be further described below in conjunction with specific examples.

[0135] This example is implemented with a linear motor and several piezoelectric motors. The linear motor is attached to the pen, and the piezoelectric motors are embedded side by side on the surface of the air film screen. The types of pens that can be selected in writing applications include ballpoint pens, pencils, and fountain pens. The types of paper include A4 paper and sketch paper. This example is just a simple schematic illustration. In actual operation, the number of piezoelectric motors can be increased or decreased according to specific circumstances, and other types of pens and paper types can also be selected. The basic principle remains unchanged.

[0136] The specific workflow is as follows:

[0137] Step 1. Render the air film screen;

[0138] (1) The friction data of the real paper-pen interaction is collected by the robotic arm, and the normal force F0 and the friction force f0 are recorded. The ratio of F0 to f0 is calculated to obtain the friction factor μ0 of the measured paper;

[0139] (2) Set the initial drive signal voltage V0, adjust and measure the new friction coefficient μ1, repeat the above adjustment and measurement steps until the desired friction coefficient μ1 = μ0 is obtained, complete the rendering of the air pressure film screen, record the ultrasonic vibration drive signal voltage value at this moment, and store the tactile data in the tablet memory 114;

[0140] Step 2. Collect interaction data;

[0141] (1) The robot arm collects the interactive data of writing with different types of paper and pen combinations. The interaction is performed with different combinations of pre-set pressure F1 and speed v1. The interactive data is acceleration a1. The collected acceleration a1 is filtered, and the low-frequency components generated by sliding are filtered out with a low-pass filter, and the high-frequency components that cannot be perceived by the human body are filtered out with a high-pass filter.

[0142] (2) Collect the interactive data of the stylus writing on the air pressure film screen that simulates different paper effects. The interaction is also written with different combinations of pressure F1 and speed v1. The interactive data is acceleration a2. The collected acceleration a2 is filtered, and the low-frequency component generated by sliding is filtered out with a low-pass filter, and the high-pass filter is used to filter out the high-frequency component that cannot be perceived by the human body;

[0143] The acceleration a1 and acceleration a2 are respectively acquired in real time by a three-axis accelerometer fixed on the pen claw of the robotic arm; the three-axis accelerometer is a 4528-B three-axis accelerometer, which provides a wide frequency and dynamic range and good linearity in the entire range, and can be easily set up and achieve consistent measurements. The multifunctional robotic arm is a Rotrics DexArm robotic arm with a repeatability of up to 0.05mm, which can easily realize functions such as writing, drawing, and measuring data;

[0144] Step 3. Process the interaction data and take its cycle length and store it in the memory;

[0145] (1) Segment the filtered acceleration data a1 and a2, and determine the waveform sequence segments a'1 and a'2 that best represent the acceleration characteristics under each interaction condition through a similarity comparison algorithm;

[0146] (2) The waveforms of a'1 and a'2 are processed by Fourier transform and inverse transform to obtain new waveform segments by processing the frequency domain signal differences. The cycle length is taken and stored in the stylus memory 106 to complete the rendering of the linear motor;

[0147] Step 4. The two motors are driven together to reproduce the writing tactile effect.

[0148] (1) Displaying a writing application on the touch screen of the tablet, and obtaining the type of paper and the type of pen selected by the user in the displayed writing application.

[0149] .Collect the writing pressure F2 and writing speed v2 in real time during the writing process, and query the closest (F i , V j ) represents the acceleration of the segment The air film screen and the motor on the stylus are driven to vibrate to produce the tactile effect of the selected pen writing on the selected paper.

[0150] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, rather than to limit it.

Claims

1. A writing tactile reproduction method based on the joint drive of a motor and an air pressure film screen, characterized in that: The following steps are involved: Step 1. Render the air film screen; Step 2. Collect interaction data acceleration a1 and acceleration a2; Step 3. Process the interaction data and take its cycle length and store it in the memory; (1) Segment the filtered acceleration data a1 and a2, and determine the waveform sequence segments a'1 and a'2 that best represent the acceleration characteristics under each interaction condition through a similarity comparison algorithm; (2) The waveforms of a'1 and a'2 are processed by Fourier transform and inverse transform to obtain new waveform segments by processing the frequency domain signal differences. The cycle length is taken and stored in the stylus memory to complete the rendering of the linear motor; Step 4. The two motors are driven together to reproduce the writing tactile effect. (1) Displaying a writing application on the touch screen of the tablet, and obtaining the type of paper and pen selected by the user in the display of the writing application; (2) During the writing process, the writing pressure F2 and writing speed v2 are collected in real time, and the nearest (F2, v2) is queried. i , V j ) represents the acceleration of the segment The air film screen and the motor on the stylus are driven to vibrate to produce the tactile effect of the selected pen writing on the selected paper.

2. The writing tactile reproduction method based on the joint drive of a motor and an air pressure film screen according to claim 1 is characterized in that: The method for rendering the air film screen in step 1 is as follows: (1) Collect the friction data of the real paper-pen interaction through the robotic arm, record the pressure F0 and tangential friction f0 applied by the pen tip, and calculate the friction factor μ0 of the measured paper through F0 and f0; (2) Set the initial drive signal voltage V0. Under the initial voltage V0, measure the tangential friction force f1 and the pressure F1 applied by the pen tip, calculate the friction coefficient μ1, increase or decrease the drive signal voltage V0 as needed, re-measure the tangential friction force f1 and the pressure F1 applied by the pen tip, calculate the new friction coefficient μ1, repeat the above adjustment and measurement steps until the required friction coefficient μ1=μ0 is obtained, record the ultrasonic vibration drive signal voltage value V1 at this moment, and complete the rendering of the air pressure film screen.

3. The writing tactile reproduction method based on the joint drive of a motor and an air pressure film screen according to claim 1 is characterized in that: The interactive data collection in step 2 is as follows: (1) Collect interactive data of different types of paper and pen combinations through the robotic arm. During the interaction, writing is performed with different combinations of pre-set pressure F1 and speed v1. The interactive data is acceleration a1; (2) Collecting interactive data of the stylus writing on the air pressure film screen simulating different paper effects. The interaction is also written with different combinations of pressure F1 and speed v1. The interactive data is acceleration a2; The acceleration a1 and the acceleration a2 are respectively acquired in real time by a three-axis accelerometer fixed on the pen claw of the mechanical arm; The normal force F1 is controlled by adjusting parameters using a multifunctional robotic arm; The speed v1 is controlled by adjusting parameters using a multifunctional robotic arm.

4. The writing tactile reproduction method based on the joint drive of a motor and an air pressure film screen according to claim 1 is characterized in that: The method for rendering the linear motor on the stylus in step 3 is specifically as follows: Convert the waveforms of a'1 and a'2 to the frequency domain through Fourier transform: A1(f)=F{a'1(t)} A2(f)=F{a'2(t)} According to the superposition principle of waveforms, a'1 minus a'2 gives the difference spectrum signal: ΔA(f)=A1(f)-A2(f) The difference spectrum signal is then converted back to the time domain by inverse Fourier transform to obtain a new waveform segment Finally, By waveform segmentation and similarity comparison, the representative segment with the most acceleration characteristics is found, and its waveform period length is taken and stored in the stylus memory.

5. The writing tactile reproduction method based on the joint drive of a motor and an air pressure film screen according to claim 1 is characterized in that: In step 4: the writing pressure F2 is acquired in real time by a pressure sensor fixed on the stylus; the writing speed v2 is calculated by the position where the stylus contacts the air pressure film screen, and the calculation formula is: Where (x, y) is the coordinate of the stylus at the previous moment, (x', y') is the coordinate of the stylus at the current moment, and f is the time interval; The query is the closest (F2, v2) to (F2, v2). i , V j ), (F2, v2) and (F i , V j ) is calculated as: Where (F2, v2) is the normal force applied to the pen and the writing speed in the current state; (F i , V j ) is the normal force and writing speed applied to the pen during the data acquisition phase.

6. A mobile terminal tactile feedback device that implements the writing tactile reproduction method based on the joint drive of a motor and an air pressure film screen as described in any one of claims 1 to 5, characterized in that: It includes a stylus and an air film screen, wherein the stylus includes a vibration motor, a pressure sensor, a short-range communication unit, a memory and a processor, and the air film screen includes a tablet, an air film screen, an infrared positioning device, a piezoelectric motor, a transceiver, a processor and a memory.

7. The tactile feedback device for a mobile terminal according to claim 6, characterized in that: The vibration motor is attached to the pen to render the tactile effect of writing with the selected pen, and the piezoelectric motor is embedded in the air pressure film screen on the tablet in parallel to render the tactile effect of the selected paper.

8. The tactile feedback device for a mobile terminal according to claim 6, characterized in that: The pressure sensor is used to collect the pressure of the user when writing in real time; The short-range communication unit is used to receive the type of paper and pen, writing speed information and send the collected pressure signal to the tablet; The memory is used to store the processed tactile data The processor is used to read the corresponding tactile data in the memory according to the received paper and pen type, writing speed and writing pressure information to output a waveform for driving the motor on the pen.

9. The tactile feedback device for a mobile terminal according to claim 6, characterized in that: The tablet is used to display a writing application and receive information about a paper type and a pen type selected in the displayed writing application; The air pressure film screen is used to stick a piezoelectric motor to produce an air pressure film tactile effect; The infrared positioning device is used to obtain the position of the pen tip on the touch screen; The transceiver is used to receive the pressure of the stylus pen when writing and send the type of selected paper and pen, and writing speed information; The processor is used for processing to output a waveform for driving the piezoelectric motor; The memory is used to store tactile data for rendering real paper.

10. The tactile feedback device for a mobile terminal according to claim 9, characterized in that: The writing application includes the following menus: a progress bar for selecting the strength of the vibration amplitude, a progress bar for selecting the thickness of the handwriting, a submenu for selecting the combination of paper type and pen type, a submenu for returning to the previous writing step, a submenu for restoring the previous writing step, a submenu for selecting the handwriting color, and a submenu for clearing the canvas.