Vehicle-mounted terminal tactile representation rendering method and device under vibration interference

By combining air pressure membrane and mechanical vibration, the tactile reproduction device calculates and cancels external vibrations in real time, solving the problems of single tactile feedback and high power consumption in existing vehicle terminals, and realizing diversified tactile feedback and improved safety.

CN119024966APending Publication Date: 2024-11-26JILIN UNIVERSITY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411161547.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-23
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing tactile reproduction methods for vehicle terminals rely on a single mechanical vibration mode under vibration interference, resulting in limited tactile feedback, increased driver reliance on visual perception, high power consumption, long latency, and difficulty in adapting to complex road conditions.

Method used

The tactile reproduction device, which combines air pressure membrane and mechanical vibration, calculates the mechanical vibration and air pressure membrane drive signal in real time through image preprocessing, information acquisition, information processing and signal output, and provides tactile feedback to counteract external vibrations.

Benefits of technology

It provides diverse tactile feedback in complex road conditions, reduces driver reliance on visual input, improves interaction accuracy and efficiency, reduces power consumption, reduces system heat generation, and enhances driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024966A_ABST
    Figure CN119024966A_ABST
Patent Text Reader

Abstract

The invention relates to a vehicle-mounted terminal tactile representation rendering method and device under vibration interference, and belongs to the field of touch technology, virtual reality and human-computer interaction. The tactile representation device fusing two modes of air film pressing and mechanical vibration is used for receiving parameters of information processing through image preprocessing, information acquisition, information processing and signal output, converting the parameters into corresponding control signals and acting on a piezoelectric ceramic piece and a vibration motor to generate a vibration counteracting phenomenon, so that the tactile representation effect is achieved. And interaction content is presented on the tactile interaction unit to realize tactile feedback. The device has the advantages that the provided tactile feedback styles are diverse, diverse and complex tactile modes can be generated, the interaction accuracy and efficiency are improved, feedback of different tactile effects can be provided according to the display content of an interaction interface and finger positions, different mechanical vibration driving signals can be provided according to different external vibration signals, and the damping effect is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of touch technology, virtual reality and human-computer interaction, and in particular to a method and device for reproducing tactile sensation of a vehicle-mounted terminal under vibration interference. Background Art

[0002] With the advancement of science and technology, the high degree of integration of equipment has made touch screens that can provide touch control gradually become an important part of mobile phones, computer screens, car central control and other devices, which has gradually replaced physical buttons with virtual buttons. This has greatly increased the reliance on vision when operating buttons, but driving a car is a task that is highly dependent on vision. Although driving assistance and autonomous driving technologies are booming, drivers sometimes still need to interact with the car to complete corresponding driving and non-driving tasks. This will cause the driver's attention to shift from the road to the interaction with the car, which greatly increases the risk of driving.

[0003] At present, the research on tactile feedback mainly focuses on the confirmation of control actions, such as providing confirmation of click information to users through vibration feedback when clicking on the screen. However, with the globalization trend of touch screens in car interiors, it is particularly important to provide touch screens with feedback to provide drivers with effective feedback on search and control elements.

[0004] In car driving, using an interactive terminal with tactile feedback has the following advantages. First, when providing tactile information to the driver, it can reduce the driver's need for vision during interactive operations, allowing the driver to control many functions of the vehicle through tactile sensations when searching and controlling, thus achieving "blind operation". Secondly, tactile information can provide information reminders to the driver to improve the driver's awareness and response. For example, when the vehicle detects danger or changes in the road conditions ahead, it can use specific tactile signals to remind the driver. Studies have shown that vibration tactile technology used in driver assistance systems (ADAS) can improve lane keeping capabilities by 30%. Finally, experiments have shown that the reaction time of tactile stimulation is 1.7 times faster than that of visual stimulation. When encountering danger, touch will provide a corresponding response faster.

[0005] However, in most cases, vehicles are not completely driven on a flat road surface, and uneven roads have different effects on the effect of tactile reproduction. Currently, there have been some studies on the effect of vibration interference on tactile reproduction when driving a vehicle.

[0006] paper" The MIMI full-touch series application of Audi Q7 was introduced in the "Effective Touch Feedback". The system is designed with a tactile brake with adjustable threshold. When the vehicle travels over uneven terrain, the movement of the entire vehicle including the driver is large, which will increase the tactile threshold. This will increase the force required to select the function (that is, the pressure that the finger must apply on the operating surface) compared to the force on a flat road.

[0007] The paper "Effect of Vibration on Tactile Sensitivity" studied whether vibration has an effect on tactile thresholds. The experiment found that vibration does increase the tactile threshold of "normal" hands, and the effect can last for at least 10 minutes. There is a significant difference in the average threshold of vibration between men and women, but the trend of vibration's effect on the tactile threshold of men and women is the same. The duration and frequency of vibration may also affect the amount and duration of "desensitization". The paper "Frequency and amplitude discrimination along the kinesthetic-cutaneous continuum in the presence of masking stimulia" also proves the above conclusions, and points out that low-frequency and high-frequency vibration stimulation are channel-independent.

[0008] The paper "Development of a Human-Display Interface with VibrotactileFeedback for Real-World Assistive Applications" designed a touch screen style for use in vibration conditions. This style uses a fully mechanical vibration method to provide tactile feedback to the driver by providing a signal greater than the tactile threshold during vibration. Experiments show that touch screens that provide tactile feedback reduce the driver's visual needs during interactive operations and improve the user experience.

[0009] At present, air piezoelectric film tactile reproduction technology has attracted much attention due to its better operating performance and delicate tactile feeling. Its core is that when a high-frequency driving signal is applied to the piezoelectric ceramic sheet pasted on the touch screen, the touch screen will vibrate violently. When the finger slides on the touch screen, the high-speed vibration will cause the air molecules between the finger and the screen to be unable to escape quickly and produce an air film, thereby generating a squeezing force of the air film on the finger and the touch screen, thereby reducing the tangential friction between the finger and the touch screen.

[0010] The extrusion model due to the air pressure film effect is:

[0011]

[0012] Where, κ is the vibration frequency of the touch screen, h is the viscosity of the air fluid, θ is the contact length between the finger and the touch screen, p0 is the atmospheric pressure, and h r is the surface roughness of the touch screen, h e is the average amplitude of the fingerprint, h vib is the vibration amplitude of the touch screen.

[0013]

[0014]

[0015] Among them, Q m is the mechanical quality factor of the piezoelectric ceramic, d 31 is the piezoelectric constant, V is the driving signal voltage, h p is the thickness of the resonator, λ is twice the length of the piezoelectric ceramic sheet, and z0 is the length of the plate compressed and stretched in the z direction;

[0016] When the air pressure film effect is formed, the squeezing force of the air pressure film on the finger and the touch screen is:

[0017]

[0018]

[0019] Among them, ζ is the contact area between the finger and the touch screen. Since the offset ratio is 0≤μ≤1, it can be known that when the vibration amplitude of the touch screen is larger, the squeezing force generated is larger and the tactile sensation is smoother. At this time, the tangential friction force on the finger is:

[0020] f=μ(F N -F)

[0021] Where μ is the sliding friction coefficient, F N Apply pressure to the finger. Therefore, the sliding friction force on the finger can be changed by applying different driving signals to the piezoelectric ceramic.

[0022] Through the analysis of the tactile reproduction and rendering methods of vehicle-mounted terminals under vibration interference, most of the existing tactile reproduction and rendering methods use a single mechanical vibration method to provide tactile feedback. This method provides a single tactile feedback style and can only be used to provide a simple and direct tactile mode, which is difficult to adapt to the current development trend. In addition, there are generally two methods for the tactile feedback mechanism. One is to reduce the impact of vibration by increasing the pressure applied by the finger, and the other is to reduce the impact by adding a signal greater than the tactile threshold during vibration. The first method will cause the user to spend extra energy on the pressure applied by the finger, which will reduce the driver's controllability of the vehicle. The second method will cause the power consumption of the touch system to increase significantly, increase the system heat, reduce the service life of the touch system, and impose additional requirements on the vehicle power consumption system. The original solution did not pre-process the digital image, establish the relationship between the drive signal and the relevant influencing parameters, and require real-time processing and calculation when tactile interaction occurs, resulting in an increase in the delay of tactile feedback, which is not conducive to providing real-time tactile feedback. Summary of the invention

[0023] The present invention provides a method and device for tactile reproduction and rendering of a vehicle-mounted terminal under vibration interference, which can be applied to provide tactile feedback to the driver when the vehicle is driving under different road conditions, reduce the driver's visual dependence during interaction, improve driving safety and enhance the sense of interaction. When the driver performs touch interaction, the finger position information, pressure information and external vibration information are obtained in real time. After the pressure information is judged, the mechanical vibration and the air film drive signal are calculated in real time through the external vibration signal-mechanical vibration drive signal parameter mapping model and the tactile perception roughness-air film drive signal voltage mapping model, so as to realize the mechanical vibration cancellation technology and the air film tactile reproduction technology, and provide the driver with tactile feedback to offset the external interference vibration, thereby improving driving safety and enhancing the sense of interaction.

[0024] The technical solution adopted by the present invention is: a tactile reproduction device that combines air compression and mechanical vibration, the method includes image preprocessing, information collection, information processing and signal output, wherein:

[0025] Image preprocessing is used to detect textures of digital images by Laws texture filtering in a statistical energy manner, thereby reflecting the distribution of certain grayscale changes on the image and reflecting the relationship between pixel grayscale and surrounding space;

[0026] Information collection is used to collect external information and send the obtained information in the form of signals for information processing;

[0027] The information processing is used to receive the signal of information collection, and according to the collected external vibration information, according to the external vibration signal-mechanical vibration drive signal parameter mapping model, the external vibration signal is processed, and according to the collected current finger position information and the image pixel grayscale and spatial relationship data set of image preprocessing, the grayscale information of the current position image is obtained, and according to the tactile perception roughness-air pressure film drive signal voltage mapping model, the tactile perception roughness is processed, and the amplitude, frequency, and phase parameters of the mechanical vibration and air pressure film drive signal are generated for signal output;

[0028] The signal output is used to receive parameters for information processing and convert the parameters into corresponding control signals, which act on the piezoelectric ceramic sheet and the vibration motor respectively to produce vibration cancellation phenomenon, and present the interactive content on the tactile interaction unit to achieve tactile feedback.

[0029] The implementation method of the image preprocessing method of the present invention is as follows:

[0030] (1) Texture analysis of digital images

[0031] Select a one-bit convolution kernel of length 5: L5, E5, S5, W5, R5, and convolve it with a vertical one-dimensional kernel and a horizontal one-dimensional kernel to obtain 25 two-dimensional convolution kernels:

[0032]

[0033] A two-dimensional coordinate system is established with the lower left corner of the screen display image as the origin, the digital image is divided into different regions in the form of N×M, and the two-dimensional convolution is applied to each different region to obtain 25 N×M grayscale images;

[0034] (2) Generate texture energy measurement (TEM) images

[0035] The following nonlinear filter was applied to 25 N × M grayscale images to generate 25 TEM images;

[0036]

[0037] Where n and m are the positions of the current pixel, and i and j are the 15×15 square local neighborhoods around the current pixel;

[0038] TEM images are indicated by appending a "T" to the name of the original convolution kernel.

[0039]

[0040] (3) Normalized contrast feature

[0041] All TEM images were pixel-by-pixel normalized using the L5L5T image to obtain the contrast A;

[0042] (4) Combining similar features

[0043] The features generated using the transposed convolution kernel are added together, with an additional “R” to indicate rotational invariance:

[0044] E5L5TR=E5L5T+L5E5T

[0045] S5L5TR=S5L5T+L5S5T

[0046] W5L5TR=W5L5T+L5W5T

[0047] R5L5TR=R5L5T+L5R5T

[0048] S5E5TR=S5E5T+E5S5T

[0049] W5E5TR=W5E5T+E5W5T

[0050] R5E5TR=R5E5T+E5R5T

[0051] W5S5TR=W5S5T+S5W5T

[0052] R5S5TR=R5S5T+S5R5T

[0053] R5W5TR=R5W5T+W5R5T

[0054] E5E5TR=2×E5E5T

[0055] S5S5TR=2×S5S5T

[0056] W5W5TR=2×W5W5T

[0057] R5R5TR=2×R5R5T

[0058] The 14 feature images are stacked together to obtain a data set of the pixel and space relationship in each feature image. When the finger position information is processed, the grayscale information of the finger's current position image is obtained, so as to generate the amplitude, frequency and phase parameters of the air pressure film driving signal according to the tactile perception roughness-air pressure film driving signal voltage mapping model.

[0059] The external information of the present invention includes external vibration information, finger position information and finger pressure information;

[0060] The finger position information refers to the two-dimensional coordinates (x, y) of the finger on the terminal.

[0061] The implementation method of information collection described in the present invention is as follows: a two-dimensional coordinate system is established with the lower left corner of the screen as the origin, and the real-time two-dimensional coordinates (x, y) of the interaction between the finger and the screen are tracked and measured through an infrared positioning device to obtain the finger position information, and the real-time finger pressure information on the screen is obtained through a pressure sensor fixed under the screen. At the same time, real-time interference information of the terminal to the terminal due to external vibration is obtained through a vibration sensor fixed on the terminal shell.

[0062] The information processing method of the present invention is as follows: first, a data set of the grayscale and spatial relationship of the current image pixels is obtained to improve the processing speed when calculating the drive signal parameters; then, because the vehicle-mounted terminal is in a vibrating environment, in order to prevent accidental touches, a user's finger pressure threshold F0 is set, that is, when the user's finger pressure F N ≥F0, it is determined as a legal press, otherwise it is determined as an illegal press and no information is processed; when it is determined to be a legal press, the amplitude, frequency and phase parameters of the mechanical vibration drive signal are generated according to the collected external vibration information and the external vibration signal-mechanical vibration drive signal parameter mapping model; according to the data set of finger position information and the grayscale and spatial relationship of image pixels, the grayscale information of the pixel at the current position is obtained, and according to the tactile perception roughness-air pressure film drive signal voltage mapping model, the amplitude, frequency and phase parameters of the air pressure film drive signal are generated, and the parameters are sent to the information drive unit.

[0063] The tactile reproduction and rendering method of the vehicle-mounted terminal under vibration interference described in the present invention establishes a tactile perception roughness-air pressure film driving signal voltage mapping model, and establishes an external vibration signal-mechanical vibration driving signal parameter mapping model:

[0064] (1) Tactile perception roughness-air pressure film driving signal voltage mapping model

[0065] In the dataset of feature image pixels and spatial relationships, the contrast feature A max The maximum value corresponds to the maximum tangential friction force f max , at this time the driving voltage V min =0, contrast feature A min The minimum corresponds to the minimum tangential friction force, at which time the driving voltage is the maximum value V max , and map it proportionally:

[0066]

[0067]

[0068] Among them, f is the magnitude of the tangential friction force on the finger, A is the contrast feature size of the finger, and V is the air pressure film driving signal voltage at this time, that is, when the contrast feature is larger, the tangential friction force on the finger is larger, and the air pressure film driving signal voltage is smaller;

[0069] (2) External vibration signal-mechanical vibration driving signal parameter mapping model:

[0070] By collecting vibration time domain signals, performing mean analysis, variance analysis, and root mean square value analysis on the signals in the time domain, calculating their probability density functions, and analyzing the signals in the frequency domain, we can obtain the phase-frequency characteristics and amplitude-frequency characteristics of the signals as they change with frequency:

[0071] [1] Time domain analysis of vibration signals

[0072] <1> Time Domain Mean Analysis

[0073] The time domain mean represents the average value of the signal within one period, which describes the static component of the data;

[0074]

[0075] Among them, x(l) is the original sequence of vibration signal, is the average value of the original sequence, N is the number of sampling points, and l is the sequence number of each sampling point;

[0076] <2> Time Domain ANOVA

[0077] The time domain variance is the average of the sum of the squares of the differences between each domain and the mean, reflecting the intensity of the signal fluctuation around the mean;

[0078]

[0079] Among them, D x is the variance, x (l) is the original sequence of vibration signal, is the average value;

[0080] <3> Time Domain RMS Analysis

[0081] The time domain RMS value indicates the strength of the signal and is a manifestation of the signal energy;

[0082]

[0083] Among them, X rms is the root mean square value, x(l) is the original sequence of the vibration signal;

[0084] <4> Probability density function

[0085] The probability density function describes the possibility that the output value of a random variable is located at a certain value point, reflecting the change of the signal amplitude;

[0086] For a time domain signal x(t) whose amplitude varies with time, the probability that the value of x(t) is within the range of x and (x+Δx) is:

[0087]

[0088] in, The total time falling within the range from x to (x+Δx), T is the total observation time;

[0089] The fitting relationship is established through the above parameters:

[0090]

[0091] Among them, the max function is a function that takes the maximum value of the probability density function. Therefore, the distribution of the instantaneous value of the amplitude of the vibration signal can be obtained by obtaining the amplitude with the maximum possibility of the fitting relationship probability value;

[0092] [2] Frequency domain analysis of vibration signals

[0093] The Hanning window is used to truncate the vibration signal, and the signal is processed. The sampling frequency Ω and the number of sampling points N are used to perform DFT transformation on the signal:

[0094]

[0095] In the formula, is the discrete frequency, k is the serial number of the discrete frequency point, and the DFT value X[k] frequency is periodic, and the period is N;

[0096] Calculate the unilateral power spectrum of the signal:

[0097]

[0098] Where, Γ is the sampling interval;

[0099] The fitting relationship is established through the above parameters:

[0100] w 频率 =w(G k )

[0101] Among them, the w function is to take the value of the prominent frequency component in the unilateral power spectrum of the signal, so according to the distribution of the energy of the vibration signal on the frequency component, the instantaneous value of the frequency of the vibration signal can be obtained;

[0102] According to the instantaneous value of amplitude X 幅值 and the instantaneous value of frequency w 频率External vibration signal function can be established:

[0103] Y=X 幅值 cos(w 频率 t)

[0104] The mechanical vibration signal cancellation signal function is:

[0105] Y 抵消 =X 幅值 cos(w 频率 t+π)

[0106] The amplitude of the mechanical vibration driving signal function is consistent with that of the external vibration signal function, the frequency of the mechanical vibration driving signal function is consistent with that of the external vibration signal function, and the phases of the mechanical vibration driving signal function and the external vibration signal function are opposite. Vibrations with opposite phases will cause the vibrations to cancel each other out and play a role in shock absorption.

[0107] The control signal in the signal output of the present invention includes an air pressure film driving signal and a mechanical vibration driving signal, which are used to control the vibration mode of the piezoelectric ceramic piece and the vibration motor to produce a tactile reproduction effect that offsets vibration interference.

[0108] The implementation method of the signal output described in the present invention is as follows: the information driving unit will generate a corresponding driving signal according to the amplitude, frequency, and phase parameters of the air pressure film driving signal and the mechanical vibration driving signal processed and generated in the information processing unit, and act on the piezoelectric ceramic piece and the vibration motor respectively to produce a vibration cancellation phenomenon, and present the interactive content on the tactile interaction unit to achieve tactile feedback.

[0109] The tactile interaction unit of the present invention uses the air pressure film tactile reproduction technology and the mechanical vibration offset technology to provide a tactile feedback phenomenon after offsetting the external vibration interference, wherein:

[0110] (1) Air pressure film tactile reproduction technology:

[0111] When a high-frequency driving signal is applied to the piezoelectric ceramic sheet attached to the touch screen, the touch screen will vibrate violently. When a finger slides on the touch screen, the high-speed vibration will cause the air molecules between the finger and the screen to be unable to escape quickly, resulting in an air film. This will create a squeezing force on the finger and the touch screen, thereby reducing the tangential friction between the finger and the touch screen.

[0112] (2) Mechanical vibration cancellation technology

[0113] When a low-frequency driving signal is applied to the vibration motor attached to the touch screen, the vibration motor will generate low-frequency vibration. The generated mechanical disturbance will propagate on the touch screen, and the interference of external vibration on the touch screen will be offset by the generated mechanical vibration wave. The vibration equation at this time is:

[0114] γ v (t) = Υ0cos(ωt+θ)

[0115] Among them, Υ0 is the amplitude of the mechanical vibration wave, ω is the frequency of the mechanical vibration wave, and θ is the phase of the mechanical vibration wave. When the user interacts with the touch screen, the information acquisition unit will collect the external vibration information of the terminal in real time, so as to offset the interference of the external vibration on the touch screen by adjusting different parameters of the driving signal, thereby reducing the influence of the external vibration on the tactile reproduction effect.

[0116] The present invention is based on a tactile reproduction device that combines air compression and mechanical vibration, and its structure includes:

[0117] (1) Information collection unit: including a finger positioning device for collecting finger position information, a pressure sensor for collecting finger pressure, and a vibration sensor for collecting vibration information. The finger positioning device uses infrared positioning, which can realize the positioning function and track the finger position information in real time; the pressure sensor can measure the pressure of the finger on the screen in real time, so as to determine whether a tactile reproduction effect is provided; the vibration sensor is responsible for collecting external vibration information on the terminal, including vibration frequency and amplitude, and sending it to the information processing unit for information processing;

[0118] (2) Information processing unit: The vehicle-mounted terminal is used as an information processing device. It preprocesses the currently displayed digital image through an image preprocessing method to obtain a data set of the grayscale and spatial relationship of the current image pixels, and then receives the finger pressure information, finger position information and external vibration information collected by the information acquisition unit. After determining the finger pressure information, it generates the amplitude, frequency and phase parameters of the mechanical vibration drive signal according to the external vibration signal-mechanical vibration drive signal parameter mapping model. According to the finger position information and the data set of the grayscale and spatial relationship of the image pixels, it obtains the grayscale information of the pixel at the current position. According to the tactile perception roughness-air pressure film drive signal voltage mapping model, it generates the amplitude, frequency and phase parameters of the air pressure film drive signal, and sends the parameters to the drive unit;

[0119] (3) Information driving unit: including a power supply, a signal amplifier, and a signal generator, used to generate a corresponding driving signal according to the driving signal parameters processed by the information processing unit, and transmit it to the tactile interaction unit to generate a corresponding tactile feeling;

[0120] (4) Tactile interaction unit: includes a touch screen, a piezoelectric ceramic sheet and a vibration motor, which is used to receive the driving signal sent by the information driving unit, drive the piezoelectric ceramic sheet and the vibration motor to generate vibration cancellation, and present the interactive content on the touch screen to achieve tactile feedback.

[0121] The present invention has the following advantages:

[0122] 1. The present invention adopts a tactile reproduction device that combines air pressure film and mechanical vibration for rendering, wherein the air pressure film is used to change the friction force on the finger, and the mechanical vibration is used to offset the interference of external vibration on the tactile reproduction effect, providing a variety of tactile feedback styles and being able to produce diverse and complex tactile patterns.

[0123] 2. The tactile reproduction scenario of the vehicle terminal under vibration interference can be used to meet the driver's demand for touch operation in various vibration scenarios. There is no need to increase the touch effect by increasing power consumption, thereby reducing the driver's visual needs for interaction and improving the accuracy and efficiency of interaction.

[0124] 3. The texture of the interactive interface is detected by using Laws texture filtering in a statistical energy manner, which reflects the relationship between the pixel grayscale and the surrounding space. At the same time, similar features are combined to eliminate the deviation of dimensional features.

[0125] 4. Establish a tactile perception roughness-air pressure film driving signal voltage mapping model, which can provide feedback of different tactile effects according to the interactive interface display content and finger position.

[0126] 5. Establish an external vibration signal-mechanical vibration driving signal parameter mapping model, which can provide different mechanical vibration driving signals according to different external vibration signals to achieve the effect of shock absorption. BRIEF DESCRIPTION OF THE DRAWINGS

[0127] Figure 1 is a structural block diagram of a tactile reproduction device of the present invention;

[0128] Figure 2 It is a schematic diagram of the layout of the pressure sensor and the vibration sensor of the present invention;

[0129] Figure 3 is a schematic diagram of the actuator distribution of the present invention;

[0130] Figure 4 is a flow chart of the present invention;

[0131] Figure 5 It is the image preprocessing flow chart of the present invention;

[0132] Figure 6 It is a flow chart of establishing a tactile perception roughness-air pressure film driving signal voltage mapping model of the present invention;

[0133] Figure 7 It is a flow chart of the external vibration signal-mechanical vibration driving signal parameter mapping model;

[0134] FIG8( a ) is a schematic diagram of the relationship between the characteristic image contrast feature and the friction force of the present invention;

[0135] FIG8( b ) is a schematic diagram of the relationship between the voltage amplitude of the driving signal and the friction force of the present invention;

[0136] Fig. 9 It is the graph of the change of the absolute threshold of the air pressure film when the mechanical vibration cancellation technology exists;

[0137] Fig.10 It is a schematic diagram of the external vibration interference signal and the cancellation signal of the present invention;

[0138] Fig.11 is a schematic diagram of the change of friction force after the driving signal is applied in the present invention;

[0139] Fig.12 It is a schematic diagram demonstrating the user interface of the present invention.

[0140] Specific implementation method

[0141] The present invention proposes a method and device for rendering tactile sensation of a vehicle-mounted terminal under vibration interference, which is used to provide a tactile sensation to the driver during driving, reduce the driver's visual dependence during interaction, and improve driving safety. The present invention is described in detail below based on the accompanying drawings and specific examples.

[0142] The tactile reproduction device of the present invention is based on the fusion of air pressure film and mechanical vibration. Figure 1 As shown, its structure includes:

[0143] (1) Information collection unit 1: including a finger positioning device for collecting finger position information, a pressure sensor for collecting finger pressure, and a vibration sensor for collecting vibration information. The pressure sensor and the vibration sensor are placed as follows: Figure 2 As shown, the finger positioning device uses infrared positioning, which can realize the positioning function and track the position information of the finger in real time. The pressure sensor can measure the pressure of the finger on the screen in real time to determine whether to provide a tactile reproduction effect. The vibration sensor is responsible for collecting external vibration information on the terminal, including vibration frequency and amplitude, and sending it to the information processing unit for information processing;

[0144] (2) Information processing unit 2: The vehicle-mounted terminal is used as an information processing device, which preprocesses the currently displayed digital image through an image preprocessing method to obtain a data set of the current image pixel grayscale and spatial relationship. Then, the finger pressure information, finger position information and external vibration information collected by the information acquisition unit are received, and after judging the finger pressure information, the amplitude, frequency and phase parameters of the mechanical vibration drive signal are generated according to the external vibration signal-mechanical vibration drive signal parameter mapping model. According to the finger position information and the data set of the image pixel grayscale and spatial relationship, the grayscale information of the pixel at the current position is obtained, and the amplitude, frequency and phase parameters of the air pressure film drive signal are generated according to the tactile perception roughness-air pressure film drive signal voltage mapping model, and the parameters are sent to the drive unit.

[0145] (3) Information driving unit 3: includes a power supply, a signal amplifier, and a signal generator, and is used to generate a corresponding driving signal according to the driving signal parameters processed by the information processing unit, and transmit it to the tactile interaction unit to generate a corresponding tactile sensation.

[0146] (4) Tactile interaction unit 4: including a touch screen, a piezoelectric ceramic sheet and a vibration motor. The piezoelectric ceramic sheet and the vibration motor are placed as follows: Figure 3 As shown, it is used to receive the driving signal sent by the information driving unit, drive the piezoelectric ceramic sheet and the vibration motor, produce vibration cancellation phenomenon, and present interactive content on the touch screen to achieve tactile feedback.

[0147] The process of the vehicle terminal tactile reproduction and rendering method under vibration interference of the present invention is as follows: Figure 4 The method comprises image preprocessing, information acquisition, information processing and signal output, wherein:

[0148] Image preprocessing is used to detect texture of digital images by Laws texture filtering in a statistical energy manner, thereby reflecting the distribution of certain grayscale changes on the image and reflecting the relationship between pixel grayscale and the surrounding space.

[0149] Information collection is used to collect external information and send the obtained information in the form of signals for information processing;

[0150] External information includes external vibration information, finger position information and finger pressure information;

[0151] Finger position information refers to the two-dimensional coordinates (x, y) of the finger on the terminal;

[0152] The information processing is used to receive the signal of information collection, and according to the collected external vibration information, according to the external vibration signal-mechanical vibration driving signal parameter mapping model, the external vibration signal is processed, and the grayscale information of the current position image is obtained according to the collected current finger position information and the image pixel grayscale and spatial relationship data set of image preprocessing, and the tactile perception roughness is processed according to the tactile perception roughness-air pressure film driving signal voltage mapping model to generate the amplitude, frequency and phase parameters of the mechanical vibration and air pressure film driving signal for signal output.

[0153] The signal output is used to receive parameters for information processing and convert the parameters into corresponding control signals.

[0154] The control signal includes an air film pressure control signal and a mechanical vibration control signal, which are used to control the vibration mode of the piezoelectric ceramic piece and the vibration motor to produce a tactile reproduction effect that offsets vibration interference.

[0155] The method of the present invention is applied to the use of a vehicle-mounted terminal during vibration interference, and is used to implement operations such as information selection and information browsing. The demonstration is based on Unity.

[0156] like Figure 5 The implementation method of the image preprocessing method of the present invention is as follows:

[0157] (1) Texture analysis of digital images

[0158] Select a one-bit convolution kernel of length 5: L5, E5, S5, W5, R5, and convolve it with a vertical one-dimensional kernel and a horizontal one-dimensional kernel to obtain 25 two-dimensional convolution kernels:

[0159] L5L5 E5L5 S5L5 W5L5 R5L5

[0160] L5E5 E5E5 S5E5 W5E5 R5E5

[0161] L5S5 E5S5 S5S5 W5S5 R5S5

[0162] L5W5 E5W5 S5W5 W5W5 R5W5

[0163] L5R5 E5R5 S5R5 W5R5 R5R5

[0164] A two-dimensional coordinate system is established with the lower left corner of the screen display image as the origin, the digital image is divided into different regions in the form of N×M, and the two-dimensional convolution is applied to each different region to obtain 25 N×M grayscale images.

[0165] (2) Generate texture energy measurement (TEM) images

[0166] The following nonlinear filter was applied to 25 N × M grayscale images to generate 25 TEM images.

[0167]

[0168] Among them, n and m are the positions of the current pixel, and i and j are the 15×15 square local neighborhoods around the current pixel.

[0169] TEM images are indicated by appending a "T" to the name of the original convolution kernel.

[0170]

[0171] (3) Normalized contrast feature

[0172] All TEM images were feature-normalized pixel by pixel with the L5L5T image to obtain the contrast A.

[0173] (4) Combining similar features

[0174] The features generated using the transposed convolution kernel are added together, with an additional “R” to indicate rotational invariance:

[0175] E5L5TR=E5L5T+L5E5T

[0176] S5L5TR=S5L5T+L5S5T

[0177] W5L5TR=W5L5T+L5W5T

[0178] R5L5TR=R5L5T+L5R5T

[0179] S5E5TR=S5E5T+E5S5T

[0180] W5E5TR=W5E5T+E5W5T

[0181] R5E5TR=R5E5T+E5R5T

[0182] W5S5TR=W5S5T+S5W5T

[0183] R5S5TR=R5S5T+S5R5T

[0184] R5W5TR=R5W5T+W5R5T

[0185] E5E5TR=2×E5E5T

[0186] S5S5TR=2×S5S5T

[0187] W5W5TR=2×W5W5T

[0188] R5R5TR=2×R5R5T

[0189] The 14 feature images are stacked together to obtain a data set of the pixel and space relationship in each feature image. When the finger position information is processed, the grayscale information of the finger's current position image is obtained, so as to generate the amplitude, frequency and phase parameters of the air pressure film driving signal according to the tactile perception roughness-air pressure film driving signal voltage mapping model.

[0190] The implementation method of information collection described in the present invention is as follows: a two-dimensional coordinate system is established with the lower left corner of the screen as the origin, and the real-time two-dimensional coordinates (x, y) of the interaction between the finger and the screen are tracked and measured through an infrared positioning device to obtain the finger position information, and the real-time finger pressure information on the screen is obtained through a pressure sensor fixed under the screen. At the same time, real-time interference information of the terminal to the terminal due to external vibration is obtained through a vibration sensor fixed on the terminal shell.

[0191] The information processing method of the present invention is as follows: First, a data set of the grayscale and spatial relationship of the current image pixels is obtained to improve the processing speed when calculating the drive signal parameters. Then, because the vehicle-mounted terminal is in a vibrating environment, in order to prevent accidental touches, a user's finger pressure threshold F0 is set, that is, when the user's finger pressure F N ≥F0, it is determined as a legal press, otherwise it is determined as an illegal press and no information is processed. When it is determined to be a legal press, according to the collected external vibration information and the external vibration signal-mechanical vibration drive signal parameter mapping model, such as Figure 7 As shown, the amplitude, frequency, and phase parameters of the mechanical vibration driving signal are generated. According to the data set of the finger position information and the grayscale and spatial relationship of the image pixel, the grayscale information of the pixel at the current position is obtained, and the tactile perception roughness-air pressure film driving signal voltage mapping model is used, as shown in FIG. Figure 6 As shown, the amplitude, frequency, and phase parameters of the air pressure film driving signal are generated and sent to the information driving unit.

[0192] The implementation method of the signal output described in the present invention is as follows: the information driving unit will generate a corresponding driving signal according to the amplitude, frequency, and phase parameters of the air pressure film driving signal and the mechanical vibration driving signal processed and generated in the information processing unit, and act on the piezoelectric ceramic piece and the vibration motor respectively to produce a vibration cancellation phenomenon, and present the interactive content on the tactile interaction unit to achieve tactile feedback.

[0193] The tactile interaction unit of the present invention uses the air pressure film tactile reproduction technology and the mechanical vibration offset technology to provide a tactile feedback phenomenon after offsetting the external vibration interference, wherein:

[0194] (1) Air pressure film tactile reproduction technology:

[0195] When a high-frequency driving signal is applied to the piezoelectric ceramic sheet attached to the touch screen, the touch screen will vibrate violently. When the finger slides on the touch screen, the high-speed vibration will cause the air molecules between the finger and the screen to be unable to escape quickly, resulting in an air film, which will produce a squeezing force between the finger and the touch screen, thereby reducing the tangential friction between the finger and the touch screen. Therefore, the sliding friction of the finger can be changed by applying different driving signals to the piezoelectric ceramic sheet. Because the piezoelectric ceramic sheet works at the resonant frequency, the parameter that can be changed by the driving signal at this time specifically refers to the voltage of the driving signal.

[0196] (2) Mechanical vibration cancellation technology

[0197] When a low-frequency driving signal is applied to the vibration motor attached to the touch screen, the vibration motor will generate low-frequency vibration. The generated mechanical disturbance will propagate on the touch screen, and the interference of external vibration on the touch screen will be offset by the generated mechanical vibration wave. The vibration equation at this time is:

[0198] Υ v (t) = γ0cos(ωt+θ)

[0199] Among them, γ0 is the amplitude of the mechanical vibration wave, ω is the frequency of the mechanical vibration wave, and θ is the phase of the mechanical vibration wave. When the user interacts with the touch screen, the information acquisition unit will collect the external vibration information of the terminal in real time, so as to offset the interference of the external vibration on the touch screen by adjusting different parameters of the driving signal, thereby reducing the influence of the external vibration on the tactile reproduction effect.

[0200] The tactile reproduction and rendering method of the vehicle-mounted terminal under vibration interference described in the present invention establishes a tactile perception roughness-air pressure film driving signal voltage mapping model, and establishes an external vibration signal-mechanical vibration driving signal parameter mapping model:

[0201] (1) Tactile perception roughness-air pressure film driving signal voltage mapping model

[0202] In the dataset of feature image pixels and spatial relationships, the contrast feature A max The maximum value corresponds to the maximum tangential friction force f max , at this time the driving voltage V min =0, contrast feature A min The minimum corresponds to the minimum tangential friction force, at which time the driving voltage is the maximum value V max ,like Figure 8(a) , 8(b) As shown, map it proportionally:

[0203]

[0204]

[0205] Among them, f is the magnitude of the tangential friction force on the finger, A is the contrast feature size of the finger, and V is the air pressure film driving signal voltage at this time, that is, when the contrast feature is larger, the tangential friction force on the finger is larger, and the air pressure film driving signal voltage is smaller;

[0206] (2) External vibration signal-mechanical vibration driving signal parameter mapping model:

[0207] By collecting vibration time domain signals, performing mean analysis, variance analysis, and root mean square value analysis on the signals in the time domain, calculating their probability density functions, and analyzing the signals in the frequency domain, we can obtain the phase-frequency characteristics and amplitude-frequency characteristics of the signals as they change with frequency:

[0208] [1] Time domain analysis of vibration signals

[0209] <1> Time Domain Mean Analysis

[0210] The time domain mean represents the average value of the signal within one period, which describes the static component of the data.

[0211]

[0212] Among them, x(l) is the original sequence of vibration signal, is the average value of the original sequence, N is the number of sampling points, and l is the sequence number of each sampling point.

[0213] <2> Time Domain ANOVA

[0214] The time domain variance is the average of the sum of the squares of the differences between each number domain and the mean, reflecting the severity of the signal fluctuation around the mean.

[0215]

[0216] Among them, D x is the variance, x (l) is the original sequence of vibration signal, is the average value.

[0217] <3> Time Domain RMS Analysis

[0218] The time domain RMS value indicates the strength of the signal and is a reflection of the signal energy.

[0219]

[0220] Among them, X rms is the root mean square value, and x(l) is the original sequence of the vibration signal.

[0221] <4> Probability density function

[0222] The probability density function describes the possibility that the output value of a random variable is located at a certain value point, reflecting the change of signal amplitude.

[0223] A time domain signal x(t) with amplitude varying with time is collected. The probability that the value of x(t) is within the range of x and (x+Δx) is

[0224]

[0225] in, is the total time that x(t) falls within the range from x to (x+Δx), and T is the total observation time.

[0226] The fitting relationship is established through the above parameters:

[0227]

[0228] Among them, the max function is the function that takes the maximum value of the probability density function. Therefore, the distribution of the instantaneous value of the amplitude of the vibration signal can be obtained by obtaining the amplitude with the maximum probability of the fitting relationship probability.

[0229] [2] Frequency domain analysis of vibration signals

[0230] The Hanning window is used to truncate the vibration signal, the signal is processed, and the signal is transformed into DFT using the sampling frequency Ω and the number of sampling points N.

[0231]

[0232] In the formula, is the discrete frequency, k is the serial number of the discrete frequency point, and the DFT value X[k] frequency is periodic with a period of N.

[0233] Calculate the signal's unilateral power spectrum

[0234]

[0235] Where Γ is the sampling interval.

[0236] The fitting relationship is established through the above parameters:

[0237] w 频率 =w(G k )

[0238] Among them, the w function is to take the value of the prominent frequency component in the unilateral power spectrum of the signal. Therefore, according to the distribution of the energy of the vibration signal on the frequency component, the instantaneous value of the frequency of the vibration signal can be obtained.

[0239] According to the instantaneous value of amplitude X 幅值and the instantaneous value of frequency w 频率 External vibration signal function can be established

[0240] Y=X 幅值 cos(w 频率 t)

[0241] The mechanical vibration signal cancellation signal function is:

[0242] Y 抵消 =X 幅值 cos(w 频率 t+π)

[0243] The amplitude of the mechanical vibration driving signal function is consistent with that of the external vibration signal function, the frequency of the mechanical vibration driving signal function is consistent with that of the external vibration signal function, and the phases of the mechanical vibration driving signal function and the external vibration signal function are opposite. Vibrations with opposite phases will cause the vibrations to cancel each other out and play a role in shock absorption.

[0244] Finally, through the above method, when the finger interacts with the touch screen, different driving signals are provided to the device according to the real-time position of the finger interaction and the external vibration, thereby reducing the external vibration interference and providing tactile feedback.

[0245] The present invention will be further described below specifically:

[0246] With the advancement of science and technology, the high degree of integration of equipment has made touch screens that can provide touch control gradually become an important part of mobile phones, computer screens, car central control and other devices. This has led to the gradual replacement of physical buttons with virtual buttons, which has greatly increased the reliance on vision when operating buttons. However, driving a car is a task that relies heavily on vision. Although driving assistance and autonomous driving technologies are booming, drivers sometimes still need to interact with the car to complete corresponding driving and non-driving tasks. Fig.12 As shown, the present invention is further illustrated by performing tactile reproduction and rendering on a vehicle-mounted terminal under vibration interference.

[0247] Piezoelectric ceramic sheets are symmetrically attached to the two sides of the tactile interaction unit 1. When a high-frequency driving signal is applied to the piezoelectric ceramic sheets, the touch screen will vibrate violently. When a finger slides on the touch screen, the high-speed vibration will cause the air molecules between the finger and the screen to be unable to escape quickly, resulting in an air film, which will generate a squeezing force of the air film on the finger and the touch screen, thereby reducing the tangential friction between the finger and the touch screen. The vibration motor is attached to the four sides of the tactile processing unit 2. When a low-frequency driving signal is applied to the vibration motor, the vibration motor will generate low-frequency vibration. The generated mechanical disturbance will propagate on the touch screen, and the interference of external vibration on the touch screen will be offset by the generated mechanical vibration wave.

[0248] When the screen presents a digital image, the information processing unit 2 will first pre-process the digital image to obtain a data set of the grayscale and spatial relationship of the current image pixels to improve the subsequent information processing speed.

[0249] When the finger touches the tactile interaction unit 4, because the vehicle-mounted terminal is in a vibrating environment, in order to prevent accidental touch, the user's finger pressure threshold F0 is set to 2N, that is, when the user's finger pressure F N ≥F0, it is judged as a legal press, otherwise it is judged as an illegal press and no information is processed.

[0250] When it is determined that the press is legal, the information processing unit 2 will calculate the mechanical vibration and air pressure film driving signal parameters in real time through the external vibration signal-mechanical vibration driving signal parameter mapping model and the tactile perception roughness-air pressure film driving signal voltage mapping model, and transmit the parameters to the information driving unit 3 in real time to drive the piezoelectric ceramic plate and the vibration motor to generate tactile feedback.

[0251] When the finger slides on the touch screen that does not offset the external vibration and the touch screen that offsets the external vibration, the finger feels the same friction stimulation. At this time, the air pressure film threshold changes as follows Fig. 9 As shown in the figure, when the external vibration intensity increases, the air pressure film threshold on the touch screen that does not offset the external vibration increases significantly, while the air pressure film threshold on the touch screen that uses the external vibration offset technology increases slightly, and there is no significant change overall.

[0252] When the finger Fig.12 When the finger slides in the sliding area, the friction force on the finger is as follows Fig.11 As shown, at this time, the external vibration signal, the mechanical vibration cancellation signal and the vibration signal after cancellation are as follows Fig.10 As shown. When the finger slides over a place with large contrast features, the friction force on the finger is large, and the voltage of the air pressure film drive signal is small. When the finger slides over a place with small contrast features, the friction force on the finger is small, and the voltage of the air pressure film drive signal is large. At the same time, the vibration sensor on the information acquisition unit collects external vibration signals in real time. After being processed by the information processing unit, the driving unit drives the vibration motor to generate a vibration offset signal.

[0253] Through the above method, the tactile reproduction device based on the fusion of air pressure film and mechanical vibration realizes the tactile reproduction of the vehicle terminal under vibration interference under the rendering of the tactile reproduction rendering method. By real-time detection of finger position, finger pressure and external vibration, and by adjusting the driving signals of air pressure film and mechanical vibration respectively, tactile reproduction is realized under reduced external vibration interference, the realism of interaction is enhanced, the visual dependence of interaction is reduced, and the driving safety is improved to a certain extent.

Claims

1. A tactile reproduction rendering method for an in-vehicle terminal under vibration interference, using a tactile reproduction device that combines air compression and mechanical vibration. Features: The method includes image preprocessing, information acquisition, information processing and signal output, wherein: The image preprocessing is used to detect the texture of the digital image by Laws texture filtering in a statistical energy manner, thereby reflecting the distribution of a certain grayscale change on the image and reflecting the relationship between the pixel grayscale and the surrounding space; The information collection is used to collect external information and send the obtained information in the form of signals for information processing; The information processing is used to receive the signal of information collection, and according to the collected external vibration information, according to the external vibration signal-mechanical vibration drive signal parameter mapping model, the external vibration signal is processed, and according to the collected current finger position information and the image pixel grayscale and spatial relationship data set of the image preprocessing, the grayscale information of the current position image is obtained, and according to the tactile perception roughness-air pressure film drive signal voltage mapping model, the tactile perception roughness processing is performed to generate the amplitude, frequency, and phase parameters of the mechanical vibration and air pressure film drive signal for signal output; The signal output is used to receive information processing parameters and convert the parameters into corresponding control signals, which act on the piezoelectric ceramic sheet and the vibration motor respectively to produce vibration cancellation phenomenon, and present the interactive content on the tactile interaction unit to achieve tactile feedback.

2. According to the method for tactile reproduction and rendering of a vehicle-mounted terminal under vibration interference according to claim 1, It is characterized in that The implementation method of the image preprocessing method is as follows: (1) Texture analysis of digital images Select a one-bit convolution kernel of length 5: L5, E5, S5, W5, R5, and convolve it with a vertical one-dimensional kernel and a horizontal one-dimensional kernel to obtain 25 two-dimensional convolution kernels: L5L5 E5L5 S5L5 W5L5 R5L5 L5E5 E5E5 S5E5 W5E5 R5E5 L5S5 E5S5 S5S5 W5S5 R5S5 L5W5 E5W5 S5W5 W5W5 R5W5 L5R5 E5R5 S5R5 W5R5 R5R5 A two-dimensional coordinate system is established with the lower left corner of the screen display image as the origin, and the digital image is divided into different regions in the form of N×M. The two-dimensional convolution is applied to each different region to obtain 25 N×M grayscale images, where N is the number of horizontal axis divisions of the image in the two-dimensional coordinate system, and M is the number of vertical axis divisions of the image in the two-dimensional coordinate system; (2) Generate texture energy measurement TEM image The following nonlinear filter was applied to 25 N × M grayscale images to generate 25 TEM images; Where n and m are the positions of the current pixel, and i and j are the 15×15 square local neighborhoods around the current pixel; TEM images are represented by adding a "T" to the name of the original convolution kernel. (3) Normalized contrast feature All TEM images were pixel-by-pixel normalized using the L5L5T image to obtain the contrast A; (4) Combining similar features The features generated using the transposed convolution kernel are added together, with an additional "R" to indicate rotational invariance: E5L5TR=E5L5T+L5E5T S5L5TR=S5L5T+L5S5T W5L5TR=W5L5T+L5W5T R5L5TR=R5L5T+L5R5T S5E5TR=S5E5T+E5S5T W5E5TR=W5E5T+E5W5T R5E5TR=R5E5T+E5R5T W5S5TR=W5S5T+S5W5T R5S5TR=R5S5T+S5R5T R5W5TR=R5W5T+W5R5T E5E5TR=2×E5E5T S5S5TR=2×S5S5T W5W5TR=2×W5W5T R5R5TR=2×R5R5T The 14 feature images are stacked together to obtain a data set of the pixel and space relationship in each feature image. When the finger position information is processed, the grayscale information of the finger's current position image is obtained, so as to generate the amplitude, frequency and phase parameters of the air pressure film driving signal according to the tactile perception roughness-air pressure film driving signal voltage mapping model.

3. According to the method for tactile reproduction and rendering of a vehicle terminal under vibration interference according to claim 1, Features: The external information includes external vibration information, finger position information and finger pressure information; The finger position information refers to the two-dimensional coordinates (x, y) of the finger on the terminal.

4. According to claim 3, a tactile reproduction and rendering method of a vehicle terminal under vibration interference, It is characterized in that The implementation method of the information collection is as follows: a two-dimensional coordinate system is established with the lower left corner of the screen as the origin, and the real-time two-dimensional coordinates (x, y) of the interaction between the finger and the screen are tracked and measured through an infrared positioning device to obtain the finger position information, and the real-time finger pressure information on the screen is obtained through a pressure sensor fixed under the screen. At the same time, real-time interference information of the terminal by external vibration is obtained through a vibration sensor fixed on the terminal shell.

5. The tactile reproduction and rendering method of the vehicle-mounted terminal under vibration interference according to claim 1, It is characterized in that The information processing is implemented as follows: first, a data set of the grayscale and spatial relationship of the current image pixels is obtained to improve the processing speed when calculating the drive signal parameters; then, because the vehicle terminal is in a vibrating environment, the user's finger pressure threshold F is set to prevent accidental touches. 0 , that is, when the user's finger presses the pressure F N ≥F 0 , it is determined to be a legal press, otherwise it is determined to be an illegal press and no information is processed; when it is determined to be a legal press, the amplitude, frequency and phase parameters of the mechanical vibration drive signal are generated according to the collected external vibration information and the external vibration signal-mechanical vibration drive signal parameter mapping model; according to the data set of finger position information and image pixel grayscale and spatial relationship, the grayscale information of the pixel at the current position is obtained, and the amplitude, frequency and phase parameters of the air pressure film drive signal are generated according to the tactile perception roughness-air pressure film drive signal voltage mapping model, and the parameters are sent to the information drive unit.

6. The method for tactile reproduction and rendering of a vehicle-mounted terminal under vibration interference according to claim 5, Features: Establish a tactile perception roughness-air pressure film driving signal voltage mapping model, and establish an external vibration signal-mechanical vibration driving signal parameter mapping model: (1) Tactile perception roughness-air pressure film driving signal voltage mapping model In the dataset of feature image pixels and spatial relationships, the contrast feature A max The maximum value corresponds to the maximum tangential friction force f max , at this time the driving voltage V min =0, contrast feature A min The minimum corresponds to the minimum tangential friction force, at which time the driving voltage is the maximum value V max , and map it proportionally: Among them, f is the magnitude of the tangential friction force on the finger, A is the contrast feature size of the finger, and V is the air pressure film driving signal voltage at this time, that is, when the contrast feature is larger, the tangential friction force on the finger is larger, and the air pressure film driving signal voltage is smaller; (2) External vibration signal-mechanical vibration driving signal parameter mapping model: By collecting vibration time domain signals, performing mean analysis, variance analysis, and root mean square value analysis on the signals in the time domain, calculating their probability density functions, and analyzing the signals in the frequency domain, we can obtain the phase-frequency characteristics and amplitude-frequency characteristics of the signals as they change with frequency: [1] Time domain analysis of vibration signals <1> Time Domain Mean Analysis The time domain mean represents the average value of the signal within one period, which describes the static component of the data; Among them, x(l) is the original sequence of vibration signal, is the average value of the original sequence, N is the number of sampling points, and l is the sequence number of each sampling point; <2> Time Domain ANOVA The time domain variance is the average of the sum of the squares of the differences between each domain and the mean, reflecting the intensity of the signal fluctuation around the mean; Among them, D x is the variance, x (l) is the original sequence of vibration signal, is the average value; <3> Time Domain RMS Analysis The time domain RMS value indicates the strength of the signal and is a manifestation of the signal energy; Among them, X rms is the root mean square value, x(l) is the original sequence of the vibration signal; <4> Probability density function The probability density function describes the possibility that the output value of a random variable is located at a certain value point, reflecting the change of the signal amplitude; For a time domain signal x(t) whose amplitude varies with time, the probability that the value of x(t) is within the range of x and (x+Δx) is: in, is the total time that x(t) falls within the range from x to (x+Δx), and T is the total observation time; The fitting relationship is established through the above parameters: Among them, the max function is a function that takes the maximum value of the probability density function. Therefore, the distribution of the instantaneous value of the amplitude of the vibration signal can be obtained by obtaining the amplitude with the maximum possibility of the fitting relationship probability value; [2] Frequency domain analysis of vibration signals The Hanning window is used to truncate the vibration signal, and the signal is processed. The sampling frequency Ω and the number of sampling points N are used to perform DFT transformation on the signal: In the formula, is the discrete frequency, k is the serial number of the discrete frequency point, and the DFT value X[k] frequency is periodic, and the period is N; Calculate the unilateral power spectrum of the signal: Where, Γ is the sampling interval; The fitting relationship is established through the above parameters: w 频率 =w(G k ) Among them, the w function is to take the value of the prominent frequency component in the unilateral power spectrum of the signal, so according to the distribution of the energy of the vibration signal on the frequency component, the instantaneous value of the frequency of the vibration signal can be obtained; According to the instantaneous value of amplitude X 幅值 and the instantaneous value of frequency w 频率 External vibration signal function can be established: Y=X 幅值 cos(w 频率 t) The mechanical vibration signal cancellation signal function is: Y 抵消 =X 幅值 cos(w 频率 t+π) The amplitude of the mechanical vibration driving signal function is consistent with that of the external vibration signal function, the frequency of the mechanical vibration driving signal function is consistent with that of the external vibration signal function, and the phases of the mechanical vibration driving signal function and the external vibration signal function are opposite. Vibrations with opposite phases will cause the vibrations to cancel each other out and play a role in shock absorption.

7. The method for tactile reproduction and rendering of a vehicle-mounted terminal under vibration interference according to claim 1, It is characterized in that The control signal in the signal output includes an air pressure film driving signal and a mechanical vibration driving signal, which are used to control the vibration mode of the piezoelectric ceramic piece and the vibration motor to produce a tactile reproduction effect that offsets vibration interference.

8. The method for tactile reproduction and rendering of a vehicle-mounted terminal under vibration interference according to claim 7, It is characterized in that The implementation method of the signal output is as follows: the information driving unit will generate a corresponding driving signal according to the amplitude, frequency, and phase parameters of the air pressure film driving signal and the mechanical vibration driving signal processed and generated in the information processing unit, and act on the piezoelectric ceramic piece and the vibration motor respectively to produce a vibration cancellation phenomenon, and present the interactive content on the tactile interaction unit to achieve tactile feedback.

9. The method for tactile reproduction and rendering of a vehicle-mounted terminal under vibration interference according to claim 8, Features: The tactile interaction unit uses the air pressure film tactile reproduction technology and the mechanical vibration offset technology to provide a tactile feedback phenomenon after offsetting the external vibration interference, wherein: (1) Air pressure film tactile reproduction technology: When a high-frequency driving signal is applied to the piezoelectric ceramic sheet attached to the touch screen, the touch screen will vibrate violently. When a finger slides on the touch screen, the high-speed vibration will cause the air molecules between the finger and the screen to be unable to escape quickly, resulting in an air film. This will generate a squeezing force on the finger and the touch screen, thereby reducing the tangential friction between the finger and the touch screen. (2) Mechanical vibration cancellation technology When a low-frequency driving signal is applied to the vibration motor attached to the touch screen, the vibration motor will generate low-frequency vibration. The generated mechanical disturbance will propagate on the touch screen, and the interference of external vibration on the touch screen will be offset by the generated mechanical vibration wave. The vibration equation at this time is: Y v (t)=Y 0 cos(ωt+θ) Among them, 0 is the amplitude of the mechanical vibration wave, ω is the frequency of the mechanical vibration wave, and θ is the phase of the mechanical vibration wave. When the user interacts with the touch screen, the information acquisition unit will collect the external vibration information of the terminal in real time, and then offset the interference of the external vibration on the touch screen by adjusting different parameters of the driving signal, thereby reducing the influence of the external vibration on the tactile reproduction effect.

10. The method for tactile reproduction and rendering of a vehicle-mounted terminal under vibration interference according to claim 1, It is characterized in that The structure of the tactile reproduction device based on the fusion of air pressure film and mechanical vibration includes: (1) Information collection unit: including a finger positioning device for collecting finger position information, a pressure sensor for collecting finger pressure, and a vibration sensor for collecting vibration information. The finger positioning device uses infrared positioning, which can realize the positioning function and track the finger position information in real time; the pressure sensor can measure the pressure of the finger on the screen in real time, so as to determine whether a tactile reproduction effect is provided; the vibration sensor is responsible for collecting external vibration information on the terminal, including vibration frequency and amplitude, and sending it to the information processing unit for information processing; (2) Information processing unit: The vehicle-mounted terminal is used as an information processing device. It preprocesses the currently displayed digital image through an image preprocessing method to obtain a data set of the grayscale and spatial relationship of the current image pixels, and then receives the finger pressure information, finger position information and external vibration information collected by the information acquisition unit. After determining the finger pressure information, it generates the amplitude, frequency and phase parameters of the mechanical vibration drive signal according to the external vibration signal-mechanical vibration drive signal parameter mapping model. According to the finger position information and the data set of the grayscale and spatial relationship of the image pixels, it obtains the grayscale information of the pixel at the current position. According to the tactile perception roughness-air pressure film drive signal voltage mapping model, it generates the amplitude, frequency and phase parameters of the air pressure film drive signal, and sends the parameters to the drive unit; (3) Information driving unit: including a power supply, a signal amplifier, and a signal generator, used to generate a corresponding driving signal according to the driving signal parameters processed by the information processing unit, and transmit it to the tactile interaction unit to generate a corresponding tactile feeling; (4) Tactile interaction unit: includes a touch screen, a piezoelectric ceramic sheet and a vibration motor, which is used to receive the driving signal sent by the information driving unit, drive the piezoelectric ceramic sheet and the vibration motor to generate vibration cancellation, and present the interactive content on the touch screen to achieve tactile feedback.