Haptic rendering system and haptic rendering method

By detecting the touch position and pressure in the tactile reproduction system, determining the touch mode and outputting the corresponding driving voltage, a variety of tactile effects are achieved, and the problem that the existing system cannot detect the mode is solved, improving the authenticity of human-computer interaction and users Experience.

WO2024182972A9PCT designated stage expired Publication Date: 2024-11-21BOE TECHNOLOGY GROUP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2023/079844
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-03-06
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

The existing haptic reproduction system cannot detect and judge different modes of touch operation, resulting in the inability to change the haptic effect, lacking the authenticity of human-computer interaction and user immersion experience.

Method used

Design a tactile reproduction system, including a display panel, a touch structure, a piezoelectric actuator and a control module, determine the touch mode by detecting the touch position and pressure, and outputting different driving voltages according to the mode, so that the display panel can be different vibration, thereby achieving a variety of tactile effects.

Benefits of technology

It improves the authenticity of human-computer interaction and the immersive experience of users, and can provide richer tactile feedback according to different touch modes, enhancing the interactive experience between the device and the user.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023079844_21112024_PF_FP_ABST
    Figure CN2023079844_21112024_PF_FP_ABST
Patent Text Reader

Abstract

A haptic rendering system and a haptic rendering method. The haptic rendering system comprises a display panel, a touch structure, a piezoelectric actuator, and a control module; the touch structure is located on the display panel and is configured to detect a touch position of a touch operation; the piezoelectric actuator is located on the display panel; the control module is communicationally connected to the display panel, the touch structure, and the piezoelectric actuator, separately; and the control module is configured to extract the touch position detected by the touch structure, determine a touch mode of the touch operation according to a change in the touch position, and output different driving voltages to the piezoelectric actuator according to the touch mode, so that the piezoelectric actuator drives the display panel to generate different vibrations, thereby achieving different haptic rendering effects. Therefore, the haptic rendering system can improve the realism of human-computer interaction and the immersive experience of a user.
Need to check novelty before this filing date? Find Prior Art

Description

Tactile reproduction system and tactile reproduction method Technical Field

[0001] Embodiments of the present disclosure relate to a tactile reproduction system and a tactile reproduction method. Background Art

[0002] Humans perceive the world primarily through vision, hearing, and touch. Compared to vision and hearing, the flow of tactile information is bidirectional, providing a two-way channel for interaction between humans and devices, which is more in line with the concept of human-computer interaction.

[0003] Haptic reproduction technology combines tactile reproduction devices with computer simulation to enable users to feel, manipulate, and touch objects in a virtual environment. With tactile reproduction technology, electronic device manufacturers can create unique and personalized tactile feedback for specific interactive experiences on their devices, providing consumers with more valuable and realistic unique experiences.

[0004] Summary of the Invention

[0005] In order to detect and determine different modes of touch operations to change the tactile effect and improve the authenticity of human-computer interaction, at least one embodiment of the present disclosure provides a tactile reproduction system, which includes: a display panel; a touch structure located on the display panel and configured to detect the touch position of the touch operation; a piezoelectric actuator located on the display panel; and a control module, which is communicatively connected to the display panel, the touch structure and the piezoelectric actuator respectively, wherein the control module is configured to extract the touch position detected by the touch structure, determine the touch mode of the touch operation according to the change of the touch position, and output different driving voltages to the piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects.

[0006] For example, the tactile reproduction system provided by an embodiment of the present disclosure also includes: a first pressure sensor, located on the display panel, and configured to detect the touch pressure of the touch operation; the control module is also communicatively connected to the first pressure sensor, and configured to extract the touch pressure detected by the first pressure sensor, and determine the touch mode of the touch operation based on the change in the touch position and the touch pressure.

[0007] For example, in the tactile reproduction system provided in an embodiment of the present disclosure, the control module is further configured to compare the touch pressure with a preset pressure threshold to determine whether the touch operation is a false touch.

[0008] For example, in the tactile reproduction system provided in an embodiment of the present disclosure, the control module detects that the trajectory formed by the touch position is a straight line and the change of the touch pressure is within a first preset range, and then determines that the touch operation is in sliding mode.

[0009] For example, in the tactile reproduction system provided in one embodiment of the present disclosure, the control module is configured to: divide a first sliding area on the display panel; store the first touch position detected by the touch structure in the first sliding area as the initial position; then extract the touch position detected by the touch structure in the first sliding area every first time period and use it as a subsequent position; calculate the horizontal offset between the subsequent position and the initial position, and when the horizontal offset is less than a preset horizontal offset, determine that the touch operation is in sliding mode.

[0010] For example, in the tactile reproduction system provided in one embodiment of the present disclosure, the control module is configured to: divide a first sliding area on the display panel; divide the first sliding area into a plurality of sub-sliding areas arranged in sequence; store the first touch position detected by the touch structure in the first sliding area as the initial position; then extract the touch position detected by the touch structure in the first sliding area every second time period as the subsequent position; determine whether the sub-sliding area where the subsequent position is located is located in the sub-sliding area adjacent to the sub-sliding area where the initial position is located, and if so, determine that the touch operation is in sliding mode.

[0011] For example, in the tactile reproduction system provided by an embodiment of the present disclosure, the control module is configured to determine that the sliding mode is terminated after detecting that the touch position is outside the first sliding area.

[0012] For example, in the tactile reproduction system provided in one embodiment of the present disclosure, the control module outputs a high-frequency driving voltage to the piezoelectric actuator according to the sliding mode, so that the display panel generates high-frequency vibration, thereby achieving the tactile effect of the corresponding sliding bar, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

[0013] For example, in the tactile reproduction system provided in an embodiment of the present disclosure, the control module detects that the trajectory formed by the touch position is an arc and the change of the touch pressure is within a second preset range, then determines that the touch operation is a rotation mode.

[0014] For example, in a tactile reproduction system provided in an embodiment of the present disclosure, the control module is configured to: divide a second sliding area on the display panel, where the second sliding area is circular and includes a center; store the first touch position detected by the touch structure in the second sliding area as an initial position; calculate the initial angle between the line between the initial position and the center of the circle and a reference straight line; then extract the touch position detected by the touch structure in the first sliding area every third time period as a subsequent position; calculate the subsequent angle between the line between the subsequent position and the center of the circle and the reference straight line; calculate the angle difference between the subsequent angle and the initial angle, and when the angle difference is greater than a preset angle value, determine that the touch operation is a rotation mode.

[0015] For example, in the tactile reproduction system provided by an embodiment of the present disclosure, the control module is configured to determine that the rotation mode is terminated after detecting that the touch position is outside the second sliding area.

[0016] For example, in the tactile reproduction system provided in one embodiment of the present disclosure, the control module outputs a high-frequency driving voltage to the piezoelectric actuator according to the sliding mode, so that the display panel generates high-frequency vibration, thereby achieving the tactile effect of the corresponding knob, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

[0017] For example, in the tactile reproduction system provided in one embodiment of the present disclosure, the control module is configured to: divide a pressing area on the display panel; extract the touch position detected by the touch structure, and determine whether the touch position is located in the pressing area; if the touch position is located in the pressing area and the touch pressure is greater than a preset pressure value, then determine that the touch operation is a strong pressing mode.

[0018] For example, in the tactile reproduction system provided in one embodiment of the present disclosure, the preset pressure value includes multiple pressure levels of different sizes, and the control module is configured to determine the level of the strong press mode by determining the relationship between the touch pressure and the multiple pressure levels.

[0019] For example, in the tactile reproduction system provided in one embodiment of the present disclosure, the control module outputs a low-frequency driving voltage to the piezoelectric actuator according to the sliding mode, so that the display panel generates low-frequency vibrations, thereby achieving the tactile effect of the corresponding button, and the frequency of the low-frequency driving voltage ranges from 200Hz to 300Hz.

[0020] For example, the tactile reproduction system provided by an embodiment of the present disclosure also includes: a second pressure sensor, located on the display panel, and configured to detect the vibration of the display panel and convert the vibration into a vibration signal; and a closed-loop feedback controller, communicatively connected to the second pressure sensor and the control module respectively, the closed-loop feedback controller being configured to extract the vibration signal detected by the second pressure sensor, compare the vibration signal with a reference signal, and feed back the comparison result to the control module to change the driving voltage, where the reference signal is a standard vibration signal of the tactile reproduction effect corresponding to the touch mode.

[0021] For example, in the tactile reproduction system provided in an embodiment of the present disclosure, the control module is further configured to output a display signal to the display panel according to the touch mode to enhance the visual reproduction effect.

[0022] For example, the tactile reproduction system provided in an embodiment of the present disclosure further includes: a speaker, the control module is communicatively connected to the speaker, and the control module is further configured to output an audio signal to the speaker according to the touch mode to enhance the auditory reproduction effect.

[0023] For example, in a tactile reproduction system provided in one embodiment of the present disclosure, the control module includes: a data processor; and a field programmable logic gate array, wherein the data processor is configured to extract the touch position detected by the touch structure, determine the touch mode according to the touch position, and output a control signal to the field programmable logic gate array according to the touch mode; the field programmable logic gate array calls a pre-stored driving voltage library corresponding to different tactile reproduction effects according to the control signal, and outputs the driving voltage to the piezoelectric actuator to achieve different tactile reproduction effects.

[0024] For example, the tactile reproduction system provided by one embodiment of the present disclosure also includes: an analog-to-digital converter, including an input end and an output end; an operational amplifier, including an input end and an output end; and a digital-to-analog converter, including an input end and an output end, the input end of the analog-to-digital converter is communicatively connected to the touch structure, and the output end of the analog-to-digital converter is communicatively connected to the data processor; the input end of the digital-to-analog converter is connected to the field programmable logic gate array, the output end of the digital-to-analog converter is connected to the input end of the operational amplifier, and the output end of the operational amplifier is connected to the piezoelectric actuator.

[0025] At least one embodiment of the present disclosure also provides a tactile reproduction method, which includes: detecting the touch position of a touch operation through a touch structure on a display panel; judging the touch mode of the touch operation through changes in the touch position; and outputting different driving voltages to a piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects.

[0026] For example, the tactile reproduction method provided by an embodiment of the present disclosure also includes: detecting the touch pressure of the touch operation through a first pressure sensor on the display panel, and judging the touch mode of the touch operation through the change of the touch position, including: judging the touch mode according to the change of the touch position and the touch pressure.

[0027] For example, in the tactile reproduction method provided in one embodiment of the present disclosure, judging the touch mode based on the change of the touch position and the touch pressure includes: detecting that the trajectory formed by the touch position is a straight line and the change of the touch pressure is within a first preset range, then judging that the touch operation is a sliding mode.

[0028] For example, in the tactile reproduction method provided in an embodiment of the present disclosure, judging the touch mode according to the change of the touch position and the touch pressure includes: dividing a first sliding area on the display panel; storing the first touch position detected by the touch structure in the first sliding area as the initial position; extracting the touch position detected by the touch structure in the first sliding area every first time period as the subsequent position; and calculating the horizontal offset between the subsequent position and the initial position, and when the horizontal offset is less than the preset horizontal offset, judging that the touch operation is a sliding mode.

[0029] For example, in the tactile reproduction method provided in an embodiment of the present disclosure, judging the touch mode according to the change of the touch position and the touch pressure includes: dividing a first sliding area on the display panel; dividing the first sliding area into a plurality of sub-sliding areas arranged in sequence; storing the first touch position detected by the touch structure in the first sliding area as the initial position; then extracting the touch position detected by the touch structure in the first sliding area every second time period as the subsequent position; judging whether the sub-sliding area where the subsequent position is located is located in the sub-sliding area adjacent to the sub-sliding area where the initial position is located, and if so, judging that the touch operation is in a sliding mode.

[0030] For example, the tactile reproduction method provided by an embodiment of the present disclosure further includes: after detecting that the touch position is outside the first sliding area, determining that the sliding mode is terminated.

[0031] For example, in the tactile reproduction method provided in one embodiment of the present disclosure, different driving voltages are output to the piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects, including: outputting a high-frequency driving voltage to the piezoelectric actuator according to the sliding mode to cause the display panel to generate high-frequency vibrations, thereby achieving the tactile effect of the corresponding sliding bar, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

[0032] For example, in the tactile reproduction method provided in one embodiment of the present disclosure, judging the touch mode according to the change of the touch position and the touch pressure includes: detecting that the trajectory formed by the touch position is an arc, and the change of the touch pressure is within a second preset range, then judging that the touch operation is a rotation mode.

[0033] For example, in the tactile reproduction method provided in an embodiment of the present disclosure, judging the touch mode according to the change of the touch position and the touch pressure includes: dividing a second sliding area on the display panel, the second sliding area is circular and includes a center of the circle; storing the first touch position detected by the touch structure in the second sliding area as the initial position; calculating the initial angle between the line between the initial position and the center of the circle and the reference straight line; extracting the touch position detected by the touch structure in the first sliding area every third time period as the subsequent position; calculating the subsequent angle between the line between the subsequent position and the center of the circle and the reference straight line; calculating the angle difference between the subsequent angle and the initial angle, and when the angle difference is greater than a preset angle value, judging that the touch operation is a rotation mode.

[0034] For example, the tactile reproduction method provided by an embodiment of the present disclosure further includes: after detecting that the touch position is outside the second sliding area, determining that the rotation mode is terminated.

[0035] For example, in the tactile reproduction method provided in one embodiment of the present disclosure, different driving voltages are output to the piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects, including: outputting a high-frequency driving voltage to the piezoelectric actuator according to the sliding mode to cause the display panel to generate high-frequency vibrations, thereby achieving the tactile effect of the corresponding knob, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

[0036] For example, in the tactile reproduction method provided in one embodiment of the present disclosure, judging the touch mode according to the change of the touch position and the touch pressure includes: dividing a pressing area on the display panel; extracting the touch position detected by the touch structure, and judging whether the touch position is located in the pressing area; if the touch position is located in the pressing area and the touch pressure is greater than a preset pressure value, judging that the touch operation is a strong pressing mode.

[0037] For example, in the tactile reproduction method provided in an embodiment of the present disclosure, the preset pressure value includes multiple pressure levels of different sizes, and the control module is configured to determine the level of the strong press mode by determining the size relationship between the touch pressure and the multiple pressure levels.

[0038] For example, in the tactile reproduction method provided in one embodiment of the present disclosure, different driving voltages are output to the piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects, including: outputting a low-frequency driving voltage to the piezoelectric actuator according to the sliding mode to cause the display panel to generate low-frequency vibrations, thereby achieving the tactile effect of the corresponding button, and the frequency of the low-frequency driving voltage ranges from 200Hz to 300Hz.

[0039] For example, the tactile reproduction method provided in an embodiment of the present disclosure further includes: comparing the touch pressure with a preset pressure threshold to determine whether the touch operation is a false touch.

[0040] For example, the tactile reproduction method provided in one embodiment of the present disclosure also includes: detecting the vibration of the display panel through a second pressure sensor located on the display panel and converting it into a vibration signal; and comparing the vibration signal with a reference signal, and changing the driving voltage according to the comparison result, wherein the reference signal is a standard vibration signal of the tactile reproduction effect corresponding to the touch mode.

[0041] For example, the tactile reproduction method provided in an embodiment of the present disclosure further includes: outputting a display signal to the display panel according to the touch mode to enhance the visual reproduction effect.

[0042] For example, the tactile reproduction method provided by an embodiment of the present disclosure further includes: outputting an audio signal to a speaker according to the touch control mode to enhance the auditory reproduction effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly introduced below. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, rather than limiting the present disclosure.

[0044] FIG1 is a schematic diagram of a tactile reproduction system provided by an embodiment of the present disclosure;

[0045] FIG2 is a flow chart of a tactile reproduction system for determining a touch mode according to an embodiment of the present disclosure;

[0046] FIG3 is a flowchart of another tactile reproduction system for determining a touch mode according to an embodiment of the present disclosure;

[0047] FIG4 is a flowchart of another tactile reproduction system for determining a touch mode according to an embodiment of the present disclosure;

[0048] FIG5 is a flowchart of another tactile reproduction system for determining a touch mode according to an embodiment of the present disclosure;

[0049] FIG6 is a schematic diagram of another tactile reproduction system provided by an embodiment of the present disclosure; and

[0050] FIG7 is a flow chart of a tactile reproduction method provided in accordance with an embodiment of the present disclosure. DETAILED DESCRIPTION

[0051] To make the purpose, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0052] Unless otherwise defined, the technical or scientific terms used in this disclosure should have the usual meanings understood by persons of ordinary skill in the field to which this disclosure belongs. The words "first", "second" and similar terms used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Words such as "include" or "comprise" mean that the elements or objects preceding the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

[0053] Unless otherwise defined, the features such as “parallel”, “perpendicular” and “identical” used in the embodiments of the present disclosure include situations such as “parallel”, “perpendicular” and “identical” in a strict sense, as well as situations such as “approximately parallel”, “approximately perpendicular” and “approximately identical” that contain a certain error. For example, the above-mentioned “approximately” may mean that the difference between the compared objects is 10% of the average value of the compared objects, or within 5%. When the number of a component or element is not specifically indicated below in the embodiments of the present disclosure, it means that the component or element may be one or more, or may be understood as at least one. “At least one” refers to one or more, and “plurality” refers to at least two.

[0054] Conventional tactile reproduction systems can only generate a single vibration tactile feedback effect based on touch, and cannot detect and determine different touch operation patterns to modify the tactile effect. On the other hand, to enhance the realism of human-computer interaction, it is necessary to reproduce different tactile effects based on the user's different touch modes, such as the boundary and pressing feeling of buttons, and the sliding feeling of knobs and progress bars.

[0055] To this end, the embodiments of the present disclosure provide a tactile reproduction system and a tactile reproduction method. The tactile reproduction system includes a display panel, a touch structure, a piezoelectric actuator, and a control module; the touch structure is located on the display panel and is configured to detect the touch position of the touch operation; the piezoelectric actuator is located on the display panel and is configured to generate vibrations; the control module is respectively connected to the display panel, the touch structure, and the piezoelectric actuator in communication; the control module is configured to extract the touch position detected by the touch structure, determine the touch mode of the touch operation according to the change of the touch position, and output different driving voltages to the piezoelectric actuator according to the touch mode so that the piezoelectric actuator drives the display panel to generate different vibrations to achieve different tactile reproduction effects. Therefore, the tactile reproduction system extracts the touch position detected by the touch structure, determines the touch mode of the touch operation according to the change of the touch position, and then achieves different tactile reproduction effects according to the touch mode, thereby improving the authenticity of human-computer interaction and the user's immersive experience.

[0056] The tactile reproduction system and tactile reproduction method provided by the embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0057] An embodiment of the present disclosure provides a tactile reproduction system. FIG1 is a schematic diagram of a tactile reproduction system provided by an embodiment of the present disclosure.

[0058] As shown in FIG1 , the tactile reproduction system 100 includes a display panel 110, a touch structure 120, a piezoelectric actuator 130, and a control module 140; the touch structure 120 is located on the display panel 110 and is configured to detect the touch position of the touch operation; the piezoelectric actuator 130 is located on the display panel 110; the control module 140 is respectively connected to the display panel 110, the touch structure 120, and the piezoelectric actuator 130; the control module 140 is configured to extract the touch position detected by the touch structure 120, determine the touch mode of the touch operation according to the change of the touch position, and output different driving voltages to the piezoelectric actuator 130 according to the touch mode, so that the display panel 110 generates different vibrations, thereby achieving different tactile reproduction effects. It should be noted that the above-mentioned communication connection includes communication connection through a wired connection (such as a wire, an optical fiber, etc.) and communication connection through a wireless connection (such as WiFi, a mobile network).

[0059] In the tactile reproduction system provided in the embodiment of the present disclosure, the touch position detected by the touch structure is extracted, the touch mode of the touch operation is determined according to the change of the touch position, and then different tactile reproduction effects are achieved according to the touch mode, thereby improving the authenticity of human-computer interaction and the user's immersive experience.

[0060] In some examples, as shown in FIG1 , the tactile reproduction system 100 further includes a first pressure sensor 150 located on the display panel 110; the first pressure sensor 150 is configured to detect the touch pressure of a touch operation. The control module 140 is further communicatively coupled to the first pressure sensor 150 and configured to extract the touch pressure detected by the first pressure sensor 150 and determine the touch mode of the touch operation based on changes in the touch position and the touch pressure. As a result, the tactile reproduction method can identify a wider variety of touch modes based on touch pressure, thereby providing a richer tactile reproduction effect.

[0061] In some examples, as shown in FIG1 , the control module 130 is further configured to compare the touch pressure with a preset pressure threshold to determine whether the touch operation is a false touch. Thus, the visual reproduction system can determine whether the user's touch operation is a valid touch and avoid false touches.

[0062] For example, a first preset pressure threshold may be set; when the touch pressure is less than the first preset pressure threshold, the touch operation is determined to be a false touch; when the touch pressure is greater than the first preset pressure threshold, the touch operation is determined to be a valid touch.

[0063] For example, a first preset pressure threshold and a second preset pressure threshold can also be set, and the second preset pressure threshold is greater than the first preset pressure threshold; when the touch pressure is less than the first preset pressure threshold, the touch operation is judged to be a false touch; when the touch pressure is greater than the second preset pressure threshold, the touch operation is judged to be a false touch; when the touch pressure is between the first preset pressure threshold and the second preset pressure threshold, the touch operation is judged to be a valid touch.

[0064] In some examples, the touch structure may be a capacitive touch structure. Of course, the embodiments of the present disclosure include but are not limited to this, and the touch structure may also include other types of touch structures.

[0065] In some examples, as shown in Figure 1, the haptic reproduction system 100 further includes a second pressure sensor 160 and a closed-loop feedback controller 170. The second pressure sensor 160 is located on the display panel 110 and is configured to detect vibrations of the display panel 110 and convert the vibrations into a vibration signal, such as a voltage signal. The closed-loop feedback controller 170 is communicatively connected to the second pressure sensor 160 and the control module 140. The closed-loop feedback controller 170 is configured to extract the vibration signal detected by the second pressure sensor 160, compare the vibration signal with a reference signal, and feed the comparison result back to the control module 140 to adjust the driving voltage. For example, the reference signal can be a standard vibration signal for the haptic reproduction effect corresponding to the touch mode. Thus, the haptic reproduction system can form a closed-loop feedback loop through the second pressure sensor and the closed-loop feedback controller, precisely controlling the haptic reproduction effect and thus improving the user experience. It should be noted that the pressing force of a touch operation can cause the resonant frequency of the vibration to shift, so the haptic reproduction effect can be corrected through closed-loop feedback.

[0066] For example, the control module may store driving voltages and corresponding standard vibration signals corresponding to different tactile reproduction effects; when the control module determines a tactile reproduction effect and outputs a driving voltage corresponding to the tactile reproduction effect to the piezoelectric actuator, due to various reasons, the vibration actually generated by the display panel differs from the standard vibration corresponding to the tactile reproduction effect. By comparing the above-mentioned vibration signal with the reference signal, the tactile reproduction system may correct the driving voltage so that the actually generated vibration is the same as the standard vibration corresponding to the tactile reproduction effect.

[0067] In some examples, as shown in FIG1 , the control module 140 is further configured to output a display signal to the display panel 110 according to the touch mode to enhance the visual reproduction effect. Thus, the tactile reproduction system can further enhance the user experience.

[0068] In some examples, as shown in FIG1 , the tactile reproduction system 100 further includes a speaker 180 , and the control module 140 is communicatively connected to the speaker 180 . The control module 140 is configured to output an audio signal to the speaker 180 according to the touch mode to enhance the auditory reproduction effect. Thus, the tactile reproduction system can further enhance the user experience.

[0069] In some examples, the first pressure sensor 150 and the second pressure sensor 160 may be the same pressure sensor. For example, the pressure sensor may be used in a time-sharing manner such that the pressure sensor functions as the first pressure sensor 150 to detect touch pressure during a first time period and as the second pressure sensor 160 to detect vibration of the display panel 110 during a second time period.

[0070] In some examples, as shown in FIG1 , the control module 140 includes a data processor 142 and a field programmable gate array (FPGA) 144. The data processor 142 is configured to extract the touch position detected by the touch structure 120 and the touch pressure detected by the first pressure sensor 150, determine the touch mode based on the touch position and touch pressure, and output a control signal to the FPGA 144 based on the touch mode. The FPGA 144 then calls a pre-stored drive voltage library corresponding to different tactile reproduction effects based on the control signal and outputs the drive voltage to the piezoelectric actuator 130 to achieve different tactile reproduction effects. Thus, the tactile reproduction system can improve processing efficiency and reduce latency through the combination of the data processor and the FPGA, thereby enhancing user experience.

[0071] For example, the aforementioned driving voltage library may include driving voltages corresponding to different tactile reproduction effects and corresponding standard vibration signals.

[0072] For example, the data processor 142 may be a central processing unit (CPU). Of course, the embodiments of the present disclosure include but are not limited to this.

[0073] In some examples, as shown in Figure 1, the tactile reproduction system 100 also includes an analog-to-digital converter (ADC) 191, an operational amplifier 192 and a digital-to-analog converter (DAC) 193; the analog-to-digital converter 191 includes an input end and an output end, the operational amplifier 192 includes an input end and an output end, and the digital-to-analog converter 193 includes an input end and an output end; the input end of the analog-to-digital converter 191 is communicatively connected to the touch structure 120, and the output end of the analog-to-digital converter 191 is communicatively connected to the data processor 142; the input end of the digital-to-analog converter 193 is connected to the field programmable logic gate array 144, the output end of the digital-to-analog converter 193 is connected to the input end of the operational amplifier 192, and the output end of the operational amplifier 192 is connected to the piezoelectric actuator 130.

[0074] Figure 2 is a flow chart of a tactile reproduction system for determining touch mode, provided by one embodiment of the present disclosure. As shown in Figure 2, first, a data processor extracts the touch position detected by the touch structure and the touch pressure detected by the first pressure sensor. The touch position can be the coordinates of a pixel on the display panel. Therefore, the coordinates (x, y) of the pressed position on the display panel can be derived from the touch position detected by the touch structure, and the pressure value F can be derived from the touch pressure detected by the first pressure sensor. The data processor then determines whether the user's touch is valid by comparing the pressure value F with a preset pressure threshold.

[0075] For example, the above-mentioned preset pressure threshold may include a first preset pressure threshold; when the pressure value F of the touch pressure is less than the first preset pressure threshold, the touch operation is judged to be a false touch; when the touch pressure is greater than the first preset pressure threshold, the touch operation is judged to be a valid touch.

[0076] For example, the above-mentioned preset pressure threshold may include a first preset pressure threshold and a second preset pressure threshold, and the second preset pressure threshold is greater than the first preset pressure threshold; when the pressure value F of the touch pressure is less than the first preset pressure threshold, the touch operation is judged to be a false touch; when the pressure value F of the touch pressure is greater than the second preset pressure threshold, the touch operation is judged to be a false touch; when the touch pressure is between the first preset pressure threshold and the second preset pressure threshold, the touch operation is judged to be a valid touch.

[0077] After determining that the touch operation is a valid touch, the data processor can store the coordinates (x0, y0) and pressure value F0 of the pressed position at this time, that is, store the touch data, and at the same time output a control signal corresponding to the normal press mode (i.e., touch mode) to the FPGA, causing it to output a low-frequency excitation signal (i.e., a low-frequency drive voltage) to cause the piezoelectric actuator (e.g., piezoelectric ceramic) to vibrate the display panel, thereby achieving a tactile reproduction effect corresponding to the press operation. It should be noted that the above-mentioned coordinates can be the coordinates of the pressed position on the display panel. For example, the frequency of the above-mentioned low-frequency drive voltage is less than 1kHz.

[0078] Then, the data processor continues to receive the touch position and touch pressure detected by the touch structure and the first pressure sensor, and determines whether the touch operation is interrupted; if the touch operation is interrupted, the FPGA stops outputting the excitation signal and clears the stored touch data, waiting for the next valid touch; if the touch operation is not interrupted, it simultaneously detects and determines whether the pressing position (x, y) and the pressure value F have changed, and determines the touch mode of the touch operation based on the changes of the two, and then outputs different control signals according to different touch modes, controlling the FPGA to output excitation signals of different frequencies and amplitudes to the piezoelectric actuator, so that the piezoelectric actuator drives the display panel to produce different vibrations, thereby producing different tactile reproduction effects.

[0079] In some examples, when the touch position forms a straight line, the control module may determine that the current touch operation is in a sliding mode; when the touch position forms an arc, the control module may determine that the current operation is in a rotating mode; and when the touch position remains unchanged and the touch pressure increases, the control module may determine that the touch operation is in a strong press mode. The following describes in detail how the control module determines touch modes using several examples.

[0080] In some examples, the control module determines that the touch operation is in sliding mode when it detects that the trajectory formed by the touch position is a straight line and the change in touch pressure is within a first preset range. It should be noted that the first preset range can be set according to actual circumstances. In addition, the first preset range refers to the change in touch pressure, not the absolute pressure value.

[0081] Figure 3 is a flowchart illustrating another tactile reproduction system for determining touch mode, provided by an embodiment of the present disclosure. As shown in Figure 3, when a user continuously slides and touches, the touch structure and first pressure sensor at the user's touch location continuously output the touch location and touch pressure of the valid touch. The data processor extracts these touch locations and touch pressures in real time and compares them with initially stored data. When the touch location trajectory is detected to be a straight line or a substantially straight line, and the change in touch pressure is within a first preset range, the data processor determines that the touch operation is in sliding mode.

[0082] Then, based on the above judgment result, the data processor can output a control signal corresponding to the sliding mode to the FPGA. Based on the control signal, the FPGA calls a high-frequency excitation signal (i.e., a high-frequency driving voltage) corresponding to the sliding mode from a pre-stored driving voltage library and outputs the high-frequency excitation signal to the piezoelectric actuator, causing the piezoelectric actuator to vibrate the display panel, thereby allowing the user to experience a tactile effect corresponding to the sliding bar. It should be noted that the above-mentioned sliding mode can correspond to a sliding mode such as a progress bar.

[0083] In some examples, the control module is configured to: divide a first sliding area on the display panel, which may be a bar or rectangle; store the first touch position detected by the touch structure in the first sliding area as the initial position (x, y); then extract the touch position detected by the touch structure in the first sliding area every first time period and use it as a subsequent position (x1, y1); calculate the horizontal offset between the subsequent position (x1, y1) and the initial position (x, y); and determine that the touch operation is in sliding mode when the horizontal offset is less than a preset horizontal offset. It should be noted that the above-mentioned sliding mode can correspond to a sliding mode such as a progress bar.

[0084] Subsequently, the control module calls the high-frequency driving voltage corresponding to the sliding mode in the pre-stored driving voltage library according to the determined sliding mode, and outputs the high-frequency driving voltage to the piezoelectric actuator so that the piezoelectric actuator drives the display panel to generate high-frequency vibration, thereby allowing the user to experience the tactile effect corresponding to the sliding bar. For example, the frequency of the above-mentioned high-frequency driving voltage ranges from 20kHz to 30kHz. If the control module detects that the touch position is outside the first sliding area, it determines that the sliding mode is terminated, and can stop outputting the above-mentioned high-frequency driving voltage to the piezoelectric actuator, and switch to outputting the low-frequency driving voltage corresponding to the normal pressing mode.

[0085] For example, the high-frequency driving voltage has a value range of 80 V to 160 V, such as 100 V. Of course, the embodiments of the present disclosure include but are not limited to this. The value range of the driving voltage is determined according to the operating voltage of the piezoelectric actuator. Therefore, when different piezoelectric actuators are used, the value range of the driving voltage can be changed according to actual conditions.

[0086] Thus, the control module can determine whether the trajectory of the touch operation is a straight line by determining the horizontal offset between the subsequent position and the initial position, thereby determining whether the touch operation is in sliding mode. In addition, by dividing the display panel into a first sliding area, the control module can perform the above-mentioned determination process only in the first sliding area, thereby reducing false positives while providing the corresponding function.

[0087] It should be noted that the aforementioned initial position and subsequent position can be represented by coordinates on the display panel, and thus the horizontal offset can be calculated using a function to calculate the coordinates of the initial position and subsequent position. In addition, the aforementioned preset horizontal offset can be set according to the circumstances, for example, it can be less than the width of the first sliding area.

[0088] In some examples, the control module is further configured to: divide a first sliding area on the display panel; divide the first sliding area into a plurality of sequentially arranged sub-sliding areas, such as A1, A2, A3, and A4; store the first touch position detected by the touch structure in the first sliding area as the initial position; then extract the touch position detected by the touch structure in the first sliding area every second time period and use it as the subsequent position; determine whether the sub-sliding area where the subsequent position is located is located in a sub-sliding area adjacent to the sub-sliding area where the initial position is located, and if so, determine that the touch operation is in sliding mode. For example, if the initial position is A2 and the subsequent position is A1 or A3, then the current touch operation can be determined to be in sliding mode.

[0089] Subsequently, the control module calls the high-frequency driving voltage corresponding to the sliding mode in the pre-stored driving voltage library according to the determined sliding mode, and outputs the high-frequency driving voltage to the piezoelectric actuator so that the piezoelectric actuator drives the display panel to generate high-frequency vibration, thereby allowing the user to experience the tactile effect corresponding to the sliding bar. For example, the frequency of the above-mentioned high-frequency driving voltage ranges from 20kHz to 30kHz. If the control module detects that the touch position is outside the first sliding area, it determines that the sliding mode is terminated, and can stop outputting the above-mentioned high-frequency driving voltage to the piezoelectric actuator, and switch to outputting the low-frequency driving voltage corresponding to the normal pressing mode.

[0090] For example, the high-frequency driving voltage has a value range of 80 V to 160 V, such as 100 V. Of course, the embodiments of the present disclosure include but are not limited to this. The value range of the driving voltage is determined according to the operating voltage of the piezoelectric actuator. Therefore, when different piezoelectric actuators are used, the value range of the driving voltage can be changed according to actual conditions.

[0091] Thus, the control module can determine whether the touch operation is in sliding mode by determining in which sub-sliding area the subsequent position and the initial position are located within the first sliding area. In addition, by dividing the first sliding area on the display panel, the control module can perform the above-mentioned determination process only in the first sliding area, thereby reducing false positives while providing the corresponding function.

[0092] In some examples, the control module determines that the touch operation is in a rotation mode when it detects that the trajectory formed by the touch position is an arc and the change in the touch pressure is within a second preset range. For example, the second preset range and the first preset range may be the same. Of course, embodiments of the present disclosure include but are not limited to this, and the second preset range and the first preset range may also be different.

[0093] FIG4 is a flowchart of another tactile reproduction system for determining touch mode according to an embodiment of the present disclosure. As shown in FIG4 , when a user rotates and slides, the touch structure and the first pressure sensor at the user's touch position continuously output the touch position and touch pressure of the effective touch. The data processor extracts the above touch position and touch pressure in real time and compares them with the initial stored data. When it is detected that the trajectory formed by the touch position is an arc (the arc in the embodiment of the present disclosure may include a circle) and the change in touch pressure is within a second preset range, the data processor determines that the touch operation is in a rotation mode.

[0094] Then, based on the above judgment result, the data processor can output a control signal corresponding to the rotation mode to the FPGA. Based on this control signal, the FPGA calls the drive voltage corresponding to the rotation mode from the pre-stored drive voltage library and outputs this drive voltage to the piezoelectric actuator, causing the piezoelectric actuator to vibrate the display panel, thereby providing the user with a corresponding tactile effect. It should be noted that the rotation mode can correspond to a touch mode such as a rotating button.

[0095] In some examples, the control module is configured to: divide a second sliding area on the display panel, the second sliding area being circular and including a center; store the first touch position detected by the touch structure in the second sliding area as the initial position (x, y); calculate the initial angle w between the line connecting the initial position and the center of the circle and the reference line; then extract the touch position detected by the touch structure in the first sliding area every third time period as the subsequent position (x1, y1); calculate the subsequent angle w1 between the line connecting the subsequent position and the center of the circle and the reference line; calculate the angle difference between the subsequent angle w1 and the initial angle w, and when the angle difference is greater than a preset angle value, determine that the touch operation is in a rotation mode. It should be noted that the preset angle value can be set according to actual conditions, for example, it can be 30 degrees, 15 degrees, 45 degrees, etc.

[0096] Subsequently, the control module calls the high-frequency driving voltage corresponding to the rotation mode in the pre-stored driving voltage library according to the determined rotation mode, and outputs the high-frequency driving voltage to the piezoelectric actuator so that the piezoelectric actuator drives the display panel to generate high-frequency vibration, thereby allowing the user to produce a tactile effect corresponding to the knob. For example, the frequency of the above-mentioned high-frequency driving voltage ranges from 20kHz to 30kHz. If the control module detects that the touch position is outside the second sliding area, it is determined that the rotation mode is terminated, and the output of the above-mentioned high-frequency driving voltage to the piezoelectric actuator can be stopped, and the low-frequency driving voltage corresponding to the normal pressing mode can be output instead.

[0097] For example, the high-frequency driving voltage has a value range of 80 V to 160 V, such as 100 V. Of course, the embodiments of the present disclosure include but are not limited to this. The value range of the driving voltage is determined according to the operating voltage of the piezoelectric actuator. Therefore, when different piezoelectric actuators are used, the value range of the driving voltage can be changed according to actual conditions.

[0098] Thus, the control module can determine whether the touch operation is in sliding mode by calculating the difference between the subsequent angle w1 between the line connecting the subsequent position and the center of the circle and the reference line and the initial angle w. Furthermore, by demarcating a second sliding area on the display panel, the control module can perform the above determination process only in the second sliding area, thereby reducing false positives while providing the corresponding functionality.

[0099] FIG5 is a flowchart of another tactile reproduction system for determining touch mode provided by an embodiment of the present disclosure. As shown in FIG5 , when a user presses a touch with force, the touch structure and the first pressure sensor at the user's touch position continuously output the touch position and touch pressure of the effective touch. The data processor extracts the above-mentioned touch position and touch pressure in real time and compares them with the initial stored data. When it is detected that the touch position remains unchanged and the touch pressure exceeds the first preset pressure, the data processor determines that the touch operation is in a strong press mode. It should be noted that the above-mentioned first preset pressure is greater than the above-mentioned first preset pressure threshold.

[0100] In addition, the data processor may also determine whether the difference between the touch pressure and the first preset pressure is within different threshold ranges to determine the level of the strong press mode.

[0101] For example, the above-mentioned different threshold ranges may include, from small to large, a first threshold range A, a second threshold range B and a third threshold range C; when the difference between the touch pressure and the first preset pressure is in the first threshold range A, it can be determined that the strong press mode is in the strong press mode of gear A; when the difference between the touch pressure and the first preset pressure is in the second threshold range B, it can be determined that the strong press mode is in the strong press mode of gear B; when the difference between the touch pressure and the first preset pressure is in the third threshold range C, it can be determined that the strong press mode is in the strong press mode of gear C.

[0102] The data processor then outputs a control signal corresponding to the force press mode to the FPGA. Based on this control signal, the FPGA calls a pre-stored drive voltage library corresponding to the force press mode and outputs this drive voltage to the piezoelectric actuator, causing the piezoelectric actuator to vibrate the display panel, thereby creating a corresponding tactile effect for the user. It should be noted that the force press mode described above can also correspond to touch modes such as a long press in a game.

[0103] In some examples, a press area can be defined to determine whether the touch operation is in a strong press mode. In this case, the control module is configured to: define a press area on the display panel; extract the touch position detected by the touch structure and determine whether the touch position is within the press area; if the touch position is within the press area and the touch pressure is greater than a preset pressure value, then the touch operation is determined to be in a strong press mode.

[0104] Subsequently, the control module calls a pre-stored low-frequency drive voltage corresponding to the rotation mode in accordance with the determined strong press mode and outputs this low-frequency drive voltage to the piezoelectric actuator, causing the display panel to generate low-frequency vibrations, thereby achieving the tactile effect of the corresponding button. For example, the frequency of the low-frequency drive voltage mentioned above ranges from 200Hz to 300Hz. If the control module detects that the touch position is outside the press area, it determines that the strong press mode has terminated.

[0105] In some examples, the preset pressure value includes multiple pressure levels of different sizes, and the control module is configured to determine the level of the strong press mode by determining a relationship between the touch pressure and the multiple pressure levels.

[0106] It is worth noting that in addition to the above-mentioned application scenarios, the embodiments of the present disclosure can also judge different operation modes according to the speed of touch position change and other changes, and produce different tactile reproduction effects accordingly, thereby further enhancing the authenticity of human-computer interaction and the user's immersive experience.

[0107] Figure 6 is a schematic diagram of another tactile reproduction system provided in accordance with an embodiment of the present disclosure. As shown in Figure 6, unlike the tactile reproduction system shown in Figure 1, this tactile reproduction system can be based on an Android development board. The control module 140, which can be an Android development board, extracts the touch position detected by the touch structure, determines the touch mode of the touch operation based on changes in the touch position, and outputs different drive voltages to the piezoelectric actuator based on the touch mode to achieve different tactile reproduction effects.

[0108] For example, as shown in FIG6 , the control module 140 may control the audio module to encode and output an audio signal, and then amplify the audio signal and load it into the piezoelectric actuator to generate a tactile reproduction effect.

[0109] An embodiment of the present disclosure further provides a tactile reproduction method. FIG7 is a flow chart of a tactile reproduction method provided by an embodiment of the present disclosure. As shown in FIG7 , the tactile reproduction method includes the following steps S101 to S103.

[0110] Step S101: detecting a touch position of a touch operation through a touch structure on a display panel.

[0111] Step S102: determining the touch mode of the touch operation according to the change of the touch position.

[0112] Step S103: outputting different driving voltages to the piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects.

[0113] In the tactile reproduction method provided in the embodiment of the present disclosure, the touch position detected by the touch structure is extracted, the touch mode of the touch operation is determined according to the change of the touch position, and then different tactile reproduction effects are achieved according to the touch mode, thereby improving the authenticity of human-computer interaction and the user's immersive experience.

[0114] In some examples, the tactile reproduction method further includes: detecting the touch pressure of the touch operation using a first pressure sensor on the display panel; and determining the touch mode of the touch operation based on the change in touch position includes determining the touch mode based on the change in touch position and the touch pressure. Thus, the tactile reproduction method can identify a wider variety of touch modes based on touch pressure, thereby providing a richer tactile reproduction effect.

[0115] In some examples, the tactile reproduction method further includes comparing the touch pressure with a preset pressure threshold to determine whether the touch operation is a false touch. Thus, the visual reproduction system can determine whether the user's touch operation is a valid touch and avoid false touches.

[0116] In some examples, the touch structure may be a capacitive touch structure. Of course, the embodiments of the present disclosure include but are not limited to this, and the touch structure may also include other types of touch structures.

[0117] In some examples, the tactile reproduction method further includes: detecting the vibration of the display panel through a second pressure sensor located on the display panel and converting it into a vibration signal; and comparing the vibration signal with a reference signal, and changing the driving voltage according to the comparison result. For example, the above-mentioned reference signal is a standard vibration signal of the tactile reproduction effect corresponding to the touch mode. Thus, the tactile reproduction system can form a closed-loop feedback through the second pressure sensor and the closed-loop feedback controller to accurately control the tactile reproduction effect, thereby improving the user experience. It should be noted that the pressing force of the touch operation will cause the resonant frequency point of the vibration to shift, so the tactile reproduction effect can be corrected through closed-loop feedback.

[0118] In some examples, the tactile reproduction method further includes: outputting a display signal to a display panel according to the touch mode to enhance the visual reproduction effect. Thus, the tactile reproduction system can further enhance the user experience.

[0119] In some examples, the tactile reproduction method further includes: outputting an audio signal to a speaker according to the touch mode to enhance the auditory reproduction effect. Thus, the tactile reproduction system can further enhance the user experience.

[0120] In some examples, in the aforementioned tactile reproduction method, outputting different driving voltages to the piezoelectric actuator to generate different vibrations based on the touch mode includes: generating a control signal based on the touch mode by a data processor and outputting the control signal to a field programmable gate array; and the field programmable gate array, based on the control signal, calling a pre-stored driving voltage library corresponding to different tactile reproduction effects and outputting the driving voltage to the piezoelectric actuator to achieve the different tactile reproduction effects. Thus, the tactile reproduction system can improve processing efficiency and reduce latency through the combination of the data processor and the field programmable gate array, thereby enhancing the user experience.

[0121] For example, the data processor may be a central processing unit (CPU). Of course, the embodiments of the present disclosure include but are not limited to this.

[0122] In some examples, in the aforementioned tactile reproduction method, outputting different driving voltages to the piezoelectric actuator to generate different vibrations based on the touch mode includes: generating a control signal based on the touch mode by a data processor and outputting the control signal to a field programmable gate array; and the field programmable gate array, based on the control signal, calling a pre-stored driving voltage library corresponding to different tactile reproduction effects and outputting the driving voltage to the piezoelectric actuator to achieve the different tactile reproduction effects. Thus, by pre-storing the driving voltage library, the tactile reproduction method can improve operational efficiency and reduce latency, thereby enhancing the user experience.

[0123] In some examples, the tactile reproduction method also includes: converting an analog signal output by the touch structure into a digital signal through an analog-to-digital converter; converting a driving voltage connected to the output of a field programmable logic gate array into an analog signal through a digital-to-analog converter; and amplifying the analog signal through an operational amplifier.

[0124] In some examples, the tactile reproduction method can determine the touch mode by changes in touch position and touch pressure. The following describes the determination process in detail through several examples. It should be noted that the touch modes in the embodiments of the present disclosure are all based on valid touch.

[0125] In some examples, if the touch position is detected to form a straight line and the touch pressure change is within a first preset range, the touch operation is determined to be in sliding mode. It should be noted that the first preset range can be set according to actual conditions.

[0126] For example, when a user continuously slides and touches, the touch structure and the first pressure sensor at the user's touch location continuously output the touch location and touch pressure of the valid touch. The data processor extracts the touch location and touch pressure in real time and compares them with the initially stored data. If it is detected that the trajectory formed by the touch location is a straight line or a substantially straight line, and the change in touch pressure is within a first preset range, the data processor determines that the touch operation is in sliding mode.

[0127] Then, based on the above judgment result, the data processor can output a control signal corresponding to the sliding mode to the FPGA. Based on the control signal, the FPGA calls a high-frequency excitation signal (i.e., a high-frequency driving voltage) corresponding to the sliding mode from a pre-stored driving voltage library and outputs the high-frequency excitation signal to the piezoelectric actuator, causing the piezoelectric actuator to vibrate the display panel, thereby allowing the user to experience a tactile effect corresponding to the sliding bar. It should be noted that the above-mentioned sliding mode can correspond to a sliding mode such as a progress bar.

[0128] In some examples, determining a touch mode based on changes in touch position and touch pressure includes: dividing a first sliding area on the display panel, which may be a bar or rectangle; storing the first touch position detected by the touch structure in the first sliding area as the initial position (x, y); then extracting the touch position detected by the touch structure in the first sliding area every first time period as a subsequent position (x1, y1); calculating a horizontal offset between the subsequent position (x1, y1) and the initial position (x, y); and determining that the touch operation is in sliding mode when the horizontal offset is less than a preset horizontal offset. It should be noted that the above-mentioned sliding mode can correspond to a sliding mode such as a progress bar.

[0129] In some examples, outputting different drive voltages to the piezoelectric actuator based on the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects, includes: calling a high-frequency drive voltage corresponding to the sliding mode from a pre-stored drive voltage library based on the determined sliding mode, and outputting the high-frequency drive voltage to the piezoelectric actuator so that the piezoelectric actuator drives the display panel to generate high-frequency vibrations, thereby allowing the user to experience the tactile effect corresponding to the sliding bar. For example, the frequency of the high-frequency drive voltage ranges from 20kHz to 30kHz.

[0130] If the touch position is detected to be outside the first sliding area, the sliding mode is determined to be terminated, and the high-frequency driving voltage output to the piezoelectric actuator is stopped, and the low-frequency driving voltage corresponding to the normal pressing mode is output instead.

[0131] For example, the high-frequency driving voltage has a value range of 80 V to 160 V, such as 100 V. Of course, the embodiments of the present disclosure include but are not limited to this. The value range of the driving voltage is determined according to the operating voltage of the piezoelectric actuator. Therefore, when different piezoelectric actuators are used, the value range of the driving voltage can be changed according to actual conditions.

[0132] Thus, the tactile reproduction method can determine whether the trajectory of the touch operation is a straight line by determining the horizontal offset between the subsequent position and the initial position, thereby determining whether the touch operation is in a sliding mode. In addition, by dividing the display panel into a first sliding area, the tactile reproduction method can perform the above-mentioned determination process only in the first sliding area, thereby reducing false positives while providing the corresponding function.

[0133] It should be noted that the aforementioned initial position and subsequent position can be represented by coordinates on the display panel, and thus the horizontal offset can be calculated using a function to calculate the coordinates of the initial position and subsequent position. In addition, the aforementioned preset horizontal offset can be set according to the circumstances, for example, it can be less than the width of the first sliding area.

[0134] In some examples, determining a touch mode based on changes in touch position and touch pressure includes: dividing a first sliding area on the display panel; dividing the first sliding area into a plurality of sequentially arranged sub-sliding areas, such as A1, A2, A3, and A4; storing the first touch position detected by the touch structure in the first sliding area as the initial position; then extracting the touch position detected by the touch structure in the first sliding area every second time period as the subsequent position; determining whether the sub-sliding area where the subsequent position is located is located in a sub-sliding area adjacent to the sub-sliding area where the initial position is located, and if so, determining that the touch operation is in sliding mode. For example, if the initial position is at A2 and the subsequent position is at A1 or A3, then the current touch operation can be determined to be in sliding mode.

[0135] In some examples, outputting different drive voltages to the piezoelectric actuator based on the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects, includes: calling a high-frequency drive voltage corresponding to the sliding mode from a pre-stored drive voltage library based on the determined sliding mode, and outputting the high-frequency drive voltage to the piezoelectric actuator so that the piezoelectric actuator drives the display panel to generate high-frequency vibrations, thereby allowing the user to experience the tactile effect corresponding to the sliding bar. For example, the frequency of the high-frequency drive voltage ranges from 20kHz to 30kHz.

[0136] If the touch position is detected to be outside the first sliding area, the sliding mode is determined to be terminated, and the high-frequency driving voltage output to the piezoelectric actuator is stopped, and the low-frequency driving voltage corresponding to the normal pressing mode is output instead.

[0137] For example, the high-frequency driving voltage has a value range of 80 V to 160 V, such as 100 V. Of course, the embodiments of the present disclosure include but are not limited to this. The value range of the driving voltage is determined according to the operating voltage of the piezoelectric actuator. Therefore, when different piezoelectric actuators are used, the value range of the driving voltage can be changed according to actual conditions.

[0138] Thus, the tactile reproduction method can determine whether the touch operation is in sliding mode by determining in which sub-sliding area the subsequent position and the initial position are located within the first sliding area. In addition, by dividing the first sliding area on the display panel, the tactile reproduction method can also perform the above-mentioned determination process only in the first sliding area, thereby reducing false positives while providing the corresponding function.

[0139] In some examples, determining the touch mode based on the change in touch position and touch pressure includes: if the trajectory formed by the touch position is detected to be an arc and the change in touch pressure is within a second preset range, then determining that the touch operation is in a rotation mode. For example, the second preset range and the first preset range may be the same. Of course, embodiments of the present disclosure include but are not limited to this, and the second preset range and the first preset range may also be different.

[0140] For example, when a user rotates and slides, the touch structure and the first pressure sensor at the user's touch position continuously output the touch position and touch pressure of the effective touch. The data processor extracts the above touch position and touch pressure in real time and compares them with the initially stored data. When it is detected that the trajectory formed by the touch position is an arc (the arc in the embodiment of the present disclosure may include a circle) and the change in touch pressure is within a second preset range, the data processor determines that the touch operation is in the rotation mode.

[0141] Then, based on the above judgment result, the data processor can output a control signal corresponding to the rotation mode to the FPGA. Based on this control signal, the FPGA calls the drive voltage corresponding to the rotation mode from the pre-stored drive voltage library and outputs this drive voltage to the piezoelectric actuator, causing the piezoelectric actuator to vibrate the display panel, thereby providing the user with a corresponding tactile effect. It should be noted that the rotation mode can correspond to a touch mode such as a rotating button.

[0142] In some examples, determining a touch mode based on a change in touch position and touch pressure includes: dividing a second sliding area on the display panel, the second sliding area being circular and including a center; storing the first touch position detected by the touch structure in the second sliding area as an initial position (x, y); calculating an initial angle w between a line connecting the initial position and the center of the circle and a reference line; then extracting the touch position detected by the touch structure in the first sliding area every third time period as a subsequent position (x1, y1); calculating a subsequent angle w1 between a line connecting the subsequent position and the center of the circle and the reference line; calculating an angle difference between the subsequent angle w1 and the initial angle w, and determining that the touch operation is in a rotation mode when the angle difference is greater than a preset angle value. It should be noted that the preset angle value can be set according to actual conditions, for example, 30 degrees, 15 degrees, 45 degrees, etc.

[0143] In some examples, different driving voltages are output to the piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects, including: calling the high-frequency driving voltage corresponding to the rotation mode in the pre-stored driving voltage library according to the determined rotation mode, and outputting the high-frequency driving voltage to the piezoelectric actuator so that the piezoelectric actuator drives the display panel to generate high-frequency vibrations, so that the user can generate a tactile effect corresponding to the knob. For example, the frequency range of the above-mentioned high-frequency driving voltage is 20kHz to 30kHz. If the control module detects that the touch position is outside the second sliding area, it is determined that the rotation mode is terminated, and the output of the above-mentioned high-frequency driving voltage to the piezoelectric actuator can be stopped, and the low-frequency driving voltage corresponding to the normal pressing mode can be output instead.

[0144] For example, the high-frequency driving voltage has a value range of 80 V to 160 V, such as 100 V. Of course, the embodiments of the present disclosure include but are not limited to this. The value range of the driving voltage is determined according to the operating voltage of the piezoelectric actuator. Therefore, when different piezoelectric actuators are used, the value range of the driving voltage can be changed according to actual conditions.

[0145] Thus, the tactile reproduction method can determine whether the touch operation is in sliding mode by calculating the difference between the subsequent angle w1 between the line connecting the subsequent position and the center of the circle and the reference line and the initial angle w. Furthermore, by demarcating a second sliding area on the display panel, the tactile reproduction method can perform the aforementioned determination process only within the second sliding area, thereby reducing false positives while still providing the corresponding functionality.

[0146] In some examples, determining the touch mode based on changes in touch position and touch pressure includes: dividing a pressing area on the display panel; extracting the touch position detected by the touch structure, and determining whether the touch position is located in the pressing area; if the touch position is located in the pressing area and the touch pressure is greater than a preset pressure value, determining that the touch operation is a strong pressing mode.

[0147] In some examples, outputting different driving voltages to the piezoelectric actuator according to the touch mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects, includes: calling a low-frequency driving voltage corresponding to a rotation mode in a pre-stored driving voltage library according to a determined strong press mode, and outputting the low-frequency driving voltage to the piezoelectric actuator to cause the display panel to generate low-frequency vibrations, thereby achieving the tactile effect of the corresponding button. For example, the frequency of the above-mentioned low-frequency driving voltage ranges from 200Hz to 300Hz. If it is detected that the touch position is outside the pressing area, it is determined that the strong press mode is terminated.

[0148] In some examples, the preset pressure value includes multiple pressure levels of different sizes, and the control module is configured to determine the level of the strong press mode by determining a relationship between the touch pressure and the multiple pressure levels.

[0149] It is worth noting that in addition to the above-mentioned application scenarios, the embodiments of the present disclosure can also judge different operation modes according to the speed of touch position change and other changes, and produce different tactile reproduction effects accordingly, thereby further enhancing the authenticity of human-computer interaction and the user's immersive experience.

[0150] One embodiment of the present disclosure further provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer program performs the steps of the above-mentioned tactile reproduction method. The storage medium may include ROM, RAM, a magnetic disk, or an optical disk. The storage medium may also include non-volatile memory or non-transitory memory.

[0151] There are a few points to note:

[0152] (1) The drawings of the embodiments of the present disclosure only relate to the structures related to the embodiments of the present disclosure, and other structures may refer to conventional designs.

[0153] (2) Unless there is any conflict, the features of the same embodiment and different embodiments of the present disclosure may be combined with each other.

[0154] The above are merely specific embodiments of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any modifications or substitutions that can be readily conceived by a person skilled in the art within the technical scope disclosed herein should be included within the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A tactile reproduction system, comprising: Display panel; A touch structure, located on the display panel and configured to detect a touch position of a touch operation; A piezoelectric actuator, located on the display panel; as well as a control module, which is respectively connected to the display panel, the touch control structure and the piezoelectric actuator for communication, Among them, the control module is configured to extract the touch position detected by the touch structure, determine the touch mode of the touch operation according to the change of the touch position, and output different driving voltages to the piezoelectric actuator according to the touch mode to drive the display panel to produce different vibrations, thereby achieving different tactile reproduction effects.

2. The tactile reproduction system according to claim 1, further comprising: a first pressure sensor, located on the display panel and configured to detect the touch pressure of the touch operation, The control module is also connected to the first pressure sensor for communication, and is configured to extract the touch pressure detected by the first pressure sensor, and determine the touch mode of the touch operation according to the change of the touch position and the touch pressure.

3. The tactile reproduction system according to claim 2, wherein: The control module is further configured to compare the touch pressure with a preset pressure threshold to determine whether the touch operation is a false touch.

4. The tactile reproduction system according to claim 2, wherein: The control module determines that the touch operation is in a sliding mode when it detects that the track formed by the touch position is a straight line and the change of the touch pressure is within a first preset range.

5. The tactile reproduction system according to any one of claims 1 to 4, wherein: The control module is configured to: divide a first sliding area on the display panel; store the first touch position detected by the touch structure and located in the first sliding area as an initial position; Then, the touch position detected by the touch structure in the first sliding area is extracted every first time period and used as a subsequent position; the horizontal offset between the subsequent position and the initial position is calculated, and when the horizontal offset is less than a preset horizontal offset, the touch operation is determined to be a sliding mode.

6. The tactile reproduction system according to any one of claims 1 to 4, wherein: The control module is configured to: divide a first sliding area on the display panel; divide the first sliding area into a plurality of sub-sliding areas arranged in sequence; store the first touch position detected by the touch structure in the first sliding area as an initial position; then extract the touch position detected by the touch structure in the first sliding area every second time period as a subsequent position; determine whether the sub-sliding area where the subsequent position is located is located in the sub-sliding area adjacent to the sub-sliding area where the initial position is located, and if so, determine that the touch operation is in sliding mode.

7. The tactile reproduction system according to claim 5 or 6, wherein: The control module is configured to determine that the sliding mode is terminated after detecting that the touch position is outside the first sliding area.

8. The tactile reproduction system according to any one of claims 4 to 7, wherein: The control module outputs a high-frequency driving voltage to the piezoelectric actuator according to the sliding mode, so that the display panel generates high-frequency vibration, thereby achieving a tactile effect corresponding to the sliding bar, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

9. The tactile reproduction system according to claim 2, wherein: The control module detects that the track formed by the touch position is an arc, and the change of the touch pressure is within a second preset range, and then determines that the touch operation is a rotation mode.

10. The tactile reproduction system according to claim 1 or 9, wherein: The control module is configured to: divide a second sliding area on the display panel, where the second sliding area is circular and includes a center; store the first touch position detected by the touch structure in the second sliding area as an initial position; calculate an initial angle between a line between the initial position and the center of the circle and a reference straight line; then extract the touch position detected by the touch structure in the first sliding area every third time period as a subsequent position; calculate a subsequent angle between a line between the subsequent position and the center of the circle and a reference straight line; calculate an angle difference between the subsequent angle and the initial angle, and when the angle difference is greater than a preset angle value, determine that the touch operation is a rotation mode.

11. The tactile reproduction system according to claim 10, wherein: The control module is configured to determine that the rotation mode is terminated after detecting that the touch position is outside the second sliding area.

12. The tactile reproduction system according to any one of claims 9 to 11, wherein: The control module outputs a high-frequency driving voltage to the piezoelectric actuator according to the sliding mode, so that the display panel generates high-frequency vibration, thereby achieving a tactile effect of the corresponding knob, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

13. The tactile reproduction system according to claim 2, wherein: The control module is configured to: divide a pressing area on the display panel; extract the touch position detected by the touch structure, and determine whether the touch position is located in the pressing area; if the touch position is located in the pressing area and the touch pressure is greater than a preset pressure value, determine that the touch operation is a strong pressing mode.

14. The tactile reproduction system according to claim 13, wherein: The preset pressure value includes a plurality of pressure levels of different magnitudes, and the control module is configured to determine the level of the strong pressing mode by determining a magnitude relationship between the touch pressure and the plurality of pressure levels.

15. The tactile reproduction system according to claim 13 or 14, wherein: The control module outputs a low-frequency driving voltage to the piezoelectric actuator according to the sliding mode, so that the display panel generates low-frequency vibration, thereby achieving a tactile effect of the corresponding button, and the frequency of the low-frequency driving voltage ranges from 200 Hz to 300 Hz.

16. The tactile reproduction system according to any one of claims 1 to 15, further comprising: a second pressure sensor, located on the display panel and configured to detect the vibration of the display panel and convert the vibration into a vibration signal; as well as A closed-loop feedback controller is connected to the second pressure sensor and the control module for communication. Among them, the closed-loop feedback controller is configured to extract the vibration signal detected by the second pressure sensor, compare the vibration signal with a reference signal, and feed back the comparison result to the control module to change the driving voltage, and the reference signal is a standard vibration signal of the tactile reproduction effect corresponding to the touch mode.

17. The tactile reproduction system according to any one of claims 1 to 15, wherein: The control module is further configured to output a display signal to the display panel according to the touch mode to enhance visual reproduction effects.

18. The tactile reproduction system according to any one of claims 1 to 15, further comprising: speaker, The control module is communicatively connected to the speaker, and the control module is further configured to output an audio signal to the speaker according to the touch mode to increase the auditory reproduction effect.

19. The tactile reproduction system according to any one of claims 1 to 15, wherein: The control module comprises: Data processors; and Field Programmable Gate Array, Wherein, the data processor is configured to extract the touch position detected by the touch structure, determine the touch mode according to the touch position, and output a control signal to the field programmable logic gate array according to the touch mode; The field programmable logic gate array calls the driving voltage corresponding to different tactile reproduction effects in the pre-stored driving voltage library according to the control signal, and outputs the driving voltage to the piezoelectric actuator to achieve different tactile reproduction effects.

20. The tactile reproduction system of claim 19, further comprising: An analog-to-digital converter, including an input terminal and an output terminal; An operational amplifier, including an input terminal and an output terminal; as well as A digital-to-analog converter, comprising an input terminal and an output terminal, Wherein, the input end of the analog-to-digital converter is communicatively connected to the touch control structure, and the output end of the analog-to-digital converter is communicatively connected to the data processor; The input end of the digital-to-analog converter is connected to the field programmable logic gate array, the output end of the digital-to-analog converter is connected to the input end of the operational amplifier, and the output end of the operational amplifier is connected to the piezoelectric actuator.

21. A method for reproducing tactile sensation, comprising: Detecting a touch position of a touch operation through a touch structure on the display panel; Determining a touch mode of the touch operation according to a change in the touch position; Different driving voltages are output to the piezoelectric actuator according to the touch control mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects.

22. The tactile reproduction method according to claim 21, further comprising: The touch pressure of the touch operation is detected by a first pressure sensor on the display panel. Wherein, judging the touch mode of the touch operation by the change of the touch position includes: judging the touch mode according to the change of the touch position and the touch pressure.

23. The tactile reproduction method according to claim 22, wherein: Determining the touch mode according to the change of the touch position and the touch pressure includes: If it is detected that the track formed by the touch position is a straight line and the change of the touch pressure is within a first preset range, it is determined that the touch operation is in a sliding mode.

24. The tactile reproduction method according to claim 23, wherein: Determining the touch mode according to the change of the touch position and the touch pressure includes: dividing a first sliding area on the display panel; storing the first touch position detected by the touch structure and located in the first sliding area as an initial position; Extracting the touch position located in the first sliding area detected by the touch structure every first time period and using it as a subsequent position; and A horizontal offset between the subsequent position and the initial position is calculated, and when the horizontal offset is less than a preset horizontal offset, it is determined that the touch operation is a sliding mode.

25. The tactile reproduction method according to claim 23, wherein: Determining the touch mode according to the change of the touch position and the touch pressure includes: dividing a first sliding area on the display panel; Dividing the first sliding area into a plurality of sub-sliding areas arranged in sequence; storing the first touch position detected by the touch structure and located in the first sliding area as an initial position; Then, the touch position detected by the touch structure and located in the first sliding area is extracted every second time period and used as a subsequent position; It is determined whether the sub-sliding area where the subsequent position is located is located in the sub-sliding area adjacent to the sub-sliding area where the initial position is located, and if so, it is determined that the touch operation is in a sliding mode.

26. The tactile reproduction method according to claim 24 or 25, further comprising: After detecting that the touch position is outside the first sliding area, it is determined that the sliding mode is terminated.

27. The tactile reproduction method according to any one of claims 23 to 26, wherein: Outputting different driving voltages to the piezoelectric actuator according to the touch control mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects includes: According to the sliding mode, a high-frequency driving voltage is output to the piezoelectric actuator to make the display panel generate high-frequency vibration, thereby achieving a tactile effect corresponding to the sliding bar, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

28. The tactile reproduction method according to claim 22, wherein: Determining the touch mode according to the change of the touch position and the touch pressure includes: If it is detected that the track formed by the touch position is an arc and the change of the touch pressure is within a second preset range, it is determined that the touch operation is a rotation mode.

29. The tactile reproduction method according to claim 28, wherein: Determining the touch mode according to the change of the touch position and the touch pressure includes: Dividing a second sliding area on the display panel, wherein the second sliding area is circular and includes a center; storing the first touch position detected by the touch structure and located in the second sliding area as an initial position; Calculating an initial angle between a line connecting the initial position and the center of the circle and a reference straight line; extracting the touch position located in the first sliding area detected by the touch structure every third time period and using it as a subsequent position; Calculate the subsequent angle between the line between the subsequent position and the center of the circle and the reference straight line; calculate the angle difference between the subsequent angle and the initial angle, and when the angle difference is greater than a preset angle value, determine that the touch operation is a rotation mode.

30. The tactile reproduction method according to claim 29, further comprising: After detecting that the touch position is outside the second sliding area, it is determined that the rotation mode is terminated.

31. The tactile reproduction method according to any one of claims 28 to 30, wherein: Outputting different driving voltages to the piezoelectric actuator according to the touch control mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects includes: A high-frequency driving voltage is output to the piezoelectric actuator according to the sliding mode to make the display panel generate high-frequency vibration, thereby achieving a tactile effect of the corresponding knob, and the frequency of the high-frequency driving voltage ranges from 20kHz to 30kHz.

32. The tactile reproduction method according to claim 22, wherein: Determining the touch mode according to the change of the touch position and the touch pressure includes: dividing a pressing area on the display panel; Extracting the touch position detected by the touch structure, and determining whether the touch position is located in the pressing area; If the touch position is located in the pressing area and the touch pressure is greater than a preset pressure value, the touch operation is determined to be a strong pressing mode.

33. The tactile reproduction method according to claim 32, wherein: The preset pressure value includes a plurality of pressure levels of different magnitudes, and the control module is configured to determine the level of the strong pressing mode by determining a magnitude relationship between the touch pressure and the plurality of pressure levels.

34. The tactile reproduction method according to claim 32 or 33, wherein: Outputting different driving voltages to the piezoelectric actuator according to the touch control mode to drive the display panel to generate different vibrations, thereby achieving different tactile reproduction effects includes: A low-frequency driving voltage is output to the piezoelectric actuator according to the sliding mode, so that the display panel generates low-frequency vibration, thereby achieving a tactile effect of the corresponding button, and the frequency of the low-frequency driving voltage ranges from 200 Hz to 300 Hz.

35. The tactile reproduction method according to any one of claims 21 to 34, further comprising: The touch pressure is compared with a preset pressure threshold to determine whether the touch operation is a false touch.

36. The tactile reproduction method according to any one of claims 21 to 34, further comprising: Detecting the vibration of the display panel through a second pressure sensor located on the display panel and converting it into a vibration signal; as well as The vibration signal is compared with a reference signal, and the driving voltage is changed according to the comparison result. The reference signal is a standard vibration signal of the tactile reproduction effect corresponding to the touch mode.

37. The tactile reproduction method according to any one of claims 21 to 34, further comprising: A display signal is output to the display panel according to the touch mode to enhance visual reproduction effect.

38. The tactile reproduction method according to any one of claims 21 to 34, further comprising: An audio signal is output to a speaker according to the touch control mode to enhance the auditory reproduction effect.