Touchpad interaction system and method
By combining a capacitive touch sensing layer, a piezoelectric ceramic feedback unit, and a pressure sensing layer, the problems of high learning barriers and easy string wear in traditional guitars are solved, achieving highly realistic touch and dynamic control in stringless guitars, suitable for stringless guitars and other instruments.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- RONGCHENG GOERTEK MICROELECTRONICS CO LTD
- Filing Date
- 2025-12-30
- Publication Date
- 2026-05-29
AI Technical Summary
Traditional guitars rely on the physical interaction between the strings and the fretboard, which presents problems such as a high learning curve, complex tuning, and easy string wear. Existing electronic guitars or MIDI controllers lack the ability to recognize and dynamically control continuous gestures such as string bending and sliding, making it difficult to truly reproduce the playing performance of traditional guitars.
It employs a capacitive touch sensing layer, a piezoelectric ceramic feedback unit, and a pressure sensing layer combined with a control circuit and processing module. Through multi-sensor fusion technology, it achieves gesture recognition and tactile feedback, providing an interactive fingerboard system without physical strings. It recognizes slide, bend, and press gestures, and provides vibration feedback through the piezoelectric ceramic feedback unit.
Without physical strings, it enhances the realism and expressiveness of the performance, lowers the barrier to entry, achieves precise recognition and dynamic control of gestures such as string bending and sliding, and provides a realistic string rebound feel. It is suitable for stringless guitars, stringless basses and other instruments.
Smart Images
Figure CN122111213A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of human-computer interaction technology, and more specifically, to a fingertip interaction system and method. Background Technology
[0002] Traditional guitars rely on the physical interaction between solid strings and the fretboard, requiring the player to control pitch and volume through a combination of pressing the strings with the left hand and plucking with the right. While this structure offers high expressiveness, it also presents challenges such as a high learning curve, complex tuning, and easily worn-out strings, hindering its widespread adoption and maintenance.
[0003] While existing electronic guitars or MIDI controllers attempt to achieve virtual performance through touchscreens, buttons, and other means, most only have note triggering functions and lack the ability to recognize and dynamically control continuous gestures such as string bending and sliding, making it difficult to truly reproduce the performance of a traditional guitar.
[0004] Therefore, there is an urgent need for an interactive fretboard system that can utilize multi-sensor fusion technology to realize guitar playing logic, gesture recognition, and tactile feedback without physical strings, in order to enhance the realism and expressiveness of the performance while lowering the barrier to entry. Summary of the Invention
[0005] In view of the above problems, the purpose of this invention is to provide a fingerboard interaction system and method to solve the problems of existing guitars relying on physical strings and fingerboards, which have high learning barriers, complex tuning, and easy string wear.
[0006] On one hand, the present invention provides a fingertip interaction system, including a capacitive touch sensing layer, a piezoelectric ceramic feedback unit, a pressure sensing layer, and a control circuit and processing module; wherein, The capacitive touch sensing layer is deployed on the surface of the finger plate to collect the two-dimensional coordinates and sliding trajectory of the finger touch point; The piezoelectric ceramic feedback unit is located below the capacitive touch sensing layer and is used to generate vibration feedback when the capacitive touch sensing layer is effectively pressed. The pressure sensing layer is disposed below the piezoelectric ceramic feedback unit and is used to detect the pressure and release status information of the finger. The control circuit and processing module are used to fuse the detection signals of the capacitive touch sensing layer and the pressure sensing layer, and output the corresponding control signals to the piezoelectric ceramic feedback unit and the sound generating unit.
[0007] Alternatively, an optional technical solution is that the finger plate adopts a multi-layer structure, including an upper cover and a lower shell; wherein, The capacitive touch sensing layer, the piezoelectric ceramic feedback unit, the pressure sensing layer, and the control circuit and processing module are sequentially disposed between the upper cover and the lower housing.
[0008] Furthermore, an optional technical solution is to divide the fingerboard into eight regions along its length, including seven independent touch areas and one customizable function area; wherein, At least one piezoelectric ceramic feedback unit is provided in each region or at least in every two regions.
[0009] In addition, an optional technical solution is that when one piezoelectric ceramic feedback unit is provided in every two regions, the piezoelectric ceramic feedback unit is located at the intersection of the two regions.
[0010] In addition, an optional technical solution is that the capacitive touch sensing layer collects the two-dimensional coordinates and sliding trajectory of the finger touch point, including: The capacitive touch sensing layer is used to detect finger touch points and prevent accidental touches, thereby determining the valid touch points and their two-dimensional coordinates. The X-axis displacement of the two-dimensional coordinates is compared with a first preset value, and the Y-axis displacement of the two-dimensional coordinates is compared with a second preset value; The current finger gesture is determined based on the comparison result of the X-axis displacement with the first preset value and the comparison result of the Y-axis displacement with the second preset value.
[0011] In addition, an optional technical solution is to determine the current finger gesture based on the comparison result of the X-axis displacement with the first preset value and the comparison result of the Y-axis displacement with the second preset value, including: When the X-axis displacement is greater than the first preset value within a preset time, the current gesture is determined to be a sliding string gesture; When the Y-axis displacement is greater than the second preset value within the preset time, the current gesture is determined to be a string-pushing gesture; When the X-axis displacement is not greater than the first preset value and the Y-axis displacement is not greater than the second preset value within the preset time, the current gesture is determined to be a string-pressing gesture.
[0012] In addition, an optional technical solution is that, through the capacitive touch sensing layer, touch point detection and anti-accidental touch filtering are performed to determine the valid touch point and the two-dimensional coordinates of the valid touch point, including: The pressure signal at the corresponding coordinate position is acquired through the pressure sensing layer; Based on the comparison result between the pressure signal and the preset threshold, it is determined whether the current finger contact is a valid contact; When the current touch point is in valid contact, determine the two-dimensional coordinates and sliding trajectory of the current touch point; otherwise, ignore the current finger touch point operation.
[0013] In addition, an optional technical solution is that the pressure sensing layer is used to monitor the pressure applied by the finger in real time and feed it back to the control circuit and processing module; The control circuit and processing module drive the sound-producing unit to output corresponding sound signals based on the pressure, the two-dimensional coordinates, and the gesture.
[0014] Alternatively, the control circuit and processing module control the piezoelectric ceramic feedback unit in the corresponding area to output vibration feedback with corresponding amplitude, frequency and duration based on the pressing force and the two-dimensional coordinates.
[0015] On the other hand, the present invention also provides a fingerboard interaction method, which utilizes the above-mentioned fingerboard interaction system to realize fingerboard interaction.
[0016] Using the fingerboard interaction system and method provided by the present invention, the two-dimensional coordinates and sliding trajectory of the finger touch point can be collected through the capacitive touch sensing layer. When the capacitive touch sensing layer is effectively pressed, the piezoelectric ceramic feedback unit generates corresponding vibration feedback. Based on the pressure sensing layer, the pressing pressure and release state information of the finger are detected. The control circuit and processing module output corresponding control signals to the piezoelectric ceramic feedback unit and the sound generation unit based on the detection signals of the capacitive touch sensing layer and the pressure sensing layer. It is possible to realize an interactive fingerboard system with guitar playing logic, gesture recognition and tactile feedback without physical strings by using multi-sensor fusion technology, so as to improve the realism and expressiveness of the performance, while reducing the threshold for use.
[0017] To achieve the foregoing and related objectives, one or more aspects of the invention include the features which will be described in detail below and specifically pointed out in the claims. The following description and accompanying drawings illustrate certain exemplary aspects of the invention. However, these aspects indicate only a few of the various ways in which the principles of the invention can be used. Furthermore, the invention is intended to include all such aspects and their equivalents. Attached Figure Description
[0018] Other objects and results of the invention will become more apparent and readily understood with reference to the following description taken in conjunction with the accompanying drawings and the contents of the claims, and with a more complete understanding of the invention. In the drawings: Figure 1 This is a schematic diagram of the structure of a fingertip interaction system according to an embodiment of the present invention; Figure 2 This is a logic block diagram of a fingertip interaction system according to an embodiment of the present invention; Figure 3 This is a schematic diagram of region division according to an embodiment of the present invention; Figure 4 This is a flowchart of a fingerpad interaction method according to an embodiment of the present invention.
[0019] Reference numerals: 1. Top cover; 2. Capacitive film; 3. Piezoelectric ceramic sheet; 4. Support frame; 5. Pressure sensor; 6. PCBA; 7. Lower housing. Detailed Implementation
[0020] In the following description, numerous specific details are set forth for illustrative purposes and to provide a thorough understanding of one or more embodiments. However, it will be apparent that these embodiments may also be implemented without these specific details. In other instances, well-known structures and devices are shown in block diagram form for ease of description of one or more embodiments.
[0021] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. The terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Furthermore, unless otherwise explicitly specified and limited, the terms "installed," "connected," and "linked" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal communication of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.
[0022] Furthermore, unless otherwise defined, including technical or scientific terms, all terms used herein have the same meaning as commonly understood by those skilled in the art. Terms as defined in commonly used dictionaries should be interpreted in a meaning consistent with their meaning in the context of the relevant art, and should not be construed as having an ideal or overly formal meaning unless explicitly defined in this invention.
[0023] The fingerpad interaction system and method provided by the present invention will be described in detail below with reference to the accompanying drawings.
[0024] Figure 1 and Figure 2 The schematic structure and principle block diagram of the fingerpad interaction system according to embodiments of the present invention are shown respectively; Figure 3 The region division according to an embodiment of the present invention is shown.
[0025] Figures 1 to 3As shown, the fingerboard interaction system provided by this invention includes a capacitive touch sensing layer, a piezoelectric ceramic feedback unit, a pressure sensing layer, and a control circuit and processing module. The capacitive touch sensing layer is disposed on the surface of the fingerboard and is used to directly acquire the two-dimensional coordinates and sliding trajectory of the finger touch point. The piezoelectric ceramic feedback unit is disposed below the capacitive touch sensing layer and is used to generate corresponding vibration feedback when the capacitive touch sensing layer is effectively pressed. The pressure sensing layer is disposed below the piezoelectric ceramic feedback unit and can detect the pressure intensity and release state information of the finger. The control circuit and processing module can be disposed at the bottom and is connected to the above functional layers. It can integrate the detection signals from the capacitive touch sensing layer and the pressure sensing layer and output corresponding control signals to the piezoelectric ceramic feedback unit and the sound generation unit respectively, thereby achieving sound and vibration feedback effects.
[0026] The interactive fingerboard can adopt a multi-layer structure, including an upper cover and a lower shell. A capacitive touch sensing layer, a piezoelectric ceramic feedback unit, a pressure sensing layer, and a control circuit and processing module are sequentially arranged between the upper cover and the lower shell. Furthermore, a detection capacitor is installed in the capacitive touch sensing layer, a piezoelectric ceramic is installed in the piezoelectric ceramic feedback unit, and various types of detection chips, such as pressure sensors, are installed in the pressure sensing layer. Vibration feedback is provided through the piezoelectric ceramic feedback unit, which can be understood as vibration feedback through the piezoelectric ceramic (sheet) in this layer. The pressure sensing layer detects the pressure applied and released by the finger, which can be understood as pressure detection at the corresponding position through the detection chip in this layer. Other functional layers are similar.
[0027] Specifically, along the length of the fingerboard (X-axis), the fingerboard can be divided into 8 areas, including 7 independent touch areas and 1 custom function area. The 7 independent touch areas can each correspond to a preset chord mapping, while the custom function area can be flexibly configured according to user habits and needs. The entire system supports multi-key switching, such as C major and G major, thereby achieving dynamic configuration of multiple chord arrangements and multiple playing modes to adapt to different playing needs. In each area, or at least every two areas, there is at least one piezoelectric ceramic feedback unit. When the user's finger effectively presses the finger, the corresponding vibration feedback can be provided through the piezoelectric ceramic feedback unit in the corresponding pressing area.
[0028] Each region can be equipped with one piezoelectric ceramic feedback unit, and the vibration feedback of the piezoelectric ceramic feedback units in different regions can be different. When one piezoelectric ceramic feedback unit is set in every two regions, the piezoelectric ceramic feedback unit can be set at the junction of the two regions, such as... Figure 3 The ceramics 1 to 4 in the piezoelectric ceramic feedback unit can provide corresponding vibration feedback when the user's finger is effectively pressed at any position in the two areas.
[0029] Furthermore, the fingerboard interaction system of the present invention can adopt a separate drive circuit architecture, which can be driven independently through multiple control pins. This enables a single piezoelectric drive chip to control multiple piezoelectric ceramic sheets separately. When any one of the piezoelectric sheets needs to work, only its corresponding branch is turned on, thereby achieving the effect of vibration on demand and no interference between them.
[0030] Specifically, the fingerboard assembly is assembled in a top-to-bottom order, including fixing the top cover 1 to the outermost layer as the surface directly contacted by the user, providing mechanical support for finger sliding or pressing operations, while also possessing good wear resistance and tactile feel. Below it, a capacitive film 2 is attached as a capacitive touch sensing layer to achieve touch detection. Below the capacitive film 2, a piezoelectric ceramic sheet 3 can be installed through a support frame 4 as a piezoelectric ceramic feedback unit to provide vibration feedback. The support frame 4 is located between the piezoelectric ceramic sheet 3 and the pressure sensor 5 in the pressure sensing layer, achieving mechanical support and deformation isolation. The pressure sensing layer formed by the pressure sensor 5 corresponds to the capacitive touch area, and its signal pins are soldered to the circuit board (PCBA6) of the control circuit and processing module. The PCBA6 integrates a microcontroller unit (MCU), signal acquisition circuit, and piezoelectric drive circuit, etc. Finally, all modules are packaged and fixed by the lower housing 7 to complete the fingerboard assembly.
[0031] In the fingertip interaction system of the present invention, the capacitive touch sensing layer collects the two-dimensional coordinates and sliding trajectory of the finger touch point, and may further include: 1. Finger touch detection and accidental touch filtering are performed through the capacitive touch sensing layer to determine the valid touch points and their two-dimensional coordinates; 2. Compare the X-axis displacement of the two-dimensional coordinates with the first preset value, and compare the Y-axis displacement of the two-dimensional coordinates with the second preset value; 3. Determine the current finger gesture based on the comparison results of the X-axis displacement with the first preset value and the Y-axis displacement with the second preset value.
[0032] The process of determining the current finger gesture based on the comparison results of the X-axis displacement with the first preset value and the Y-axis displacement with the second preset value may further include: determining the current gesture as a slide gesture when the X-axis displacement is greater than the first preset value within a preset time; determining the current gesture as a push gesture when the Y-axis displacement is greater than the second preset value within a preset time; and determining the current gesture as a press gesture when the X-axis displacement is not greater than the first preset value and the Y-axis displacement is not greater than the second preset value within a preset time.
[0033] It can be seen that this logic can ensure that the interactive system has good recognition stability and robustness at different playing speeds by setting preset time and preset value, based on time window filtering and threshold dynamic adjustment.
[0034] Furthermore, the detection of touch points and the filtering of accidental touches through the capacitive touch sensing layer to determine the effective touch points and their two-dimensional coordinates can be further included as follows: collecting pressure signals at the corresponding coordinate positions through the pressure sensing layer; determining whether the current finger touch point is a valid contact based on the comparison result of the pressure signal and a preset threshold; wherein, when the pressure signal is less than the preset threshold, it indicates that the current finger touch point is not a valid contact, otherwise, when the pressure signal is not less than the preset threshold, it indicates that the current finger touch point is a valid contact; then, when the current touch point is a valid contact, the two-dimensional coordinates and sliding trajectory of the current touch point are determined; otherwise, the current touch point can be considered an accidental touch, and the current finger touch point operation is ignored.
[0035] It can be seen that the process is based on the capacitive touch sensing layer for touch detection and anti-accidental touch filtering. It only responds to input under effective contact conditions. Afterwards, the pressure signal of the corresponding coordinate can be sampled through the pressure sensing layer, and the trigger and release states can be determined according to the set threshold.
[0036] Furthermore, the pressure-sensing layer can feed back the pressure signal, which is the real-time monitored pressure of the finger, to the control circuit and processing module. This allows the control circuit and processing module to drive the sound-generating unit to output the corresponding sound signal based on the pressure signal, two-dimensional coordinates, and gesture information. Additionally, the control circuit and processing module can control the piezoelectric ceramic feedback unit in the corresponding area to output vibration feedback with corresponding amplitude, frequency, and duration based on the pressure and two-dimensional coordinates.
[0037] The control circuit and processing module can send custom waveform curves to the piezoelectric ceramic feedback unit to adapt to different tactile needs, thereby achieving a true reproduction of string tension, relaxation, or slight vibration.
[0038] As can be seen, the fingerboard interaction system provided by the present invention can collect the pressing force through the pressure sensing layer and dynamically map it into volume or trigger intensity. During the coordinated use of the system and the whole machine, the system receives external trigger commands through the control circuit and processing module (the trigger command source can be generated by the right hand playing unit of the whole machine or other trigger devices; this fingerboard system is only responsible for recognizing the left hand pressing and gesture actions), and realizes the dynamic response and real-time change of volume and vibration based on the relevant parameters of the left fingers, such as gesture, pressing force, two-dimensional coordinates, etc., thereby improving the user's realistic experience.
[0039] It should be noted that the above-mentioned fingerboard interaction system of the present invention can be applied to various types of musical instruments such as stringless guitars, stringless basses, and stringless ukuleles. The corresponding fingerboard area division can be flexibly set according to the differences of the instruments. In this way, the stringless design reduces the learning threshold and device wear and tear, and can be widely applied to related fields such as smart musical instruments, MIDI controllers and music teaching.
[0040] Corresponding to the aforementioned fingerpad interaction system, the present invention also provides a fingerpad interaction method, which utilizes the aforementioned fingerpad interaction system to achieve fingerpad interaction. Specifically, as... Figure 4 As shown, the fingerpad interaction method of this invention embodiment may include: 1. After starting the fingerboard interaction system, perform a press test; 2. Determine whether the pressure signal of the current finger meets the trigger condition, that is, whether the pressure signal is greater than the set threshold; if the trigger condition is met, proceed to step 3; otherwise, return to step 1 to continue pressing detection; 3. Based on the magnitude of the pressure signal, the corresponding parameters are fed back through the piezoelectric ceramic feedback unit, and it is determined whether the vibration is complete. If so, proceed to step 4; otherwise, continue vibrating. 4. Finger press-release detection: If it is determined that the current finger is in the release state, vibration feedback is provided through the piezoelectric ceramic feedback unit, and the process returns to step 1 for press detection; otherwise, step 5 is executed to perform gesture detection on the current finger. 5. Detect the current gesture and determine whether it is a slide gesture, a push gesture, or a press gesture; 6. Perform a trigger playback test. If the trigger playback is not met, proceed to step 4 for release detection; otherwise, play the music at different volumes based on the real-time pressure value and gesture position coordinates, and clear the playback flag.
[0041] As can be seen from the above specific embodiments, the fingerboard interaction system and method provided by the present invention have a highly realistic tactile feel. The piezoelectric ceramic feedback unit can provide physical vibration when pressed, realistically simulating the rebound of the strings. Moreover, the pressure and capacitance signals compensate for each other, effectively isolating vibration interference, ensuring the accuracy of force sampling, and improving detection precision. In addition, it can realize multi-gesture fusion recognition, accurately recognize continuous playing gestures such as slides and bends, achieve natural tone transitions, and achieve dynamic volume response consistent with a real guitar through pressure mapping algorithms. It can be integrated as an independent fingerboard module into different electronic guitars or music interaction systems, has good compatibility and scalability, and can effectively solve the shortcomings of existing systems in terms of feel, recognition, and expressiveness. It can be widely applied to fields such as smart musical instruments, MIDI controllers, and music teaching.
[0042] As referred above Figure 1 To be continued Figure 4 The fingerpad interaction system and method according to the present invention are described by way of example. However, those skilled in the art should understand that various modifications can be made to the fingerpad interaction system and method proposed in the present invention without departing from the scope of the invention. Therefore, the scope of protection of the present invention should be determined by the content of the appended claims.
[0043] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.
Claims
1. A finger-pad interaction system, characterized in that, It includes a capacitive touch sensing layer, a piezoelectric ceramic feedback unit, a pressure sensing layer, and a control circuit and processing module; among which, The capacitive touch sensing layer is deployed on the surface of the finger plate to collect the two-dimensional coordinates and sliding trajectory of the finger touch point; The piezoelectric ceramic feedback unit is located below the capacitive touch sensing layer and is used to generate vibration feedback when the capacitive touch sensing layer is effectively pressed. The pressure sensing layer is disposed below the piezoelectric ceramic feedback unit and is used to detect the pressure and release status information of the finger. The control circuit and processing module are used to fuse the detection signals of the capacitive touch sensing layer and the pressure sensing layer, and output the corresponding control signals to the piezoelectric ceramic feedback unit and the sound generating unit.
2. The fingerpad interaction system as described in claim 1, characterized in that, The finger plate adopts a multi-layer structure, including an upper cover and a lower shell; wherein, The capacitive touch sensing layer, the piezoelectric ceramic feedback unit, the pressure sensing layer, and the control circuit and processing module are sequentially disposed between the upper cover and the lower housing.
3. The fingerpad interaction system as described in claim 1, characterized in that, Along the length of the fingerboard, the fingerboard is divided into 8 regions, including 7 independent touch areas and 1 customizable function area; wherein, At least one piezoelectric ceramic feedback unit is provided in each region or at least in every two regions.
4. The fingerpad interaction system as described in claim 3, characterized in that, When one piezoelectric ceramic feedback unit is provided in every two regions, the piezoelectric ceramic feedback unit is located at the intersection of the two regions.
5. The fingerpad interaction system as described in claim 1, characterized in that, The capacitive touch sensing layer acquires the two-dimensional coordinates and sliding trajectory of the finger touch point, including: The capacitive touch sensing layer is used to detect finger touch points and prevent accidental touches, thereby determining the valid touch points and their two-dimensional coordinates. The X-axis displacement of the two-dimensional coordinates is compared with a first preset value, and the Y-axis displacement of the two-dimensional coordinates is compared with a second preset value; The current finger gesture is determined based on the comparison result of the X-axis displacement with the first preset value and the comparison result of the Y-axis displacement with the second preset value.
6. The fingerpad interaction system as described in claim 5, characterized in that, Based on the comparison results of the X-axis displacement with the first preset value and the Y-axis displacement with the second preset value, the current finger gesture is determined, including: When the X-axis displacement is greater than the first preset value within a preset time, the current gesture is determined to be a sliding string gesture; When the Y-axis displacement is greater than the second preset value within the preset time, the current gesture is determined to be a string-pushing gesture; When the X-axis displacement is not greater than the first preset value and the Y-axis displacement is not greater than the second preset value within the preset time, the current gesture is determined to be a string-pressing gesture.
7. The fingerpad interaction system as described in claim 5, characterized in that, Touch detection and accidental touch filtering are performed through the capacitive touch sensing layer to determine valid touch points and their two-dimensional coordinates, including: The pressure signal at the corresponding coordinate position is acquired through the pressure sensing layer; Based on the comparison result between the pressure signal and the preset threshold, it is determined whether the current finger contact is a valid contact; When the current touch point is in valid contact, determine the two-dimensional coordinates and sliding trajectory of the current touch point; otherwise, ignore the current finger touch point operation.
8. The fingerpad interaction system as described in claim 5, characterized in that, The pressure sensing layer is used to monitor the pressure applied by the finger in real time and feed it back to the control circuit and processing module; The control circuit and processing module drive the sound-producing unit to output corresponding sound signals based on the pressure, the two-dimensional coordinates, and the gesture.
9. The fingerpad interaction system as described in claim 1, characterized in that, The control circuit and processing module control the piezoelectric ceramic feedback unit in the corresponding area to output vibration feedback with corresponding amplitude, frequency and duration based on the pressing force and the two-dimensional coordinates.
10. A fingerpad interaction method, characterized in that, Fingerpad interaction is implemented using the fingerpad interaction system as described in any one of claims 1 to 9.