A touch panel force detection method and system
By obtaining the four-angle pressure value of the touchpad and using the deep neural network model to match the cursor coordinates, the touchpad problem caused by the user's excessive force is solved, real-time prompts and fault handling are achieved, ensuring that the system can still be used in the event of a failure Run normally and prevent errors when wiping.
Patent Information
- Application Number
- CN202210550170.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-20
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2042-05-20
AI Technical Summary
When users use the trackpad, the trackpad may not be triggered or easily damaged due to excessive force, and the existing technology cannot prompt or resolve the fault in a timely manner, which will affect the user experience.
By obtaining the pressure value of the four corners of the touchpad, calculating the total pressure value, and comparing it with the preset normal pressure range, the control prompt device responds, and using the deep neural network model to match the pressure value and cursor coordinates in the event of a failure to ensure that The system is running normally and locks the screen cursor when wiping to prevent errors.
It realizes real-time prompts users whether the pressure level is appropriate, ensuring that the touchpad can still be used normally in the event of a failure, reducing equipment damage, and improving operational safety during cleaning.
Smart Images

Figure CN115016672B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of smart phone accessories, and in particular to a touch panel force detection method and system. Background Art
[0002] A touchpad, also known as a trackpad, is an input device widely used on laptops. It controls the movement of the pointer by sensing the movement of the user's finger. A touchpad can be considered a substitute for a mouse.
[0003] Its working principle is that when the user's finger approaches the touchpad, the capacitance will change, and the touchpad's own control IC will detect the change in capacitance and convert it into coordinates.
[0004] With respect to the above-mentioned related technologies, when a user clicks the touchpad, the touchpad may not be triggered due to light force or may be damaged due to excessive force. Ordinary touchpads cannot promptly remind the user, which is quite inconvenient. Summary of the invention
[0005] In order to help people understand the force with which they press the touch pad, the present application provides a touch pad force detection method and system.
[0006] The present application provides a touch panel force detection method using the following technical solution:
[0007] A touch panel force detection method comprises the following steps:
[0008] Get the four pressure values of the four corners of the touchpad;
[0009] Calculate according to the obtained pressure value to obtain the total pressure value;
[0010] Compare the total pressure value with the preset normal pressure range to obtain a comparison result, wherein the comparison result includes too light, normal, and too heavy;
[0011] According to the comparison result, the internal prompt device is controlled to make corresponding response actions.
[0012] By adopting the above technical solution, the pressure values of the four corners of the touch panel are obtained through the smart device to determine whether the person's low pressure is within the normal pressure range. When the person presses too lightly or too heavily, and the total pressure value is lower than or exceeds the normal pressure range, the smart device will give the person corresponding prompts to make the person aware of the problem.
[0013] Preferably, after controlling the internal vibration module to make a corresponding response action according to the comparison result, the following steps are also included:
[0014] Get the touch panel feedback signal;
[0015] Determine the state of the touch panel according to the feedback signal of the touch panel and obtain a normal result or a fault result;
[0016] According to the fault result, the four pressure values are arranged in sequence and transmitted to the preset pressure-coordinate model to obtain the touch point coordinates to control the movement of the screen cursor.
[0017] By adopting the above technical solution, when the touchpad fails and the coordinates of the pressure contact cannot be obtained, the present application uses a deep learning model of a neural network to match the pressure value with the cursor coordinates. After receiving the four pressure values, the pressure-coordinate model can accurately output the corresponding contact coordinates and control the normal operation of the smart device, so that personnel can continue to use the touchpad during the touchpad failure time.
[0018] Preferably, the training method of the pressure-coordinate model is:
[0019] The actual touch point coordinates are obtained, and the four pressure values are arranged in sequence and transmitted to the preset DNN model. The actual touch point coordinates are used as the gold standard to train the detection model, and the pressure-coordinate model is obtained after convergence.
[0020] By adopting the above technical solution, the DNN model is the correct mathematical operation for the deep neural network to convert input into output. Regardless of whether it is a linear relationship or a nonlinear relationship, the network traverses each layer and calculates the probability of each output. It can accurately associate the pressure value with the actual touch point coordinates. After the model converges, it can accurately output the actual touch point coordinates through four pressure values.
[0021] Preferably, after judging the state of the touch panel according to the feedback signal of the touch panel and obtaining a normal result or a fault result, the following steps are further included:
[0022] Based on the normal results, continue training the pressure-coordinate model.
[0023] By adopting the above technical solution, the relationship between the pressure value and the actual touch point coordinates can be updated in real time according to the state of the device, so that the association between the two is more in line with reality.
[0024] Preferably, before the four pressure values are arranged in sequence and transmitted to a preset pressure-coordinate model according to the fault result to obtain the contact point coordinates, the following steps are also included:
[0025] According to the fault result, a prompt signal is sent to make the device respond with a prompt.
[0026] By adopting the above technical solution, after a fault of the touch panel is detected, a prompt signal is output to prompt personnel, so that the personnel can understand it easily.
[0027] Preferably, after judging the state of the touch panel according to the feedback signal of the touch panel and obtaining a normal result, the following steps are further included:
[0028] Get the coordinate running trajectory of the actual touch point coordinates;
[0029] Determine whether the coordinate motion trajectory enters the preset working area and the preset locking area, and obtain the locking result and the normal working result;
[0030] Freeze the operation interface based on the locking result.
[0031] By adopting the above technical solution, when a person needs to wipe the screen, he can slide the touch pad on the touch pad so that the formed motion trajectory enters the lock area from the working area on the touch pad, and freeze the screen cursor, so that when the person wipes the screen of the notebook, it is less likely to make a wrong click.
[0032] Preferably, after obtaining the locking result, the following steps are further included:
[0033] Determine whether the coordinate motion trajectory enters the locking area or the working area, and obtain the unlocking result;
[0034] Unfreeze the operation interface according to the unlocking result.
[0035] By adopting the above technical solution, after the personnel finish wiping, they can enter the working area by checking whether the coordinate motion trajectory enters the locking area, so that the personnel can use the touch panel normally.
[0036] Preferably, in controlling the internal vibration module to make a corresponding response action according to the comparison result, the following steps are included:
[0037] According to the underweight result, the voice module is controlled to make a corresponding voice prompt response;
[0038] According to the normal result, the vibration module is controlled to make a slight vibration response;
[0039] According to the overweight result, the vibration module is controlled to make a strong vibration response.
[0040] By adopting the above technical solution and through different response actions, personnel can clearly understand whether the force with which they press the touch panel is normal.
[0041] The present application also provides a system for a touch panel force detection method.
[0042] A system for a touch panel force detection method, comprising:
[0043] A detection module is used to obtain four pressure values at the four corners of the touch panel;
[0044] A calculation module, used for performing calculations based on the acquired pressure values to obtain a total pressure value;
[0045] A comparison module, used for comparing the total pressure value with a preset normal pressure range to obtain a comparison result, wherein the comparison result includes too light, normal, and too heavy; and,
[0046] The prompt module is used to control the internal prompt device to make corresponding response actions according to the comparison results.
[0047] In summary, the present application includes at least one of the following beneficial technical effects:
[0048] 1. By detecting the pressure values at the four corners of the touchpad and making different responses to the pressure, personnel can promptly understand whether the force they press on the touchpad is appropriate;
[0049] 2. By adopting the pressure-coordinate model, the touch panel can obtain the position of the touch point pressed by the person according to the pressing force, so that after the normal touch function of the touch panel is damaged, the person can still obtain the touch point coordinates by pressing the touch panel, which is more convenient;
[0050] 3. By detecting the corresponding motion trajectory, this application can lock the screen cursor, making it easier for personnel to clean the touchpad. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] Figure 1 This is a first flow chart of an embodiment of a touch panel force detection method of the present application.
[0052] Figure 2 This is a second flow chart of an embodiment of a touch panel force detection method of the present application.
[0053] Figure 3 It is an architectural diagram of an embodiment of a touch pad force detection system of the present application.
[0054] Explanation of the accompanying drawings: 1. Detection module; 2. Calculation module; 3. Comparison module; 4. Prompt module; 5. Feedback signal acquisition module; 6. Fault judgment module; 7. Result processing module; 8. Fault reminder module; 9. Coordinate motion trajectory acquisition module; 10. Lock judgment module; 11. Freeze module; 12. Thaw module. DETAILED DESCRIPTION
[0055] The embodiment of the present application discloses a touch panel force detection method.
[0056] Reference Figure 1 and Figure 2 , a touch panel force detection method, comprising the following steps:
[0057] S10: Obtain four pressure values at the four corners of the touch panel;
[0058] Specifically: the smart device uses pressure sensors fixed on the four corners of the touch panel to detect the pressure values transmitted to the four corners of the touch panel. The smart device can be a computer or a smart phone.
[0059] S20: Calculate according to the obtained pressure value to obtain the total pressure value;
[0060] Specifically: the smart device accumulates and calculates the four pressure values according to the obtained pressure values to obtain the total pressure value;
[0061] S30: comparing the total pressure value with a preset normal pressure range to obtain a comparison result, wherein the comparison result includes too light, normal, and too heavy;
[0062] Specifically: the smart device has a preset normal pressure range. After obtaining the total pressure value, the smart device will compare the total pressure value with the normal pressure range. If the total pressure value is lower than the minimum value of the normal pressure range, the smart device will obtain a too light result; if the total pressure value falls within the normal pressure range, the smart device will obtain a normal result; if the total pressure value is higher than the maximum value of the normal pressure range, the smart device will obtain an overweight result;
[0063] S40: According to the comparison result, the internal prompt device is controlled to make a corresponding response action;
[0064] Specifically: after obtaining the underweight result, the smart device controls the voice player to make a corresponding voice prompt response according to the underweight result;
[0065] After obtaining a normal result, the smart device controls the vibration module to make a slight vibration response to prompt the person that the operation is effective. In this embodiment, the vibration module uses a small vibration motor;
[0066] After the intelligent device obtains the result of overweight, it controls the vibration module to make a strong vibration response according to the result of overweight, prompting the person to use too much force;
[0067] S50: Acquire a touch panel feedback signal; determine the touch panel status according to the touch panel feedback signal, and obtain a normal result or a fault result;
[0068] Specifically: When the touch panel fails, the signal fed back to the smart device by the touch panel will also change, and the smart processing device can determine whether the touch panel has failed based on the state of the feedback signal. For example, if the feedback signal is missing, it means that the feedback signal is abnormal and the result is a failure; if the feedback signal is within the normal current range, it means that the feedback signal is normal and the result is normal;
[0069] S51: according to the fault result, the four pressure values are arranged in sequence and transmitted to a preset pressure-coordinate model to obtain the contact point coordinates to control the movement of the screen cursor;
[0070] Specifically: When a person's finger presses the touchpad, the deformation of the touchpad causes different pressure values at each corner of the touchpad. When the person's finger presses different positions on the touchpad, the pressure values at the four corners of the touchpad will also be different. By using this phenomenon, the contact point between the person's finger and the touchpad can be inferred by detecting the four pressure values. Therefore, after obtaining the fault result, the four pressure values are input into the preset pressure-coordinate model in a specific order, such as the clockwise order of the pressure values on the touchpad. The preset pressure-coordinate model is a pre-trained DNN deep neural network model. The preset pressure-coordinate model is a program model pre-stored in the intelligent processing device. The training process of the preset pressure-coordinate model is: the actual touch point coordinates are obtained through the touch pad. The actual touch point coordinates are the coordinates formed by the intelligent device according to the position where the person's finger touches the touch pad. The four pressure values are arranged in a specific order and transmitted to the preset DNN model. The actual touch point coordinates are used as the gold standard to train the detection model until the DNN model converges. After the DNN model converges, the pressure-coordinate model is obtained; the specific order here is consistent with the pressure value input order after the fault result is obtained. In addition, in other embodiments, the DNN deep neural network model can also be stored in an external server and communicate data with the intelligent device of the present application through the network; after the pressure-coordinate model obtains the four pressure values, the touch point coordinates are simulated, and the intelligent device controls the screen cursor movement of the operation interface according to the touch point coordinates to open various files and software in the intelligent device.
[0071] S52: according to the fault result, a prompt signal is issued to enable the device to make a prompt response;
[0072] Specifically: After obtaining the fault result, the smart device will control its own loudspeaker or display screen to give voice or text fault reminders to personnel, so that the personnel can understand the situation of the touch panel fault.
[0073] S53: according to the normal result, continue to train the pressure-coordinate model;
[0074] Specifically: After the smart device obtains a normal result, the four pressure values will be input into the DNN deep neural network model in a specific order according to the normal result, and the actual touch point coordinates collected by the touchpad at that time will be used as the standard to continue training the pressure-coordinate model; so that the pressure-coordinate model can match the current state of the smart device, making the output touch point coordinates more in line with the actual situation.
[0075] In addition, in other embodiments, in order to save costs, in an environment where the touchpad operation accuracy requirements are not high and the smart device has fewer functions, the sizes of the four detected pressure values can be directly used. By storing the pre-trained pressure-coordinate model in the smart device, the touch point coordinates of a person's finger on the touchpad can be simulated without any other structure, so that the touchpad can be used normally. The touch point coordinates in training can be collected by collecting the touch point coordinates of the corresponding position on another conventional touchpad, and the collected four pressure values are input into the pressure-coordinate model. The touch point coordinates of the corresponding position are used as the standard to train the DNN deep neural network model to obtain the required pressure-coordinate model, thereby greatly reducing the manufacturing cost of the touchpad.
[0076] S60: Obtaining the coordinate running trajectory of the actual touch point coordinates;
[0077] Specifically: after obtaining the actual touch point coordinates of the person's finger touching the touchpad, if the smart device detects that the actual touch point coordinates change continuously, it means that the person slides his finger on the touchpad, and the continuously changing actual touch point coordinates are obtained. The continuously changing actual touch point coordinates are fitted into a trajectory route to obtain the coordinate motion trajectory.
[0078] S61: Determine whether the coordinate motion trajectory enters a preset working area or a preset locking area, and obtain a locking result and a normal working result;
[0079] Specifically: the working area and the locking area are both partial areas divided on the touchpad. The locking area is adjacent to the working area. The corresponding locking area and the working area of the smart device also have corresponding coordinate areas in the coordinate system of the actual touch point coordinates. After detecting that the coordinate movement trajectory enters the coordinate area corresponding to the locking area from the coordinate area corresponding to the working area, the locking result is obtained; in other cases, the normal working result is obtained. After the normal working result is obtained, the smart device operates normally.
[0080] S62: Freeze the operation interface according to the locking result;
[0081] Specifically: After the locking result is obtained, the smart device will freeze its own operating interface. For example, when playing a video, after freezing, the interface cannot be switched. The purpose of this setting is mainly to prevent personnel from misoperating the operating system in the smart device when cleaning the touchpad. When personnel freeze the operating interface by moving the actual contact point coordinates, when personnel wipe the touchpad, it is not easy to accidentally switch the operating interface due to pressing the touchpad and cause losses.
[0082] S63: Determine whether the coordinate motion trajectory enters the locking area or the working area, and obtain an unlocking result; unfreeze the operation interface according to the unlocking result.
[0083] Specifically: After the personnel finishes cleaning the touchpad, they can place their finger in the lock area and then slide their finger so that the coordinate movement trajectory of the actual touch point coordinates enters the working area from the lock area, thereby unfreezing the operation interface and restoring the smart device to normal working state.
[0084] The implementation principle of a touch pad force detection method in an embodiment of the present application is: by obtaining four pressure values and accumulating them, the total pressure value is compared with the normal pressure range, and different prompts are given for too light, normal and too heavy pressures, so that the personnel can understand the pressure they press on the touch pad. In addition, the four detected pressure values can be processed by the pressure-coordinate model to reversely deduce the actual position of the person pressing the touch pad, so that after the touch pad fails, the person can still use the touch pad to control the operation interface. The four pressure sensors can also be directly used to replace the touch circuit of the traditional touch pad, thereby achieving the effect of cost saving. When the person needs to clean the dust on the touch pad, the person can freeze the operation interface by drawing a specific coordinate motion trajectory, so that the person is less likely to make erroneous operations on the operating system when wiping the touch pad.
[0085] The present application also provides a touch panel force detection system.
[0086] Reference Figure 3 , a touch panel force detection system, comprising:
[0087] Detection module 1, used to obtain four pressure values at the four corners of the touch panel;
[0088] Calculation module 2, used to perform calculations based on the acquired pressure values to obtain a total pressure value;
[0089] Comparison module 3, used for comparing the total pressure value with a preset normal pressure range to obtain a comparison result, wherein the comparison result includes too light, normal, and too heavy;
[0090] The prompt module 4 is used to control the internal prompt device to make a corresponding response action according to the comparison result;
[0091] A feedback signal acquisition module 5 is used to acquire a touch panel feedback signal;
[0092] A fault judgment module 6 is used to judge the state of the touch panel according to the feedback signal of the touch panel and obtain a normal result or a fault result;
[0093] Result processing module 7, used to sequentially transmit the four pressure values to a preset pressure-coordinate model according to the fault result, and obtain the touch point coordinates to control the movement of the screen cursor; used to continue training the pressure-coordinate model according to the normal result;
[0094] A fault reminder module 8 is used to send a reminder signal according to the fault result so that the device can make a reminder response;
[0095] A coordinate motion trajectory acquisition module 9 is used to acquire the coordinate motion trajectory of the actual touch point coordinates;
[0096] The locking judgment module 10 is used to judge whether the coordinate motion trajectory enters the preset working area or the preset locking area, and obtain the locking result and the normal working result;
[0097] A freezing module 11 is used to freeze the operation interface according to the locking result;
[0098] The unfreezing module 12 determines whether the coordinate motion trajectory enters the locking area or the working area, obtains an unlocking result, and unfreezes the operation interface according to the unlocking result.
[0099] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.
Claims
1. A touch panel force detection method, characterized in that: The following steps are involved: Get the four pressure values at the four corners of the touchpad when the person's finger presses the touchpad; Calculate according to the obtained pressure value to obtain the total pressure value; Compare the total pressure value with the preset normal pressure range to obtain a comparison result, wherein the comparison result includes too light, normal, and too heavy; According to the comparison result, the internal prompt device is controlled to make a corresponding response action; Get the touch panel feedback signal; Determine the state of the touch panel according to the feedback signal of the touch panel and obtain a normal result or a fault result; According to the fault result, the four pressure values are arranged in sequence and transmitted to the preset pressure-coordinate model to obtain the contact point coordinates to control the movement of the screen cursor; The training method of the pressure-coordinate model is: The actual contact coordinates are obtained, and the four pressure values are arranged in sequence and transmitted to the preset DNN model. The actual contact coordinates are used as the gold standard to train the detection model, and the pressure-coordinate model is obtained after convergence. The sequence arrangement is consistent with the pressure value input sequence after the fault result is obtained.
2. A touch panel force detection method according to claim 1, characterized in that: After judging the state of the touch panel according to the feedback signal of the touch panel and obtaining a normal result or a fault result, the following steps are also included: Based on the normal results, continue training the pressure-coordinate model.
3. A touch panel force detection method according to claim 1, characterized in that: Before the four pressure values are arranged in sequence and transmitted to the preset pressure-coordinate model according to the fault result to obtain the contact point coordinates, the following steps are also included: According to the fault result, a prompt signal is sent to make the device respond with a prompt.
4. A touch panel force detection method according to claim 1, characterized in that: After judging the state of the touch panel according to the feedback signal of the touch panel and obtaining a normal result, the following steps are also included: Get the coordinate running trajectory of the actual touch point coordinates; Determine whether the coordinate motion trajectory enters the preset working area and the preset locking area, and obtain the locking result and the normal working result; according to the locking result, freeze the operation interface.
5. A touch panel force detection method according to claim 4, characterized in that: After the locking result is obtained, the following steps are also included: Determine whether the coordinate motion trajectory enters the locking area or the working area, and obtain the unlocking result; Unfreeze the operation interface according to the unlocking result.
6. A touch panel force detection method according to claim 1, characterized in that: In controlling the internal vibration module to make a corresponding response action according to the comparison result, the following steps are included: According to the underweight result, the voice module is controlled to make a corresponding voice prompt response; According to the normal result, the vibration module is controlled to make a slight vibration response; According to the overweight result, the vibration module is controlled to make a strong vibration response.
7. A system based on the touch panel force detection method according to any one of claims 1 to 6, characterized in that: include: A detection module (1), used for obtaining four pressure values at the four corners of the touch panel; A calculation module (2), used for performing calculations based on the obtained pressure values to obtain a total pressure value; A comparison module (3) is used to compare the total pressure value with a preset normal pressure range to obtain a comparison result, wherein the comparison result includes too light, normal, and too heavy; as well as, The prompt module (4) is used to control the internal prompt device to make a corresponding response action according to the comparison result.
Citation Information
Patent Citations
Three-dimensional position recognition method of matrix type pressure touch equipment
CN106095169A
Touch reminding method based on stylus, terminal and computer readable storage medium
CN111124159A