Touch identification method and electronic equipment
By applying equal load forces in the touch area, ensuring that the acceleration sensor detects consistent acceleration, it solves the problem of inconsistent acceleration when the user applies equal force at different positions, and improves the accuracy and user experience of touch operation recognition.
Patent Information
- Application Number
- CN202310533550.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-11
- Publication Date
- 2024-11-12
AI Technical Summary
In the prior art, when a user applies the same amount of force at different positions of the touch screen, the acceleration value detected by the acceleration sensor is inconsistent, resulting in a decrease in the accuracy of the user's touch operation recognition. How to improve the accuracy of the touch operation recognition is urgently solved. The problem.
By determining the target acceleration threshold corresponding to the target touch area according to the position of the user's touch operation, and applying equal load forces in the same touch area, ensuring that the detection acceleration of the acceleration sensor is consistent, thereby improving the recognition accuracy.
In the same touch area, users can identify preset touch actions with less force, reduce false triggers, improve user experience and recognition accuracy.
Smart Images

Figure CN118939169A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of touch control, and more specifically, to a touch control recognition method and an electronic device. Background Art
[0002] Electronic devices have become an indispensable communication and entertainment tool in people's work and life. As a human-computer interaction device, touch screens are used in more and more electronic devices. Users perform basic touch actions such as pressing, moving or lifting on the touch screen to generate various types of touch gestures. The recognition of touch gestures can be based on position and trajectory. With the increase in the number of functions and application software on electronic devices, this two-dimensional plane-based touch gesture is increasingly unable to meet the interaction needs of electronic devices, and gestures such as tapping and pressing have emerged.
[0003] The acceleration sensor provided in the electronic device may be located below the touch screen of the electronic device. When the user performs a user touch operation on the touch screen, the acceleration sensor generates acceleration for the user touch operation. When the acceleration sensor is greater than or equal to a preset threshold, the user touch operation may be determined to be a preset touch action, thereby identifying the preset touch action to obtain the gesture category to which the user touch operation belongs.
[0004] However, when the user uses the same force to perform the same user touch operation at different positions on the touch screen, the acceleration value generated by the acceleration sensor for the user touch operation at the position is inconsistent, thereby reducing the accuracy of user touch operation recognition. How to improve the recognition accuracy of user touch operation is a problem that needs to be solved urgently. Summary of the invention
[0005] The present application provides a touch recognition method and an electronic device, which can improve the accuracy of identifying user touch operations.
[0006] In a first aspect, a method is provided, comprising: determining a target acceleration threshold corresponding to a target touch area according to a touch position of a user touch operation on a display screen and first relationship information, wherein the first relationship information indicates a first correspondence between multiple first touch areas and multiple first acceleration thresholds, the touch position is located in the target touch area among the multiple first touch areas, first detection accelerations of a first acceleration sensor caused by a first load force applied to different first connection positions on a phase line between two adjacent first touch areas are equal, and the first load force applied to the different first connection positions are equal; when the response acceleration of the first acceleration sensor to the user touch operation is greater than or equal to the target acceleration threshold, the user touch operation is determined to be a preset touch action.
[0007] When the area of the first touch area remains unchanged, equal load forces are applied to multiple positions of the display screen, and the positions where the first detected accelerations of the first acceleration sensor for the load forces at the multiple positions are equal are used as the edges of the first touch area. Then, the acceleration changes generated by the first acceleration sensor for the equal load forces at different positions in the first touch area are smaller, and the response is more uniform. The range of acceleration of the first acceleration sensor caused by the user applying equal forces at different positions in a first touch area is smaller. Thus, the possibility of the user using a smaller force to perform a user touch operation at some positions of the same first touch area to identify the user touch operation as a preset touch action is reduced, while a larger force is required at other positions to identify the user touch operation as a preset touch action, thereby improving the accuracy of identifying the user touch operation and improving the user experience.
[0008] In a possible implementation, the first acceleration threshold of each first touch area in the first relationship information is positively correlated with the second detected acceleration of the first touch area, and the second detected acceleration of each first touch area is the acceleration of the first acceleration sensor caused by the second load force applied to the first touch area, and the second load force applied to different first touch areas is equal.
[0009] The acceleration threshold of each first touch area in the first relationship information is positively correlated with the second detected acceleration, so that the acceleration threshold of the first touch area is set more reasonably, reducing the possibility of some first touch areas of the display screen requiring the user to apply a greater force to perform a user touch operation in order to achieve a user touch operation that can be achieved with a smaller force in other first touch areas. The user's touch operation is identified as a preset touch action, thereby improving the accuracy of identifying the user's touch operation and improving the user experience.
[0010] In a possible implementation, the method further includes: determining, based on the touch position and the correspondence between multiple sensor areas and multiple acceleration sensors, that the acceleration sensor corresponding to the target sensor area where the touch position is located is the first acceleration sensor, the multiple sensor areas correspond to multiple relationship information, and the first relationship information is the relationship information corresponding to the first acceleration sensor.
[0011] In the case where multiple acceleration sensors are provided, the display screen is divided into multiple sensor areas corresponding to the multiple acceleration sensors. Whether the user's touch operation is a preset touch action is determined based on the response acceleration of the first acceleration sensor corresponding to the target sensor area where the touch position is located among the multiple acceleration sensors, so that the touch recognition process is simpler and the amount of calculation is reduced.
[0012] In a possible implementation manner, the third load force applied to the touch position causes a third detection acceleration of the first acceleration sensor to be greater than or equal to a fourth detection acceleration of other acceleration sensors among the multiple sensors.
[0013] In this case, in the process of dividing the sensor area, for each position of the display screen, among the test accelerations generated by the multiple acceleration sensors when a load force is applied at the position, the sensor area corresponding to the acceleration sensor that generates the largest test acceleration is the sensor area including the position.
[0014] By using the relationship information of the acceleration sensor that generates a large acceleration for the load force at a certain position to perform touch recognition, the possibility of false triggering can be reduced and the accuracy of touch recognition can be improved.
[0015] In a possible implementation, the method also includes: obtaining a target coefficient; adjusting the second acceleration threshold corresponding to each first touch area in the second relationship information according to the target coefficient to obtain the first acceleration threshold corresponding to the first touch area in the first relationship information, the second relationship information indicating a second corresponding relationship between multiple second acceleration thresholds and the multiple first touch areas, and the second acceleration threshold corresponding to each first touch area is positively correlated with the second detected acceleration of the first touch area.
[0016] The first relationship information is determined according to the target coefficient, so that the method of determining the first relationship information is more flexible, thereby improving user experience.
[0017] In one possible implementation, obtaining the target coefficient includes: determining a historical difference based on a historical acceleration of a historical operation by the first acceleration sensor and the second relationship information, wherein the historical operation is the preset touch action, the historical difference is the difference between the historical acceleration and a historical acceleration threshold, the historical acceleration threshold is a second acceleration threshold corresponding to a historical first touch area in the second relationship, and the historical first touch area is a touch area to which a historical position of the historical operation on the display screen belongs among the multiple touch areas; determining the target coefficient based on the historical difference, wherein the target coefficient is positively correlated with the historical difference.
[0018] The target coefficient is determined according to the user's historical operations. The target coefficient is positively correlated with the historical difference, so that the first relationship information determined according to the target coefficient is more in line with the user's usage habits, thereby improving the user experience.
[0019] In a possible implementation, the method is applied to a first terminal device, and the acquiring the target coefficient includes: receiving the target coefficient of a second terminal device, the second terminal device having the same user as the second terminal device, the second terminal device being used to identify the preset touch action by using third relationship information, the third relationship information indicating a third correspondence between multiple second touch areas and multiple third acceleration thresholds, the third relationship information being obtained by adjusting fourth acceleration thresholds corresponding to the multiple second touch areas in fourth relationship information by using the target coefficient, fifth detected accelerations of the second acceleration sensor caused by fourth load forces applied to different second connection positions on a connection line between two adjacent second touch areas being equal, the fourth load forces applied to the different second connection positions being equal, the third acceleration threshold and the fourth acceleration threshold corresponding to each second touch area being positively correlated with a sixth detected acceleration of the second touch area, the sixth detected acceleration of each second touch area being the acceleration of the second acceleration sensor caused by the fifth load force applied to the second touch area, and the fifth load forces applied to different second touch areas being equal.
[0020] By receiving the target coefficient sent by the second terminal device used by the user and adjusting the second relationship information according to the target coefficient to obtain the first relationship information, the first relationship information is made more consistent with the user's usage habits of the second terminal device. In the case where the first terminal device is a terminal device that the user has just started to use and the second terminal device is a terminal device that the user has used for a period of time, the user has become accustomed to the configuration of the second terminal device. The first relationship information is determined according to the target coefficient of the second terminal device, so that the recognition of the preset touch action by the first terminal device is more similar to the recognition condition of the second terminal device that the user has used, which is consistent with the user's habits and improves the user experience.
[0021] In a possible implementation manner, the method further includes: determining, according to a correspondence between a plurality of forms and a plurality of relationship information, that the first relationship information is relationship information corresponding to the current form of the display screen in the plurality of relationship information.
[0022] By providing different relationship information for different display screen forms, the display screen can select relationship information suitable for the form to recognize gesture types in different forms, which can improve the recognition accuracy of user touch operations and improve user experience.
[0023] In a second aspect, a touch recognition device is provided, comprising a unit for executing the method of the first aspect. The device may be a terminal device or a chip in the terminal device. The image processing device comprises a unit for executing the method of the first aspect.
[0024] In a third aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the electronic device executes the method of the first aspect.
[0025] A fourth aspect provides a chip, comprising a processor. When the processor executes instructions, the processor executes the method of the first aspect.
[0026] According to a fifth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program code, and the computer program code is used to implement the method according to the first aspect.
[0027] According to a sixth aspect, a computer program product is provided, the computer program product comprising: a computer program code, wherein the computer program code is used to implement the method according to the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1 is a schematic diagram of a hardware system of an apparatus suitable for the present application;
[0029] Figure 2 is a schematic diagram of a software system suitable for the device of the present application;
[0030] Figure 3 It is a schematic diagram of an application scenario provided by an embodiment of the present application;
[0031] Figure 4 is a schematic flow chart of a touch recognition method provided in an embodiment of the present application;
[0032] Figure 5 is a schematic flow chart of a method for determining relationship information provided in an embodiment of the present application;
[0033] Figure 6 is a schematic structural diagram of a display screen of a terminal device provided in an embodiment of the present application;
[0034] Figure 7 is a schematic diagram of the change of the test acceleration with the position of the test point provided in the embodiment of the present application;
[0035] Figure 8 is a schematic diagram of a response distribution of an acceleration sensor provided in an embodiment of the present application;
[0036] Fig. 9 is a schematic structural diagram of a display screen of another terminal device provided in an embodiment of the present application;
[0037] Fig.10 is a schematic diagram of response distribution of another acceleration sensor provided in an embodiment of the present application;
[0038] Fig.11 is a schematic flow chart of a touch recognition method provided in an embodiment of the present application;
[0039] Fig.12 is a schematic structural diagram of a touch recognition device provided by the present application;
[0040] Fig.13 It is a schematic structural diagram of an electronic device for touch recognition provided in this application. DETAILED DESCRIPTION
[0041] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0042] Figure 1 A hardware system suitable for the device of the present application is shown.
[0043] The method provided in the embodiments of the present application can be applied to various electronic devices capable of network communication, such as mobile phones, tablet computers, wearable devices, laptop computers, netbooks, personal digital assistants (PDAs), etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.
[0044] Figure 1 1 shows a schematic diagram of the structure of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0045] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0046] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0047] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0048] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0049] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0050] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0051] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0052] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0053] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0054] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0055] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0056] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0057] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0058] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.
[0059] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0060] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0061] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0062] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0063] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0064] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0065] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0066] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0067] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0068] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0069] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.
[0070] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0071] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0072] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0073] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0074] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0075] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0076] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0077] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
[0078] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.
[0079] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.
[0080] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.
[0081] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0082] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
[0083] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.
[0084] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
[0085] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.
[0086] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0087] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
[0088] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0089] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0090] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0091] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
[0092] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.
[0093] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.
[0094] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.
[0095] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0096] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0097] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0098] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.
[0099] Figure 2 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the system library of the Android runtime (Android runtime), and the kernel layer. The application layer can include a series of application packages.
[0100] like Figure 2 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
[0101] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0102] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0103] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0104] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0105] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0106] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).
[0107] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0108] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0109] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.
[0110] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0111] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0112] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0113] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0114] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0115] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0116] A 2D graphics engine is a drawing engine for 2D drawings.
[0117] The kernel layer is the layer between hardware and software. The kernel layer can include driver modules such as display driver, camera driver, audio driver and sensor driver.
[0118] Electronic devices have become an indispensable communication and entertainment tool in people's work and life. As a human-computer interaction device, touch screens are used in more and more electronic devices. Users perform basic touch actions such as pressing, moving or lifting on the touch screen to generate various types of touch gestures. Touch gestures can be recognized based on position and trajectory. With the increase in the number of functions and application software on electronic devices, this two-dimensional plane-based touch gesture is increasingly unable to meet the interaction needs of electronic devices, and gestures such as tapping and pressing have emerged.
[0119] Different gesture categories can correspond to different functions. Figure 3 As shown in (a) in FIG. 1 , the user can double-click the display screen with a knuckle, and the function corresponding to the gesture category of double-clicking the display screen with a knuckle can be screenshot; Figure 3 As shown in (b), the user can use the knuckles to slide in an "s" shape on the display screen, and the function corresponding to the gesture category of knuckle "s" sliding can be to start screen recording.
[0120] For operations such as tapping or pressing, it is necessary to detect the force exerted on the display screen by the operation. According to the magnitude of the force and in combination with other judgment conditions, it is determined whether the operation is a gesture category such as tapping or pressing.
[0121] An accelerometer is a sensor that can measure acceleration. The accelerometer provided in an electronic device can be located at a position opposite to the bottom of the display screen of the electronic device, and is used to detect the force exerted by the user on the display screen. When the user taps or presses the display screen, the accelerometer can detect the change in acceleration perpendicular to the display screen. The magnitude of the change in acceleration is positively correlated with the force with which the user taps or presses the display screen.
[0122] Therefore, when the acceleration generated by the acceleration sensor in response to the user operation is greater than or equal to the preset acceleration, it can be determined that the user operation is a preset touch action, and then the gesture type of the preset touch action is identified.
[0123] As for the force exerted by the user on the display screen, when the user taps the display screen with the same force, the acceleration values detected by the acceleration sensor for the positions of the various forces are inconsistent. Whether the user operation is a preset touch action is determined based on whether the acceleration of the acceleration sensor caused by the user operation exceeds a certain threshold, so that the user operation can be judged as a preset touch action by performing a user operation with a smaller force in some areas of the display screen, while a larger force is required in other areas for the user operation to be judged as a preset touch action, resulting in a poor user experience.
[0124] Different thresholds can be set for different areas of the display screen, so that according to the touch position of the user operation, the target threshold corresponding to the touch area where the touch position is located can be determined. When the acceleration of the acceleration sensor caused by the user operation exceeds the target threshold, the user operation can be determined to be a preset touch action.
[0125] However, the unreasonable way of dividing the touch area has a serious impact on the recognition accuracy of user operations. In the same touch area, the user can use a small force to perform a user touch operation at some positions in the same touch area, and the user's touch operation can be recognized as a preset touch action, while at other positions, a larger force is required to recognize the user's touch operation as a preset touch action. For these other positions, the accuracy of touch recognition is low. How to improve the accuracy of touch recognition is a problem that needs to be solved urgently.
[0126] In order to solve the above problems, the embodiments of the present application provide a touch recognition method and device.
[0127] Combine the following Figures 4 to 13 The touch recognition method provided in the embodiment of the present application is described in detail.
[0128] Figure 44 is a schematic flow chart of a touch recognition method provided in an embodiment of the present application. The method may include steps S410 to S420, and these steps are described in detail below.
[0129] Step S410, determining a target acceleration threshold corresponding to a target touch area according to a touch position of a user's touch operation on the display screen and first relationship information, wherein the first relationship information indicates a first correspondence between multiple first touch areas of the display screen and multiple first acceleration thresholds, the touch position is located in the target touch area among the multiple first touch areas, the first detected accelerations of the first acceleration sensor caused by the first load force applied to different first connection positions on the connecting line of two adjacent first touch areas are equal, and the first load force applied at the different first connection positions are equal.
[0130] The user touch operation may be an operation performed by the user on a display screen. The display screen may be a touch screen, and the touch screen includes a touch sensor, and the touch sensor is used to detect a touch position of the user's touch operation.
[0131] The acceleration sensor is used to detect acceleration. The first acceleration sensor can be set below the screen or at other locations. The force applied to the display screen causes the output of the acceleration sensor to change. The response of the acceleration sensor to the force can be understood as the output change of the acceleration sensor. The change can be understood as the acceleration of the acceleration sensor caused by the force, or the acceleration of the acceleration sensor to the force, or the acceleration generated by the acceleration sensor due to the force.
[0132] The acceleration sensor can detect acceleration in one or more directions. In the embodiment of the present application, the acceleration of the acceleration sensor caused by the force can be the magnitude of the vector sum of accelerations in various directions, or can be the acceleration in a direction perpendicular to the display screen.
[0133] Step S420: When the response acceleration of the first acceleration sensor to the user touch operation is greater than or equal to the target acceleration threshold, determine that the user touch operation is a preset touch action.
[0134] A touch action that meets the above acceleration threshold restriction condition may be understood as a preset touch action.
[0135] The preset touch actions may include tapping, pressing, etc. The tapping action may include finger pulp tapping, knuckle tapping, etc.
[0136] Through S410 to S420, it is identified whether the user's touch operation is a preset touch action. If it is determined that the user's touch operation is a preset touch action, the gesture type can be identified according to the preset touch action. Thus, the preset function corresponding to the terminal device is called according to the identified gesture type.
[0137] For example, different completion times of a preset touch action within a preset duration may correspond to different gesture types. Different durations of a preset touch action may also correspond to different gesture types. In other words, the gesture type may be identified based on the duration of the preset touch action and the number of preset touch actions within the preset duration.
[0138] Alternatively, the preset touch action corresponds to a certain gesture category. When it is determined that the user's touch operation is a preset touch action, a function corresponding to the certain gesture category in the terminal device may be called.
[0139] The preset functions corresponding to the terminal device may include: starting or closing the application on the terminal device or calling the function in the application. For example, starting the corresponding application on the terminal device includes entering the settings menu, starting the camera, starting the screenshot, changing the theme, etc.; or calling the reply function in the SMS application, calling the video call function in the instant messaging application, calling the screenshot function in the browser application, etc.
[0140] Different functions corresponding to different gesture types may be pre-set, for example, the user pre-customizes the functions corresponding to different gesture types. Among them, the application may be a system application or a third-party application. The system application refers to an application that comes with the operating system of the terminal device. For example, the functions corresponding to the system application include a dialing function, a setting function, and a function of entering a text message interface, etc. The third-party application refers to an application installed on the terminal device.
[0141] In the case where the area of the first touch area remains unchanged, in the first touch area divided by the equal acceleration lines of equal load forces applied by the first acceleration sensor to multiple positions of the display screen, the acceleration variation range of the first acceleration sensor to the load force is small, that is, the response of the first acceleration sensor is relatively uniform. In other words, the acceleration range of the first acceleration sensor caused by the user applying equal forces at different positions in a first touch area is small.
[0142] According to the first touch control area divided by the equal acceleration lines of equal load force of the first acceleration sensor, the first detection accelerations of the first acceleration sensor caused by the equal load force applied to different positions on the phase line of two adjacent first touch control areas are equal.
[0143] Therefore, through S410 to S420, the first touch area is divided according to the equal acceleration lines of the first acceleration sensor when equal load forces are applied to multiple positions, and multiple acceleration thresholds are set for the multiple first touch areas, thereby improving the accuracy of touch recognition.
[0144] Based on the analysis of structural dynamic response, due to the influence of the display screen structure and other factors, when equal forces are applied to the display screen, the acceleration of the acceleration sensor is inconsistent when applied to different positions. Before performing S410, the response of the acceleration sensor to the force on the display screen can be tested.
[0145] In the case where the number of acceleration sensors set is one, the acceleration sensor can be used as the first acceleration sensor. Equal load forces are applied to multiple positions of the display screen respectively, and the test acceleration of the first acceleration sensor caused by the equal load forces at each position is determined. The equal load force can be a unit load force. According to the test acceleration corresponding to each position, the display screen is divided into areas to obtain multiple first touch areas. The test accelerations corresponding to each position on the intersection line between any two adjacent first touch areas are equal.
[0146] That is to say, according to the acceleration of the first acceleration sensor caused by the equal load force applied to multiple positions, the area where the multiple positions are located is divided to obtain multiple first touch areas. The first touch area can be determined according to the equal acceleration line of the first acceleration sensor to the load force. On the intersection line of two adjacent first touch areas, an equal first load force is applied to multiple first contact positions, and the first detection acceleration of the first acceleration sensor caused by the first load force at different first contact positions is equal.
[0147] A first acceleration threshold corresponding to each first touch area can be set, and the first relationship information is used to indicate the correspondence between a plurality of first touch areas and a plurality of first acceleration thresholds. Thus, S410 to S420 can be performed using the first relationship information.
[0148] In the case that a plurality of acceleration sensors are provided, it may be determined whether the user's touch operation is a preset touch action according to the acceleration generated by one or more acceleration sensors in response to the user's touch operation.
[0149] In some embodiments, equal load forces are applied to multiple positions of the display screen, respectively, and the test acceleration of each acceleration sensor caused by the equal load forces at each position is determined. Based on the analysis of the dynamic response, the test accelerations generated by the multiple acceleration sensors for the load forces applied to the same position may be different. For each acceleration sensor, the display screen is divided according to the test accelerations of the acceleration sensor at each position to obtain multiple touch areas corresponding to the acceleration sensor. The test accelerations of the acceleration sensor corresponding to each position on the intersection line between any two adjacent touch areas corresponding to the acceleration sensor are equal. In other words, the multiple touch areas corresponding to each acceleration sensor are determined according to the equal acceleration lines of the test accelerations generated by the acceleration sensor for the equal load forces acting on multiple positions of the display screen.
[0150] Afterwards, for each acceleration sensor, the relationship information corresponding to the acceleration sensor is determined, that is, the acceleration thresholds corresponding to the multiple touch areas corresponding to each acceleration sensor are set. The relationship information corresponding to the acceleration sensor indicates the corresponding relationship between the multiple touch areas corresponding to the acceleration sensor and the multiple acceleration thresholds.
[0151] In the relationship information corresponding to different acceleration sensors, the division methods of the multiple touch control areas may be different.
[0152] Thus, in S410, the multiple acceleration sensors can be respectively used as the first acceleration sensor. Based on the multiple relationship information, the target touch area of the touch area in the multiple touch areas corresponding to each acceleration sensor and the target acceleration threshold corresponding to the target touch area can be determined, and it is determined whether the response acceleration of each acceleration sensor to the user's touch operation is greater than or equal to the target acceleration threshold corresponding to the acceleration sensor. In the judgment results of the response acceleration of the multiple acceleration sensors, if the number of judgment results of "yes" exceeds the preset number, it can be determined that the user's touch operation is a preset touch action. The preset number can be one or more.
[0153] In some other embodiments, the display screen may be divided into a plurality of sensor areas corresponding to the plurality of acceleration sensors, and the plurality of sensor areas may or may not overlap.
[0154] If the multiple acceleration sensors are arranged at different positions, the accelerations of the multiple acceleration sensors caused by the forces applied at the same position on the display screen and having the same magnitude may also be different.
[0155] The correspondence between multiple acceleration sensors and multiple sensor areas can be preset. Similar to the way of setting up an acceleration sensor, for each sensor area, equal load forces are applied at multiple positions respectively. The equal load force can be a unit load force. The acceleration generated by the acceleration sensor corresponding to the sensor area where each position is located in response to the load force at that position can be used as the test acceleration of the position. According to the test accelerations corresponding to multiple positions in the sensor area, the sensor area is divided into areas to obtain multiple touch areas. On the intersection line between any two adjacent touch areas, the test accelerations corresponding to each position are equal. In other words, the touch area in each sensor area can be determined according to the equal acceleration line of the acceleration sensor corresponding to the sensor area to the load force.
[0156] The division of the sensor area can also be determined based on the equal load forces applied by the multiple sensors to multiple positions of the display screen. Equal load forces are applied to multiple positions of the display screen. The test accelerations generated by the load forces applied by the multiple acceleration sensors to the same position may be different.
[0157] Among the test accelerations generated by the multiple acceleration sensors, the sensor area corresponding to the acceleration sensor that generates the maximum test contact acceleration may include the position. When there are two or more acceleration sensors that generate the maximum test contact acceleration, the sensor area corresponding to any one of the acceleration sensors may include the position.
[0158] Alternatively, the test experimenter may also divide the sensor area based on experience. For example, the test experimenter may divide the sensor area based on the test acceleration of each acceleration sensor caused by the equal load force applied at each position.
[0159] In each sensor area, at least one touch area can be determined based on the test accelerations generated by the acceleration sensor corresponding to the sensor area in response to the load forces applied at multiple positions. The test accelerations of the acceleration sensor corresponding to the sensor area caused by the equal load forces applied at each intersection position on the intersection line between any two adjacent touch areas in the same sensor area are equal.
[0160] For each sensor area, an acceleration threshold corresponding to the touch area may be set for each touch area, and the relationship information corresponding to the sensor area is used to indicate the correspondence between multiple touch areas in the sensor area and multiple acceleration thresholds.
[0161] By dividing the display screen into sensor areas, the touch recognition process can be simplified, making the implementation of touch recognition easier.
[0162] Before performing S410, the acceleration sensor corresponding to the target sensor area where the touch position is located can be determined as the first acceleration sensor according to the touch position of the user's touch operation and the correspondence between the multiple sensor areas and the multiple acceleration sensors. The multiple sensor areas correspond to multiple relationship information, and the relationship information corresponding to the first acceleration sensor is the first relationship information. Therefore, in S410, the target acceleration threshold can be determined using the first relationship information of the first acceleration sensor.
[0163] The third load force applied to the touch position may cause a third detection acceleration of the first acceleration sensor to be greater than or equal to a fourth detection acceleration of other acceleration sensors among the multiple sensors.
[0164] That is, the response acceleration of the first acceleration sensor caused by the user's touch operation is greater than or equal to the acceleration caused by other acceleration sensors. The third load force can be the load force of the user's touch operation or other load forces.
[0165] In this case, in the process of dividing the sensor area, for each position of the display screen, among the test accelerations generated by the multiple acceleration sensors when a load force is applied at the position, the sensor area corresponding to the acceleration sensor that generates the largest test acceleration is the sensor area including the position.
[0166] By using the relationship information of the acceleration sensor that generates a large acceleration for the load force at a certain position to perform touch recognition, the possibility of false triggering can be reduced and the accuracy of touch recognition can be improved.
[0167] The acceleration threshold corresponding to each first touch area can be positively correlated with the second detection acceleration of the first touch area. The second detection acceleration of the first touch area is the acceleration of the first acceleration sensor caused by the second load force applied to the first touch area, and the second load force applied to different first touch areas is equal.
[0168] In some embodiments, the second detected acceleration of the first touch area may be obtained by applying the second load force at any position of the first touch area.
[0169] In other embodiments, the second detection acceleration of the first touch area is obtained based on the second load force applied to multiple positions respectively. The second load force can be, for example, a unit load force. The second load force applied to multiple positions respectively causes the first acceleration sensor to generate multiple test accelerations corresponding to the multiple positions respectively. The second detection acceleration of the first touch area can reflect the magnitude of the test acceleration corresponding to the multiple positions in the first touch area. The second detection acceleration of the first touch area belongs to the range of the test acceleration corresponding to the multiple positions in the first touch area. The range of the test acceleration corresponding to the multiple positions in the first touch area, the minimum value is the minimum value of the test acceleration corresponding to the multiple positions, and the maximum value is the maximum value of the test acceleration corresponding to the multiple positions.
[0170] The second detected acceleration of the first touch area may be a representative value of the test acceleration corresponding to the multiple positions. The second detected acceleration of the first touch area may be a maximum value, a minimum value or other data concentration trends among the test accelerations corresponding to the multiple positions. A data concentration trend is a representative value of a set of data, and may be an average value, a mode, an average value after removing the maximum and minimum values, a maximum value, a minimum value, etc. of the test accelerations corresponding to the multiple positions. It should be understood that the second detected accelerations of different first touch areas may be determined in the same manner. For example, the average value of the test accelerations in each first touch area may be used as the second test acceleration of the first touch area.
[0171] First relationship information is generated according to second detected accelerations of the first acceleration sensor caused by multiple load forces respectively applied to multiple first touch regions, and the acceleration threshold of each first touch region in the first relationship information is positively correlated with the second detected acceleration.
[0172] The acceleration threshold of each first touch area in the first relationship information is positively correlated with the second detected acceleration, so that the acceleration threshold of the first touch area is set more reasonably, avoiding the situation where some positions of the display screen require the user to apply a greater force to achieve the same touch action recognition result as other positions. When the user performs a certain touch action in different first touch areas with the same force, the same touch action recognition result can be obtained, thereby improving the recognition accuracy of the user's touch operation.
[0173] It should be understood that, among the multiple first touch areas in the first relationship information, the maximum differences of the multiple test accelerations corresponding to the multiple positions in different first touch areas may be equal or unequal. In the case where the maximum differences of the multiple test accelerations corresponding to the multiple first touch areas in the first relationship information are equal, in the process of dividing the first touch area according to the equal acceleration lines, the acceleration values corresponding to the multiple equal acceleration lines by which the user divides the first touch area may be an arithmetic progression. Thus, when a unit load force acts on multiple positions of a first touch area, the maximum differences between the multiple test accelerations of the first acceleration sensor caused by the multiple unit load forces are equal, that is, for multiple touch areas, the response of the first acceleration sensor is more uniform, and the division of the first touch area is more reasonable.
[0174] In the process of setting the first relationship information, after obtaining the acceleration threshold of one or some of the first touch areas, the parameter value in the positive correlation between the acceleration threshold and the second detection acceleration can be determined based on the acceleration threshold of the one or some of the first touch areas and the second test acceleration, so as to determine the acceleration threshold of the other first touch areas based on the positive correlation and the second test acceleration of the other first touch areas, thereby determining the first relationship information.
[0175] Exemplarily, the positive correlation between the acceleration threshold and the second detected acceleration may be a positive proportional relationship, and the parameter value in the positive correlation may be a proportional coefficient. According to the acceleration threshold of a first touch area, the proportional coefficient in the positive proportional relationship between the acceleration threshold and the second detected acceleration may be determined, and then according to the positive proportional relationship and the second test acceleration of the other first touch area, the acceleration threshold of the other first touch area may be determined, that is, the first relationship information may be determined.
[0176] After the test researchers set the acceleration thresholds of some first touch areas according to experimental results or experience, the acceleration thresholds of other first touch areas can be obtained according to the positive correlation, thereby simplifying the labor cost in the process of determining the first relationship information.
[0177] Users of different genders and ages may have significant differences in the force they exert on the display screen when performing a gesture on the display screen. The smaller the acceleration threshold used to identify the gesture category, the greater the possibility of false triggering. False triggering can be understood as the user not performing an operation of a certain gesture category, but the recognition result shows that the user's operation is of this gesture category.
[0178] In order to reduce the probability of false triggering, the first relationship information that matches the user's characteristics may be set.
[0179] The second relationship information may be preset. The second relationship information indicates a second correspondence between a plurality of second acceleration thresholds and a plurality of first touch areas. The first relationship information may be obtained by adjusting the second relationship information according to a target coefficient. That is, before performing S410, the target coefficient may be obtained, and the second acceleration threshold corresponding to each first touch area in the second relationship information may be adjusted according to the target coefficient, thereby obtaining the first acceleration threshold corresponding to the first touch area in the first relationship information.
[0180] In the second relationship information, the second acceleration threshold of each first touch area may be positively correlated with the second detected acceleration of the first touch area. The second detected acceleration of the first touch area is the acceleration of the first acceleration sensor caused by the unit load force applied to the first touch area.
[0181] Exemplarily, the target coefficient may be the ratio of the first acceleration threshold to the second acceleration threshold. That is, the first acceleration threshold corresponding to each touch area in the first relationship information may be the product of the second acceleration threshold corresponding to the touch area in the second relationship information and the target coefficient.
[0182] The first relationship information is determined according to the target coefficient, so that the method of determining the first relationship information is more flexible, thereby improving user experience.
[0183] In some embodiments, the target coefficient may be determined based on user information. The user information may be used to indicate the user's gender, age group, etc. Based on the user information, a suitable target coefficient may be set for the user.
[0184] In other embodiments, the target coefficient may be input by the user according to his / her own needs.
[0185] In some other embodiments, the target coefficient may also be determined based on the user's historical operations.
[0186] The historical difference can be determined based on the historical acceleration of the historical operation by the first acceleration sensor and the second relationship information. The historical operation is a preset touch action. The second relationship information indicates a second corresponding relationship between multiple second acceleration thresholds and the multiple first touch areas. The historical difference is the difference between the historical acceleration and the historical acceleration threshold. The historical acceleration threshold is the second acceleration threshold corresponding to the historical first touch area in the second relationship. The historical first touch area is the first touch area to which the historical position of the historical operation belongs in the multiple first touch areas.
[0187] According to the historical difference, the target coefficient can be determined. The target coefficient is positively correlated with the historical difference.
[0188] The historical difference may be expressed as a difference between the historical acceleration and the historical acceleration threshold, or may be expressed as a difference or ratio between the historical acceleration and the historical acceleration threshold.
[0189] Exemplarily, the target coefficient may be determined according to the historical difference and the correspondence between the plurality of difference ranges and the plurality of adjustment coefficients. The target coefficient is the adjustment coefficient corresponding to the target difference range to which the historical difference belongs. The representative value of the difference range may have a positive correlation with the adjustment coefficient, and the representative value of the difference range may be the maximum value, the minimum value, the middle value, etc. of the difference range. That is, the larger the representative value of the difference range, the larger the adjustment coefficient.
[0190] Alternatively, the positive correlation between the target coefficient and the historical difference can be expressed as a functional relationship.
[0191] The number of historical operations may be one or more. The historical positions of the multiple historical operations may belong to different historical first touch areas. Each historical operation corresponds to a historical difference. In the case where the number of historical differences is multiple, the target coefficient is determined according to the historical differences, and the target coefficient may be determined according to the minimum value of the multiple historical differences or the trend of the data concentration. In other words, the target coefficient is the adjustment coefficient corresponding to the target difference range to which the minimum value of the multiple historical differences or the trend of the data concentration belongs.
[0192] Determining the target coefficient according to the user's historical operations can make the first relationship information determined according to the target coefficient more consistent with the user's usage habits, thereby improving the user experience.
[0193] Steps S410 to S420 may be applied in the first terminal device, and the number of terminal devices used by the same user may be one or more. In the case where a user uses multiple terminal devices, the target coefficient may be determined by one of the terminal devices and sent to the other terminal devices. In other words, the first terminal device may send the target coefficient to the other terminal devices.
[0194] The other terminal devices may use the target coefficient to adjust the acceleration threshold corresponding to each touch area in the other terminal devices in the relationship information, and use the adjusted relationship information to control touch action recognition.
[0195] In some other embodiments, the target coefficient may be obtained by obtaining the target coefficient of the second terminal device. The first terminal device and the second terminal device have the same user. Exemplarily, obtaining the target coefficient of the second terminal device may be receiving the target coefficient sent by the second terminal device.
[0196] The second terminal device is used to determine the second target acceleration threshold corresponding to the second target touch area according to the second touch position of the second user touch operation of the second terminal device on the second display screen of the second terminal device and the third relationship information. The third relationship information represents a third correspondence between multiple third acceleration thresholds and multiple second touch areas. The second touch position is located in the second target touch area of the multiple second touch areas. The second terminal device is also used to determine that the second user touch operation is a preset touch action when the response acceleration of the second acceleration sensor to the second user touch operation is greater than or equal to the second target acceleration threshold.
[0197] That is to say, the second terminal device is used to identify the preset touch action by using the third relationship information.
[0198] The fifth detected accelerations of the second acceleration sensor caused by the fourth load forces applied to different second connecting positions on the connecting line of two adjacent second touch regions are equal, and the fourth load forces applied to different second connecting positions are equal.
[0199] That is to say, the multiple second touch areas in the second terminal device are also determined according to the isoacceleration lines of the acceleration sensor in the second terminal device. The isoacceleration lines of the second acceleration sensor in the second terminal device are lines connecting positions corresponding to equal accelerations among multiple accelerations generated by the second acceleration sensor in response to equal load forces applied at various positions.
[0200] The third acceleration threshold and the fourth acceleration threshold corresponding to each second touch area are positively correlated with the sixth detection acceleration of the second touch area. The sixth detection acceleration of each second touch area is the acceleration of the second acceleration sensor caused by the fifth load force applied to the second touch area, and the fifth load force applied to different second touch areas is equal.
[0201] Receive the target coefficient sent by the second terminal device used by the user, and adjust the second relationship information according to the target coefficient to obtain the first relationship information, so that the first relationship information is more in line with the user's usage habits of the second terminal device. In the case where the first terminal device is a terminal device that the user has just started to use, and the second terminal device is a terminal device that the user has used for a period of time, the user is already accustomed to the configuration of the second terminal device, and the first relationship information is determined according to the target coefficient of the second terminal device, so that the recognition of the preset touch action by the first terminal device is more similar to the recognition condition of the second terminal device that the user has used, which is in line with the user's habits and improves the user experience.
[0202] It should be understood that the target coefficient of the second terminal device may be a default value of the second terminal device, may be set by a user, or may be determined based on historical operations of the user on the second terminal device.
[0203] The third relationship information may be obtained by adjusting the fourth acceleration thresholds corresponding to the plurality of second touch areas in the fourth relationship information by the second terminal device using the target adjustment coefficient. The fourth relationship information may be relationship information preset in the second terminal device. In other words, the third acceleration threshold corresponding to each second touch area in the third relationship information is obtained by adjusting the fourth acceleration threshold corresponding to the second touch area using the target adjustment coefficient.
[0204] The target coefficient is positively correlated with the target difference range. For example, the target coefficient may be an adjustment coefficient corresponding to the target difference range to which the historical difference belongs, determined by the second terminal device according to the correspondence between multiple difference ranges and multiple adjustment coefficients, and the representative value of the difference range may have a positive correlation with the adjustment coefficient.
[0205] The historical difference is the difference between the historical acceleration of the second acceleration sensor of the second terminal device for the historical operation and the historical acceleration threshold. The historical operation is a preset touch action. The historical acceleration threshold is the fourth acceleration threshold corresponding to the historical second touch area in the fourth relationship information, and the historical second touch area is the second touch area to which the historical position of the historical operation belongs among the multiple second touch areas of the second terminal device. The fourth relationship information indicates the fourth corresponding relationship between multiple fourth acceleration thresholds and multiple second touch areas. The fourth detection acceleration of the second acceleration sensor caused by equal load forces applied to different positions on the phase line of two adjacent second touch areas is equal. The second acceleration threshold corresponding to each second touch area in the fourth relationship information is positively correlated with the fourth detection acceleration of the second touch area, and the fourth detection acceleration of the second touch area is the acceleration of the second acceleration sensor caused by the unit load force applied to the second touch area.
[0206] Whether the users of two terminal devices are the same can be determined based on the user's identification. For example, the user account can be understood as the user's identification, and the terminal devices logged in with the same user account can be considered as the terminal devices with the same user.
[0207] In the case where the first terminal device and the second terminal device both divide the touch area according to the equal acceleration lines of the test acceleration of the acceleration sensor caused by the unit load force, the first terminal device and the second terminal device can share the target coefficient, and adjust the acceleration thresholds corresponding to the multiple touch areas in the terminal device according to the target coefficient. The correspondence between the adjusted multiple touch areas and the acceleration thresholds can conform to the user's habits, facilitate gesture type recognition of the user's touch operation, improve user experience, and reduce the probability of false triggering.
[0208] With the development of technology, flexible screens have gradually entered people's lives and are widely used in various terminal devices. Folding screens are flexible screens that can be bent or even twisted. In the case of flexible screens as display screens, the acceleration of the acceleration sensor caused by applying equal forces at the same position may be different when the display screen has different shapes.
[0209] In order to be applied in the first terminal device using a flexible screen for display, before performing S410, the first relationship information can also be determined as the relationship information corresponding to the current form of the display screen in the multiple relationship information based on the correspondence between the multiple forms and the multiple relationship information.
[0210] By providing different relationship information for different display screen forms, the display screen can select relationship information suitable for the form to recognize gesture types in different forms, which can improve the recognition accuracy of user touch operations and improve user experience.
[0211] The method provided in the embodiment of the present application, when determining the gesture type of the user touch operation according to the response acceleration of the acceleration sensor to the user touch operation, divides the display screen into multiple first touch areas according to the equal acceleration lines of equal load forces applied by the first acceleration sensor to the display screen, and sets multiple acceleration thresholds for the multiple first touch areas, so that the range of acceleration of the first acceleration sensor caused by equal forces applied at different positions in a first touch area is smaller, that is, the acceleration of the first acceleration sensor caused by the forces at different positions in the first touch area is more uniform, thereby reducing the possibility of the user using a smaller force to perform the user touch operation at some positions in the same first touch area to identify the user touch operation as a preset touch action, while a larger force is required at other positions to identify the user touch operation as the preset touch action, thereby improving the overall recognition accuracy of the user touch operation and enhancing the user experience.
[0212] Combine the following Figures 5 to 11 , the method of determining the relationship information and the use of the relationship information in the gesture recognition process are explained.
[0213] Figure 5 It is a schematic flowchart of a method for determining relationship information provided in an embodiment of the present application. Figure 5 The relationship information determination method shown may include steps S501 to S506, which are described in detail below.
[0214] The establishment of relationship information can be obtained by actually testing the terminal device or by simulating and analyzing a model of the terminal device.
[0215] When actually testing the terminal device, S501 to S506 may be performed on the terminal device.
[0216] In the case of analyzing the model of the terminal device, before performing S501, a finite element simulation model of the terminal device can be established. The finite element simulation model is used to represent the components included in the terminal device, and is provided with material parameters of each component. In the finite element simulation model, the position, connection relationship and constraint relationship of each component are set according to the actual situation of each component in the terminal device. The set finite element simulation model is used as the model of the terminal device, and can be analyzed as the terminal device in the process of performing S501 to S506. It should be understood that the set finite element simulation model can be divided into a grid to facilitate subsequent analysis.
[0217] Step S501: dividing the display screen of the terminal device into a plurality of discrete test locations.
[0218] The display screen can be a rectangle, and can be divided into multiple equal parts along the long side and width of the rectangle to obtain multiple small rectangles, and the vertex of each small rectangle can be used as a discrete test position point. For example, the display screen can be divided into 50×100 test position points.
[0219] Step S502: applying a unit load force to each test position point.
[0220] That is to say, a force of equal magnitude and direction is applied to each test position point to simulate the force of the user's operation on the display screen. For example, the display screen is divided into 50×100 test positions (100 columns are set along the length direction of the display screen, and 50 rows are set along the width direction of the display screen), and a unit load force is applied to each of the 5,000 test positions.
[0221] Step S503, obtaining the test acceleration of the acceleration sensor for the unit load force at each test position point.
[0222] When a unit load is applied at the test location, the acceleration output by the acceleration sensor changes. The test acceleration of the acceleration sensor to the unit load at the test location can be understood as the change in the output of the acceleration sensor caused by the unit load at the test location.
[0223] Step S504: generating a response distribution of the acceleration sensor.
[0224] The response distribution of the accelerometer can be understood as the change of the test acceleration with the test position point.
[0225] like Figure 6As shown, the acceleration sensor 620 of the terminal device is set at the lower right corner of the display screen 610, 9 millimeters (millimeter, mm) away from the bottom edge and 11.7 mm away from the right edge.
[0226] Figure 7 (a) in the figure shows the change of the normalized value of the test acceleration corresponding to the multiple test position points along the bottom edge of the display screen 610 with the position of the test position points. The horizontal axis represents the coordinate of the bottom edge of the display screen 610, and the horizontal axis direction is the direction from left to right of the bottom edge. The coordinate of the midpoint of the bottom edge is 0 (unit: mm). The normalized value of the test acceleration corresponding to the multiple test position points at the bottom edge represented by the vertical axis can be understood as the ratio between the test acceleration corresponding to the multiple test position points at the bottom edge and the maximum value of the multiple test accelerations at the bottom edge.
[0227] Figure 7 (b) in the figure shows the change of the normalized value of the test acceleration corresponding to the multiple test position points along the right edge of the display screen 610 with the position of the test position points. The horizontal axis represents the coordinate of the right edge of the display screen 610, and the horizontal axis direction is the direction from bottom to top of the right edge. The coordinate of the midpoint of the right edge is 0 (unit: mm). The normalized value of the test acceleration corresponding to the multiple test position points on the right edge represented by the vertical axis can be understood as the ratio between the test acceleration corresponding to the multiple test position points on the right edge and the maximum value of the multiple test accelerations on the right edge.
[0228] The acceleration tested from bottom to top on the right edge gradually decreases. The acceleration tested from right to left along the bottom edge gradually decreases. The acceleration tested from right to left along the top edge first decreases and then increases, and the acceleration tested from bottom to top along the left edge decreases and then increases. Figure 8 The figure shows the variation of the test acceleration with position. Figure 8 As shown in , at the edge of display screen 610, the test acceleration decreases in the direction of the arrow.
[0229] Figure 8 shows the response distribution of an acceleration sensor. Figure 8 The area of the display screen 610 shown is plotted with a plurality of equal acceleration lines, and the test accelerations corresponding to the test positions on each line are equal. It should be understood that the maximum difference in the test accelerations corresponding to the test positions between a set of adjacent equal acceleration lines may be equal or unequal for two different sets of adjacent equal acceleration lines. Figure 8 As shown, the range of test acceleration in areas represented by the same shading type can be equal.
[0230] Step S505 , dividing the display screen into a plurality of touch control areas according to the response distribution.
[0231] According to the response distribution, the touch area is divided using isoacceleration lines. A plurality of isoacceleration lines can be determined on the display screen 610, and the area between two adjacent isoacceleration lines can be used as a touch area.
[0232] like Figure 8 The area between two adjacent equal acceleration lines shown can be used as a touch area. In other words, the display screen 610 can be divided into a plurality of touch areas, and the shape of each touch area is similar to a trapezoid or a triangle.
[0233] When the area of the touch area remains unchanged, the difference in the test acceleration in the touch area divided by the equal acceleration line is the smallest, that is, the response of the acceleration sensor 620 is relatively uniform. In other words, when the user applies equal force to different positions of the same touch area, the acceleration difference of the acceleration sensor caused by the force is small, and the division method of the touch area is more reasonable.
[0234] When the acceleration sensor is disposed below the display screen and close to the center of the display screen, the shape of the touch area may no longer be a trapezoid or a triangle, but may be close to a rectangle.
[0235] Step S506, determining relationship information according to the test acceleration of the touch area.
[0236] The relationship information indicates the corresponding relationship between the touch area and the acceleration threshold. The acceleration threshold corresponding to the touch area is positively correlated with the test acceleration of the touch area.
[0237] The relationship information is used to determine whether the user's touch operation is a preset touch action.
[0238] The test acceleration of the touch area can be the maximum value, minimum value, average value, median value, mode value, etc. of the test acceleration corresponding to each touch position in the touch area. In other words, the test acceleration of the touch area can be Figure 4 The method shown involves a second detection of acceleration.
[0239] The acceleration threshold of the touch area has a positive correlation with the test acceleration of the touch area.
[0240] After setting the acceleration threshold for one or some touch areas, the parameter value in the positive correlation between the acceleration threshold and the test acceleration of the touch area can be determined based on the acceleration threshold of the one or some touch areas and the test acceleration of the one or some touch areas, so as to determine the acceleration threshold of the other touch areas based on the positive correlation after determining the parameter value and the test acceleration of the other touch areas, thereby determining the relationship information.
[0241] The one or some touch areas may be one or more touch areas with the smallest test acceleration of the touch areas among the multiple touch areas. Taking into account the influence of factors such as false triggering, an acceleration threshold is set for one or more touch areas with the smallest test acceleration, so as to determine the acceleration thresholds corresponding to other touch areas according to the acceleration thresholds corresponding to the one or more touch areas. In the process of determining the relationship information, the influence of factors such as false triggering is considered, so that the determined relationship information is more reasonable.
[0242] Thus, when a user performs a touch operation on the display screen of a terminal device, the target touch area to which the touch position belongs can be determined, and based on the relationship information, it can be judged whether the response acceleration of the acceleration sensor 620 caused by the user touch operation is greater than or equal to the target acceleration threshold corresponding to the target touch area, thereby determining whether the user touch operation is a preset touch action.
[0243] In some embodiments, the number of acceleration sensors provided in the terminal device is multiple. Fig. 9 As shown, an acceleration sensor 921 of the terminal device is set at the lower right corner of the display screen 910, and another acceleration sensor 922 is set at the upper left corner of the display screen 910, and is symmetrical with the center of the acceleration sensor 921 on the display screen 910.
[0244] For multiple acceleration sensors in the terminal device, steps S501 to S503 may be performed respectively to obtain the response distribution of each acceleration sensor.
[0245] Fig.10 The response distribution of multiple acceleration sensors is shown. Fig.10 (a) in FIG. 9 is the response distribution of the acceleration sensor 921. Fig.10 (b) in FIG. 9 is the response distribution of the acceleration sensor 921. Fig.10 In the direction of the arrow in (a), the test acceleration of the acceleration sensor 921 decreases, along Fig.10 In the direction of the arrow in (b), the test acceleration of the acceleration sensor 922 decreases.
[0246] according to Fig.10 As shown in (a), for the acceleration sensor 921, the acceleration tested from bottom to top along the right edge gradually decreases, the acceleration tested from right to left along the bottom edge gradually decreases, while the acceleration tested from right to left along the top edge first decreases and then increases, and the acceleration tested from bottom to top along the left edge decreases and then increases.
[0247] according to Fig.10As shown in (b), for the acceleration sensor 922, the acceleration tested from top to bottom along the left edge gradually decreases, the acceleration tested from left to right along the top edge gradually decreases, while the acceleration tested from left to right along the bottom edge first decreases and then increases, and the acceleration tested from bottom to top along the right edge decreases and then increases.
[0248] Before performing S505 , the display screen 910 may be divided according to the response distribution of the multiple acceleration sensors to obtain a sensor area corresponding to each acceleration sensor.
[0249] The unit load force applied at a certain position on the display screen 910 may cause different test accelerations of each acceleration sensor. For example, among the test accelerations of the multiple acceleration sensors, the sensor area of the acceleration sensor corresponding to the maximum test acceleration may include the position. In other words, the unit load force applied at the position located at two adjacent sensor areas causes the test accelerations of the acceleration sensors corresponding to the two sensor areas to be equal.
[0250] Alternatively, the test experimenter may comprehensively consider factors such as the shape of the display screen 910 and the response distribution of each acceleration sensor, and divide the display screen 910 to obtain the sensor area corresponding to each acceleration sensor.
[0251] according to Fig.10 The response distribution of the acceleration sensor 921 shown in (a) and Fig.10 According to the response distribution of the acceleration sensor 922 shown in (b), the test experimenter can divide the display screen 910 along the diagonal direction from the upper right to the lower left of the display screen 910. The area located at the upper left of the diagonal line can be used as the sensor area corresponding to the acceleration sensor 922, and the area located at the lower right of the diagonal line can be used as the sensor area of the acceleration sensor 921.
[0252] After determining the sensor area corresponding to each acceleration sensor, steps S505 and S506 may be performed for each sensor area. Thus, the relationship information corresponding to each acceleration sensor is determined. The relationship information corresponding to each acceleration sensor indicates the corresponding relationship between each touch control area in the sensor area corresponding to the acceleration sensor and the acceleration threshold.
[0253] Thus, when a user performs a touch operation on the display screen of a terminal device, the target sensor area to which the touch position belongs and the target touch area can be determined, and based on the relationship information of the target acceleration sensor corresponding to the target sensor area, it is determined whether the response acceleration of the target acceleration sensor caused by the user touch operation is greater than or equal to the target acceleration threshold corresponding to the target touch area, thereby determining whether the user touch operation is a preset touch action. For details, see Fig.11 Description.
[0254] Setting the acceleration threshold to a smaller value may increase the probability of false triggering. Multiple acceleration sensors are set in the terminal device, and the multiple acceleration sensors are set at different positions of the display screen. Therefore, when the display screen of the terminal device is touched by a user, the relationship information corresponding to the acceleration sensor that generates a larger response acceleration to the user's touch operation is used to determine whether the user's touch operation is a preset touch action, thereby improving the accuracy of touch recognition.
[0255] In other embodiments, the display screen of the terminal device may be a flexible screen that can be used in a variety of forms.
[0256] For example, the display screen may be a folding screen, and the various forms of the display screen may include forms with various degrees of folding, such as a fully unfolded form, a partially unfolded form, an unfolded form, etc. For a display screen that can undergo morphological changes such as twisting, the various forms of the display screen may also include forms with different degrees of twisting. The form of the display screen may also be understood as the form of the terminal device.
[0257] When the terminal device is in different states, S501 to S506 are performed respectively to obtain the relationship information in each state. Thus, when the user performs a user touch operation on a terminal device in a certain state, the relationship information of the state can be used to determine whether the user touch operation is a preset touch action.
[0258] Two terminal devices with the same structure may have the same relationship information. After performing S501 to S506 for a certain terminal device, the determined relationship information may be applied to other terminal devices with the same structure as the certain terminal device.
[0259] Through S501 to S506, the display screen is subjected to dynamic analysis to determine the relationship information. The determined relationship information can be applied to Fig.11 The touch recognition method shown is used to optimize the touch recognition process to improve the accuracy of touch recognition.
[0260] Fig.11 It is a schematic flow chart of a touch recognition method provided in an embodiment of the present application. Fig.11The touch recognition method shown may include steps S1101 to S1108, which are described by taking a terminal device provided with multiple acceleration sensors as an example.
[0261] Step S1101, controlling a plurality of acceleration sensors and touch sensors to be in a working state.
[0262] Step S1102: receiving touch position information sent by the touch sensor, where the touch position information indicates the touch position of the user's touch operation.
[0263] When the touch sensor detects a touch operation by a user, it can output touch position information.
[0264] Step S1103: determining a target sensor area where the touch position is located among the multiple sensor areas.
[0265] Step S1104: determining a target acceleration sensor corresponding to the target sensor area according to the correspondence between the multiple sensor areas and the multiple acceleration sensors.
[0266] The multiple acceleration sensors provided in the terminal device correspond to the multiple sensor areas.
[0267] Step S1105: obtaining the response acceleration of the target acceleration sensor to the user's touch operation.
[0268] It should be understood that in S1105, only the response acceleration of the target acceleration sensor to the user's touch operation can be obtained, or the accelerations generated by the multiple acceleration sensors in response to the user's touch operation can be obtained respectively, and after the target acceleration sensor is determined in S1104, the acceleration generated by the target acceleration sensor among the multiple acceleration sensors can be used as the response acceleration.
[0269] Step S1106 , determining a target touch area where the touch position is located from among the multiple touch areas indicated by the target relationship information according to the target relationship information corresponding to the target acceleration sensor.
[0270] The plurality of acceleration sensors correspond to a plurality of relationship information. Each relationship information is used to indicate the corresponding relationship between the plurality of touch control areas and the plurality of acceleration thresholds. The plurality of touch control areas in the relationship information corresponding to each acceleration sensor cover the sensor area corresponding to the acceleration sensor.
[0271] It should be understood that when the multiple touch areas indicated by the multiple relationship information do not overlap, the display screen can be divided into multiple touch areas, and one or more touch areas can belong to one sensor area. Therefore, in S1103, the target touch area where the touch position is located and the target sensor area to which the target touch area belongs are determined. The acceleration sensor corresponding to the target sensor area is the target acceleration sensor. After that, S1105 to S1108 can be performed.
[0272] Step S1107: determining whether the response acceleration is greater than or equal to the target acceleration threshold corresponding to the target touch area according to the relationship information corresponding to the target acceleration sensor.
[0273] If the judgment result of S1107 is yes, proceed to S1108.
[0274] Step S1108: determining that the user's touch operation is a preset touch action.
[0275] When it is determined that the user's touch operation is a preset touch action, the gesture category can be identified according to the preset touch action, so that the preset function corresponding to the terminal device is called according to the identified gesture type.
[0276] If the judgment result of S1107 is no, it can be determined that the user's touch operation is not a preset touch action. Afterwards, other touch actions can be judged, or the process can return to S1101.
[0277] In the embodiment of the present application, the relationship information is obtained by using Figure 5 The method shown is obtained. When the area of the touch area remains unchanged, when the user applies equal force to different positions of the same touch area, the acceleration difference of the acceleration sensor caused by the force is small, and the division method of the touch area is more reasonable, thereby reducing the possibility that the user can achieve the recognition result of the preset touch action by using a small force to perform a certain operation at some positions of the same touch area, while a large force is required to perform the certain operation at other positions to recognize the preset touch action. This improves the accuracy of touch recognition and improves the user experience.
[0278] Users of different genders and ages may have large differences in the force they use to operate the display screen. Setting a fixed threshold for the touch area makes it difficult for all users to have a good operating experience.
[0279] In some embodiments, a target coefficient may be determined based on the user's historical operations; and the relationship information may be adjusted using the target coefficient.
[0280] For example, after each S1108 is performed, the difference between the response acceleration and the target acceleration threshold may be recorded. According to the difference recorded at least once, the historical difference may be determined. The historical difference may reflect the data set trend of the difference recorded at least once.
[0281] Based on the historical differences, the target coefficient can be determined, and the target coefficient is positively correlated with the historical differences.
[0282] By using the target coefficient, the relationship information corresponding to the multiple acceleration sensors of the terminal device can be adjusted.
[0283] In the subsequent process of S1101 to S1108 , the adjusted relationship information corresponding to the plurality of acceleration sensors is used as the relationship information corresponding to the plurality of acceleration sensors.
[0284] The terminal device may also send the target adjustment device to other terminal devices used by the user, so that the other terminal devices may adjust the relationship information of the other terminal devices.
[0285] It should be understood that the above examples are intended to help those skilled in the art understand the embodiments of the present application, rather than to limit the embodiments of the present application to the specific numerical values or specific scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples, and such modifications or changes also fall within the scope of the embodiments of the present application.
[0286] Combination of the above Figures 1 to 11 , describes in detail the touch recognition method of the embodiment of the present application, and will now be combined with Fig.12 and Fig.13 It should be understood that the touch recognition device in the embodiment of the present application can execute various touch recognition methods in the aforementioned embodiment of the present application, that is, the specific working process of the following various products can refer to the corresponding process in the aforementioned method embodiment.
[0287] Fig.12 is a schematic diagram of a touch recognition device provided in an embodiment of the present application.
[0288] It should be understood that the touch recognition device 1200 can execute Figure 3 and Fig.11 The touch recognition method shown; the touch recognition device 1200 includes: a first processing unit 1210 and a second processing unit 1220.
[0289] The first processing unit 1210 is used to determine a target acceleration threshold corresponding to a target touch area according to a touch position of a user's touch operation on the display screen and first relationship information, wherein the first relationship information indicates a first correspondence between a plurality of first touch areas and a plurality of first acceleration thresholds, the touch position is located in the target touch area among the plurality of first touch areas, the first detection accelerations of the first acceleration sensor caused by the first load forces applied to different first connecting positions on a connecting line between two adjacent first touch areas are equal, and the first load forces applied to the different first connecting positions are equal;
[0290] The second processing unit 1220 is configured to determine that the user touch operation is a preset touch action when the response acceleration of the first acceleration sensor to the user touch operation is greater than or equal to the target acceleration threshold.
[0291] Optionally, as an embodiment, the first acceleration threshold of each first touch area in the first relationship information is positively correlated with the second detection acceleration of the first touch area, and the second detection acceleration of each first touch area is the acceleration of the first acceleration sensor caused by the second load force applied to the first touch area, and the second load force applied to different first touch areas is equal.
[0292] Optionally, as an embodiment, the device 1200 also includes a third processing unit, which is used to determine, based on the touch position and the correspondence between multiple sensor areas and multiple acceleration sensors, that the acceleration sensor corresponding to the target sensor area where the touch position is located is the first acceleration sensor, the multiple sensor areas correspond to multiple relationship information, and the first relationship information is the relationship information corresponding to the first acceleration sensor.
[0293] Optionally, as an embodiment, the third load force applied to the touch position causes a third detection acceleration of the first acceleration sensor to be greater than or equal to a fourth detection acceleration of other acceleration sensors among the multiple sensors.
[0294] Optionally, as an embodiment, the device 1200 further includes an acquisition unit and a fourth processing unit.
[0295] The acquisition unit is used to obtain the target coefficient.
[0296] The fourth processing unit is used to adjust the second acceleration threshold corresponding to each first touch area in the second relationship information according to the target coefficient to obtain the first acceleration threshold corresponding to the first touch area in the first relationship information, the second relationship information indicates a second corresponding relationship between multiple second acceleration thresholds and the multiple first touch areas, and the second acceleration threshold corresponding to each first touch area is positively correlated with the second detected acceleration of the first touch area.
[0297] Optionally, as an embodiment, the acquisition unit is used to determine the historical difference based on the historical acceleration of the historical operation by the first acceleration sensor and the second relationship information, the historical operation being the preset touch action, the historical difference being the difference between the historical acceleration and the historical acceleration threshold, the historical acceleration threshold being the second acceleration threshold corresponding to the historical first touch area in the second relationship, the historical first touch area being the touch area to which the historical position of the historical operation on the display screen belongs among the multiple touch areas.
[0298] The acquisition unit is further used to determine the target coefficient according to the historical difference, and the target coefficient is positively correlated with the historical difference.
[0299] Optionally, as an embodiment, the method is applied to a first terminal device, and the target coefficient is obtained. The acquisition unit is used to receive the target coefficient of a second terminal device, the second terminal device has the same user as the second terminal device, the second terminal device is used to identify the preset touch action using third relationship information, the third relationship information indicates a third correspondence between multiple second touch areas and multiple third acceleration thresholds, the third relationship information is obtained by adjusting the fourth acceleration threshold corresponding to the multiple second touch areas in the fourth relationship information using the target coefficient, the fifth detection acceleration of the second acceleration sensor caused by the fourth load force applied to different second connection positions on the connection line of two adjacent second touch areas is equal, the fourth load force applied to the different second connection positions is equal, the third acceleration threshold and the fourth acceleration threshold corresponding to each second touch area are positively correlated with the sixth detection acceleration of the second touch area, the sixth detection acceleration of each second touch area is the acceleration of the second acceleration sensor caused by the fifth load force applied to the second touch area, and the fifth load force applied to different second touch areas is equal.
[0300] Optionally, as an embodiment, the device 1200 further includes a fifth processing unit, configured to determine, based on a correspondence between multiple forms and multiple relationship information, that the first relationship information is relationship information corresponding to the current form of the display screen in the multiple relationship information.
[0301] It should be noted that the touch recognition device 1200 is implemented in the form of a functional unit. The term "unit" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.
[0302] For example, a "unit" may be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (e.g., a shared processor, a dedicated processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that support the described functions.
[0303] Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.
[0304] Fig.13 A structural schematic diagram of an electronic device provided by the present application is shown. Fig.13 The dotted line in indicates that the unit or the module is optional. The electronic device 1300 can be used to implement the touch recognition method described in the above method embodiment.
[0305] The electronic device 1300 includes one or more processors 1301, which can support the touch recognition method in the method embodiment implemented by the electronic device 1300. The processor 1301 can be a general-purpose processor or a special-purpose processor. For example, the processor 1301 can be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.
[0306] The processor 1301 may be used to control the electronic device 1300, execute software programs, and process data of the software programs. The electronic device 1300 may also include a communication unit 1305 to implement input (reception) and output (transmission) of signals.
[0307] For example, the electronic device 1300 may be a chip, the communication unit 1305 may be an input and / or output circuit of the chip, or the communication unit 1305 may be a communication interface of the chip, and the chip may be a component of a terminal device or other electronic devices.
[0308] For another example, the electronic device 1300 may be a terminal device, and the communication unit 1305 may be a transceiver of the terminal device, or the communication unit 1305 may be a transceiver circuit of the terminal device.
[0309] The electronic device 1300 may include one or more memories 1302 on which a program 1304 is stored. The program 1304 can be executed by the processor 1301 to generate instructions 1303, so that the processor 1301 executes the touch recognition method described in the above method embodiment according to the instructions 1303.
[0310] Optionally, data may be stored in the memory 1302. Optionally, the processor 1301 may read data stored in the memory 1302. The data may be stored at the same storage address as the program 1304, or may be stored at a different storage address than the program 1304.
[0311] The processor 1301 and the memory 1302 may be provided separately or integrated together; for example, integrated on a system on chip (SOC) of a terminal device.
[0312] Exemplarily, the memory 1302 may be used to store a related program 1304 of the touch recognition method provided in the embodiment of the present application, and the processor 1301 may be used to call the related program 1304 of the touch recognition method stored in the memory 1302 when recognizing a user touch operation, and execute the touch recognition method of the embodiment of the present application; for example, according to the touch position of the user touch operation on the display screen, and the first relationship information, determine the target acceleration threshold corresponding to the target touch area, the first relationship information indicates a first correspondence between multiple first touch areas and multiple first acceleration thresholds, the touch position is located in the target touch area among the multiple first touch areas, the first detection acceleration of the first acceleration sensor caused by the first load force applied to different first connection positions on the phase line of two adjacent first touch areas is equal, and the first load force applied to the different first connection positions is equal; when the response acceleration of the first acceleration sensor to the user touch operation is greater than or equal to the target acceleration threshold, it is determined that the user touch operation is a preset touch action.
[0313] The present application also provides a computer program product, which, when executed by the processor 1301, implements the touch recognition method described in any method embodiment of the present application.
[0314] The computer program product may be stored in the memory 1302 , for example, a program 1304 , which is converted into an executable target file that can be executed by the processor 1301 after preprocessing, compiling, assembling, linking and other processing processes.
[0315] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the touch recognition method described in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.
[0316] The computer-readable storage medium is, for example, a memory 1302. The memory 1302 may be a volatile memory or a nonvolatile memory, or the memory 1302 may include both a volatile memory and a nonvolatile memory. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).
[0317] The embodiments of the present application may involve the use of user data. In actual applications, user-specific personal data may be used in the scheme described herein within the scope permitted by applicable laws and regulations, subject to the requirements of applicable laws and regulations of the country where the user is located (for example, with the user's explicit consent, effective notification to the user, etc.).
[0318] In the description of this application, the terms "first", "second", etc. are used only for descriptive purposes and should not be understood as indicating or implying relative importance, or a specific order or sequence. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances.
[0319] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.
[0320] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0321] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0322] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0323] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0324] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0325] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0326] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A touch recognition method, characterized in that: include: Determine a target acceleration threshold corresponding to a target touch area according to a touch position of a user's touch operation on the display screen and first relationship information, wherein the first relationship information indicates a first correspondence between a plurality of first touch areas and a plurality of first acceleration thresholds, the touch position is located in the target touch area among the plurality of first touch areas, first detection accelerations of the first acceleration sensor caused by first load forces applied to different first connecting positions on a connecting line between two adjacent first touch areas are equal, and the first load forces applied to the different first connecting positions are equal; When the response acceleration of the first acceleration sensor to the user touch operation is greater than or equal to the target acceleration threshold, it is determined that the user touch operation is a preset touch action.
2. The method according to claim 1, characterized in that The first acceleration threshold of each first touch area in the first relationship information is positively correlated with the second detected acceleration of the first touch area. The second detected acceleration of each first touch area is the acceleration of the first acceleration sensor caused by the second load force applied to the first touch area. The second load force applied to different first touch areas is equal.
3. The method according to claim 1 or 2, characterized in that: The method also includes: according to the touch position and the corresponding relationship between multiple sensor areas and multiple acceleration sensors, determining that the acceleration sensor corresponding to the target sensor area where the touch position is located is the first acceleration sensor, the multiple sensor areas correspond to multiple relationship information, and the first relationship information is the relationship information corresponding to the first acceleration sensor.
4. The method according to claim 3, characterized in that The third load force applied to the touch position causes a third detection acceleration of the first acceleration sensor to be greater than or equal to a fourth detection acceleration of other acceleration sensors among the multiple sensors.
5. The method according to claim 2, characterized in that: The method further comprises: Get the target coefficient; According to the target coefficient, the second acceleration threshold corresponding to each first touch area in the second relationship information is adjusted to obtain the first acceleration threshold corresponding to the first touch area in the first relationship information, the second relationship information indicates a second corresponding relationship between multiple second acceleration thresholds and the multiple first touch areas, and the second acceleration threshold corresponding to each first touch area is positively correlated with the second detected acceleration of the first touch area.
6. The method according to claim 5, characterized in that The obtaining of the target coefficient comprises: Determine a historical difference according to the historical acceleration of the historical operation by the first acceleration sensor and the second relationship information, wherein the historical operation is the preset touch action, the historical difference is the difference between the historical acceleration and the historical acceleration threshold, the historical acceleration threshold is the second acceleration threshold corresponding to the historical first touch area in the second relationship, and the historical first touch area is the touch area to which the historical position of the historical operation on the display screen belongs among the multiple touch areas; The target coefficient is determined according to the historical difference, and the target coefficient is positively correlated with the historical difference.
7. The method according to claim 5, characterized in that The method is applied to a first terminal device, and obtaining a target coefficient includes: The target coefficient of a second terminal device is received, the second terminal device is the same as the user of the second terminal device, the second terminal device is used to use third relationship information to identify the preset touch action, the third relationship information indicates a third correspondence between multiple second touch areas and multiple third acceleration thresholds, the third relationship information is obtained by adjusting the fourth acceleration threshold corresponding to the multiple second touch areas in the fourth relationship information using the target coefficient, the fifth detection acceleration of the second acceleration sensor caused by the fourth load force applied to different second connection positions on the phase line of two adjacent second touch areas is equal, the fourth load force applied to the different second connection positions is equal, the third acceleration threshold and the fourth acceleration threshold corresponding to each second touch area are positively correlated with the sixth detection acceleration of the second touch area, the sixth detection acceleration of each second touch area is the acceleration of the second acceleration sensor caused by the fifth load force applied to the second touch area, and the fifth load force applied to different second touch areas is equal.
8. The method according to claim 1 or 2, characterized in that: The method further comprises: According to the correspondence between the plurality of forms and the plurality of relationship information, it is determined that the first relationship information is the relationship information corresponding to the current form of the display screen in the plurality of relationship information.
9. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the electronic device executes the method according to any one of claims 1 to 8.
10. A chip, characterized in that: The method comprises a processor, and when the processor executes instructions, the processor performs the method according to any one of claims 1 to 8.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program for implementing the method according to any one of claims 1 to 8.
12. A computer program product, characterized in that The computer program product comprises: a computer program code, wherein the computer program code is used to implement the method according to any one of claims 1 to 8.
