Touch recognition system, method and equipment and computer readable storage medium

Abstract

The invention discloses a touch recognition system, method and equipment for electronic equipment and a computer readable storage medium, and relates to the technical field of signal processing, the touch recognition system comprises a signal receiver, a first signal transmitter, a second signal transmitter and a processing module; the first signal transmitter is used for transmitting a first signal, the second signal transmitter is used for transmitting a second signal, the first signal is different from the second signal, and the first signal and the second signal are both acoustic signals; the signal receiver is used for receiving original signals and inputting the received original signals to the processing module, and the original signals comprise a first signal and a second signal; the processing module is used for conducting touch recognition according to the original signal to obtain a touch recognition result, and the touch recognition result comprises a touch position. The touch sensing of the electronic equipment in a water environment is realized.

Description

Technical Field

[0001] The present application relates to the field of signal processing technology, and in particular to a touch recognition system, method, device and computer-readable storage medium. Background Art

[0002] With the popularity of various electronic devices (such as mobile phones, tablet computers, etc.), touch screen interaction is widely used. Generally speaking, electronic devices usually use capacitive touch screens, which determine the touch position by sensing the electric field changes caused by the user's finger.

[0003] However, capacitive touch screens are easily interfered by conductive objects such as water, and therefore cannot work properly in water environments such as wet fingers, underwater environments, and electronic devices whose screen surfaces are covered with liquid. In other words, electronic devices cannot achieve touch perception in water environments. Summary of the invention

[0004] The main purpose of the present application is to provide a touch recognition system, method, device and computer-readable storage medium, aiming to solve the technical problem that current electronic devices cannot achieve touch perception in a water environment.

[0005] To achieve the above-mentioned object, the present application provides a touch recognition system for an electronic device, the touch recognition system comprising a signal receiver, a first signal transmitter, a second signal transmitter and a processing module;

[0006] The first signal transmitter is used to transmit a first signal, and the second signal transmitter is used to transmit a second signal, wherein the first signal is different from the second signal, and both the first signal and the second signal are sound wave signals;

[0007] The signal receiver is used to receive an original signal and input the received original signal into the processing module, wherein the original signal includes the first signal and the second signal;

[0008] The processing module is used to perform touch recognition according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

[0009] In one embodiment, the first signal transmitter and the second signal transmitter transmit the first signal and the second signal alternately.

[0010] In one embodiment, the first signal is an up-sweep frequency signal, and the second signal is a down-sweep frequency signal.

[0011] In one embodiment, the processing module is further used for:

[0012] The original signal is input into a pre-trained touch recognition model to obtain a touch recognition result.

[0013] In one embodiment, the touch recognition model includes a time domain signal feature extractor, a frequency domain signal feature extractor and a time-frequency residual network, and the processing module is further used to:

[0014] Inputting the original signal into the time domain signal feature extractor to obtain time domain features;

[0015] Performing Fourier transform on the original signal to obtain the original signal in the frequency domain, and transmitting the original signal in the frequency domain to the frequency domain signal feature extractor to obtain frequency domain features;

[0016] The time domain features and the frequency domain features are input into the time-frequency residual network to obtain a touch recognition result.

[0017] In one embodiment, the signal receiver, the first signal transmitter and the second signal transmitter are respectively disposed at different positions of the electronic device.

[0018] In addition, to achieve the above-mentioned purpose, the present application also provides a touch recognition method, which is applied to a touch recognition system. The touch recognition system includes a signal receiver, a first signal transmitter and a second signal transmitter. The touch recognition method includes:

[0019] Acquire an original signal received by the signal receiver, wherein the original signal includes a first signal transmitted by the first signal transmitter and a second signal transmitted by the second signal transmitter, and the first signal is different from the second signal;

[0020] Touch recognition is performed according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

[0021] In one embodiment, the step of performing touch recognition according to the original signal to obtain a touch recognition result includes:

[0022] The original signal is input into a pre-trained touch recognition model to obtain a touch recognition result, wherein the touch recognition model includes a time domain signal feature extractor and a frequency domain signal feature extractor, the time domain signal feature extractor is used to extract the time domain features in the original signal, and the frequency domain signal feature extractor is used to extract the frequency domain features in the original signal.

[0023] In addition, to achieve the above-mentioned purpose, the present application also provides a touch recognition device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the touch recognition method as described above.

[0024] In addition, to achieve the above-mentioned purpose, the present application also provides a readable storage medium, which is a computer-readable storage medium, and a computer program is stored on the computer-readable storage medium. The computer program is executed by a processor to implement the steps of the touch recognition method and / or voice enhancement method as described above.

[0025] The present application also provides a computer program product, including a computer program, which implements the steps of the touch recognition method and / or voice enhancement method as described above when executed by a processor.

[0026] One or more technical solutions proposed in this application have at least the following technical effects:

[0027] A touch recognition system for electronic devices is provided, the touch recognition system comprising a signal receiver, a first signal transmitter, a second signal transmitter and a processing module; the first signal transmitter is used to transmit a first signal, the second signal transmitter is used to transmit a second signal, wherein the first signal is different from the second signal, and the first signal and the second signal are both sound wave signals; the signal receiver is used to receive an original signal, and input the received original signal into the processing module, wherein the original signal includes the first signal and the second signal; the processing module is used to perform touch recognition according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position. Considering that when the screen of an electronic device is touched, touching the screen may change the propagation path of the signal from the transmitter to the receiver, introduce additional noise or interference, shield or absorb the signal by the human body, etc., which may cause a certain difference between the signal received by the signal receiver and the signal when the screen of the electronic device is not touched. Based on this, in an embodiment of the present application, two signal transmitters are used to transmit two different signals, and the signal is received by the signal receiver, and touch recognition is performed according to the received signal to obtain a touch recognition result, and the touch recognition result at least includes the touch position. In this way, touch recognition is completed based on the transmission and reception of sound wave signals, without relying on electromagnetic properties, and is therefore not interfered by conductive media such as water, so that even in a water environment, the touch position can be sensed based on the difference in signals received by the signal receiver caused by touching the screen, thereby realizing touch perception of electronic devices in a water environment. Furthermore, the embodiment of the present application uses two signal transmitters to transmit signals, so that the two signal transmitters and the signal receiver can be regarded as anchor points of at least three known positions, thereby realizing two-dimensional precise point positioning of the touch position. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0029] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0030] Figure 1 This is a system architecture diagram of the first embodiment of the touch recognition system of the present application;

[0031] Figure 2 A schematic diagram of the arrangement positions of a signal receiver and a signal transmitter involved in an embodiment of a touch recognition method of the present application;

[0032] Figure 3 This is a schematic diagram of a first signal and a second signal involved in an embodiment of a touch recognition method of the present application;

[0033] Figure 4 A schematic diagram of a signal received by a signal receiver according to an embodiment of a touch recognition method of the present application;

[0034] Figure 5 This is a schematic diagram of a time domain feature extractor involved in an embodiment of a touch recognition method of the present application;

[0035] Figure 6 This is a schematic diagram of a frequency domain feature extractor involved in an embodiment of a touch recognition method of the present application;

[0036] Figure 7 This is a schematic diagram of a time-frequency residual network involved in an embodiment of a touch recognition method of the present application;

[0037] Figure 8 This is a schematic diagram of TFResBlock1 in a time-frequency residual network involved in an embodiment of a touch recognition method of the present application;

[0038] Fig. 9 This is a schematic diagram of TFResBlock2 in a time-frequency residual network involved in an embodiment of a touch recognition method of the present application;

[0039] Fig.10 A schematic diagram of the system processing flow of the touch recognition system of this application;

[0040] Fig.11 Schematic diagram of the device structure of the hardware operating environment involved in the touch recognition method device in the embodiment of the present application.

[0041] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0042] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0043] Most electronic devices, such as mobile phones and tablets, rely primarily on touch screens for interaction. Electronic devices typically use capacitive touch screens that determine touch locations by sensing changes in the electric field caused by the user's finger. However, these touch screens are easily disturbed by conductive objects such as water, so they do not work properly with wet fingers or in underwater environments.

[0044] There are some designs with waterproof features, such as Samsung Galaxy and Apple iPhone series, which are designed to be immersed in 1.5 meters of water for 30 minutes and support underwater photography. However, although the mobile phone itself has waterproof features, its touch screen cannot be used underwater, resulting in inconvenience in underwater operation.

[0045] There are some products on the market that try to solve the problem of underwater photography, such as DIVEVOLK Seatouch. It puts the phone in a special box and configures an airbag on the touch screen so that the touch screen can work underwater. However, this type of equipment needs to be adapted separately for each phone model, which is costly.

[0046] Based on this, the main solution of the present application is: to provide a touch recognition system that can be used for electronic devices, the touch recognition system includes a signal receiver, a first signal transmitter, a second signal transmitter and a processing module; the first signal transmitter is used to transmit a first signal, and the second signal transmitter is used to transmit a second signal, wherein the first signal is different from the second signal, and the first signal and the second signal are both sound wave signals; the signal receiver is used to receive an original signal, and input the received original signal into the processing module, wherein the original signal includes the first signal and the second signal; the processing module is used to perform touch recognition according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

[0047] The present application transmits two different signals by using two signal transmitters, and receives the signals by a signal receiver, and obtains the touch recognition result by inputting the received signals into a pre-trained touch recognition model, and the touch recognition result includes at least the touch position. In this way, touch recognition is completed based on the transmission and reception of sound wave signals, without relying on electromagnetic properties, and is therefore not affected by conductive media such as water. Even in a water environment, the touch position can be sensed based on the difference in signals received by the signal receiver caused by the touch screen, thereby realizing touch perception of electronic devices in a water environment. Furthermore, the present application uses two signal transmitters to transmit signals, so that the two signal transmitters and the signal receiver can be regarded as anchor points of at least three known positions, thereby realizing two-dimensional precise point positioning of the touch position.

[0048] Based on this, the present application proposes a touch recognition system of the first embodiment, the touch recognition system is applied to electronic devices, please refer to Figure 1 As shown, the touch recognition system includes a signal receiver, a first signal transmitter, a second signal transmitter and a processing module;

[0049] It should be noted that the electronic device may specifically be a device with a touch screen, such as a tablet computer, a mobile phone, a smart watch, etc. For example, the electronic device is taken as a mobile phone to illustrate and describe various embodiments of the present application.

[0050] The first signal transmitter is used to transmit a first signal, and the second signal transmitter is used to transmit a second signal, wherein the first signal is different from the second signal, and both the first signal and the second signal are sound wave signals;

[0051] The first signal transmitter and the second signal transmitter are both used to transmit sound wave signals. Specifically, the first signal transmitter and the second signal transmitter can both be vibration sensors. In a specific embodiment, the first signal transmitter and the second signal transmitter can both be signal transmitters composed of a ceramic transducer and a drive system (such as a sound card), wherein the drive system is used to drive the electrical signal to the ceramic transducer. When the ceramic transducer is subjected to voltage, a piezoelectric effect occurs, that is, the electric dipoles inside the ceramic material will be rearranged due to the action of the electric field, causing the material to produce mechanical deformation, which is manifested in the form of vibration, thereby generating sound waves and realizing signal transmission.

[0052] The first signal is different from the second signal, that is, the first signal and the second signal are two distinguishable signals. For example, the first signal is a signal with a first identifier, the second signal is a signal with a second identifier, and the first identifier is different from the second identifier; for another example, the first signal is a DC signal, and the second signal is an AC signal; for another example, the first signal is a single-frequency signal, and the second signal is a multi-frequency signal; for another example, considering that the Chirp signal can adapt to different propagation environments, such as different underwater environments, and the pulse compression characteristics of the Chirp signal can provide high time resolution at the receiving end, which is very important for precise positioning. The frequency modulation characteristics of the Chirp signal enable it to have better performance in noise and interference, which helps to improve the accuracy of positioning. Based on this, in a preferred embodiment, the first signal is an up-sweep signal (also called an Up-chirp signal), and the second signal is a down-sweep signal (also called a Down-chirp signal).

[0053] The up-sweep signal and the down-sweep signal are two types of linear frequency modulation (Chirp) signals whose frequencies change linearly over time. Specifically, the frequency of the up-sweep signal increases linearly from low frequency to high frequency over time, and the frequency of the down-sweep signal decreases linearly from high frequency to low frequency over time.

[0054] Furthermore, relevant personnel may pre-set the signal frequencies of the first signal and the second signal, and this embodiment does not impose specific restrictions on this. Considering that users may still use this touch recognition system in a non-underwater environment, and that the 18kHz to 22kHz signal may not be perceived by the human ear on the one hand, and that the vibration sensor has a better frequency response at 18kHz to 22kHz and a strong anti-interference ability of the signal on the other hand, based on this, in a preferred embodiment, the first signal and the second signal are both 18kHz to 22kHz signals.

[0055] The signal receiver is used to receive an original signal and input the received original signal into the processing module, wherein the original signal includes the first signal and the second signal;

[0056] The original signal may specifically be a signal received by a signal receiver. Similar to a signal transmitter, a signal receiver may also be a vibration sensor. In a specific embodiment, the signal receiver includes a ceramic transducer and a drive system (such as a sound card). The ceramic transducer is connected to the drive system. When sound waves (or other forms of mechanical vibration) propagate to the ceramic transducer, the transducer will vibrate. The vibration of the transducer causes the piezoelectric material inside the transducer to deform. According to the piezoelectric effect, this deformation generates electric charge on the surface of the material. The drive system is used to collect the electric charge generated by the ceramic transducer and convert it into an electrical signal to achieve signal reception.

[0057] The processing module is used to perform touch recognition according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

[0058] The touch recognition result of touch recognition based on the original signal. It is understandable that for the same signal transmitted by the signal transmitter, there are certain differences in the signals received by the signal receiver when the mobile phone is not touched and when the mobile phone is touched, and there are certain differences in the signals received by the signal receiver for different touch positions. Based on this, touch recognition can be performed based on this difference characteristic to obtain the touch recognition result. Specifically, relevant personnel can pre-set the touch recognition method, and this embodiment does not make specific restrictions on this.

[0059] The touch recognition result includes but is not limited to the touch position. Relevant personnel can also set touch recognition of other sensory information based on actual needs, such as touch duration, touch pressure, etc. For example, the touch recognition result is used as the touch position to illustrate and describe various embodiments of the present application.

[0060] Furthermore, the touch position may specifically be a position on the touch screen of the mobile phone. When the touch position is determined, the input logic of the mobile phone at this position may be triggered so that the touch screen of the mobile phone responds normally to external touch operations.

[0061] Furthermore, before the processing module performs pattern recognition on the original signal, it can also perform signal preprocessing on the original signal, and perform pattern recognition based on the preprocessed original signal to improve the signal quality of the original signal and further improve the accuracy of the pattern recognition result. Among them, the signal preprocessing may include noise reduction, normalization, outlier removal, etc., and relevant personnel can also set other signal preprocessing methods based on actual needs to improve the signal quality of the original signal, which is not specifically limited in this embodiment.

[0062] Considering that when the screen of an electronic device is touched, the touch screen may change the propagation path of the signal from the transmitter to the receiver, introduce additional noise or interference, and the shielding or absorption effect of the human body on the signal, etc., which may cause a certain difference between the signal received by the signal receiver and the signal when the screen of the electronic device is not touched. Based on this, in this embodiment, two signal transmitters are used to transmit two different signals, and the signal is received by the signal receiver, and the touch recognition result is obtained by performing touch recognition according to the received signal, and the touch recognition result at least includes the touch position. In this way, touch recognition is completed based on the transmission and reception of the sound wave signal, and does not rely on electromagnetic properties, so it is not interfered by conductive media such as water, so that even in a water environment, based on the difference in the signal received by the signal receiver caused by the touch screen, the touch position is perceived, thereby realizing the touch perception of the electronic device in a water environment. Further, in this embodiment, two signal transmitters are used to transmit signals, so that the two signal transmitters and the signal receiver can be regarded as anchor points of at least three known positions, thereby realizing two-dimensional precise point positioning of the touch position.

[0063] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated later. On this basis, the signal receiver, the first signal transmitter and the second signal transmitter are respectively arranged at different positions of the electronic device.

[0064] The first signal transmitter, the second signal transmitter and the signal receiver are respectively arranged at different positions of the mobile phone. Figure 2 As shown, the first signal transmitter, the second signal transmitter and the signal receiver are all arranged on the side of the mobile phone, and the first signal transmitter and the second signal transmitter are symmetrically distributed with the signal receiver as the center.

[0065] In a possible implementation manner, the first signal transmitter and the second signal transmitter transmit the first signal and the second signal alternately.

[0066] The first signal transmitter and the second signal transmitter transmit the first signal and the second signal alternately, that is, the first signal transmitter and the second signal transmitter do not transmit signals at the same time. Figure 3 As shown, Figure 3The horizontal axis represents time in milliseconds, and the vertical axis represents frequency in kilohertz kHz. The first signal transmitter and the second signal transmitter send up-sweep frequency signals and down-sweep frequency signals alternately every 50 milliseconds, such as the first signal transmitter sends up-sweep frequency signals from 0 to 50 milliseconds, the second signal transmitter sends down-sweep frequency signals from 50 to 100 milliseconds, the first signal transmitter sends up-sweep frequency signals from 100 to 150 milliseconds, and the second signal transmitter sends down-sweep frequency signals from 150 to 200 milliseconds.......

[0067] At this time, the original signal received by the signal receiver can be referred to Figure 4 As shown, Figure 4 The horizontal axis represents time in milliseconds, and the vertical axis represents frequency in kilohertz (kHz).

[0068] It should be noted that the first signal transmitter and the second signal transmitter send signals alternately. After the signal receiver sends the original signal to the processing module, the processing module can perform signal segmentation processing on the original signal to obtain sub-original signals of each alternating period, for example, Figure 4 Each inverted "V"-shaped signal is an alternating (100 milliseconds) sub-original signal. For each sub-original signal, the processing module performs pattern recognition according to the sub-original signal to obtain a touch recognition result corresponding to the sub-original signal.

[0069] Based on the first embodiment and / or the second embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those of the first and second embodiments can be referred to the above description, and will not be described in detail later. On this basis, the processing module is also used to:

[0070] The original signal is input into a pre-trained touch recognition model to obtain a touch recognition result.

[0071] The touch recognition model may specifically be a deep learning model, such as a neural network model based on Resnet (Residual Network).

[0072] In order to enable the touch recognition model to output the touch position, a training data set can be prepared in advance, the training data set includes multiple training signals and the touch position corresponding to each training signal, and the touch recognition model is trained with the training signal as input and the touch position as a label until the preset training end condition is met. It should be noted that the training signal in the training data set can be specifically a first signal emitted by a first signal transmitter in different scenarios (such as above water, underwater, etc.), a second signal transmitter emits a second signal, and a signal received by a signal receiver when touching different positions of the mobile phone touch screen and when not touching the mobile phone touch screen. Furthermore, it can also be a signal after the signal received by the signal receiver is preprocessed.

[0073] The training end conditions may be conditions set in advance, such as reaching a predetermined number of iterations, the loss function value being lower than a predetermined threshold, computing resources being exhausted, reaching a time limit, the accuracy reaching a predetermined threshold, etc. This embodiment does not impose specific restrictions on this.

[0074] In this embodiment, a pre-trained touch recognition model is used to perform touch recognition, so that efficient and high-accuracy recognition of the touch position can be achieved.

[0075] In a possible implementation, the touch recognition model includes a time domain signal feature extractor, a frequency domain signal feature extractor, and a time-frequency residual network, and the processing module is further used to:

[0076] Inputting the original signal into the time domain signal feature extractor to obtain time domain features;

[0077] The time domain signal feature extractor is used to extract the time domain features of the signal. The relevant personnel can pre-set the specific network structure of the feature extractor, and this embodiment does not impose any specific restrictions on this. For example, in a specific implementation, refer to Figure 5 As shown, the time domain signal feature extractor includes two Conv1d (Convolutional Layer 1D, one-dimensional convolution layer), and the activation function ReLU (Rectified Linear Unit, rectified linear unit) is used to activate the output after each Conv1d.

[0078] The time domain signal feature extractor takes the time domain signal as input and extracts time domain features based on the time domain signal.

[0079] The time domain feature is the output of the time domain feature extractor, which may specifically be features such as delay, signal energy, amplitude, and signal power.

[0080] Performing Fourier transform on the original signal to obtain the original signal in the frequency domain, and transmitting the original signal in the frequency domain to the frequency domain signal feature extractor to obtain frequency domain features;

[0081] The frequency domain signal feature extractor is used to extract the frequency domain features of the signal. Relevant personnel can pre-set the specific network structure of the feature extractor, and this embodiment does not impose specific restrictions on this. For example, in a specific implementation, refer to Figure 6 As shown, the frequency domain signal feature extractor includes three Conv1d (Convolutional Layer 1D, one-dimensional convolution layer), and the activation function ReLU (Rectified Linear Unit, rectified linear unit) is used to activate the output after each Conv1d.

[0082] The time domain signal feature extractor takes the frequency domain signal as input and extracts frequency domain features based on the frequency domain signal.

[0083] The frequency domain feature is the output of the frequency domain feature extractor, and specifically may be features such as frequency component, amplitude spectrum, power spectrum, and spectrum peak.

[0084] The time domain features and the frequency domain features are input into the time-frequency residual network to obtain a touch recognition result.

[0085] The time-frequency residual network is used to process the time domain features and the frequency domain features to obtain the touch recognition result, which can be the output of the time-frequency residual network. Relevant personnel can pre-set the specific network structure of the time-frequency residual network, and this embodiment does not make specific restrictions on this. For example, in a specific implementation, refer to Figure 7 As shown, the time-frequency residual network includes an input block, a TFRes (Time-Frequency ResNet) block and an output block connected in sequence. Specifically, the input block includes a Conv1d (one-dimensional convolution) layer, a BN (Batch Normalization) layer and a MaxPool (Max Pooling) layer connected in sequence, and the ReLU activation function is used to activate the output after the BN layer; the output block includes an AvgPool (Average Pooling) layer, a Flatten (flattening) layer and a FC (Fully Connected) layer connected in sequence; the TFRes block includes TFResBlock1 (TFRes block 1) and TFResBlock2 (TFRes block 2) connected alternately in sequence. The specific number of layers of the TFRes block can be preset by relevant personnel, and this embodiment does not impose specific restrictions on this. Among them, refer to Figure 8As shown, TFResBlock1 includes a Conv1d layer, a BN layer (the ReLU activation function is used to activate the output after the BN layer), a Conv1d layer, and a BN layer connected in sequence, and the input data is connected to the output residual of the BN layer after passing through the Conv1d layer, and finally the output is activated by the ReLU activation function; refer to Fig. 9 As shown, TFResBlock2 includes a Conv1d layer, a BN layer (the output is activated by the ReLU activation function after the BN layer), a Conv1d layer, and a BN layer connected in sequence. The input data is residually connected to the output of the BN layer, and finally the output is activated by the ReLU activation function.

[0086] Considering the traditional vibration touch perception, touch perception is achieved by transmitting very short high-frequency pulse signals based on the time domain characteristics of high-frequency pulse signals. High-frequency pulse signals have high requirements on the sampling rate of the device, and the device is usually required to reach a sampling rate of about 10MHz. Based on this, in this embodiment, the time domain characteristics and frequency domain characteristics of the signal are extracted respectively for touch recognition. In this way, the time domain characteristics and frequency domain characteristics are used for touch recognition at the same time, and the complementary advantages of frequency domain characteristics and time domain characteristics are used to reduce the high accuracy requirements of the time domain characteristics, thereby reducing the frequency requirements for the transmitted signal, and then reducing the sampling rate requirements (the sampling rate requirements can be reduced from the MHz level to the KHz level), so that low-cost touch perception can be achieved in mobile phones.

[0087] For example, to help understand the technical concept or technical principle of the touch recognition system after the present embodiment is combined with the first embodiment and the second embodiment, please refer to Fig.10 As shown, the touch recognition system includes a first signal transmitter, a second signal transmitter, a signal receiver and a processing module. The first signal transmitter, the second signal transmitter and the signal receiver are respectively arranged on the sides of the mobile phone. The first signal transmitter and the second signal transmitter alternately transmit upper sweep frequency signals and lower sweep frequency signals. The signal receiver inputs the received upper sweep frequency signals and lower sweep frequency signals into the processing module respectively. The processing module extracts the time domain features and frequency domain features of the input data based on the time domain processing block (also known as the time domain feature extractor) and the frequency domain processing block (also known as the frequency domain feature extractor), and inputs the extracted time domain features and frequency domain features into the feature processing block (also known as the time-frequency residual network). The feature processing block outputs the touch position to realize the touch perception of the position of the touch point on the mobile phone.

[0088] It should be noted that the above examples are only used to assist in understanding the present application and do not constitute a limitation on the touch recognition system of the present application. More simple transformations based on this technical concept are all within the protection scope of the present application.

[0089] In addition, the present invention also proposes a touch recognition system including a signal receiver, a first signal transmitter and a second signal transmitter, and the touch recognition method includes:

[0090] In addition, an embodiment of the present application further proposes a touch recognition method, which is applied to a touch recognition system, wherein the touch recognition system includes a signal receiver, a first signal transmitter, and a second signal transmitter, and the touch recognition method includes the following steps:

[0091] Step S10, acquiring an original signal received by the signal receiver, wherein the original signal includes a first signal transmitted by the first signal transmitter and a second signal transmitted by the second signal transmitter, and the first signal is different from the second signal;

[0092] Step S20: performing touch recognition according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

[0093] In one embodiment, the step of performing touch recognition according to the original signal to obtain a touch recognition result includes:

[0094] Step S201, input the original signal into a pre-trained touch recognition model to obtain a touch recognition result, wherein the touch recognition model includes a time domain signal feature extractor and a frequency domain signal feature extractor, the time domain signal feature extractor is used to extract the time domain features in the original signal, and the frequency domain signal feature extractor is used to extract the frequency domain features in the original signal.

[0095] In one embodiment, the first signal transmitter and the second signal transmitter transmit the first signal and the second signal alternately.

[0096] In one embodiment, the first signal is an up-sweep frequency signal, and the second signal is a down-sweep frequency signal.

[0097] In one embodiment, the signal receiver, the first signal transmitter and the second signal transmitter are respectively disposed at different positions of the mobile phone.

[0098] In addition, an embodiment of the present application also proposes a touch recognition device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the touch recognition method and / or speech enhancement method as described above.

[0099] refer to Fig.11, which shows a schematic diagram of the structure of a touch recognition device suitable for implementing the embodiment of the present application. The touch recognition device in the embodiment of the present application may also include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.11 The touch recognition device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0100] like Fig.11 As shown, the touch recognition device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the touch recognition device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the touch recognition device to communicate with other devices wirelessly or by wire to exchange data. Although the touch recognition device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0101] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0102] The touch recognition device provided in the embodiment of the present application adopts the touch recognition method in the above embodiment, which can solve the technical problem that the current electronic equipment cannot realize touch perception in a water environment. Compared with the prior art, the beneficial effects of the touch recognition device provided in the present application are the same as the beneficial effects of the touch recognition method provided in the above embodiment, and the other technical features in the touch recognition device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0103] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0104] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0105] In addition, to achieve the above-mentioned purpose, an embodiment of the present application further provides a readable storage medium having computer-readable program instructions (ie, computer program) stored thereon, and the computer-readable program instructions are used to execute the touch recognition method in the above-mentioned embodiment.

[0106] The computer-readable storage medium provided in the embodiment of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0107] The computer-readable storage medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0108] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by an electronic device, the electronic device: obtains an original signal received by a signal receiver, wherein the original signal includes a first signal transmitted by a first signal transmitter and a second signal transmitted by a second signal transmitter, and the first signal is different from the second signal; performs touch recognition according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

[0109] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0110] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0111] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of a module does not, in some cases, constitute a limitation on the module itself.

[0112] The readable storage medium provided in this application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned touch recognition method and / or voice enhancement method, and can solve the technical problem that current electronic devices cannot achieve touch perception in a water environment. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the touch recognition method provided in the above-mentioned embodiment, and will not be repeated here.

[0113] In addition, an embodiment of the present application further proposes a computer program product, including a computer program, which implements the steps of the touch recognition method and / or voice enhancement method described above when executed by a processor.

[0114] The specific implementation of the computer program product of the present application is basically the same as the above-mentioned embodiments of the touch recognition and / or voice enhancement method, and will not be repeated here.

[0115] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0116] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0117] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software sensor, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, including a number of instructions for a terminal device (which can be a mobile phone, computer, server or network device, etc.) to execute the methods described in each embodiment of the present application.

[0118] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A touch recognition system for an electronic device, characterized in that: The touch recognition system includes a signal receiver, a first signal transmitter, a second signal transmitter and a processing module; The first signal transmitter is used to transmit a first signal, and the second signal transmitter is used to transmit a second signal, wherein the first signal is different from the second signal, and both the first signal and the second signal are sound wave signals; The signal receiver is used to receive an original signal and input the received original signal into the processing module, wherein the original signal includes the first signal and the second signal; The processing module is used to perform touch recognition according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

2. The touch recognition system according to claim 1, characterized in that: The first signal transmitter and the second signal transmitter transmit the first signal and the second signal alternately.

3. The touch recognition system according to claim 1, characterized in that: The first signal is an up-sweep frequency signal, and the second signal is a down-sweep frequency signal.

4. The touch recognition system according to claim 1, characterized in that: The processing module is further used for: The original signal is input into a pre-trained touch recognition model to obtain a touch recognition result.

5. The touch recognition system as claimed in claim 4, characterized in that: The touch recognition model includes a time domain signal feature extractor, a frequency domain signal feature extractor and a time-frequency residual network, and the processing module is further used for: Inputting the original signal into the time domain signal feature extractor to obtain time domain features; Performing Fourier transform on the original signal to obtain the original signal in the frequency domain, and transmitting the original signal in the frequency domain to the frequency domain signal feature extractor to obtain frequency domain features; The time domain features and the frequency domain features are input into the time-frequency residual network to obtain a touch recognition result.

6. The touch recognition system according to any one of claims 1 to 5, characterized in that: The signal receiver, the first signal transmitter and the second signal transmitter are respectively arranged at different positions of the electronic device.

7. A touch recognition method, characterized in that: Applied to a touch recognition system, the touch recognition system includes a signal receiver, a first signal transmitter and a second signal transmitter, and the touch recognition method includes: Acquire an original signal received by the signal receiver, wherein the original signal includes a first signal transmitted by the first signal transmitter and a second signal transmitted by the second signal transmitter, and the first signal is different from the second signal; Touch recognition is performed according to the original signal to obtain a touch recognition result, wherein the touch recognition result includes a touch position.

8. The touch recognition method according to claim 7, characterized in that: The step of performing touch recognition according to the original signal to obtain a touch recognition result comprises: The original signal is input into a pre-trained touch recognition model to obtain a touch recognition result, wherein the touch recognition model includes a time domain signal feature extractor and a frequency domain signal feature extractor, the time domain signal feature extractor is used to extract the time domain features in the original signal, and the frequency domain signal feature extractor is used to extract the frequency domain features in the original signal.

9. A touch recognition device, characterized in that: The touch recognition device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the touch recognition method according to any one of claims 7 to 8.

10. A readable storage medium, characterized in that: The readable storage medium is a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method according to any one of claims 7 to 8 are implemented.

Images