Knock control method and device, electronic equipment and storage medium

Abstract

The invention discloses a knock control method and device, electronic equipment and a storage medium. The method is applied to the electronic equipment, the electronic equipment is placed on a target object, and the method comprises the following steps: acquiring a knocking signal transmitted through the target object; recognizing the knocking signal to obtain a knocking recognition result; and executing a knock response event corresponding to the knock identification result. By means of the mode, it is avoided that when contaminants exist on the hands of a user, the user directly makes contact with the electronic equipment, and damage to the electronic equipment is caused.

Description

Technical Field

[0001] The present application relates to the field of tapping control technology, and in particular to a tapping control method, device, electronic device and storage medium. Background Art

[0002] Electronic devices provide more and more functions. For example, users can control the electronic devices by touching physical buttons or virtual buttons on the electronic devices.

[0003] In some scenarios, there is a certain distance between the user and the electronic device, making it inconvenient to directly control the electronic device, or the user's hands are covered with pollutants such as oil or water, making it inconvenient to directly touch the electronic device. Summary of the invention

[0004] The present application provides a tapping control method, device, electronic device and storage medium to prevent the user's hands from directly contacting the electronic device when there are contaminants on them, thereby preventing the electronic device from being damaged.

[0005] In a first aspect, the present application provides a knock control method, which is applied to an electronic device, where the electronic device is placed on a target object, and the method includes: obtaining a knock signal transmitted through the target object; identifying the knock signal to obtain a knock recognition result; and executing a knock response event corresponding to the knock recognition result.

[0006] In the second aspect, the present application provides a knock control device, which is applied to an electronic device, and the electronic device is placed on a target object. The knock control device includes: an acquisition module, which is used to acquire a knock signal transmitted through the target object; an identification module, which is used to identify the knock signal and obtain a knock recognition result; and an execution module, which is used to execute a knock response event corresponding to the knock recognition result.

[0007] In a third aspect, the present application provides an electronic device, comprising a processor and a memory coupled to the processor; wherein the memory is used to store a computer program, and the processor is used to execute the computer program to implement the method provided in the first aspect.

[0008] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the method provided in the first aspect.

[0009] The beneficial effects of the present application are as follows: different from the prior art, the tapping control method, device, electronic device and storage medium provided by the present application enable the electronic device to non-contactly acquire the tapping signal transmitted through the target object, identify the tapping signal, and obtain a tapping recognition result; execute a tapping response event corresponding to the tapping recognition result to avoid direct contact with the electronic device when there are contaminants on the user's hands, causing damage to the electronic device; further, when there is a certain distance between the user and the electronic device, the electronic device can be controlled by tapping the target object, which can reduce the user's movement toward the electronic device and achieve non-contact control. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0011] Figure 1 It is a flowchart of an embodiment of a knock control method provided by the present application;

[0012] Figure 2 is a flow chart of another embodiment of the tapping control method provided by the present application;

[0013] Figure 3 is a flow chart of another embodiment of the tapping control method provided by the present application;

[0014] Figure 4 is a flow chart of another embodiment of the tapping control method provided by the present application;

[0015] Figure 5 is a flow chart of another embodiment of the tapping control method provided by the present application;

[0016] Figure 6 It is a schematic diagram of the coordinate axis distribution of the electronic device provided by this application;

[0017] Figure 7 is a schematic diagram of an embodiment of a knock signal provided by the present application;

[0018] Figure 8 It is a structural schematic diagram of an embodiment of a knocking control method and device provided by the present application;

[0019] Fig. 9 It is a structural schematic diagram of an embodiment of an electronic device provided by the present application;

[0020] Fig.10 is a structural schematic diagram of another embodiment of the electronic device provided by the present application;

[0021] Fig.11 It is a structural schematic diagram of an embodiment of a computer-readable storage medium provided by the present application. DETAILED DESCRIPTION

[0022] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It will be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some but not all structures related to the present application are shown in the drawings. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0023] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0024] See also Figure 1 , Figure 1 1 is a flow chart of an embodiment of a tapping control method provided by the present application. Applied to an electronic device, the electronic device is placed on a target object, and the method includes:

[0025] Step 11: Acquire the knocking signal conducted through the target object.

[0026] In some embodiments, the electronic device may be a mobile electronic device, such as a smart phone or tablet computer, or other electronic device with corresponding autonomous processing capabilities, or the electronic device may be a non-mobile electronic device that may be fixedly mounted on a target object.

[0027] The target object may be a table, and the electronic device may be placed on the tabletop. The target object may be a chair, and the electronic device may be placed on the main surface of the chair.

[0028] In other application scenarios, the surface of the target object may be a horizontal surface or a non-horizontal surface, and the electronic device may be placed on the surface of the target object.

[0029] It can be understood that since the electronic device is a three-dimensional structure, the electronic device can be placed on the surface of the target object at different placement angles, that is, the electronic device can contact the target object through different surfaces and be placed on the target object.

[0030] In some embodiments, the target object has a specific corresponding conduction function. For example, if an electronic device is placed on the target object, the energy (such as vibration) generated by tapping the target object can be conducted to the electronic device through the target object.

[0031] In some embodiments, a corresponding sensor may be provided in the electronic device to collect the corresponding tapping signal.

[0032] Step 12: Identify the knocking signal and obtain the knocking recognition result.

[0033] In some embodiments, if a knock signal is generated, there will be obvious signal fluctuations in the knock signal. If the target object is single-clicked, there will be obvious one signal fluctuation in the knock signal. If the target object is double-clicked, there will be obvious two signal fluctuations in the knock signal. If the target object is triple-clicked, there will be obvious three signal fluctuations in the knock signal.

[0034] Therefore, the knock recognition result can be obtained by identifying the number of signal fluctuations in the knock signal.

[0035] In some embodiments, the corresponding tap recognition result can be set for the current usage scenario according to the current usage scenario of the electronic device. For example, in scenario A, the required tap signal is a double-click signal. Then, only when a double-click signal is recognized, the corresponding tap recognition result is a successful recognition, and the other tap signals will fail to recognize. For example, in scenario B, the required tap signal is a triple-click signal. Then, only when a triple-click signal is recognized, the corresponding tap recognition result is a successful recognition, and the other tap signals will fail to recognize.

[0036] In some embodiments, when identifying a knock signal, it is necessary to determine the time interval between adjacent signal fluctuations. If the time interval is less than a first preset time interval, the adjacent signal fluctuations can be considered to be continuous. If there are two signal fluctuations in the current knock signal, and the time interval between the two signal fluctuations is less than the first preset time interval, it can be determined that the knock signal at this time is a double-click signal. If there are three signal fluctuations in the current knock signal, and the time interval between adjacent signal fluctuations in these three signal fluctuations is less than the first preset time interval, it can be determined that the knock signal at this time is a triple-click signal. If there are three signal fluctuations in the current knock signal, and among these three signal fluctuations, only the time interval between the first two adjacent signal fluctuations is less than the first preset time interval, or only the time interval between the last two adjacent signal fluctuations is less than the first preset time interval, it can be determined that the knock signal at this time is a double-click signal, and the other signal fluctuation is an interference signal.

[0037] Furthermore, if the time interval between another signal fluctuation and its previous signal fluctuation is greater than the first preset time interval, and the time interval is much greater than the first preset time interval, and step 13 has been executed within this time interval, then the other signal fluctuation and subsequent signal fluctuations can be re-identified as knocking signals.

[0038] Step 13: Execute a tap response event corresponding to the tap recognition result.

[0039] In some embodiments, the tap response event corresponding to the tap recognition result may be executed by switching the electronic device from a first state to a second state.

[0040] In some embodiments, the electronic device invokes an application that matches the tap response event.

[0041] In some embodiments, if the tap recognition result is a recognition failure, the tap response event is no response. If the tap recognition result is a recognition success, the corresponding tap response event is obtained and executed by searching the relationship corresponding to the tap recognition result.

[0042] For example, if the tap recognition result is a double-click recognition success, tap response event A is executed; if the tap recognition result is a single-click recognition success, tap response event B is executed; if the tap recognition result is a triple-click recognition success, tap response event C is executed.

[0043] In one application scenario, an electronic device is placed on a desktop and is playing music. The user can control the music by tapping the desktop. For example, if the user double-clicks the desktop, the electronic device obtains the corresponding tapping signal, and the tapping recognition result is a successful double-click recognition, then the music playback is paused. If the user double-clicks the desktop again, the electronic device obtains the corresponding tapping signal again, and the tapping recognition result is a successful double-click recognition, then the music playback is switched from pause to music playback. If the user single-clicks the desktop, the electronic device obtains the corresponding tapping signal, and the tapping recognition result is a successful single-click recognition, then the next music playback is switched. If the user triple-clicks the desktop again, the electronic device obtains the corresponding tapping signal again, and the tapping recognition result is a successful triple-click recognition, then the previous music playback is switched.

[0044] It can be understood that in an electronic device, corresponding tapping control instructions can be set for different applications so that the user can control the electronic device by tapping.

[0045] In this embodiment, the electronic device non-contactly acquires the knock signal transmitted through the target object, identifies the knock signal, and obtains a knock recognition result; executes a knock response event corresponding to the knock recognition result to avoid direct contact with the electronic device when there are contaminants on the user's hands, causing damage to the electronic device; further, when there is a certain distance between the user and the electronic device, the electronic device can be controlled by knocking on the target object, which can reduce the user's movement toward the electronic device and achieve non-contact control.

[0046] See also Figure 2 , Figure 2 1 is a flow chart of another embodiment of the tapping control method provided by the present application. The method is applied to an electronic device, the electronic device is placed on a target object, and a sensor is provided on the electronic device, wherein the sensor can be built into the electronic device or externally placed on the electronic device. The method includes:

[0047] Step 21: Use a sensor to collect the knocking signal transmitted through the target object.

[0048] When the electronic device is placed on the target object, the sensor collects the knocking signal according to the corresponding collection frequency. The sensor can be an accelerometer. The accelerometer produces data at a frequency of 200 frames, 100 frames or 50 frames per second. Of course, the specific collection frequency needs to be determined according to the performance of the accelerometer.

[0049] In some embodiments, the acceleration sensor is a three-axis sensor. When the electronic device is placed on the target object in a corresponding manner, the three-axis sensor can respectively collect knocking signals of corresponding axes.

[0050] Step 22: The knocking signal within the unit time is taken as the target knocking signal.

[0051] In some embodiments, the unit time may be 2 seconds, 1 second or 50 milliseconds, which may be determined specifically according to the acquisition frequency of the sensor. If the acquisition frequency is high, the unit time may be smaller, and if the acquisition frequency is low, the unit time may be larger. That is, the unit time is negatively correlated with the acquisition frequency of the sensor.

[0052] In some embodiments, part of the signals between adjacent target knocking signals overlap. Because the target knocking signal is collected in the dimension of time, the time between adjacent target knocking signals is partially overlapped, so part of the signals will also overlap. For example, if the unit time is 1 second, the time interval between adjacent target knocking signals is 0.1 second. For example, during the period from the 0th second to the 1st second, since it is less than 1 second, no target knocking signal is generated. At the 1.0th second, the knocking signal during the period from the 0th second to the 1st second is used as the target knocking signal; when it is 1.1 seconds, the knocking signal from the 0.1st second to the 1.1st second is used as the target knocking signal. By analogy, at the 1.2th second, the knocking signal from the 0.2nd second to the 1.2th second is used as the target knocking signal, and at the 1.3th second, the knocking signal from the 0.3rd second to the 1.3th second is used as the target knocking signal. The target knocking signal obtained in this way can retain more information of the knocking signal to a greater extent, and improve the accuracy of subsequent knocking signal recognition.

[0053] Step 23: Identify the target knocking signal and obtain the knocking recognition result.

[0054] Step 24: Execute a tap response event corresponding to the tap recognition result.

[0055] Step 23 and step 24 may have the same or similar technical solutions as the other embodiments of the present application and will not be described in detail here.

[0056] In one application scenario, an electronic device is placed on a target object, and the user is at a certain distance from the electronic device. When the electronic device receives an incoming call, it is inconvenient for the user to directly touch and control the electronic device. In this case, the target object can be knocked in the above manner to cause the target object to transmit a knocking signal to the electronic device. When the electronic device receives the knocking signal, it identifies the knocking signal and then controls the incoming call accordingly. For example, a double-click signal corresponds to hanging up the call, and a triple-click signal corresponds to answering the call. If the knocking signal is identified and the identification result is a double-click signal, the electronic device hangs up the call. If the knocking signal is identified and the identification result is a triple-click signal, the electronic device answers the call and puts the call out to allow the user to answer the call.

[0057] In one application scenario, an electronic device is placed on a target object, and the electronic device is playing a video. The user wants to control the video to pause, but there are contaminants on the user's hands, such as water, oil or other contaminants. The user taps the target object so that the target object transmits a tapping signal to the electronic device. When the electronic device receives the tapping signal, it identifies the tapping signal and pauses the video played in the electronic device according to the identification result. If the user wants to continue playing, the user can tap the target object again so that the target object transmits a tapping signal to the electronic device. When the electronic device receives the tapping signal, it identifies the tapping signal and continues to play the video according to the identification result.

[0058] In this embodiment, the electronic device non-contactly acquires the knock signal transmitted through the target object, identifies the knock signal, and obtains a knock recognition result; executes a knock response event corresponding to the knock recognition result to avoid direct contact with the electronic device when there are contaminants on the user's hands, causing damage to the electronic device; further, when there is a certain distance between the user and the electronic device, the electronic device can be controlled by knocking on the target object, which can reduce the user's movement toward the electronic device and achieve non-contact control.

[0059] See also Figure 3 , Figure 3 1 is a flow chart of another embodiment of the tapping control method provided by the present application. Applied to an electronic device, the electronic device is placed on a target object, and the method includes:

[0060] Step 31: Acquire the knocking signal transmitted through the target object.

[0061] Step 31 may have the same or similar technical solutions as the other embodiments of the present application and will not be described in detail here.

[0062] Step 32: Input the knock signal into the knock recognition model for recognition to obtain a knock recognition result.

[0063] In some embodiments, the knock recognition model can be trained in advance using corresponding training knock signals, and after the training is completed, it is applied to normal recognition.

[0064] In some embodiments, the tap recognition model can be trained using an unsupervised learning approach or a supervised learning approach.

[0065] In some embodiments, the tap recognition model can recognize multiple types of tap signals, such as a single tap signal, a double tap signal, a triple tap signal, and more than three tap signals.

[0066] In some embodiments, the knock recognition model can be adapted to the applications of different electronic devices. That is, the application identifier currently running on the electronic device is input into the knock recognition model, so that the knock recognition model is used in combination with the currently running application to identify the knock signal, and obtain the knock recognition result corresponding to the currently running application. For example, if application a only corresponds to one knock signal, then when the knock signal is obtained, the application identifier and the knock signal of application a are input into the knock recognition model, and the knock recognition model only recognizes the knock signal corresponding to application a, and the remaining knock signals will fail to be recognized. For example, if application b corresponds to two knock signals, then when the knock signal is obtained, the application identifier and the knock signal of application b are input into the knock recognition model, and the knock recognition model only recognizes the two knock signals corresponding to application b, and the remaining knock signals will fail to be recognized.

[0067] Step 33: Execute a tap response event corresponding to the tap recognition result.

[0068] Step 33 may have the same or similar technical solutions as the other embodiments of the present application and will not be described in detail here.

[0069] In one application scenario, an electronic device is placed on a target object, and the electronic device is playing music. The user wants to control the music, but there are contaminants on the user's hands, such as water, oil, or other contaminants. The user can tap the target object so that the target object transmits a tapping signal to the electronic device. When the electronic device receives the tapping signal, it recognizes the tapping signal and controls the music in the electronic device according to the recognition result, such as switching music, pausing music, or fast forwarding.

[0070] In this embodiment, the electronic device non-contactly acquires the knock signal transmitted through the target object, identifies the knock signal, and obtains a knock recognition result; executes a knock response event corresponding to the knock recognition result to avoid direct contact with the electronic device when there are contaminants on the user's hands, causing damage to the electronic device; further, when there is a certain distance between the user and the electronic device, the electronic device can be controlled by knocking on the target object, which can reduce the user's movement toward the electronic device and achieve non-contact control.

[0071] In some application scenarios, relying solely on the above-mentioned acceleration sensor to judge the knocking signal may result in misidentification or missed recognition. This is especially true when the target object is relatively large, such as a large table in a large conference room. Even if the table is knocked from a distance of several meters, the electronic device may still capture the corresponding knocking signal because the table is integrated. Based on this, refer to Figure 4 , Figure 4 1 is a flow chart of an embodiment of a tapping control method provided by the present application. Applied to an electronic device, the electronic device is placed on a target object, and the method includes:

[0072] Step 41: Acquire a knocking vibration signal transmitted through the target object, and acquire a corresponding knocking audio signal.

[0073] It can be understood that when the target object is struck, there will be a sound (audio signal) synchronously.

[0074] The knocking vibration signal can be collected by an acceleration sensor, and the audio signal can be collected by a pickup, such as a pickup used for talking in an electronic device, so that an additional pickup does not need to be provided. In other embodiments, an additional pickup may also be provided.

[0075] Step 42: Input the knocking vibration signal and the knocking audio signal into the knocking recognition model for recognition to obtain a knocking recognition result.

[0076] In some embodiments, the knock recognition model can be trained in advance using corresponding training knock vibration signals and training knock audio signals, and after the training is completed, it is applied to normal recognition.

[0077] In some embodiments, the tap recognition model can be trained using an unsupervised learning approach or a supervised learning approach.

[0078] In some embodiments, the tap recognition model can recognize multiple types of tap signals, such as a single-tap signal and its corresponding audio signal, a double-tap signal and its corresponding audio signal, a triple-tap signal and its corresponding audio signal, and more than three-tap signals and their corresponding audio signals.

[0079] In some embodiments, the knocking vibration signal and the knocking audio signal can be input into the knocking recognition model for recognition, and the corresponding recognition results are obtained respectively, and the knocking recognition result is obtained by combining the two recognition results. For example, the knocking recognition model usually obtains the recognition probability, then the two recognition probabilities can be averaged, and the knocking recognition result is obtained according to the average value. For example, the probability that the knocking recognition model recognizes that the current knocking vibration signal is a double-click signal is 0.8, and the probability that the distance between the sound source of the knocking audio signal and the electronic device is less than the preset distance is 0.7, then the average value is 0.75, therefore, the knocking recognition result is 1, wherein 1 indicates successful recognition. For example, the probability that the knocking recognition model recognizes that the current knocking vibration signal is a double-click signal is 0.6, and the probability that the distance between the sound source of the knocking audio signal and the electronic device is less than the preset distance is 0.3, then the average value is 0.45, therefore, the knocking recognition result is 0, wherein 0 indicates failed recognition.

[0080] In other embodiments, the recognition results corresponding to the knocking vibration signal and the knocking audio signal may be weighted. The knocking recognition result is obtained according to the weighted result. For example, it is expressed as follows:

[0081] Y=a*y1+b*y2. Wherein, Y represents the knocking recognition result, y1 represents the recognition result corresponding to the knocking vibration signal, y2 represents the recognition result corresponding to the knocking audio signal, and a and b represent weights, where a and b can be set according to the importance of the knocking vibration signal and the knocking audio signal. If a is greater than b, then a+b=1.

[0082] In some embodiments, see Figure 5 , step 42 may be the following process:

[0083] Step 421: input the knocking vibration signal into the knocking recognition model for recognition, and obtain a vibration recognition result.

[0084] Step 422: Input the knocking audio signal into the knocking recognition model for recognition to obtain an audio recognition result.

[0085] In some embodiments, the knock recognition model can identify whether the knock audio signal corresponds to the knock vibration signal, and can also identify the distance between the sound source of the knock audio signal and the electronic device. The sound source refers to the source of the sound, that is, the place where the sound is generated.

[0086] In the knock recognition model, a corresponding preset distance is set. When the distance is less than the preset distance, the audio recognition result is a first value, and when the distance is greater than the preset distance, the audio recognition result is a second value. When the knock audio signal is not recognized, the audio recognition result is the second value.

[0087] Step 423: Obtain a tapping recognition result according to the vibration recognition result and the audio recognition result.

[0088] In some embodiments, if the vibration recognition result is a first value and the audio recognition result is a second value, the tap recognition result is a second value, wherein the first value indicates successful recognition and the second value indicates failed recognition, indicating that the tap vibration signal is a false tap or is not a tap for the electronic device.

[0089] If the vibration recognition result is the first value and the audio recognition result is the first value, then the knock recognition result is the first value. The first value indicates that the recognition is successful, and the second value indicates that the recognition fails, indicating that the knock vibration signal is a knock on the electronic device.

[0090] If the vibration recognition result is the second value, the tapping recognition result is the second value, wherein the first value indicates successful recognition and the second value indicates failed recognition, indicating that no tapping is performed at this time, and the tapping recognition result is the second value regardless of whether the audio recognition result is the first value or the second value.

[0091] Step 43: Execute a tap response event corresponding to the tap recognition result.

[0092] Step 43 may have the same or similar technical solutions as the other embodiments of the present application and will not be described in detail here.

[0093] In this embodiment, the electronic device non-contactly acquires the knock signal transmitted through the target object, identifies the knock signal, and obtains a knock recognition result; executes a knock response event corresponding to the knock recognition result to avoid direct contact with the electronic device when there are contaminants on the user's hands, causing damage to the electronic device; further, when there is a certain distance between the user and the electronic device, the electronic device can be controlled by knocking on the target object, which can reduce the user's movement toward the electronic device and achieve non-contact control.

[0094] In one application scenario, an accelerometer is provided in an electronic device, and the accelerometer produces data at a frequency of 200 frames per second. The accelerometer transmits the data of the most recent second to the tapping recognition model every 0.1 seconds. For example, during the period from 0 to 1 second, since it is less than 1 second, no data is transmitted to the tapping recognition model, and the tapping recognition model does not run. At 1.0 seconds, 200 frames of data generated during the period from 0 to 1 second are sent to the tapping recognition model. If the return value of the tapping recognition model is 1, it is considered that the user has an action of tapping the target object, such as tapping the table. Then, the electronic device performs operations related to tapping. If the return value of the tapping recognition model is 0, the electronic device does not perform any operations related to tapping. Then, wait until 1.1 seconds, send the data from 0.1 to 1.1 seconds to the tapping recognition model, and continue the same steps. And so on, at 1.2 seconds, the data from 0.2 seconds to 1.2 seconds are sent to the tapping recognition model, and at 1.3 seconds, the data from 0.3 seconds to 1.3 seconds are sent to the tapping recognition model.

[0095] Specifically, in this application scenario, the tap recognition model is a neural network model based on deep learning. The input of the model is a 3*200 list of data, and the output is a value. The meaning of 3*200 is: 200 is the 200 frames of data collected by the acceleration sensor in the last 1 second. Each frame of data contains 3 dimensions: the value of acceleration in the x-axis direction, the value of acceleration in the y-axis direction, and the value of acceleration in the z-axis direction. Figure 6 As shown, the left and right direction of the electronic device is the direction of the x-axis, the up and down direction of the mobile phone is the direction of the y-axis, and the front and back direction of the mobile phone is the direction of the z-axis.

[0096] The output is a value in the range of (0, 1), which represents the probability of the data being a double-click, a single-click, or a triple-click. The threshold is 0.5. If it is greater than 0.5, it is considered a double-click, a single-click, or a triple-click. If it is less than 0.5, it is not considered a double-click, a single-click, or a triple-click.

[0097] The following is an introduction to the principle. Figure 7As shown, this is a 2-second data segment. The length of the horizontal axis is 400, representing 400 frames, where each second corresponds to 200 frames. Figure 7 Different lines are used to correspond to the acceleration values ​​in the x-axis direction, the y-axis direction, and the z-axis direction. Figure 6 Place it flat on the table in the manner shown. Every time the user taps the table once, the z-axis of the accelerometer will produce an obvious change in acceleration, showing an oscillating state. If the user taps the table twice, two obvious accelerations will appear. Figure 7 There are two obvious peaks in the graph.

[0098] Further, if the return value of the tap recognition model is 1, the pre-set behavior is turned on. In some embodiments, the pre-set behavior can be functions that can be realized by electronic devices such as pausing playback, switching to the next picture, switching to the next video, sliding down Weibo, starting screen recording, and clearing memory, which are not listed here one by one.

[0099] In other application scenarios, relying solely on the phone's accelerometer to determine a double-click on the desktop may result in misidentification or missed identification. This is especially true when the table is large, such as a large table in a large conference room. Even if you tap on the table from a few meters away, the phone may still capture the acceleration because the table is integrated. If you do not want tapping too far away to affect the phone, you can use sound information to make a judgment.

[0100] While acquiring the acceleration sensor information, the audio signal is captured, and then the acceleration data and the audio signal are simultaneously sent to the tap recognition model. The tap recognition model will combine the audio signal and acceleration information to make a judgment on the current data. The combination of the two will significantly reduce the probability of misidentification.

[0101] In some embodiments, if the electronic device is placed on the target object, and the target object is covered with soft materials such as cowhide and mouse pads, the knocking vibration signal may be weak. At this time, the audio signal can be combined for judgment. For example, the probability that the knocking recognition model recognizes that the current knocking vibration signal is a double-click signal is 0.4, and the probability that the distance between the sound source of the knocking audio signal and the electronic device is less than the preset distance is 0.9, then the average value is 0.65, so the knocking recognition result is 1, where 1 indicates successful recognition. Among them, a preset probability value can be set for the audio signal. When the recognition probability of the audio signal is greater than the preset probability value, it can be characterized that a knock must have occurred, and usually the user knows the control method of the knock in advance, then the knocking recognition result is directly identified as a successful recognition.

[0102] See also Figure 8 , Figure 81 is a schematic diagram of a structure of an embodiment of a knock control device provided by the present application. Applied to an electronic device, the electronic device is placed on a target object, and the knock control device 80 includes: an acquisition module 81, a recognition module 82 and an execution module 83.

[0103] The acquisition module 81 is used to acquire the knocking signal transmitted through the target object.

[0104] The recognition module 82 is used to recognize the knocking signal and obtain a knocking recognition result.

[0105] The execution module 83 is used to execute a tap response event corresponding to the tap recognition result.

[0106] It can be understood that the acquisition module 81, the identification module 82 and the execution module 83 cooperate to implement the method of any of the above embodiments.

[0107] See also Fig. 9 , Fig. 9 1 is a schematic diagram of the structure of an embodiment of an electronic device provided by the present application. The electronic device 110 includes a processor 111 and a memory 112 coupled to the processor 111; wherein the memory 112 is used to store a computer program, and the processor 111 is used to execute the computer program to implement the following method:

[0108] Acquire a knock signal transmitted through the target object; identify the knock signal and obtain a knock recognition result; and execute a knock response event corresponding to the knock recognition result.

[0109] It can be understood that the processor 111 is used to execute a computer program to implement the method of any of the above embodiments.

[0110] See also Fig.10 , Fig.10 1 is a schematic diagram of the structure of another embodiment of the electronic device provided by the present application. The electronic device 110 may be, for example, a mobile electronic device, and the electronic device 110 may include: a memory 112, a processor (Central Processing Unit, CPU) 111, a circuit board (not shown in the figure), a power circuit and a microphone 123. The circuit board is placed inside the space surrounded by the shell; the processor 111 and the memory 112 are arranged on the circuit board; the power circuit is used to supply power to various circuits or devices of the electronic device; the memory 112 is used to store executable program codes; the processor 111 runs a computer program corresponding to the executable program code by reading the executable program code stored in the memory 112, so as to implement the method of any of the above embodiments.

[0111] The electronic device may also include: a peripheral interface 114, an RF (Radio Frequency) circuit 116, an audio circuit 117, a speaker 122, a power management chip 119, an input / output (I / O) subsystem 120, other input / control devices 121, a display 124 and an external port 115. These components communicate through one or more communication buses or signal lines 118.

[0112] The memory 112 can be accessed by the processor 111, the peripheral interface 114, etc. The memory 112 can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other volatile solid-state storage devices. The peripheral interface 114 can connect the input and output peripherals of the device to the processor 111 and the memory 112.

[0113] The I / O subsystem 120 can connect the input and output peripherals on the device, such as a display 124 and other input / control devices 121, to the peripheral interface 114. The I / O subsystem 120 may include a display controller 1201 and one or more input controllers 1202 for controlling other input / control devices 121. Among them, the one or more input controllers 1202 receive electrical signals from other input / control devices 121 or send electrical signals to other input / control devices 121, and other input / control devices 121 may include physical buttons (press buttons, rocker buttons, etc.), dials, slide switches, joysticks, and click wheels. It is worth noting that the input controller 1202 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

[0114] The display 124 is an input interface and an output interface between the user electronic device and the user, and displays visual output to the user. The visual output may include graphics, text, icons, videos, etc.

[0115] The display controller 1201 in the I / O subsystem 120 receives an electrical signal from the display 124 or sends an electrical signal to the display 124. The display 124 detects contact on the touch screen, and the display controller 1201 converts the detected contact into interaction with a user interface object displayed on the display 124, that is, realizes human-computer interaction. The user interface object displayed on the display 124 may be an icon for running a game, an icon for connecting to a corresponding network, etc.

[0116] The RF circuit 116 is mainly used to establish communication between the mobile phone and the wireless network (i.e., the network side) to realize data reception and transmission between the mobile phone and the wireless network. For example, sending and receiving short messages, emails, etc. Specifically, the RF circuit 116 receives and sends RF signals, which are also called electromagnetic signals. The RF circuit 116 converts electrical signals into electromagnetic signals or converts electromagnetic signals into electrical signals, and communicates with the communication network and other devices through the electromagnetic signals. The RF circuit 116 may include known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC (COder-DECoder, codec) chipsets, Subscriber Identity Module (SIM), etc.

[0117] The audio circuit 117 is mainly used to receive audio data from the peripheral interface 114, convert the audio data into an electrical signal, and send the electrical signal to the speaker 122. The speaker 122 is used to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 116 to sound and play the sound to the user. The power management chip 119 is used to provide power supply and power management for the processor 111, the I / O subsystem 120 and the hardware connected to the peripheral interface 114.

[0118] The above-mentioned electronic device may be a mobile terminal, such as a smart phone, a tablet or other mobile device, or a terminal device, such as a personal computer.

[0119] See also Fig.11 , Fig.11 1 is a schematic diagram of a computer readable storage medium according to an embodiment of the present application. The computer readable storage medium 150 stores a computer program 151. When the computer program 151 is executed by a processor, the following method is implemented:

[0120] Acquire a knock signal transmitted through the target object; identify the knock signal and obtain a knock recognition result; and execute a knock response event corresponding to the knock recognition result.

[0121] It can be understood that when the computer program 151 is executed by a processor, it can also implement the method of any of the above embodiments.

[0122] In summary, the tapping control method, device, electronic device and storage medium provided by the present application enable the electronic device to non-contactly acquire the tapping signal transmitted through the target object, identify the tapping signal, and obtain a tapping recognition result; execute a tapping response event corresponding to the tapping recognition result to avoid direct contact with the electronic device when there are contaminants on the user's hands, causing damage to the electronic device; further, when there is a certain distance between the user and the electronic device, the electronic device can be controlled by tapping the target object, which can reduce the user's movement toward the electronic device and achieve non-contact control.

[0123] In the several embodiments provided in this application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device implementation described above is only illustrative, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0124] If the integrated units in the above other embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), disk or optical disk and other media that can store program codes.

[0125] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A knocking control method, characterized in that: Applied to an electronic device, the electronic device is placed on a target object, and the method comprises: Acquiring a knocking signal transmitted through the target object; Recognize the knock signal and obtain a knock recognition result; Execute a tap response event corresponding to the tap recognition result.

2. The method according to claim 1, characterized in that The electronic device is provided with a sensor, and the step of obtaining the knocking signal transmitted by the target object includes: Using the sensor to collect a knock signal transmitted through the target object; Taking the knocking signal within a unit time as a target knocking signal; The step of identifying the knock signal and obtaining a knock recognition result includes: The target knocking signal is identified to obtain a knocking recognition result.

3. The method according to claim 2, characterized in that Adjacent target tapping signals partially overlap.

4. The method according to claim 1, characterized in that The step of identifying the knock signal and obtaining a knock recognition result includes: The knock signal is input into a knock recognition model for recognition to obtain the knock recognition result.

5. The method according to claim 2, characterized in that: The knock signal includes a knock vibration signal and a knock audio signal; the knock signal is input into the knock recognition model for recognition to obtain the recognition result, including: The knocking vibration signal and the knocking audio signal are input into a knocking recognition model for recognition to obtain the knocking recognition result.

6. The method according to claim 5, characterized in that The step of inputting the knocking vibration signal and the knocking audio signal into a knocking recognition model for recognition to obtain the knocking recognition result includes: Inputting the knock vibration signal into a knock recognition model for recognition to obtain a vibration recognition result; Inputting the knocking audio signal into a knocking recognition model for recognition to obtain an audio recognition result; The tapping recognition result is obtained according to the vibration recognition result and the audio recognition result.

7. The method according to claim 6, characterized in that The obtaining the tapping recognition result according to the vibration recognition result and the audio recognition result includes: If the vibration recognition result is a first value and the audio recognition result is a second value, then the tapping recognition result is the second value; If the vibration recognition result is a first value and the audio recognition result is a first value, then the tapping recognition result is the first value; If the vibration recognition result is a second value, the tap recognition result is the second value; wherein the first value indicates successful recognition, and the second value indicates failed recognition.

8. A knock control device, characterized in that: Applied to an electronic device, the electronic device is placed on a target object, and the knock control device comprises: An acquisition module, used for acquiring a knocking signal transmitted through the target object; An identification module, used to identify the knocking signal and obtain a knocking identification result; The execution module is used to execute the tap response event corresponding to the tap recognition result.

9. An electronic device, characterized in that: The electronic device includes a processor and a memory coupled to the processor; The memory is used to store a computer program, and the processor is used to execute the computer program to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements the method according to any one of claims 1 to 7.

Images