Interaction method and device, storage medium and electronic equipment

Abstract

The invention provides an interaction method and device, a storage medium and electronic equipment, and the method comprises the steps: obtaining at least one group of spatial position change data detected by a sensor of the electronic equipment; in response to the condition that the at least one group of spatial position change data meets a touch identification condition, determining that a touch operation is detected; the number of the touch operations is equal to the group number of the spatial position change data, and the spatial position change data is caused by the touch operations on the electronic equipment; and executing a corresponding touch feedback action based on the number of the touch operations. According to the method provided by the embodiment of the invention, the operation power consumption of the electronic equipment can be reduced.

Description

Technical Field

[0001] The technical solution disclosed herein relates to the field of human-computer interaction technology, and in particular to an interaction method, device, storage medium, and electronic device. Background Art

[0002] In the prior art, when an electronic device with touch function, such as a mobile phone or tablet computer, is in a black screen standby state, the electronic device will always activate the touch detection function. In this way, when a user taps the touch screen of the electronic device, the touch function detection function can detect the user's tapping, and then activate the corresponding function according to the number of taps by the user. For example, when it is detected that the user double-clicks the screen, the screen wake-up operation can be executed.

[0003] However, this method of always starting the touch detection function in the black screen standby state has high power consumption. Based on this, a new interaction solution needs to be provided. Summary of the Invention

[0004] In view of this, the present disclosure provides an interaction method, device, storage medium and electronic device to provide a new interaction solution.

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an interaction method, the method comprising:

[0006] Acquire at least one set of spatial position change data detected by a sensor of the electronic device;

[0007] In response to the at least one set of spatial position change data satisfying a touch recognition condition, confirming that a touch operation is detected; the number of the touch operations is equal to the number of sets of the spatial position change data, and the spatial position change data is caused by a touch operation on the electronic device;

[0008] Based on the number of touch operations, corresponding touch feedback actions are performed.

[0009] According to a second aspect of an embodiment of the present disclosure, an interaction device is provided, the device comprising:

[0010] an acquisition module, configured to acquire at least one set of spatial position change data of a sensor of the electronic device;

[0011] a confirmation module, configured to confirm, in response to the at least one set of spatial position change data satisfying a touch recognition condition, that a touch operation is detected; the number of the touch operations is equal to the number of sets of the spatial position change data, and the spatial position change data is caused by a touch operation on the electronic device;

[0012] The execution module is configured to execute a corresponding touch feedback action based on the number of the touch operations.

[0013] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0014] processor;

[0015] a memory for storing processor-executable instructions;

[0016] Wherein, the processor is configured to implement the steps of any of the interaction methods of the first aspect by running the executable instructions.

[0017] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the steps of any of the interactive methods described in the first aspect are implemented.

[0018] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0019] When an electronic device is triggered by a user's touch operation (e.g., tapping the screen), it will experience a certain amount of shaking, which in turn causes the electronic device's spatial position to change, thereby generating at least one set of spatial position change data. Therefore, by acquiring at least one set of spatial position change data detected by the electronic device's sensor, the user's touch operation can be captured.

[0020] However, considering that in addition to user touch operations, many other operations can also cause the spatial position of an electronic device to change, such as placing the electronic device in a constantly shaking structure. In this case, in order to identify whether at least one set of spatial position change data is indeed caused by a user touch operation, it is necessary to further perform the following operations: determine whether at least one set of spatial position change data meets the touch recognition conditions. If so, it is considered to be a user touch operation; if not, it is considered not to be a user touch operation.

[0021] In this way, the exact number of touch operations can be determined.

[0022] Afterwards, based on the accurate number of touch operations determined, the touch feedback action that matches this number is executed. For example, if the number of touch operations is recognized to be 2, that is, after recognizing 2 taps, the screen wake-up action is executed; or if the number of touch operations is recognized to be 3, that is, after recognizing 3 taps, the photo taking action is executed.

[0023] The present disclosure performs touch detection by acquiring spatial position change data of the electronic device. Compared with the prior art which requires continuous touch detection in a black screen state and determines the number of times the user taps the screen by continuously detecting whether the user touches the screen to generate capacitance values, the present disclosure can reduce the operating power consumption of the electronic device.

[0024] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0026] Figure 1 is a flow chart of an interaction method according to an exemplary embodiment of the present disclosure;

[0027] Figure 2 is an application diagram of an interaction method according to an exemplary embodiment of the present disclosure;

[0028] Figure 3 is a flow chart of another interaction method according to an exemplary embodiment of the present disclosure;

[0029] Figure 4 is an application diagram of another interaction method according to an exemplary embodiment of the present disclosure;

[0030] Figure 5 is an application diagram of another interaction method according to an exemplary embodiment of the present disclosure;

[0031] Figure 6 is a flow chart of another interactive method according to an exemplary embodiment of the present disclosure;

[0032] Figure 7 is a structural diagram of an interactive device according to an exemplary embodiment of the present disclosure;

[0033] Figure 8 It is a structural diagram of an electronic device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0034] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0035] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0036] It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining."

[0037] When electronic devices such as mobile phones and tablet computers are in a black screen standby state, users are usually provided with a shortcut operation method that can quickly wake up the screen or quickly perform specific operations.

[0038] For example, tap the screen twice to turn on the screen, tap the screen three times to start the camera, and so on.

[0039] Therefore, for electronic devices, it is necessary to be able to accurately detect how many times the user taps the screen in order to accurately execute shortcut operations.

[0040] Generally speaking, the detection is performed as follows:

[0041] For electronic devices with touch screens, when the electronic device is in a black screen standby state, the electronic device will always start the touch detection function. In this way, when the user taps the touch screen of the electronic device, the touch detection function can detect the change in the capacitance value when the user taps the screen, and then consider that the tap is detected, and then perform corresponding operations according to the number of taps by the user, such as waking up the screen.

[0042] However, this method of always starting the touch detection function in the black screen standby state has high power consumption.

[0043] Based on this, a new interaction solution needs to be provided.

[0044] In the present disclosure, the user's touch operation can be detected by a sensor installed in the electronic device.

[0045] Illustratively, the sensor may be a vibration sensor, a knock sensor, and the like.

[0046] For example, if an additional vibration sensor is installed in an electronic device, its detection principle is usually based on the following principles:

[0047] The sensor contains an inertial element (such as a piezoelectric ceramic or metal reed) that is very sensitive to physical shock or vibration. When a user taps, vibrates, or bumps the sensor, the inertial element deforms due to the external force. The degree of deformation is then converted into an electrical signal, which is used to determine whether the user tapped the screen or sensor.

[0048] In a more preferred embodiment, the sensor may be a sensor for detecting spatial position change. For example, an IMU (Inertial Measurement Unit) provided in an electronic device is used as the sensor.

[0049] An IMU can measure the operating status or motion parameters of electronic devices in three-dimensional space, primarily for measuring angular velocity and acceleration. An IMU typically contains three single-axis gyroscopes (used to measure rotation rates around three orthogonal axes) and three single-axis accelerometers (used to measure linear acceleration along these three axes). By integrating this data, the attitude (such as heading, pitch angle, and roll angle), velocity, and position of the electronic device can be calculated in real time.

[0050] When a user strikes an electronic device, they apply a transient impact force of specific direction and magnitude. This causes the device to accelerate momentarily along one or more axes, resulting in changes in angular velocity and acceleration. The IMU in the device can monitor these changes and generate at least one set of spatial position change data.

[0051] If at least one set of detected spatial position change data satisfies the touch recognition condition, it is determined that a user's touch operation has been detected, and the number of touch operations is the same as the number of sets of spatial position change data. A corresponding touch feedback action is then performed based on the determined number of touch operations.

[0052] Based on the above, a faster human-computer interaction is achieved, as detailed below:

[0053] Figure 1 is a flow chart of an interactive method according to an exemplary embodiment of the present disclosure. Figure 1 As shown, the method includes the following steps:

[0054] Step 101: Acquire at least one set of spatial position change data detected by a sensor of an electronic device.

[0055] Each time the user taps the electronic device, a set of continuous spatial position change data is generated. Therefore, the number of times the user taps the electronic device is the same as the number of sets of spatial position change data.

[0056] The specific principles are as follows:

[0057] Every time a user taps an electronic device, it causes a series of spatial position changes (usually not just frozen at one or two spatial positions), thereby obtaining a set of continuous spatial position change data. Since the user's reaction speed is relatively slow, even if the user taps continuously, there will be a certain time interval between each two adjacent taps (which can be understood as the user's reaction time). At this time, a preset time interval can be set, assuming it is 0.5s (the value is only exemplary). The spatial position change data can be accurately divided into different groups based on this preset time interval, so that the number of user taps can be determined based on the number of groups of spatial position change data.

[0058] For example, the user taps the electronic device in the first second, and the spatial position of the electronic device changes as follows (the following spatial position changes are exemplary):

[0059] From (x1, y1, z1), to (x2, y2, z2), and then to (x3, y3, z3), since the time interval between each two consecutive spatial position change data is less than the certain preset time interval mentioned above, it can be determined that the three coordinate transformations from (x1, y1, z1), to (x2, y2, z2), and then to (x3, y3, z3) are triggered by the same tap of the user. At this time, the spatial position change data process from (x1, y1, z1), to (x2, y2, z2), and then to (x3, y3, z3) can be classified as the same group of spatial position change data. It can be seen that the number of taps by the user is the same as the number of groups of spatial position change data.

[0060] When the user taps the electronic device again at 1.6 seconds, the spatial position of the electronic device changes as follows (the following spatial position changes are for illustrative purposes):

[0061] From (x3, y3, z3), transformed to (x4, y4, z4), then transformed to (x5, y5, z5), and finally transformed to (x6, y6, z6). The time interval between each two consecutive spatial position change data is still less than the certain preset time interval mentioned above. At this time, it can be determined that the four coordinate transformations from (x3, y3, z3), transformed to (x4, y4, z4), then transformed to (x5, y5, z5), and finally transformed to (x6, y6, z6) are triggered by the same tap of the user (the tap at 1.6 seconds) and can be classified as the same set of spatial position change data.

[0062] Based on this, the number of taps (ie, the number of triggers) of the user can be determined by the number of groups of spatial position change data.

[0063] Among them, when the user taps, it may be continuous tapping or discontinuous tapping. The number of taps in the shortcut operation is usually determined based on the number of continuous taps by the user, rather than the cumulative number of taps. Therefore, at least one set of spatial position change data in the present disclosure needs to be caused by continuous touch operations. Exemplarily, at least one set of spatial position change data detected by the sensor of the electronic device can be obtained in the following way:

[0064] If multiple sets of spatial position change data are detected, and the time interval between the detection times of any two adjacent sets of spatial position change data is within a preset threshold, it is determined that at least two sets of spatial position change data of the electronic device are acquired.

[0065] That is, if at least one set of spatial position change data includes only one set of spatial position change data, and this set of spatial position change data meets the touch recognition criteria, then one touch operation is actually detected. If at least one set of spatial position change data includes x sets of spatial position change data, and if each set of spatial position change data meets the touch recognition criteria, then x touch operations are detected.

[0066] At this time, the time interval between the detection times of any two adjacent sets of spatial position change data also needs to meet the requirement of being less than or equal to a preset threshold (eg, 1 s).

[0067] In other words, suppose the user taps 4 times in total, and the time interval between each of the first 3 taps is no more than 1 second, and after the 3rd tap, the user taps 4th time after 2 seconds. In this case, the first 3 taps can be considered continuous, and the 4th tap is discontinuous with the previous 3 taps.

[0068] At this time, at least one set of spatial position change data (here, 3 sets of spatial position change data) will be obtained for the first three taps, and subsequent steps 102 to 103 will be executed thereon.

[0069] For the last tap, at least one set of spatial position change data (here, one set of spatial position change data) is obtained, and subsequent steps 102 and 103 are performed on it. The first three taps and the last tap are processed separately.

[0070] Exemplarily, the sensor includes an accelerometer. The time interval between the detection times of any two adjacent sets of spatial position change data includes:

[0071] For any two adjacent sets of spatial position change data, the time difference between the last peak of the X-axis signal of the accelerometer in the first set of spatial position change data and the first peak of the X-axis signal of the accelerometer in the second set of spatial position change data.

[0072] Figure 2 This is a schematic diagram of an application of an interaction method according to an exemplary embodiment of the present disclosure. Figure 2 As shown:

[0073] The x-axis indicates time, and the y-axis indicates intensity value. The time interval T between the detection times of any two adjacent sets of spatial position change data is:

[0074] T=T2-T1; Formula 1

[0075] Step 102: In response to at least one set of spatial position change data satisfying a touch recognition condition, confirm that a touch operation is detected; the number of touch operations is equal to the number of sets of spatial position change data, and the spatial position change data is caused by a touch operation on the electronic device.

[0076] Generally speaking, touch recognition conditions can be set in advance.

[0077] In this way, when identifying whether a touch operation occurs, at least one set of spatial position change data can be directly compared with the touch recognition condition to determine whether each set of spatial position change data in the at least one set of spatial position change data meets the touch recognition condition.

[0078] For example, assuming that only one fixed touch recognition condition is set, each set of spatial position change data in the at least one set of spatial position change data needs to meet this touch recognition condition.

[0079] Alternatively, different touch recognition conditions can be set for different spatial position change data based on the relationship between the first tap and the nth tap (n is greater than 1) in a user's continuous tapping process. For example, touch recognition condition 1 can be set for the first set of spatial position change data, touch recognition condition 2 can be set for the second set of spatial position change data, touch recognition condition n can be set for the nth set of spatial position change data, and so on.

[0080] At this time, if at least one set of spatial position change data includes two sets of spatial position change data, then when: the first set of spatial position change data needs to meet the above-mentioned touch recognition condition 1, and the second set of spatial position change data needs to meet the above-mentioned touch recognition condition 2, it is considered that at least one set of spatial position change data meets the touch recognition condition, and the touch operations detected at this time are: 2.

[0081] Step 103: Execute corresponding touch feedback actions based on the number of touch operations.

[0082] Based on the number of touch operations detected, the touch feedback action that matches this number is performed. For example, if the number of touch operations is 2, wake up the screen; if the number of touch operations is 3, start the camera; if the number of touch operations is 4, start the address book, and so on.

[0083] In this way, more convenient human-computer interaction can be achieved.

[0084] When an electronic device is triggered by a user's touch operation (e.g., tapping the screen), it will experience a certain amount of shaking, which in turn causes the electronic device's spatial position to change, thereby generating at least one set of spatial position change data. Therefore, by acquiring at least one set of spatial position change data detected by the electronic device's sensor, the user's touch operation can be captured.

[0085] However, considering that in addition to user touch operations, many other operations can also cause the spatial position of an electronic device to change, such as placing the electronic device in a constantly shaking structure. In this case, in order to identify whether at least one set of spatial position change data is indeed caused by a user touch operation, it is necessary to further perform the following operations: determine whether at least one set of spatial position change data meets the touch recognition conditions. If so, it is considered to be a user touch operation; if not, it is considered not to be a user touch operation.

[0086] In this way, the exact number of touch operations can be determined.

[0087] Afterwards, based on the accurate number of touch operations determined, the touch feedback action that matches this number is executed. For example, if the number of touch operations is recognized to be 2, that is, after recognizing 2 taps, the screen wake-up action is executed; or if the number of touch operations is recognized to be 3, that is, after recognizing 3 taps, the photo taking action is executed.

[0088] The present disclosure performs touch detection by acquiring spatial position change data of the electronic device. Compared with the prior art which requires continuous touch detection in a black screen state and determines the number of times the user taps the screen by continuously detecting whether the user touches the screen to generate capacitance values, the present disclosure can reduce the operating power consumption of the electronic device.

[0089] Furthermore, when the sensor for detecting spatial position change data is an IMU that is installed in the electronic device itself and runs continuously, there is no need to install or turn on other functional modules, which helps to further reduce the operating power consumption of the electronic device.

[0090] Optional, Figure 3 is a flow chart of another interactive method according to an exemplary embodiment of the present disclosure, such as Figure 3 As shown, when step 102 is executed and the at least one set of spatial position change data meets the touch recognition condition and confirms that a touch operation is detected, the following steps are included:

[0091] Step 301 : When it is confirmed that a first touch operation is detected, a touch detection module of the electronic device is started. The first touch operation is the first touch operation corresponding to a first set of spatial position change data detected.

[0092] The touch detection module is used to detect whether the user touches the touch area (touch screen or touch component) of the electronic device. When the user touches the touch area of ​​the electronic device, if the touch detection module is activated, it can detect the change in capacitance generated when the user touches the touch area, and at this time it is considered that the user's touch operation (such as tapping) has been detected. The touch detection module can be a hardware module or a software module. Exemplarily, activating the touch detection module can be to activate the Touch monitoring event (and / or corresponding hardware).

[0093] In the present disclosure, after detecting that the first set of spatial position change data in at least one set of spatial position change data meets the touch recognition condition, it is considered that the first touch operation is detected, that is, the first set of spatial position change data is caused by the first touch operation touching the electronic device, and the first touch operation is the first touch operation corresponding to this at least one set of spatial position change data.

[0094] At this time, the touch detection module is started, so that the user's touch position can be determined through the position of the capacitance change detected by the touch detection module.

[0095] Depending on where a user taps, the change in the value detected by the sensor in the electronic device will also vary. For example, when the touch position is close to the sensor, the change in the value detected by the sensor is larger, while when the touch position is farther away from the sensor, the change in the value detected by the sensor is smaller.

[0096] Therefore, the touch recognition conditions that must be met for a set of spatial position change data caused by touching the electronic device at different touch locations are different. The touch detection module can assist in determining the touch recognition conditions that must be met for each set of spatial position change data, and then determine whether each set of spatial position change data meets the touch recognition conditions. This allows for more accurate determination of whether the set of spatial position change data is caused by a user's touch operation.

[0097] Furthermore, the present disclosure starts the touch detection module only after detecting the first touch operation (first touch operation). Therefore, when the electronic device is locked or in black screen standby, there is no need to continuously run the touch detection module, which can reduce the device's operating power consumption; and, in the present disclosure, only the approximate area detected by the touch detection module is needed to determine the user's touch position, and very precise detection is not required, which further saves the power consumption of the electronic device.

[0098] Optionally, after the touch detection module is started, if the next touch operation is not detected within a preset threshold time period, the touch detection module is turned off.

[0099] In this way, the touch detection module can be turned off in time to reduce device power consumption.

[0100] Step 302 : For the second set of spatial position change data obtained, based on the distance between the touch position detected by the touch detection module and the sensor, obtain a touch recognition condition corresponding to the touch position.

[0101] For at least one set of spatial position change data, all other sets of spatial position change data except the first set of spatial position data are second sets of spatial position change data.

[0102] For each second set of spatial position change data, the touch detection module will detect the corresponding touch position (if not detected, this set of spatial position change data is not triggered by the user's touch operation, and this set of spatial position change data will be deleted), and determine the touch recognition conditions corresponding to the pre-set distance based on the distance between the touch position and the sensor.

[0103] Exemplarily, the sensor includes an accelerometer. In this case, the touch recognition condition may be:

[0104] There are a target number of peaks in the X-axis signal of the accelerometer within a preset period, and the peak value of each peak reaches a peak threshold; as the distance between the touch position of the second touch operation and the sensor is closer, the peak threshold is larger.

[0105] Figure 4 is an application diagram of another interactive method according to an exemplary embodiment of the present disclosure, such as Figure 4 As shown:

[0106] The electronic device is equipped with a sensor (assuming it is an IMU), such as Figure 4 As shown, the IMU is actually located inside the electronic device (in the area below the screen), and the user cannot see the IMU from the surface of the electronic device. 402 is the touch position detected by the touch detection module, and the distance between the touch position 402 and the IMU is the distance indicated by the dotted line 401.

[0107] According to this distance, a touch recognition condition for setting the spatial position change data corresponding to the touch position 402 can be determined.

[0108] Figure 5 is an application diagram of another interactive method according to an exemplary embodiment of the present disclosure, such as Figure 5 As shown, the directions of the x-axis, y-axis, and z-axis relative to the electronic device are indicated.

[0109] For the first touch operation, since the touch detection module has not yet been activated, the touch recognition condition corresponding to the first touch operation is: the accelerometer's X-axis signal has a target number of peaks within a preset period, and the peak value of each of these peaks reaches a peak threshold. The target number is preset, for example, 3; the peak threshold is also a preset fixed value, for example, a first value.

[0110] For each second touch operation, since the touch detection module has already been activated after the first touch operation, each second touch operation can be detected by the touch detection module as a touch position. At this time, as the distance between the touch position and the sensor becomes closer, the peak threshold that must be met by the second set of spatial position change data corresponding to the second touch operation can be changed, for example, to a second value (the target number can also be set to increase or decrease).

[0111] It should be noted that, generally speaking, the first value is set to be relatively small, so that the first set of spatial position change data can easily meet the first value, thereby preventing the electronic device from failing to detect the first touch operation.

[0112] The second value is set to be slightly larger than the first value (for example, the first value is less than or equal to any of the second values). For each second value, the greater the distance between the touch position and the sensor, the smaller the second value is set; the smaller the distance between the touch position and the sensor, the smaller the second value is set. This allows for more accurate identification of user touch operations.

[0113] Step 303 : In response to the second set of spatial position change data satisfying the corresponding touch recognition condition, confirming that a second touch operation is detected, where the second touch operation is a touch operation subsequent to the first touch operation.

[0114] When each second set of spatial position change data satisfies its corresponding touch recognition condition, it is confirmed that a second touch operation is detected. The number of the second touch operations is the same as the number of the second set of spatial position change data.

[0115] In this way, assuming that each second set of spatial position change data meets its corresponding touch recognition condition and the second set of spatial position change data is 2, then the number of touch operations actually detected is: 1 first touch operation + 2 second touch operations, that is, a total of 3 touch operations are detected.

[0116] Through the above, an interactive solution for the fusion of sensors and touch detection is provided. By setting more accurate touch recognition conditions for each set of second spatial position change data, the recognition accuracy of the user's touch operation (especially the second touch operation) is improved. In addition, there is no need to continuously run the touch detection module, which helps to reduce power consumption.

[0117] Optionally, the above touch recognition conditions may further include:

[0118] The variation relationship between the target number of peaks meets the preset requirements.

[0119] Change relationships include but are not limited to at least one of the following:

[0120] The relationship between the peak values ​​of the target quantity waves is: first increasing and then decreasing.

[0121] The absolute value of the slope of any two adjacent peaks connected together is greater than a specified slope (for example, greater than 2).

[0122] Optionally, when the sensor further includes a gyroscope, the touch recognition conditions may further include:

[0123] The waveform of the Z-axis signal of the gyroscope within the preset period after filtering is a sine wave.

[0124] Schematically, filtering can be performed as follows:

[0125] Get the preset cutoff frequency and perform filtering based on the cutoff frequency.

[0126] The waveform of the Z-axis signal after filtering within a preset period must still be a sine wave. When determining whether it is a sine wave, it can be compared with a standard sine wave waveform. When the similarity reaches a preset similarity, it is considered that the waveform after filtering is still a sine wave.

[0127] Optionally, executing step 102 in response to the at least one set of spatial position change data satisfying the touch recognition condition and confirming that a touch operation is detected includes the following steps:

[0128] Based on the motion parameters detected by the sensor, the state of the electronic device is determined; the state includes a stable state and a shaking state.

[0129] If the electronic device is in a stable state, obtain the corresponding first touch recognition condition; if the electronic device is in a shaking state, obtain the corresponding second touch recognition condition; wherein, for the same spatial position change data, the difficulty of satisfying the first touch recognition condition is less than or equal to the difficulty of satisfying the second touch recognition condition.

[0130] The stable state indicates that the electronic device is on a stable structure, such as lying flat on a table, fixed in a card slot on the wall, etc. In this case, the electronic device will produce relatively slight shaking when touched by a touch operation. In this case, a first touch recognition condition can be set. The first touch recognition condition is easier to meet, such as setting a smaller peak threshold or a smaller number of targets in the first touch recognition condition.

[0131] The shaking state indicates that the electronic device is located on an unstable structure, such as when held in the user's hand or placed in a shaky stand. In this case, the electronic device will experience severe shaking when touched by a touch operation. In this case, a second touch recognition condition can be set, which is more difficult to meet. For example, a larger peak threshold or a larger number of targets can be set in the second touch recognition condition.

[0132] You can set an appropriate cutoff frequency based on the state of the electronic device. For example, when the device is in a stable state with less interference, you can adjust the cutoff frequency to filter fewer signals and reduce filtering pressure. Conversely, when there is more interference (such as shaking), you can adjust the cutoff frequency to filter more signals.

[0133] Exemplarily, the detection can be performed according to the following detection method:

[0134] When the sensor includes an accelerometer and a gyroscope, determining the state of the electronic device based on the motion parameters detected by the sensor includes:

[0135] When the accelerometer data meets the first condition and the gyroscope data meets the second condition, it is determined that the electronic device is in a stable state; the first condition indicates that the accelerometer is only affected by the acceleration of gravity, and the second condition indicates that the gyroscope is stationary; otherwise, it is determined that the electronic device is in a shaking state.

[0136] For example, taking the stable state where the electronic device is placed flat on a table as an example, the first condition is:

[0137] abs(acc_x)≤0.4, and abs(acc_y)≤0.4, and 9.4≤abs(acc_z)≤10.2.

[0138] Wherein, abs(acc_x) represents the value measured by the accelerometer in the x-axis direction, abs(acc_y) represents the value measured by the accelerometer in the y-axis direction, and abs(acc_z) represents the value measured by the accelerometer in the z-axis direction.

[0139] Among them, when the electronic device is stationary on a horizontal desktop, abs(acc_x), abs(acc_y), and abs(acc_z) all meet the values ​​set in the above first condition; when the electronic device is not placed on a horizontal desktop, at least one of abs(acc_x), abs(acc_y), and abs(acc_z) does not meet the values ​​set in the above first condition.

[0140] Among them, abs(acc_x)≤0.4 and abs(acc_y)≤0.4 indicate that the accelerometer of the electronic device is not disturbed on both the x-axis and the y-axis; 9.4≤abs(acc_z)≤10.2 indicates that the accelerometer of the electronic device is disturbed by gravity on the z-axis. When there is no error, abs(acc_z) should be 9.8. Considering the possible error, it is set to 9.4≤abs(acc_z)≤10.2.

[0141] The second condition is: abs(gyro_x)≤0.01&&, and (abs(gyro_y)≤0.01, and (abs_gyro_z)≤0.01.

[0142] Where abs(gyro_x) indicates the value measured by the gyroscope in the x-axis direction, abs(gyro_y) indicates the value measured by the gyroscope in the y-axis direction, and abs(gyro_z) indicates the value measured by the gyroscope in the z-axis direction.

[0143] When the electronic device is stationary on a horizontal table, the gyroscope is stationary, so the value on any axis is less than or equal to 0.01 (0.01 here is only for illustration and can be set to other values).

[0144] When the sensor does not meet any of the first condition and the second condition, the electronic device is considered to be in a shaking state. When both the first condition and the second condition are met, the electronic device is considered to be in a stable state.

[0145] For example, Figure 6 is a flow chart of another interactive method according to an exemplary embodiment of the present disclosure, such as Figure 6 As shown, the following specific embodiments are provided:

[0146] In step 601, the screen of the electronic device (eg, tablet) is turned off, and the touch detection module is not started.

[0147] Step 602: Determine whether the electronic device is in a stable state. If yes, go to step 603; otherwise, go to step 604.

[0148] Step 603: Acquire touch recognition conditions in a stable state. For example, in a stable state, the peak threshold value of the touch recognition conditions pre-set for the first set of spatial position change data corresponding to the first touch operation is threshold one.

[0149] Step 604: Acquire touch recognition conditions in the shaking state. For example, in the shaking state, the peak threshold value pre-set for the first set of spatial position change data corresponding to the first touch operation is threshold 2 (threshold 1 is less than or equal to threshold 2).

[0150] Step 605: Determine whether a first touch operation has occurred. If so, proceed to step 606. If the first set of spatial position change data in the stable state meets the touch recognition conditions of step 603, or if the first set of spatial position change data in the shaking state meets the touch recognition conditions of step 604, then the first touch operation is considered to have been detected.

[0151] Step 606: Start the touch detection module to obtain the touch position (of the second touch operation).

[0152] Step 607: Acquire a touch recognition condition for the second touch function operation. The touch recognition condition here can be obtained by combining the current state of the electronic device (stable state or shaking state) to obtain a specific touch recognition condition.

[0153] Step 608 , determining whether a second touch operation occurs. If yes, proceed to step 609 , otherwise proceed to step 611 .

[0154] Step 609: Determine the total number of recognized touch operations.

[0155] Step 610: Execute a touch feedback action that matches the total number of times.

[0156] Step 611: If no new touch function operation occurs within a preset threshold time (after each touch operation is detected), the touch detection module is turned off.

[0157] The contents involved in the above steps 601 to 611 have been described in the above embodiments and will not be repeated here.

[0158] For the sake of simplicity, the aforementioned method embodiments are all expressed as a series of action combinations. However, those skilled in the art should know that the present disclosure is not limited to the order of the actions described, because according to the present disclosure, certain steps can be performed in other orders or simultaneously.

[0159] Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0160] Corresponding to the aforementioned embodiment of the method for realizing application functions, the present disclosure also provides an embodiment of an interaction device and a corresponding terminal.

[0161] Figure 7 is a structural diagram of an interactive device according to an exemplary embodiment of the present disclosure. Figure 7 As shown, the interaction device may include:

[0162] The acquisition module 701 is configured to acquire at least one set of spatial position change data detected by a sensor of the electronic device.

[0163] Confirmation module 702 is used to confirm that a touch operation is detected in response to at least one set of spatial position change data satisfying the touch recognition condition; the number of touch operations is equal to the number of groups of spatial position change data, and the spatial position change data is caused by a touch operation on the electronic device.

[0164] The execution module 703 is configured to execute a corresponding touch feedback action based on the number of touch operations.

[0165] Optionally, when the confirmation module 702 is configured to confirm that a touch operation is detected in response to the at least one set of spatial position change data satisfying a touch recognition condition, it is configured to:

[0166] When it is confirmed that a first touch operation is detected, a touch detection module of the electronic device is started, where the first touch operation is the first touch operation corresponding to the first set of detected spatial position change data.

[0167] For the acquired second set of spatial position change data, a touch recognition condition corresponding to the touch position is acquired based on the distance between the touch position detected by the touch detection module and the sensor.

[0168] In response to the second set of spatial position change data satisfying the corresponding touch recognition condition, it is confirmed that a second touch operation is detected, where the second touch operation is a touch operation subsequent to the first touch operation.

[0169] Optionally, the sensor includes: an accelerometer.

[0170] The touch recognition conditions include: there are a target number of peaks in the X-axis signal of the accelerometer within a preset period, and the peak value of each peak reaches a peak threshold; as the distance between the touch position of the second touch operation and the sensor is closer, the peak threshold becomes larger.

[0171] Optionally, the touch recognition condition further includes:

[0172] The variation relationship between the target number of peaks meets the preset requirements.

[0173] Optionally, the sensor further includes: a gyroscope.

[0174] The touch recognition conditions also include:

[0175] The waveform of the Z-axis signal of the gyroscope within the preset period after filtering is a sine wave.

[0176] Optionally, when the confirmation module 702 is configured to confirm that a touch operation is detected in response to the at least one set of spatial position change data satisfying a touch recognition condition, it is configured to:

[0177] Based on the motion parameters detected by the sensor, the state of the electronic device is determined; the state includes a stable state and a shaking state.

[0178] If the electronic device is in a stable state, a corresponding first touch recognition condition is obtained.

[0179] If the electronic device is in a shaking state, a corresponding second touch recognition condition is obtained.

[0180] Among them, for the same spatial position change data, the difficulty of satisfying the first touch recognition condition is less than or equal to the difficulty of satisfying the second touch recognition condition.

[0181] Optionally, the sensor includes an accelerometer and a gyroscope. When the confirmation module 702 is used to determine the state of the electronic device based on the motion parameters detected by the sensor, it is used to:

[0182] When the accelerometer data meets a first condition and the gyroscope data meets a second condition, it is determined that the electronic device is in a stable state; the first condition indicates that the accelerometer is only affected by gravity acceleration, and the second condition indicates that the gyroscope is stationary.

[0183] Otherwise, it is determined that the electronic device is in a shaking state.

[0184] Optionally, when the acquisition module 701 is used to acquire at least one set of spatial position change data detected by a sensor of the electronic device, it is used to:

[0185] If multiple sets of spatial position change data are detected, and the time interval between the detection times of any two adjacent sets of spatial position change data is within a preset threshold, it is determined that at least two sets of spatial position change data of the electronic device are acquired.

[0186] Optionally, the sensor includes: an accelerometer.

[0187] The time interval between the detection times of any two adjacent sets of spatial position change data includes:

[0188] For any two adjacent sets of spatial position change data, the time difference between the last peak of the X-axis signal of the accelerometer in the first set of spatial position change data and the first peak of the X-axis signal of the accelerometer in the second set of spatial position change data.

[0189] Optionally, the device further includes:

[0190] The shut-down module is configured to shut down the touch detection module if no next touch operation is detected within a preset threshold time period after the touch detection module of the electronic device is started.

[0191] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial description of the method embodiments. The device embodiments described above are merely illustrative, wherein the units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the disclosed solution. A person of ordinary skill in the art can understand and implement it without paying any creative work.

[0192] Accordingly, an embodiment of the present disclosure provides an electronic device, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the steps of any of the above-mentioned interaction methods by running the executable instructions.

[0193] Figure 8 8 is a schematic diagram illustrating the structure of an electronic device according to an exemplary embodiment of the present disclosure. For example, electronic device 800 may be a user device, specifically a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or a wearable device such as a smartwatch, smart glasses, a smart bracelet, or a smart running shoe.

[0194] Reference Figure 8 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0195] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0196] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0197] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0198] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensors may not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0199] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0200] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0201] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of components, such as the display and keypad of the electronic device 800. The sensor assembly 814 can also detect changes in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0202] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 4G or 5G, 4G LTE, 5G NR or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0203] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0204] In an exemplary embodiment, a non-temporary computer-readable storage medium is also provided, such as a memory 804 including instructions, which, when executed by the processor 820 of the electronic device 800, enables the electronic device 800 to perform the steps of any of the above-mentioned interaction methods.

[0205] The non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0206] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0207] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An interactive method, characterized in that: The method comprises: Acquire at least one set of spatial position change data detected by a sensor of the electronic device; In response to the at least one set of spatial position change data satisfying a touch recognition condition, confirming that a touch operation is detected; the number of the touch operations is equal to the number of sets of the spatial position change data, and the spatial position change data is caused by a touch operation on the electronic device; Based on the number of touch operations, corresponding touch feedback actions are performed.

2. The method according to claim 1, characterized in that The step of confirming that a touch operation is detected in response to the at least one set of spatial position change data satisfying a touch recognition condition includes: When it is confirmed that a first touch operation is detected, starting a touch detection module of the electronic device, wherein the first touch operation is a first touch operation corresponding to the first set of spatial position change data detected; For the second set of spatial position change data obtained, based on the distance between the touch position detected by the touch detection module and the sensor, obtaining a touch recognition condition corresponding to the touch position; In response to the second set of spatial position change data satisfying the corresponding touch recognition condition, it is confirmed that a second touch operation is detected, where the second touch operation is a touch operation subsequent to the first touch operation.

3. The method according to claim 2, characterized in that The sensor includes: an accelerometer; The touch recognition condition includes: the presence of a target number of peaks in the X-axis signal of the accelerometer within a preset period, and the peak value of each peak reaches a peak threshold; As the distance between the touch position of the second touch operation and the sensor is closer, the peak threshold is larger.

4. The method according to claim 3, characterized in that The touch recognition conditions also include: The variation relationship between the target number of peaks meets the preset requirements.

5. The method according to claim 3, characterized in that The sensor further includes: a gyroscope; The touch recognition conditions also include: The waveform of the Z-axis signal of the gyroscope within the preset period after filtering is a sine wave.

6. The method according to claim 1, wherein The step of confirming that a touch operation is detected in response to the at least one set of spatial position change data satisfying a touch recognition condition includes: Determining a state of the electronic device based on the motion parameters detected by the sensor; the state includes a stable state and a shaking state; If the electronic device is in a stable state, obtaining a corresponding first touch recognition condition; If the electronic device is in a shaking state, obtaining a corresponding second touch recognition condition; Among them, for the same spatial position change data, the difficulty of satisfying the first touch recognition condition is less than or equal to the difficulty of satisfying the second touch recognition condition.

7. The method according to claim 6, characterized in that The sensor includes an accelerometer and a gyroscope; The determining the state of the electronic device based on the motion parameter detected by the sensor includes: When the accelerometer data satisfies a first condition and the gyroscope data satisfies a second condition, determining that the electronic device is in a stable state; the first condition indicates that the accelerometer is only affected by gravity acceleration, and the second condition indicates that the gyroscope is stationary; Otherwise, it is determined that the electronic device is in a shaking state.

8. The method according to claim 1, characterized in that The at least one set of spatial position change data detected by the sensor of the electronic device includes: If multiple sets of spatial position change data are detected, and the time interval between the detection times of any two adjacent sets of spatial position change data is within a preset threshold, it is determined that at least two sets of spatial position change data detected by the sensor of the electronic device are acquired.

9. The method according to claim 8, characterized in that The sensor includes: an accelerometer; The time interval between the detection times of any two adjacent sets of spatial position change data includes: For any two adjacent sets of spatial position change data, the time difference between the last peak of the X-axis signal of the accelerometer in the first set of spatial position change data and the first peak of the X-axis signal of the accelerometer in the second set of spatial position change data.

10. The method according to claim 2, characterized in that The method further comprises: After the touch detection module of the electronic device is started, if the next touch operation is not detected within a preset threshold time, the touch detection module is turned off.

11. An interactive device, characterized in that: The device comprises: an acquisition module, configured to acquire at least one set of spatial position change data of a sensor of the electronic device; a confirmation module, configured to confirm, in response to the at least one set of spatial position change data satisfying a touch recognition condition, that a touch operation is detected; the number of the touch operations is equal to the number of sets of the spatial position change data, and the spatial position change data is caused by a touch operation on the electronic device; The execution module is configured to execute a corresponding touch feedback action based on the number of the touch operations.

12. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the steps of any one of the methods of claims 1 to 10 by running the executable instructions.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

Images