Method, apparatus and device for outputting feedback state information

Abstract

This application provides a method, apparatus, and a mobile terminal device for outputting feedback status information. The solution includes: the mobile terminal acquiring vibration status data collected by sensors based on vibrations generated when an external object strikes the mobile terminal; determining whether the vibration status data meets preset striking conditions; and if so, triggering a feedback device to output feedback status information to mimic the striking of a wooden fish.

Description

Technical Field

[0001] This application relates to the field of information processing technology, and in particular to a method for outputting feedback status information. This application also relates to an apparatus for outputting feedback status information and a computing device. Background Technology

[0002] The wooden fish, a traditional musical instrument, is frequently used in Buddhist ceremonies and musical performances. It not only creates a solemn and dignified atmosphere but also has the function of purifying the mind and improving concentration. Traditional wooden fish are handmade, often using hardwoods such as rosewood or mahogany to ensure a pure and resonant tone. Users typically hold a wooden stick and gently tap the surface of the wooden fish to produce a crisp and melodious sound.

[0003] In recent years, with the rapid development of mobile internet technology, many traditional cultural elements have been cleverly integrated into mobile applications, including the traditional musical instrument, the wooden fish. By using software on mobile devices to simulate a virtual wooden fish, users can touch the virtual wooden fish icon on the screen. Upon receiving the touch event, the mobile device can play the corresponding wooden fish sound effect. This method of using software on mobile devices to play the wooden fish overcomes the lack of portability of traditional wooden fish, allowing users to enjoy the pleasure of striking the wooden fish anytime, anywhere, achieving relaxation and meditation.

[0004] However, while this digital approach brings many conveniences, it also causes a problem of high power consumption on mobile devices. Summary of the Invention

[0005] In view of this, embodiments of this application provide a method, apparatus, and device for outputting feedback status information to solve the problem of high power consumption of mobile terminals caused by existing methods of using the "wooden fish" software in mobile terminals to play the "wooden fish" sound.

[0006] According to a first aspect of the embodiments of this application, a method for outputting feedback state information is provided, applied to a mobile terminal, comprising: acquiring vibration state data collected by a sensor; the vibration state data being generated based on an object outside the mobile terminal striking the mobile terminal; determining whether the vibration state data meets a preset striking judgment condition, and obtaining a striking judgment result; if the striking judgment result indicates that the vibration state data meets the preset striking judgment condition, then triggering a feedback device to output feedback state information for simulating the striking of a wooden fish.

[0007] According to a second aspect of the embodiments of this application, a device for outputting feedback status information is provided, applied to a mobile terminal, comprising: a vibration status data acquisition module, configured to acquire vibration status data collected by a sensor; the vibration status data is generated based on an object outside the mobile terminal striking the mobile terminal; a striking judgment module, configured to determine whether the vibration status data meets a preset striking judgment condition, and obtain a striking judgment result; and a feedback status information output module, configured to, if the striking judgment result indicates that the vibration status data meets the preset striking judgment condition, trigger the feedback device to output feedback status information for simulating the striking of a wooden fish.

[0008] According to a third aspect of the present application, a mobile terminal device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to: acquire vibration state data collected by a sensor; the vibration state data being generated based on an object outside the mobile terminal striking the mobile terminal; determine whether the vibration state data meets a preset striking condition, and obtain a striking result; if the striking result indicates that the vibration state data meets the preset striking condition, trigger a feedback device to output feedback state information for simulating the striking of a wooden fish.

[0009] One embodiment of this specification can achieve at least the following beneficial effects: by acquiring vibration state data generated by external tapping through a sensor collected by a mobile terminal, and triggering a feedback device to output feedback state information to simulate the tapping of a wooden fish when the vibration state data meets preset tapping judgment conditions, the mobile terminal can achieve the effect of tapping a wooden fish without displaying a virtual wooden fish icon on the screen of the mobile terminal, and without the mobile terminal sensing the user's touch events through the wooden fish software, thus at least partially solving the problem of high power consumption of the mobile terminal when tapping a wooden fish. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in the embodiments or prior art of this specification, the drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This diagram illustrates an application scenario of a method for outputting feedback status information provided in the embodiments of this specification.

[0012] Figure 2 A schematic diagram illustrating the implementation environment of a method for outputting feedback status information provided in the embodiments of this specification;

[0013] Figure 3 A flowchart illustrating a method for outputting feedback status information provided in an embodiment of this specification;

[0014] Figure 4 This is a schematic diagram illustrating an example of the time-varying first acceleration component data used in a method for outputting feedback state information as provided in embodiments of this specification.

[0015] Figure 5 A flowchart illustrating the process of determining the knocking judgment result provided in the embodiments of this specification;

[0016] Figure 6 The embodiments provided in this specification correspond to Figure 3 A schematic diagram of a device for outputting feedback status information;

[0017] Figure 7 The embodiments provided in this specification correspond to Figure 3 A schematic diagram of the structure of a mobile terminal device. Detailed Implementation

[0018] Many specific details are set forth in the following description to provide a full understanding of this application. However, this application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this application; therefore, this application is not limited to the specific embodiments disclosed below.

[0019] The terminology used in one or more embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the scope of one or more embodiments of this application. The singular forms “a,” “the,” and “the” used in one or more embodiments of this application and in the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” used in one or more embodiments of this application refers to and includes any or all possible combinations of one or more associated listed items.

[0020] It should be understood that although the terms first, second, etc., may be used to describe various information in one or more embodiments of this application, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, first may also be referred to as second without departing from the scope of one or more embodiments of this application, and similarly, second may also be referred to as first. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to a determination."

[0021] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0022] In related technologies, a virtual wooden fish can be simulated using software on a mobile device. Users can touch the virtual wooden fish icon on the screen with their fingers, and the mobile device can play the corresponding wooden fish sound effect after receiving the user's touch event, thus giving the user the experience of striking a wooden fish using a mobile device. However, although this method of striking a wooden fish overcomes the inconvenience of carrying a physical wooden fish, it also has problems such as excessive power consumption of the mobile device and eye damage caused by screen light when striking the wooden fish on an electronic screen.

[0023] To address the shortcomings of the existing technology, the following embodiments are provided in this solution.

[0024] Figure 1 This diagram illustrates an application scenario of a method for outputting feedback status information provided in an embodiment of this specification.

[0025] like Figure 1 As shown, the user can use their hand 101 to tap the mobile terminal 102. The sensor in the mobile terminal 102 can collect the vibration state data generated by the tapping. Then, if the mobile terminal 102 determines that the vibration state data meets the preset tapping judgment conditions, it can trigger the feedback device to output feedback state information to simulate the tapping of the wooden fish. Thus, the user obtains the experience of tapping the wooden fish by using the mobile terminal 102.

[0026] Despite Figure 1 As shown, the user taps the mobile terminal 102 using their hand 101, but the object used to tap the mobile terminal 102 is not limited to the user's hand 101. In practical applications, the object used to tap the mobile terminal 102 can be any object outside the mobile terminal 102. For example, it can be any part of the user's body, or it can be any object held by the user.

[0027] Despite Figure 1The image shows that the mobile terminal 102 is a mobile phone, but it is not limited to this in practical applications. In practical applications, in order to facilitate users to conveniently experience the sound of the wooden fish anytime and anywhere, the mobile terminal 102 can be an item carried by the user. For example, it can be a mobile phone, a smart wearable device (e.g., a smart bracelet, smartwatch, smart glasses, etc.), a tablet computer, etc.

[0028] Despite Figure 1 The diagram shows that when the mobile terminal 102 is specifically a mobile phone, the user places the phone with the screen facing down and the back facing up when striking the wooden fish, and the striking action occurs on the back of the phone. However, in actual applications, the phone's placement, the location of the strike, and the user's striking gestures are not limited to these variations. Figure 1 The scenarios shown are as follows. For example, the phone can be set to a screen-up position, allowing the user to tap the front, side, etc. Alternatively, the phone can be set to a handheld position, held on a stand, etc., allowing the user to tap the back, front, side, etc.

[0029] Figure 2 This is a schematic diagram illustrating the implementation environment of a method for outputting feedback status information provided in the embodiments of this specification.

[0030] like Figure 2 As shown, when user 210 performs a tapping operation on mobile terminal 220, sensor 221 of mobile terminal 220 can sense the tapping operation and collect vibration state data. Then, if the mobile terminal 220 determines that the preset tapping judgment conditions are met based on the vibration state data, it can trigger the feedback device 222 of mobile terminal 220 to output feedback state information to simulate the tapping of a wooden fish.

[0031] In addition, although Figure 2 Although not shown, a target application may run on the mobile terminal 220. This target application can be used to execute a judgment process based on vibration state data to determine whether the preset striking conditions are met and to trigger the feedback device. In practical applications, the target application may be called a wooden fish application or wooden fish software, which can be an application running on the mobile terminal when the user strikes the wooden fish.

[0032] In addition, although Figure 2The implementation scenario is not shown, but optionally, it may also include a server communicatively connected to the mobile terminal 220. Specifically, the server may be a server corresponding to the target application (i.e., the "wooden fish" application / software) running on the mobile terminal 220. In practical applications, with user authorization, the mobile terminal 220 can upload the user's tapping data to the server through the target application and perform various statistical analyses based on the tapping data. In practical applications, the server may include, but is not limited to, any device, equipment, platform, or device cluster with computing and processing capabilities. Furthermore, the server can connect to one or more mobile terminals 220 via a local area network (LAN), a wide area network (WAN), the Internet, or other types of data networks.

[0033] Based on at least some of the solutions in the embodiments of this specification, a mobile terminal such as a mobile phone can be directly used as a wooden fish to strike. Compared with the method of clicking the wooden fish icon in the wooden fish software in related technologies, the user does not need to look at the display screen or click on a specific location on the display screen (e.g., the wooden fish icon). The action of striking the wooden fish is simpler and more convenient, giving the user an experience closer to the traditional way of striking the wooden fish.

[0034] Furthermore, since the mobile terminal does not need to be in a bright state to display the wooden fish icon, nor does it need to sense the user's touch operation on the screen, the energy consumption of the mobile terminal is reduced when the user uses the mobile terminal to strike the wooden fish. This at least partially solves the problem of high power consumption of the mobile terminal when using the wooden fish software on the mobile terminal to strike the wooden fish.

[0035] Furthermore, since users can trigger the sensor to collect vibration data by tapping any part of the mobile terminal without having to click on a specific location on the display screen, users have greater freedom of operation. At the same time, it avoids the problem of not being able to trigger feedback information because the user did not click on a relatively small specified location on the screen (e.g., the wooden fish icon), and the statistical accuracy of the tapping data is also higher.

[0036] In addition, since users do not need to look at the electronic screen of the mobile terminal when performing the wooden fish tapping operation, the light emitted by the electronic screen is avoided from stimulating the user's eyes, thus protecting the user's eyes and providing a more comfortable wooden fish tapping experience.

[0037] This application provides a method for outputting feedback status information, and also relates to an apparatus for outputting feedback status information and a mobile terminal device, which will be described in detail in the following embodiments.

[0038] Figure 3 This is a flowchart illustrating a method for outputting feedback status information provided in an embodiment of this specification.

[0039] From a programming perspective, the entity executing the process can be a program hosted on an application server or application terminal. It can be understood that this method can be executed by any device, equipment, platform, or cluster of devices with computing and processing capabilities.

[0040] like Figure 3 As shown, the process may include the following steps:

[0041] Step 302: Acquire vibration state data collected by the sensor; the vibration state data is generated based on the impact of an external object on the mobile terminal.

[0042] The sensor used to collect vibration data can be any sensor capable of sensing impact. For example, vibration sensors can include accelerometers and pressure sensors. An accelerometer is an electronic device that measures acceleration, detecting the magnitude and direction of the mobile terminal's acceleration. By measuring the changes in acceleration in different directions, the force applied to the mobile terminal can be indirectly understood. A pressure sensor, also known as a force sensor, is an electronic device that converts mechanical quantities into electrical signals. It can consist of an elastic body, strain gauges, compensation circuits, etc. When the mobile terminal is subjected to an external force, the pressure sensor can sense and measure the magnitude and direction of the force, converting the mechanical quantity into an electrical signal for output. Therefore, the force applied to the mobile terminal can be directly understood by reading the electrical signal.

[0043] Vibration state data can be data collected by the sensors. For example, vibration state data can include acceleration data collected by an accelerometer. Further, the acceleration data collected by the accelerometer can include acceleration component data in multiple directions. When the mobile terminal is specifically a mobile phone, the acceleration data collected by the accelerometer can include a first acceleration component along the z-axis, a second acceleration component along the x-axis, and a third acceleration component along the y-axis. The z-axis can be a direction perpendicular to the plane of the mobile phone screen, for example, a direction towards the inside (or outside) of the screen; the x-axis and y-axis can be mutually perpendicular directions within the plane of the mobile terminal's screen, for example, the x-axis can be along the width (or length) of the mobile phone, and the y-axis can be along the length (or width) of the mobile phone. In practical applications, the definitions of the z-axis, x-axis, and y-axis can differ from the aforementioned examples, as long as they conform to pre-defined settings. As another example, vibration state data can include pressure data collected by a pressure sensor. In practical applications, pressure sensors can be distributed in suitable locations on the mobile terminal for easy tapping by the user.

[0044] In the embodiments of this specification, objects outside the mobile terminal can include any type of object used by the user that can be struck on the mobile terminal to achieve the effect of striking a wooden fish. Further, objects outside the mobile terminal can include parts of the user's body or objects held by the user. For example, it can include the user's fingers. Or, it can include objects of any material and shape held by the user, such as wooden sticks, rubber rods, etc.

[0045] In the embodiments described in this specification, since the pressure data of external objects is essentially sensed by the sensors of the mobile terminal, it is not necessary to sense the user's touch operation through a touch screen. Therefore, there is no need to limit the material of the external objects, which provides users with greater freedom and enhances the user's experience of tapping the wooden fish.

[0046] Step 304: Determine whether the vibration state data meets the preset knocking judgment conditions, and obtain the knocking judgment result.

[0047] The striking criteria can be used to determine whether the vibration data indicates that the mobile terminal is being used as a wooden fish for striking. Furthermore, the striking criteria can include rules or patterns that the vibration amplitude and frequency of the mobile terminal, as reflected in the vibration data, should conform to.

[0048] Optionally, the striking criteria can be pre-determined based on experimental data or historical data on striking wooden fish. For example, a set of vibration state data collected by sensors during the process of an experimenter or test user striking a mobile terminal as a wooden fish can be obtained, and statistical analysis can be performed on this set of vibration state data to determine the pattern of vibration state data when the mobile terminal is struck as a wooden fish, and the striking criteria can be determined according to this pattern. Alternatively, a set of vibration state data collected by sensors during the process of an experimenter or test user striking a mobile terminal as a wooden fish can be obtained, and a machine learning model or deep learning model can be trained based on this set of vibration state data to obtain a model for recognizing when a mobile terminal is struck as a wooden fish. In this case, determining whether the vibration state data meets the preset striking criteria can specifically include inputting the vibration state data into the pre-trained model and determining whether the model's output prediction indicates that the mobile terminal is struck as a wooden fish. If so, the striking criteria are met; otherwise, they are not.

[0049] Optionally, the tapping judgment condition may correspond to the type of mobile terminal, or in other words, the tapping judgment conditions may differ for different types of mobile terminal devices. In practical applications, considering factors such as different sensor types and sensitivities of different types of mobile terminal devices, and different user tapping locations or habits, different tapping judgment conditions can be set for different types of mobile terminal devices. Alternatively, the basic tapping judgment conditions can be fine-tuned for different types of mobile terminal devices to improve the accuracy of the output feedback state information method provided in the embodiments of this specification. Specifically, for mobile terminal device types with historical usage records, the aforementioned analysis operation can be performed based on the vibration state data generated during the user's tapping of that type of mobile terminal as a wooden fish, to determine the tapping judgment conditions corresponding to each device type, and apply them to, for example... Figure 3 The method flow shown is as follows.

[0050] Optionally, the tapping judgment condition can be user-specific, or in other words, different users may have different tapping judgment conditions. In practical applications, considering that different users have different tapping habits—for example, different tapping locations, different phone holding positions, different tapping force, and different tapping frequencies—different tapping judgment conditions can be set for different users. Alternatively, the basic tapping judgment conditions can be fine-tuned for different users to improve the accuracy of the output feedback state information method provided in the embodiments of this specification. Specifically, for users with historical usage records, personalized tapping judgment conditions can be determined based on the personalized vibration state data generated when the user taps the mobile terminal like a wooden fish, and applied to, for example... Figure 3 The method flow shown is as follows.

[0051] In the embodiments of this specification, a target application may be installed on the mobile terminal, and from a software perspective, it can be executed by the target application. Figure 3 The process is illustrated below. Specifically, after acquiring vibration state data collected by the sensor, the target application can determine whether the vibration state data meets the preset impact judgment conditions. Then, if the preset impact judgment conditions are met, the feedback device can be invoked to output feedback state information.

[0052] Step 306: If the tapping judgment result indicates that the vibration state data meets the preset tapping judgment conditions, then the feedback device is triggered to output feedback state information to simulate the wooden fish being tapped.

[0053] In practical applications, if the vibration status data meets the preset striking judgment conditions, it can be indicated that the mobile terminal is currently being struck as a wooden fish. At this time, step 306 can be executed, that is, the feedback device is triggered to output feedback status information to simulate the wooden fish being struck.

[0054] If the vibration status data does not meet the preset striking judgment conditions, it indicates that the mobile terminal is not currently being struck as a wooden fish. In this case, step 306 can be skipped, meaning the feedback device is not triggered to output feedback status information to simulate the wooden fish being struck. Optionally, the vibration status data for the next cycle collected by the sensor can be acquired again, i.e., the process can be restarted. Figure 3 The process is shown in the figure.

[0055] Thus, through the embodiments described in this specification, repeated execution Figure 3 The process shown enables the mobile terminal to output timely feedback status information based on the user's tapping behavior when the user taps the mobile terminal like a wooden fish. For example, when the user taps the mobile terminal once, the mobile terminal outputs feedback status information to simulate the tapping of the wooden fish, thereby giving the user the experience of tapping a wooden fish.

[0056] In the embodiments of this specification, the feedback device may include a feedback device installed in the mobile terminal or an external device connected to the mobile terminal. In practical applications, for convenience, it is preferable to use a feedback device installed in the mobile terminal; for example, an audio output device or vibration device built into the mobile terminal may be used, but this is not limited to these. The feedback state information used to simulate the striking of a wooden fish may be information corresponding to the feedback device. For example, when the feedback device includes an audio output device, it can output a sound effect to simulate the striking of a wooden fish. Similarly, when the feedback device includes a vibration device, it can output vibrations to simulate the striking of a wooden fish.

[0057] It should be understood that in the methods described in one or more embodiments of this specification, the order of some steps may be adjusted according to actual needs, or some steps may be omitted.

[0058] Figure 3 The method described above acquires vibration state data generated by external tapping through sensors on a mobile terminal. When the vibration state data meets preset tapping judgment conditions, a feedback device is triggered to output feedback state information to simulate the tapping of a wooden fish. Thus, in the process of achieving the effect of tapping a wooden fish using a mobile terminal, there is no need to display a virtual wooden fish icon on the screen of the mobile terminal, nor is it necessary for the mobile terminal to sense the user's touch events through the wooden fish software. This at least partially solves the problem of high power consumption of the mobile terminal when using a mobile terminal to tap a wooden fish.

[0059] based on Figure 3 In addition to the method described herein, this specification also provides some improved implementation methods, which will be described below.

[0060] In one or more embodiments of this specification, the mobile terminal performs, as follows: Figure 3 Before the method of outputting feedback status information shown, it is also necessary to register the corresponding sensor event listener in the operating system of the mobile terminal through the target application, so that when the mobile terminal is hit by an external object, the target application can successfully obtain the vibration status data collected by the sensor.

[0061] Furthermore, a sensor event listener can be registered when a user accesses the target application. Before acquiring vibration state data collected by the sensor, the process may further include: acquiring the user's access operation to the target application; registering a sensor event listener in response to the access operation; and the sensor event listener being used to provide the vibration state data detected by the sensor.

[0062] For example, an acceleration sensor event listener can be registered, which can be used to provide the target application with acceleration data detected by the acceleration sensor.

[0063] In practical applications, when registering a sensor event listener, the sampling callback frequency of the sensor can also be set. Thus, the sensor event listener can provide the target application with the vibration state data detected by the sensor at a preset frequency.

[0064] Taking the Android system as an example, the SensorManager class has several predefined constants for setting the sampling callback frequency of sensor data. These constants can include SENSOR_DELAY_NORMAL, SENSOR_DELAY_UI, and SENSOR_DELAY_GAME. SENSOR_DELAY_NORMAL is typically suitable for applications that don't require particularly high precision or fast response times; a typical value is around 5Hz. SENSOR_DELAY_UI is typically suitable for applications that provide smooth animations for the user interface; its value is usually higher than SENSOR_DELAY_NORMAL, with a typical value around 15Hz. SENSOR_DELAY_GAME is typically suitable for games or other applications that require high sensitivity and fast response times; its value is usually higher than SENSOR_DELAY_UI, typically above 50Hz, and can reach 200Hz or higher on some devices, depending on the device's hardware capabilities. The typical values ​​for SENSOR_DELAY_NORMAL, SENSOR_DELAY_UI, and SENSOR_DELAY_GAME are not fixed and can vary depending on the device.

[0065] In practical applications, when registering a sensor event listener, one of several preset sampling callback frequencies can be selected as the actual sampling callback frequency. In the embodiments of this specification, on the one hand, considering the sampling density requirements of vibration state data needed when determining whether a user is performing a "wooden fish" operation on the mobile terminal, and on the other hand, considering factors such as excessive consumption of mobile terminal resources due to excessively high sampling frequencies, the sensor's sampling callback frequency can preferably be set to SENSOR_DELAY_UI.

[0066] In an optional embodiment, the frequency at which the sensor event listener provides vibration state data can be greater than or equal to the preset value of SENSOR_DELAY_UI in the operating system of the mobile terminal.

[0067] Based on the embodiments of this specification, by setting the frequency of vibration state data provided by the sensor event listener to a value not less than SENSOR_DELAY_UI, the basic requirements for a mobile terminal to determine a user's tapping of a wooden fish can be met. Optionally, if the user terminal has sufficient operating resources, the frequency of vibration state data provided by the sensor event listener can also be set to the value SENSOR_DELAY_GAME to further improve the accuracy of the determined tapping result.

[0068] In one or more embodiments of this specification, considering that mobile terminals are typically equipped with accelerometers in practical applications, accelerometers can be used as sensors to acquire vibration state data. Therefore, no hardware modifications to the mobile terminal device are required, making the solution widely applicable. Furthermore, accelerometers can generally detect taps from almost anywhere on the mobile terminal, greatly facilitating the use of mobile terminals to strike wooden fish.

[0069] Therefore, in such Figure 3 In the method for outputting feedback state information, the sensor may include an accelerometer; the vibration state data may include acceleration data. Specifically, acquiring the vibration state data collected by the sensor may include: acquiring the acceleration data collected by the accelerometer.

[0070] Typically, the acceleration data collected by an accelerometer can contain three sets of acceleration components, that is, acceleration components corresponding to three directions, and these three sets of acceleration components can be positive or negative. As an example, when the mobile terminal is specifically a mobile phone, the acceleration data collected by the accelerometer can include a first acceleration component along the z-axis (e.g., pointing inwards towards the inside of the phone screen), a second acceleration component along the x-axis (e.g., from the top left corner to the top right corner when the phone is in portrait mode), and a third acceleration component along the y-axis (e.g., from the top left corner to the bottom left corner when the phone is in portrait mode).

[0071] According to the classical mechanics formula F=m·a, where F represents the force acting on the mobile terminal, m represents the mass of the mobile terminal, and a represents the acceleration of the mobile terminal, it can be seen that the acceleration of the mobile terminal is linearly related to the force acting on it. By using an accelerometer to detect the acceleration of the mobile terminal and analyzing the value of the acceleration, the force acting on the mobile terminal can be determined, and thus the effects of the wooden fish striking operation on the mobile terminal can be understood.

[0072] In practical applications, taking a mobile phone as an example, when a user taps the phone, it is usually the front or back of the phone. The accelerometer can detect the change of the first acceleration component data in the z-axis direction in a short period of time. Therefore, in the embodiments of this specification, it is possible to determine whether a tapping operation has occurred on the mobile terminal based mainly on the first acceleration component data along the z-axis direction in the acceleration data.

[0073] Specifically, the vibration state data may include first acceleration component data; the first acceleration component data is acceleration component data along the z-axis direction; the z-axis direction is a direction perpendicular to the plane where the screen of the mobile terminal is located. Therefore, determining whether the vibration state data meets the preset tapping judgment condition may specifically include: determining whether the first acceleration component data meets the preset tapping judgment condition.

[0074] In one or more embodiments of this specification, the first acceleration component data can be considered as a numerical sequence, and specifically, it can be a numerical sequence that changes over time, such as a numerical sequence of "time - first acceleration component value". Considering the characteristics of the "wooden fish striking" operation, the striking time is short and the striking effect disappears quickly. This is reflected in the change of acceleration value, which may deviate significantly from the baseline value in a short period of time and then return to the baseline value in a short period of time. Therefore, in the embodiments of this specification, the fluctuation of the first acceleration component value in a short period of time can be detected to determine whether a "wooden fish striking" operation has occurred on the mobile terminal.

[0075] Specifically, the first acceleration component data can be considered as comprising multiple sequentially connected sequences that change over time. Further, the first acceleration component data may include a first sequence and a second sequence; the second sequence may contain first acceleration value components collected within a preset time period prior to the current moment; the first sequence may contain first acceleration value components collected within the preset time period prior to the start time of the second sequence. Correspondingly, determining whether the first acceleration component data meets the preset tapping judgment condition may specifically include: calculating the first variance of each first acceleration component value contained in the first sequence; calculating the second variance of each first acceleration component value contained in the second sequence; determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, thereby obtaining a variance judgment result. Therefore, if the tapping judgment result indicates that the vibration state data meets the preset tapping judgment condition, the feedback device is triggered to output feedback state information to simulate the tapping of the wooden fish. Specifically, this may include: if the variance judgment result indicates that the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, the feedback device is triggered to output feedback state information to simulate the tapping of the wooden fish.

[0076] The preset duration range used to divide the sequence reflects the time it takes for the striking operation to deviate from the baseline value and then return to it. In practical applications, the preset duration range can be determined based on historical data of users striking the wooden fish using a mobile terminal, or based on measurement data of users striking the wooden fish with a real one. This preset duration range allows for the determination of whether the mobile terminal has been subjected to a wooden fish striking operation by statistically analyzing the variance of the acceleration component values ​​between two adjacent preset duration ranges.

[0077] The variance threshold used to determine the variance judgment result can be obtained based on historical data of users performing the "wooden fish" (a traditional Chinese stringed instrument striking motion) operation on mobile terminals. In practical applications, this variance threshold can optionally be affected by sensor sensitivity; therefore, it can vary from device to device. Devices with relatively high sensor sensitivity can have a relatively high variance threshold set. Optionally, the variance threshold can also vary from person to person. Thus, by setting the variance threshold differently depending on the device or the individual, the accuracy of determining the variance judgment result can be improved.

[0078] For adjacent second and first sequences in chronological order, if the variance of the second sequence is greater than or equal to a preset variance threshold, it indicates that the mobile terminal was tapped during the second sequence. If the variance of the subsequent first sequence is less than the preset variance threshold, it indicates that the mobile terminal returned to a state without being tapped during the first sequence. Thus, it reflects that the mobile terminal was briefly tapped, which can be considered as the mobile terminal being subjected to a tapping operation.

[0079] In one or more embodiments of this specification, considering that the force / acceleration change of the mobile terminal is usually large when the wooden fish-beating operation occurs, in order to improve the accuracy of the striking judgment result, the difference in variance between adjacent sequences can be considered when determining whether the mobile terminal has been subjected to the wooden fish-beating operation.

[0080] Specifically, after determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, and obtaining the variance determination result, the method may further include: if the variance determination result indicates that the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold, then calculating the ratio of the first variance to the second variance; and determining whether the ratio is greater than or equal to a preset proportion threshold, to obtain the ratio determination result. Therefore, the step of triggering the feedback device to output feedback state information to simulate the wooden fish being struck if the tapping determination result indicates that the vibration state data meets the preset tapping judgment conditions may specifically include: if the ratio determination result indicates that the ratio is greater than or equal to a preset proportion threshold, then triggering the feedback device to output feedback state information to simulate the wooden fish being struck.

[0081] The ratio threshold used to determine the ratio judgment result can be obtained based on historical data statistics of users performing the "wooden fish striking" operation on the mobile terminal. This ratio threshold reflects the sensitivity of the mobile terminal in responding to the user's "wooden fish striking" operation and outputting feedback state information to simulate the wooden fish being struck; that is, the sensitivity of the mobile terminal as the wooden fish. In practical applications, it can be set according to actual business needs, for example, it can be set to 20, 10, etc., and is not limited to this.

[0082] exist Figure 4 The diagram illustrates an example of the time-varying nature of first acceleration component data used in a method for outputting feedback state information, as provided in embodiments of this specification. Figure 4 In the diagram, the horizontal axis represents the time unit, with one time unit being 20 ms; the vertical axis represents the acceleration value, with the unit being m / s². 2 . Figure 4 The units and data shown are for illustrative purposes only and do not constitute a limitation on the scope of the technical solutions of this application.

[0083] like Figure 4 As shown, if the sequence is divided in 200ms intervals, that is, if the preset duration range is set to 200ms, the acceleration value components corresponding to time units 1 to 10 can be divided into one sequence, the acceleration value components corresponding to time units 11 to 20 can be divided into another sequence, and so on. When it is determined that in two adjacent sequences, the variance of the acceleration value component of the former is greater than or equal to a preset variance threshold, and the variance of the acceleration value component of the latter is less than a preset variance threshold, and preferably, the ratio of the variance corresponding to the former to the variance corresponding to the latter is greater than or equal to a preset ratio threshold, then it can be determined that the mobile terminal has been subjected to a "wooden fish striking" operation. Figure 4 The image shows two instances of striking the wooden fish, determined based on the aforementioned judgment method.

[0084] In one or more embodiments of this specification, considering that when a user is using a mobile terminal and has the target application open, in addition to performing the tapping operation, they may also perform other operations due to actual needs, such as making a payment. These operations will cause the mobile terminal to move and its acceleration to change. Therefore, in the embodiments of this specification, a technical solution is provided to remove interference noise in the process of determining the tapping judgment result, so as to improve the accuracy of determining the tapping judgment result and thus improve the accuracy of the output feedback status information.

[0085] Specifically, before determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, it can be determined whether the mobile terminal is in a preset vibration state to obtain a vibration state determination result; the preset vibration state is used to reflect the vibration state of the mobile terminal other than being tapped.

[0086] Further, it may include: acquiring a status tag of the mobile terminal; the status tag being used to indicate that the mobile terminal is in a vibration state other than a tapped state; and then determining whether the mobile terminal is in a preset vibration state based on the status tag. Correspondingly, determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold may specifically include: if the vibration state determination result indicates that the mobile terminal is not in a preset vibration state, then determining whether the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold.

[0087] In practical applications, different vibration states of a mobile terminal can reflect different usage states of the terminal. For example, the preset vibration state can indicate that the mobile terminal is being shaken. Similarly, the preset vibration state can indicate that the mobile terminal is being placed.

[0088] In one or more embodiments of this specification, a process is further provided for determining that the mobile terminal is in a preset vibration state, such as being shaken.

[0089] In an optional embodiment, the first acceleration component data may further include a third sequence; the third sequence may include first acceleration value components collected within the preset time range before the start time of the first sequence. Therefore, before determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, the process may further include: determining whether the first variance corresponding to the first sequence is greater than or equal to the preset variance threshold, and whether the third variance corresponding to the third sequence is greater than or equal to the variance threshold, to obtain a multi-sequence determination result; if the multi-sequence determination result indicates that the first variance corresponding to the first sequence is greater than or equal to the preset variance threshold, and the third variance corresponding to the third sequence is greater than or equal to the variance threshold, then the status label set on the mobile terminal is set to a preset vibration state.

[0090] In the foregoing embodiments, the preset vibration state can be determined based on adjacent first and third sequences in the first acceleration component data. The third sequence includes first acceleration value components collected within the preset time range before the start time of the first sequence. In practical applications, if the variance of two consecutive sequences is greater than a preset variance threshold, i.e., in such cases... Figure 4 The diagram shows two adjacent spikes ( Figure 4 (This situation is not shown in the diagram). Therefore, it can be assumed that the mobile terminal is being shaken, and the mobile terminal is marked as a preset vibration state. In this case, even if the variance of the sequences following these two sequences is less than the preset variance threshold, it will not be mistakenly considered that the mobile terminal has been subjected to a wooden fish striking operation. This improves the accuracy of the striking judgment result, and thus improves the accuracy of the output feedback state information. For example, it will not output feedback state information to simulate a wooden fish being struck when the mobile terminal is shaken.

[0091] Furthermore, although in the aforementioned embodiments, the mobile terminal is considered to be in a shaking state when the variance of two consecutive sequences is greater than a preset variance threshold, in practical applications, in order to avoid the possibility of being misidentified as the mobile terminal being in a shaking state, and considering that shaking usually lasts for a long time, for example, it can last for the duration corresponding to three or more sequences, the preset vibration state can optionally be determined based on the first sequence, the third sequence and the fourth sequence in the first acceleration component data, wherein the fourth sequence includes the first acceleration value component collected within the preset duration range before the start time of the third sequence.

[0092] For ease of understanding, Figure 5 The diagram shows a flowchart illustrating the process of determining the knocking result provided in an embodiment of this specification.

[0093] like Figure 5 As shown in the figure, 1) the current numerical sequence can be obtained, which is collected by the sensor.

[0094] 2) It can calculate the variance of the current numerical sequence.

[0095] 3) It can be determined whether the variance of the current numerical sequence exceeds the preset variance threshold; if yes, then step 4 can be executed; if no, then step 8 can be executed.

[0096] 4) If step 3) determines that the variance of the current numerical sequence exceeds the preset variance threshold, the current numerical sequence can be marked as a suspicious sequence.

[0097] 5) Optionally, it can be determined whether the suspicious sequence has appeared consecutively a preset number of times (e.g., 3 times); if so, step 6 can be executed; if not, step 7 can be executed.

[0098] 6) If step 5) determines that the suspicious sequence appears consecutively for a preset number of times, the mobile terminal can be marked as shaking.

[0099] 7) If step 5) determines that the number of consecutive occurrences of the suspicious sequence has not reached the preset number, then the next numerical sequence can be obtained. For example, step 1 can be returned to be executed.

[0100] 8) If step 3) determines that the variance of the current numerical sequence does not exceed the preset variance threshold, then optionally, it can be determined whether the current state of the mobile terminal is a shaking state; if yes, it can indicate that the shaking has ended, and steps 13) and 7) can be executed; if no, step 9) can be executed.

[0101] 9) If step 8) determines that the current state of the mobile terminal is not a shaking state, then it can be further determined whether the previous numerical sequence is a suspicious sequence; if yes, then step 10) can be executed; if no, then steps 13) and 7) can be executed.

[0102] 10) If the judgment result of step 9) indicates that the previous numerical sequence is a suspicious sequence, then optionally, the ratio of the variance of the previous numerical sequence to the variance of the current numerical sequence can be calculated.

[0103] 11) It can be determined whether the ratio calculated in step 10) is greater than or equal to the preset ratio threshold; if yes, then step 12) can be executed; if no, it can be indicated that the current mobile terminal is being slightly shaken and is not being struck by the wooden fish, then steps 13) and 7) can be executed.

[0104] 12) If the judgment result of step 11) indicates that the ratio calculated in step 10) is greater than or equal to the preset ratio threshold, it can indicate that the current mobile terminal is being struck by the wooden fish, that is, the striking judgment condition is met, and the feedback device can be triggered to output feedback status information to simulate the wooden fish being struck.

[0105] 13) If the judgment in step 8) is yes, step 9) is no, step 11) is no, or step 12) is complete, it indicates that the judgment of the current numerical sequence is complete, and step 7) can be further executed to enter the next sampling period and obtain the next numerical sequence. In practical applications, if the judgment result in step 3) indicates that the variance of the current numerical sequence does not exceed the preset variance threshold, before executing step 7), it is necessary to clear the previous markings for suspicious sequences and the markings for the shaking state of the mobile terminal to avoid errors in the evaluation of subsequent sequences.

[0106] In one or more embodiments of this specification, considering that the usage state of the mobile terminal may be various when the user strikes the wooden fish with the mobile terminal, in order to improve the accuracy of determining the striking judgment result and thus improve the accuracy of the output feedback status information, the striking judgment result can be determined by determining the actual usage state of the mobile terminal and using different striking judgment conditions.

[0107] Specifically, before determining whether the vibration state data meets the preset tapping judgment condition, the process may further include: determining the usage state of the mobile terminal; the usage state includes a horizontal screen state or a tilted screen state; obtaining the tapping judgment condition corresponding to the usage state; the tapping judgment condition includes a variance threshold corresponding to the usage state information; the variance threshold corresponding to the horizontal screen state is different from the variance threshold corresponding to the tilted screen state.

[0108] The variance threshold can correspond to the variance threshold mentioned above used to determine whether the knocking criteria are met.

[0109] Taking mobile terminals, specifically mobile phones, as an example, in practical applications, if the phone screen is horizontal (e.g., screen up or down), it usually means the phone is placed on a horizontal surface. In this case, the variance threshold for determining whether the phone has been struck by a wooden fish can be set relatively small to ensure the sensitivity of the wooden fish strike detection. If the phone screen is tilted (e.g., at a 60-degree angle to the horizontal surface), it usually means the phone may be handheld or placed on a stand. In this case, the variance threshold for determining whether the phone has been struck by a wooden fish can be set relatively large to avoid introducing too much noise when detecting the wooden fish strike.

[0110] In one or more embodiments of this specification, a specific method for determining the usage status of a mobile terminal is further provided. Specifically, the usage status of the mobile terminal can be determined based on acceleration data collected by an accelerometer.

[0111] More specifically, acquiring the vibration state data collected by the sensor may include: acquiring acceleration data collected by an accelerometer; the acceleration data includes a second acceleration component along the x-axis and a third acceleration component along the y-axis; the x-axis and y-axis are mutually perpendicular directions within the plane where the screen of the mobile terminal is located. Therefore, determining the usage state of the mobile terminal; the usage state including a screen horizontal state or a screen tilt state, may specifically include: at a specified time, if the absolute value of the second acceleration component is less than a detection threshold and the absolute value of the third acceleration component is less than the detection threshold, then the usage state of the mobile terminal is determined to be a screen horizontal state; if only one of the absolute values ​​of the second acceleration component and the third acceleration component is greater than or equal to the detection threshold, then the usage state of the mobile terminal is determined to be a screen tilt state.

[0112] The detection threshold can be a value close to zero, or in other words, a standard for determining whether a quantity is zero at the detection level. Typically, if the value is greater than this threshold, it can be detected and recorded as a non-zero value. Based on the aforementioned scheme of the embodiments of this specification, it is possible to confirm that the screen is in a horizontal state when both the second and third acceleration components are zero at the detection level.

[0113] In one or more embodiments of this specification, when the mobile terminal determines that the tapping judgment result indicates that the vibration state data meets the preset tapping judgment conditions, it can not only trigger the feedback device to output feedback state information to simulate the wooden fish being tapped, but also include: if the tapping judgment result indicates that the vibration state data meets the preset tapping judgment conditions, then update the tapping data.

[0114] The tapping data may include, but is not limited to, the number of taps, the duration of tapping, the time of tapping, the frequency of tapping, and the force of tapping.

[0115] Traditional methods of striking a wooden fish in related technologies are not only inconvenient to carry, but also difficult to track how long and how many times a user strikes it. However, the solution based on the embodiments of this specification directly uses a mobile terminal, such as a mobile phone, as the wooden fish to strike. The target application in the mobile terminal can record and save the striking data, making it easy for users to view and understand their striking data.

[0116] In practical applications, with user authorization, the mobile terminal can also upload the user's tapping data to the server corresponding to the Muyu application, so that the server can store the user's tapping data. Therefore, the tapping data can be recorded on the mobile terminal and / or the server corresponding to the target application.

[0117] Optionally, the mobile terminal or server can also perform statistical analysis on the user's tapping data to obtain statistical data. For example, it can analyze the changing trends of data such as the number of taps or tapping time in different time periods (e.g., daily, weekly, monthly, yearly, etc.), the average number of taps or tapping time in different time periods (e.g., daily, weekly, monthly, yearly, etc.), and the distribution of the time of each tap in a certain period, etc., not limited to the statistical items shown here.

[0118] Optionally, the server can also perform comparative analysis based on the typing data of multiple users to obtain comparative data. For example, it can statistically analyze the average of the typing data (or statistical data) of multiple or all users, rank users based on the typing data (or statistical data) of multiple or all users, and provide the comparative data back to each user.

[0119] Optionally, after updating the tap data, the method may further include: when the target application is detected to be running in the foreground (e.g., when a user views the target application), displaying at least one of the tap data, statistical data obtained based on the tap data, and comparative data obtained based on the tap data and / or statistical data. Specifically, at least one of the tap data, statistical data, or comparative data may be displayed on the screen's display interface; more specifically, at least one of the tap data, statistical data, or comparative data may be displayed on the target application's page.

[0120] In one or more embodiments of this specification, one or more feedback devices may be provided in the mobile terminal.

[0121] Optionally, the feedback device may include an audio output device. Accordingly, the trigger feedback device outputs feedback status information to mimic the striking of a wooden fish, specifically including: triggering the audio output device in the mobile terminal to emit a sound effect to mimic the striking of a wooden fish.

[0122] As an example, the audio output device may specifically be a speaker, etc.

[0123] Optionally, the feedback device may include a vibration device. Accordingly, the trigger feedback device outputs feedback state information to mimic the striking of a wooden fish, specifically including: triggering the vibration device in the mobile terminal to emit vibrations to mimic the striking of a wooden fish.

[0124] As an example, the vibration device can specifically be a vibration motor, etc.

[0125] Optionally, when the trigger feedback device outputs feedback state information to mimic the striking of a wooden fish, one feedback state information may be triggered, or multiple feedback devices may be triggered to simultaneously output feedback state information. For example, only the audio output device may be triggered to emit a sound effect to mimic the striking of a wooden fish, or only the vibration device may be triggered to emit a vibration to mimic the striking of a wooden fish, or both the audio output device and the vibration device may be triggered to emit a sound effect to mimic the striking of a wooden fish.

[0126] Optionally, the mobile terminal can have multiple feedback devices of various types. When multiple feedback devices of a certain type are set, one or more of these devices can be triggered to output feedback status information to mimic the striking of a wooden fish. For example, when multiple speakers are included, one or more of them can be triggered to emit sound effects to mimic the striking of a wooden fish. Similarly, when multiple vibration motors are included, one or more of them can be triggered to emit vibrations to mimic the striking of a wooden fish.

[0127] In practical applications, the specific feedback devices used to output feedback information mimicking the striking of a wooden fish can be determined based on settings provided by the user performing the action, or by settings preset by other personnel. In practice, by changing the combination of feedback devices used to mimic the striking of a wooden fish, users can obtain a richer experience of striking the wooden fish.

[0128] In one or more embodiments of this specification, the mobile terminal may have a display screen, and during the execution of the method for outputting feedback status information, the display screen may be in a state where the target application cannot receive screen touch events; the target application is an application used to output the feedback status information.

[0129] In practical applications, taking a mobile phone as a specific example, based on the solutions in the embodiments of this specification, optionally, when the phone is placed with the screen facing down, even if the user cannot see the wooden fish icon in the target application, the experience of tapping the wooden fish can still be achieved. This reduces the power consumption caused by the phone displaying the wooden fish icon and responding to the user's touch operation, avoids the stimulation of the user's eyes by the light of the display screen, and makes the user's tapping operation more convenient, achieving multiple benefits.

[0130] In practical applications, optionally, when the Muyu app is running in the background, such as when the screen is off, it can still receive the user's tapping of the Muyu icon, whether the user taps the phone's back or the front. This reduces the power consumption caused by the phone displaying the Muyu icon and responding to the user's touch operation, avoids the stimulation of the user's eyes by the light from the display screen, and makes the user's tapping operation more convenient, achieving multiple benefits.

[0131] In practical applications, optionally, when the wooden fish application is running in the background, for example, when the user is using other applications in the foreground (such as information browsing applications), it does not prevent the user from continuing to perform the wooden fish tapping operation. This reduces the power consumption caused by the phone displaying the wooden fish icon and responding to the user's touch operation, and also makes it easier for the user to handle other tasks while tapping the wooden fish, thus providing convenience for the user.

[0132] In one or more embodiments of this specification, considering that users may still prefer to perform the wooden fish tapping operation in some scenarios in the traditional way, that is, to tap the wooden fish by touching the wooden fish icon displayed in the wooden fish application, in practical applications, optionally, the method of outputting feedback status information provided in the embodiments of this application can be executed only when the screen of the mobile terminal is facing down.

[0133] Specifically, data collected by the mobile terminal's built-in proximity sensor can be used to determine whether the mobile terminal is in a screen-down position.

[0134] Furthermore, before determining whether the vibration state data meets the preset tapping judgment condition, the process may further include: acquiring distance data collected by a distance sensor; the distance data reflecting the distance between the mobile terminal and objects outside the mobile terminal; and then determining the screen occlusion state of the mobile terminal based on the distance data; the screen occlusion state includes an occluded state or an unoccluded state. Accordingly, determining whether the vibration state data meets the preset tapping judgment condition may specifically include: if the screen occlusion state is specifically an occluded state, then determining whether the vibration state data meets the preset tapping judgment condition.

[0135] In practical applications, if the screen occlusion state of the mobile terminal is specifically an obstructed state, it can be inferred that the mobile terminal is in a screen-down state. Alternatively, to improve the accuracy of determining whether the mobile terminal is in a screen-down state, distance data collected by a distance sensor and acceleration data collected by an accelerometer can be combined. Specifically, if the usage state of the mobile terminal is determined to be a horizontal screen state based on the second and third acceleration components, and the distance data collected by the distance sensor determines that the screen occlusion state of the mobile terminal is specifically an obstructed state, then the mobile terminal is determined to be in a screen-down state.

[0136] Optionally, after determining the screen occlusion state of the mobile terminal based on the distance data, the process may further include: if the screen occlusion state is specifically an unoccluded state, then determining whether the target application is in a state where it cannot receive screen touch events, thereby obtaining a touchable state determination result; the target application is an application used to output the feedback state information; correspondingly, determining whether the vibration state data meets the preset tapping determination condition may specifically include: if the touchable state determination result indicates that the target application is in a state where it cannot receive screen touch events, then determining whether the vibration state data meets the preset tapping determination condition.

[0137] In practical applications, if the mobile terminal's screen is actually unobstructed, but the target application is unable to receive screen touch events, it can be inferred that the user is using the mobile terminal to view other applications in the foreground. In this case, based on the solutions in the embodiments of this specification, it is also possible to achieve the effect of the user using the mobile terminal as a wooden fish for striking.

[0138] The various technical features in the above embodiments can be combined arbitrarily, as long as there is no conflict or contradiction between the combinations of features. However, due to space limitations, they have not been described one by one. Therefore, the arbitrary combination of various technical features in the above embodiments is also within the scope of this specification.

[0139] Based on the same idea, embodiments of this specification also provide apparatus corresponding to the above methods.

[0140] Figure 6 The embodiments provided in this specification correspond to Figure 3 A schematic diagram of the structure of a device for outputting feedback status information.

[0141] like Figure 6 As shown, this device is applied to a mobile terminal and may include:

[0142] The vibration state data acquisition module 602 is used to acquire vibration state data collected by the sensor; the vibration state data is generated based on the mobile terminal being struck by an external object.

[0143] The tapping judgment module 604 is used to determine whether the vibration state data meets the preset tapping judgment conditions and obtain the tapping judgment result;

[0144] The feedback status information output module 606 is used to trigger the feedback device to output feedback status information to simulate the wooden fish being struck if the striking judgment result indicates that the vibration status data meets the preset striking judgment conditions.

[0145] based on Figure 6 The embodiments of this specification also provide some specific implementation schemes of the method, which are described below.

[0146] Optionally, the device for outputting feedback status information may further include: an access operation acquisition module for acquiring user access operations to the target application; a registration module for registering a sensor event listener in response to the access operation; and the sensor event listener for providing vibration status data detected by the sensor.

[0147] Optionally, the frequency at which the sensor event listener provides vibration state data is greater than or equal to the preset value of SENSOR_DELAY_UI in the operating system of the mobile terminal.

[0148] Optionally, the vibration state data includes first acceleration component data; the first acceleration component data is first acceleration component data along the z-axis direction; the z-axis direction is a direction perpendicular to the plane where the screen of the mobile terminal is located; the tapping judgment module 604 can be specifically used to: determine whether the first acceleration component data meets the preset tapping judgment conditions.

[0149] Optionally, the first acceleration component data includes a first sequence and a second sequence; the second sequence contains first acceleration value components collected within a preset time range before the current moment; the first sequence contains first acceleration value components collected within the preset time range before the start time of the second sequence; the striking judgment module 604 can be specifically used to: calculate the first variance of each first acceleration component value contained in the first sequence; calculate the second variance of each first acceleration component value contained in the second sequence; determine whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, and obtain a variance judgment result. Correspondingly, the feedback status information output module 606 can be specifically used to: if the variance judgment result indicates that the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, then trigger the feedback device to output feedback status information to simulate the wooden fish being struck.

[0150] Optionally, after determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, and obtaining the variance determination result, the method may further include: if the variance determination result indicates that the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold, then calculating the ratio of the first variance to the second variance; determining whether the ratio is greater than or equal to a preset proportion threshold, and obtaining the ratio determination result. Correspondingly, the feedback status information output module 606 can specifically be used to: if the ratio determination result indicates that the ratio is greater than or equal to a preset proportion threshold, then triggering the feedback device to output feedback status information to simulate the striking of a wooden fish.

[0151] Optionally, before determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, the process may further include: obtaining a status tag of the mobile terminal; the status tag indicating that the mobile terminal is in a vibration state other than a tapped state; and determining whether the mobile terminal is in a preset vibration state based on the status tag to obtain a vibration state determination result. Accordingly, determining whether the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold may specifically include: if the vibration state determination result indicates that the mobile terminal is not in a preset vibration state, then determining whether the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold.

[0152] Optionally, the first acceleration component data further includes a third sequence; the third sequence contains a first acceleration value component collected within the preset time range before the start time of the first sequence; correspondingly, before determining whether the first variance is greater than or equal to a preset variance threshold and the second variance is less than the variance threshold, it may further include: determining whether the first variance corresponding to the first sequence is greater than or equal to the preset variance threshold and the third variance corresponding to the third sequence is greater than or equal to the variance threshold, to obtain a multi-sequence determination result; if the multi-sequence determination result indicates that the first variance corresponding to the first sequence is greater than or equal to the preset variance threshold and the third variance corresponding to the third sequence is greater than or equal to the variance threshold, then the status label set by the mobile terminal is set to a preset vibration state.

[0153] Optionally, before determining whether the vibration state data meets the preset tapping judgment condition, the method may further include: determining the usage state of the mobile terminal; the usage state includes a screen horizontal state or a screen tilt state; obtaining the tapping judgment condition corresponding to the usage state; the tapping judgment condition includes a variance threshold corresponding to the usage state information; the variance threshold corresponding to the screen horizontal state is different from the variance threshold corresponding to the screen tilt state.

[0154] Optionally, acquiring the vibration state data collected by the sensor may specifically include: acquiring acceleration data collected by an accelerometer; the acceleration data includes a second acceleration component along the x-axis and a third acceleration component along the y-axis; the x-axis and y-axis are mutually perpendicular directions within the plane where the screen of the mobile terminal is located; correspondingly, determining the usage state of the mobile terminal; the usage state includes a screen horizontal state or a screen tilt state, may specifically include: at a specified time, if the absolute value of the second acceleration component is less than a detection threshold and the absolute value of the third acceleration component is less than the detection threshold, then the usage state of the mobile terminal is determined to be a screen horizontal state; if only one of the absolute values ​​of the second acceleration component and the third acceleration component is greater than or equal to the detection threshold, then the usage state of the mobile terminal is determined to be a screen tilt state.

[0155] Optionally, after determining whether the vibration state data meets the preset knocking judgment conditions and obtaining the knocking judgment result, the method may further include: if the knocking judgment result indicates that the vibration state data meets the preset knocking judgment conditions, then the knocking data is updated.

[0156] Optionally, the feedback device may include an audio output device; correspondingly, the feedback status information output module 606 may be specifically used to: trigger the audio output device in the mobile terminal to emit a sound effect that imitates the sound of a wooden fish being struck.

[0157] Optionally, the feedback device may include a vibration device; correspondingly, the feedback status information output module 606 may be specifically used to: trigger the vibration device in the mobile terminal to emit vibrations that mimic the sound of a wooden fish being struck.

[0158] Optionally, the mobile terminal may have a display screen, and during the execution of the method for outputting feedback status information, the display screen is in a state where the target application cannot receive screen touch events; the target application is an application used to output the feedback status information.

[0159] Optionally, before determining whether the vibration state data meets the preset knocking judgment condition, the method may further include: acquiring distance data collected by a distance sensor; the distance data is used to reflect the distance between the mobile terminal and objects outside the mobile terminal; determining the screen occlusion state of the mobile terminal based on the distance data; the screen occlusion state includes an occluded state or an unoccluded state; the knocking judgment module 604 may specifically be used to: if the screen occlusion state is specifically an occluded state, then determine whether the vibration state data meets the preset knocking judgment condition.

[0160] Optionally, after determining the screen occlusion state of the mobile terminal based on the distance data, the process may further include: if the screen occlusion state is specifically an unoccluded state, then determining whether the target application is in a state where it cannot receive screen touch events, and obtaining a touchable state determination result; the target application is an application used to output the feedback state information; the tapping determination module 604 may specifically be used to: if the touchable state determination result indicates that the target application is in a state where it cannot receive screen touch events, then determining whether the vibration state data meets a preset tapping determination condition.

[0161] It is understood that the modules mentioned above refer to computer programs or program segments used to perform one or more specific functions. Furthermore, the distinction between these modules does not imply that the actual program code must also be separate.

[0162] The above is a schematic scheme of an apparatus for outputting feedback status information according to this embodiment. It should be noted that the technical solution of this apparatus for outputting feedback status information and the technical solution of the method for outputting feedback status information described above belong to the same concept. For details not described in detail in the technical solution of the apparatus for outputting feedback status information, please refer to the description of the technical solution of the method for outputting feedback status information described above.

[0163] Based on the same idea, this specification also provides devices corresponding to the above methods in its embodiments.

[0164] Figure 7 The embodiments provided in this specification correspond to Figure 3 A schematic diagram of the structure of a mobile terminal device. (See diagram below.) Figure 7 As shown, device 700 may include:

[0165] At least one processor 710; and,

[0166] Memory 730 communicatively connected to the at least one processor; wherein,

[0167] The memory 730 stores instructions 720 that can be executed by the at least one processor 710, the instructions being executed by the at least one processor 710 to enable the at least one processor 710 to:

[0168] Acquire vibration state data collected by sensors; the vibration state data is generated based on the mobile terminal being struck by an external object.

[0169] Determine whether the vibration state data meets the preset knocking judgment conditions to obtain the knocking judgment result;

[0170] If the tapping judgment result indicates that the vibration state data meets the preset tapping judgment conditions, then the feedback device is triggered to output feedback state information to simulate the wooden fish being tapped.

[0171] The above is an illustrative scheme of a mobile terminal device according to this embodiment. It should be noted that the technical solution of this computing device and the technical solution of the above-described method for outputting feedback status information belong to the same concept. For details not described in detail in the technical solution of the computing device, please refer to the description of the technical solution of the above-described method for outputting feedback status information.

[0172] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, for the apparatus and device embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiments. The apparatus, device and method provided in the embodiments of this specification are corresponding to each other, and therefore the apparatus and device also have similar beneficial technical effects as the corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the corresponding apparatus and device will not be repeated here.

[0173] The foregoing has described specific embodiments of this application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired results. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0174] In the 1990s, improvements to a technology could be clearly distinguished as either hardware improvements (e.g., improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to methodology). However, with technological advancements, many methodological improvements today can be considered direct improvements to hardware circuit structures. Designers almost always obtain the corresponding hardware circuit structure by programming the improved methodology into the hardware circuit. Therefore, it cannot be said that a methodological improvement cannot be implemented using hardware physical modules. For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is such an integrated circuit whose logic function is determined by the user programming the device. Designers can program a digital system themselves to "integrate" it onto a PLD, without needing chip manufacturers to design and manufacture dedicated integrated circuit chips. Furthermore, nowadays, instead of manually manufacturing integrated circuit chips, this programming is mostly implemented using "logic compiler" software. Similar to the software compiler used in program development, the original code before compilation must also be written in a specific programming language, called a Hardware Description Language (HDL). There are many HDLs, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, and RHDL (Ruby Hardware Description Language). Currently, the most commonly used are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also understand that by simply performing some logic programming on the method flow using one of these hardware description languages ​​and programming it into an integrated circuit, the hardware circuit implementing the logical method flow can be easily obtained.

[0175] The controller can be implemented in any suitable manner. For example, it can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicon Labs C8051F320. A memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also recognize that, in addition to implementing the controller in purely computer-readable program code form, the same functionality can be achieved by logically programming the method steps to make the controller take the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers. Therefore, such a controller can be considered a hardware component, and the means included therein for implementing various functions can also be considered as structures within the hardware component. Alternatively, the means for implementing various functions can be considered as both software modules implementing the method and structures within the hardware component.

[0176] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.

[0177] For ease of description, the above devices are described separately by function as various units. Of course, in implementing this application, the functions of each unit can be implemented in one or more software and / or hardware.

[0178] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0179] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0180] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0181] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0182] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0183] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0184] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital character versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0185] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0186] This application can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0187] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for outputting feedback state information, applied to a mobile terminal, comprising: obtaining vibration state data collected by a sensor; the vibration state data being generated based on an object outside the mobile terminal knocking the mobile terminal; determining whether the vibration state data satisfies a preset knocking determination condition to obtain a knocking determination result; and triggering a feedback device to output feedback state information for simulating a wooden fish being knocked if the knocking determination result indicates that the vibration state data satisfies the preset knocking determination condition. 2.The method of claim 1, before the obtaining vibration state data collected by a sensor, further comprising: obtaining an access operation of a user on a target application; and registering a sensor event listener in response to the access operation; the sensor event listener being configured to provide vibration state data detected by the sensor; a frequency of the vibration state data provided by the sensor event listener being greater than or equal to a value of SENSOR_DELAY_UI preset in an operating system of the mobile terminal. 4.The method of claim 1, the vibration state data comprising first acceleration component data; the first acceleration component data being first acceleration component data along a z-axis direction; the z-axis direction being a direction perpendicular to a plane on which a screen of the mobile terminal is located; and the determining whether the vibration state data satisfies a preset knocking determination condition comprising: determining whether the first acceleration component data satisfies the preset knocking determination condition; the determining whether the first acceleration component data satisfies the preset knocking determination condition comprising: calculating a first variance of each first acceleration component value contained in a first sequence; calculating a second variance of each first acceleration component value contained in a second sequence; determining whether the first variance is greater than or equal to a preset variance threshold value and the second variance is less than the variance threshold value to obtain a variance determination result; and the triggering the feedback device to output the feedback state information for simulating the wooden fish being knocked if the knocking determination result indicates that the vibration state data satisfies the preset knocking determination condition comprising: triggering the feedback device to output the feedback state information for simulating the wooden fish being knocked if the variance determination result indicates that the first variance is greater than or equal to the preset variance threshold value and the second variance is less than the variance threshold value. 6.The method of claim 5, after the determining whether the first variance is greater than or equal to the preset variance threshold value and the second variance is less than the variance threshold value to obtain the variance determination result, further comprising: calculating a ratio of the first variance to the second variance if the variance determination result indicates that the first variance is greater than or equal to the preset variance threshold value and the second variance is less than the variance threshold value; determining whether the ratio is greater than or equal to a preset ratio threshold value to obtain a ratio determination result; and the triggering the feedback device to output the feedback state information for simulating the wooden fish being knocked if the knocking determination result indicates that the vibration state data satisfies the preset knocking determination condition comprising: triggering the feedback device to output the feedback state information for simulating the wooden fish being knocked if the ratio determination result indicates that the ratio is greater than or equal to the preset ratio threshold value. ​ ​ ​ ​ ​ 3. The method of claim 2, wherein, ​ ​ ​ 5. The method of claim 4, wherein the first acceleration component data comprises a first sequence and a second sequence; the second sequence comprises first acceleration value components collected within a preset time range before a current time; and the first sequence comprises first acceleration value components collected within the preset time range before a starting time of the second sequence. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ If the ratio determination result indicates that the ratio is greater than or equal to the preset ratio threshold, a feedback device is triggered to output feedback state information simulating a wood fish being struck.

7. The method of claim 5, before the determining whether the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold, further comprising: obtaining a state label of the mobile terminal; the state label is used to indicate that the mobile terminal is in a vibration state other than a struck state; according to the state label, determining whether the mobile terminal is in a preset vibration state to obtain a vibration state determination result; the determining whether the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold specifically comprises: if the vibration state determination result indicates that the mobile terminal is not in the preset vibration state, determining whether the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold.

8. The method of claim 7, wherein the first acceleration component data further comprises a third sequence; the third sequence comprising first acceleration value components collected within the predetermined time range before the starting time of the first sequence. before the determining whether the first variance is greater than or equal to the preset variance threshold and the second variance is less than the variance threshold, further comprising: determining whether the first variance corresponding to the first sequence is greater than or equal to a preset variance threshold and the third variance corresponding to the third sequence is greater than or equal to the variance threshold to obtain a multi-sequence determination result; if the multi-sequence determination result indicates that the first variance corresponding to the first sequence is greater than or equal to the preset variance threshold and the third variance corresponding to the third sequence is greater than or equal to the variance threshold, setting a state label of the mobile terminal to a preset vibration state.

9. The method of claim 1, before the determining whether the vibration state data satisfies a preset striking determination condition, further comprising: determining a use state of the mobile terminal; the use state comprises a screen horizontal state or a screen inclined state; obtaining a striking determination condition corresponding to the use state; the striking determination condition includes a variance threshold corresponding to the use state information; the variance threshold corresponding to the screen horizontal state is different from the variance threshold corresponding to the screen inclined state.

10. The method of claim 9, the obtaining vibration state data collected by a sensor specifically comprises: obtaining acceleration data collected by an acceleration sensor; the acceleration data includes a second acceleration component data along an x-axis direction and a third acceleration component data along a y-axis direction; the x-axis direction and the y-axis direction are perpendicular to each other in a plane of a screen of the mobile terminal; the determining the use state of the mobile terminal; the use state comprises a screen horizontal state or a screen inclined state, specifically comprising: for a specified time, if an absolute value of the second acceleration component is less than a detection threshold and an absolute value of the third acceleration component is less than the detection threshold, determining that the use state of the mobile terminal is a screen horizontal state; If only one of the absolute value of the second acceleration component and the absolute value of the third acceleration component data is greater than or equal to the detection threshold, it is determined that the use state of the mobile terminal is a screen tilt state.

11. The method of claim 1, after the step of judging whether the vibration state data satisfies a preset knocking judgment condition to obtain a knocking judgment result, further comprising: If the knocking judgment result indicates that the vibration state data satisfies the preset knocking judgment condition, updating knocking data.

12. The method of claim 1, wherein the feedback device comprises an audio output device; and the triggering the feedback device to output feedback state information simulating a wooden fish being knocked comprises: Triggering the audio output device in the mobile terminal to output a sound effect simulating a wooden fish being knocked.

13. The method of claim 1, wherein the feedback device comprises a vibration device; and the triggering the feedback device to output feedback state information simulating a wooden fish being knocked comprises: Triggering the vibration device in the mobile terminal to output a vibration simulating a wooden fish being knocked.

14. The method of any one of claims 1 to 13, wherein the mobile terminal has a display screen, and during the execution of the method of outputting feedback state information, the display screen is in a state in which a target application cannot receive a screen touch event; and the target application is an application for outputting the feedback state information.

15. The method of claim 1, before the step of judging whether the vibration state data satisfies a preset knocking judgment condition, further comprising: Obtaining distance data collected by a distance sensor; The distance data is used to reflect the distance between the mobile terminal and an object outside the mobile terminal; According to the distance data, determining a screen shielding state of the mobile terminal; The screen shielding state comprises a shielded state or an unshielded state; The step of judging whether the vibration state data satisfies a preset knocking judgment condition comprises: If the screen shielding state is specifically the shielded state, judging whether the vibration state data satisfies a preset knocking judgment condition.

16. The method of claim 15, after the step of determining a screen shielding state of the mobile terminal according to the distance data, further comprising: If the screen shielding state is specifically the unshielded state, judging whether a target application is in a state in which it cannot receive a screen touch event to obtain a touchable state judgment result; The target application is an application for outputting the feedback state information; The step of judging whether the vibration state data satisfies a preset knocking judgment condition comprises: If the touchable state judgment result indicates that the target application is in a state in which it cannot receive a screen touch event, judging whether the vibration state data satisfies a preset knocking judgment condition.

17. A device for outputting feedback state information, applied to a mobile terminal, comprising: a vibration state data acquisition module, configured to acquire vibration state data collected by a sensor; The vibration state data is based on an object outside the mobile terminal knocking the mobile terminal. A knocking judgment module is configured to judge whether the vibration state data meets a preset knocking judgment condition, and obtain a knocking judgment result. A feedback state information output module is configured to trigger a feedback device to output feedback state information for simulating a wooden fish being knocked if the knocking judgment result indicates that the vibration state data meets the preset knocking judgment condition.

18. A mobile terminal device, comprising: at least one processor; and a memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to: obtain vibration state data collected by a sensor; the vibration state data is based on an object outside the mobile terminal knocking the mobile terminal; judge whether the vibration state data meets a preset knocking judgment condition, and obtain a knocking judgment result; trigger a feedback device to output feedback state information for simulating a wooden fish being knocked if the knocking judgment result indicates that the vibration state data meets the preset knocking judgment condition.

Images