Terminal Drop Prompt Method, Device, Equipment and Storage Medium

Abstract

The present disclosure relates to a method, apparatus, device, and storage medium for terminal drop prompt. The method includes: in response to detecting that the current state of the terminal device is a drop state, determining the motion state of the terminal device before the current state; determining the drop information of the terminal device based on the motion state; and generating an alarm message for prompting the drop information. The present disclosure can accurately determine the drop information of the terminal device based on the type of the motion state of the terminal device before the current state when detecting the drop state of the terminal device, which is beneficial to subsequently prompt the user based on the generated alarm message for prompting the drop information, can provide an accurate basis for the user to discover and retrieve the terminal device, and can improve the user experience.

Description

Technical Field

[0001] The present disclosure relates to the technical field of terminals, and in particular, to a method, apparatus, device, and storage medium for terminal drop prompting. Background Art

[0002] With the development of terminal technologies, terminal devices such as smart phones are becoming increasingly common and have become an indispensable part of people's lives and work. In real life, when users are engaged in activities such as running or cycling, it is easy for terminal devices to fall, which may cause damage to the terminals. Moreover, in a noisy outdoor environment, users usually wear earphones, so they may be inattentive and easily overlook the situation of the terminal device falling, ultimately resulting in the loss of the terminal device and affecting the user experience. Summary of the Invention

[0003] To overcome the problems existing in the related art, embodiments of the present disclosure provide a method, apparatus, device, and storage medium for terminal drop prompting to solve the defects in the related art.

[0004] According to a first aspect of the embodiments of the present disclosure, a method for terminal drop prompting is provided, and the method includes:

[0005] In response to detecting that the current state of the terminal device is a falling state, determining the motion state of the terminal device before the current state;

[0006] Based on the motion state, determining the drop information of the terminal device, where the drop information at least includes a drop type;

[0007] Generating an alarm message for prompting the drop information.

[0008] In an embodiment, the method further includes:

[0009] Detecting whether the current state of the terminal device is a falling state based on the inertial measurement unit (IMU) data of the terminal device.

[0010] In an embodiment, the determining the motion state of the terminal device before the current state includes:

[0011] In response to determining that the terminal device is in a motion state based on the IMU data of the terminal device, inputting the IMU data into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device;

[0012] Based on the probabilities of the different preset motion state types, determining the motion state of the terminal device before the current state.

[0013] In an embodiment, the method further includes:

[0014] Obtain SAR data and brightness data of the environment where the terminal device is located based on the SAR sensor and the light sensor on the terminal device respectively;

[0015] Adjust the probabilities of the different preset motion state types based on the SAR data and the brightness data;

[0016] Determining the motion state of the terminal device before the current state based on the probabilities of the different preset motion state types includes:

[0017] Determine the motion state of the terminal device before the current state based on the adjusted probabilities of the different preset motion state types.

[0018] In an embodiment, the different preset motion state types at least include a first state type and a second state type. The first state type corresponds to taking the terminal device out of the pocket, and the second state type corresponds to putting the terminal device into the pocket;

[0019] When the maximum probability among the different preset motion state types is the probability of the first state type, the adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data includes:

[0020] In response to detecting that the first condition is satisfied, increase the probability of the first state type by a preset first large amplitude. The satisfaction of the first condition includes: detecting based on the SAR data that the state of the terminal device changes from the state of being put into the pocket to the state of being held in the hand and / or detecting that the value of the brightness data changes from small to large;

[0021] In response to detecting that the second condition is satisfied, keep the probability of the first state type unchanged or decrease the probability of the first state type by a preset first small amplitude. The satisfaction of the second condition includes: the value of the brightness data remains within a range less than a preset value;

[0022] In response to detecting that neither the first condition nor the second condition is satisfied, decrease the probability of the first state type by a preset second large amplitude, and the second large amplitude is greater than the first small amplitude.

[0023] In an embodiment, when the maximum probability among the different preset motion state types is the probability of the second state type, the adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data includes:

[0024] In response to detecting that the third condition is met, increase the probability of the second state type by a preset large third amplitude. The satisfaction of the third condition includes: detecting, based on the SAR data, that the state of the terminal device changes from a hand-held state to a state of being put into a pocket and / or detecting that the value of the brightness data changes from large to small;

[0025] In response to detecting that the fourth condition is met, maintain the probability of the second state type unchanged or decrease the probability of the second state type by a preset small second amplitude. The satisfaction of the fourth condition includes: the value of the brightness data remains within a data range smaller than a preset value, and the third amplitude is greater than the second small amplitude;

[0026] In response to detecting that neither the third condition nor the fourth condition is met, decrease the probability of the second state type by a preset large fourth amplitude. The fourth amplitude is greater than the second small amplitude, and the fourth amplitude is greater than, less than, or equal to the third amplitude.

[0027] In one embodiment, the determining the falling information of the terminal device based on the motion state includes:

[0028] Based on a pre-constructed corresponding relationship, determine the falling type of the terminal device corresponding to the motion state type.

[0029] In one embodiment, the type of the alarm information includes at least one of a sound type and a flashlight type.

[0030] In one embodiment, the method further includes:

[0031] Send a prompt message for prompting the falling information to a preset communication contact. The prompt message includes at least one of a falling type, a falling location, and a falling time.

[0032] According to a second aspect of the embodiments of the present disclosure, there is provided a terminal falling prompt device, the device includes:

[0033] A motion state determining module, configured to determine the motion state of the terminal device before the current state in response to detecting that the current state of the terminal device is a falling state;

[0034] A falling information determining module, configured to determine the falling information of the terminal device based on the motion state, where the falling information at least includes a falling type;

[0035] An alarm information generating module, configured to generate alarm information for prompting the falling information.

[0036] In one embodiment, the device further includes:

[0037] A fall state detection module for detecting whether the current state of the terminal device is a fall state based on the inertial sensor (IMU) data of the terminal device.

[0038] In one embodiment, the motion state determination module includes:

[0039] A type probability acquisition unit for, in response to determining that the terminal device is in a motion state based on the inertial sensor (IMU) data of the terminal device, inputting the IMU data into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device;

[0040] A motion state determination unit for determining the motion state of the terminal device before the current state based on the probabilities of the different preset motion state types.

[0041] In one embodiment, the device further includes: a probability adjustment module;

[0042] The probability adjustment module includes:

[0043] A data acquisition unit for respectively acquiring SAR data based on the SAR sensor on the terminal device and the brightness data of the environment where the terminal device is located;

[0044] A probability adjustment unit for adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data;

[0045] The motion state determination unit is further configured to determine the motion state of the terminal device before the current state based on the adjusted probabilities of the different preset motion state types.

[0046] In one embodiment, the different preset motion state types at least include a first state type and a second state type, the first state type corresponding to taking the terminal device out of the pocket, and the second state type corresponding to putting the terminal device into the pocket;

[0047] In the case where the maximum probability among the different preset motion state types is the probability of the first state type, the probability adjustment unit is further configured to:

[0048] In response to detecting that a first condition is satisfied, increase the probability of the first state type by a preset first large amplitude, where the satisfaction of the first condition includes: detecting that the state of the terminal device changes from the state of being put into the pocket to the state of being held in the hand based on the SAR data and / or detecting that the value of the brightness data changes from small to large;

[0049] In response to detecting that the second condition is satisfied, maintain the probability of the first state type unchanged or decrease the probability of the first state type by a preset small first amplitude. The satisfaction of the second condition includes: the value of the brightness data remains within a range less than a preset data range;

[0050] In response to detecting that neither the first condition nor the second condition is satisfied, decrease the probability of the first state type by a preset large second amplitude, where the large second amplitude is greater than the small first amplitude.

[0051] In an embodiment, when the maximum probability among the different preset motion state types is the probability of the second state type, the probability adjustment unit is further configured to:

[0052] In response to detecting that the third condition is satisfied, increase the probability of the second state type by a preset large third amplitude. The satisfaction of the third condition includes: based on the SAR data, detecting that the state of the terminal device changes from a held state to a put-in-pocket state and / or detecting that the value of the brightness data changes from large to small;

[0053] In response to detecting that the fourth condition is satisfied, maintain the probability of the second state type unchanged or decrease the probability of the second state type by a preset small second amplitude. The satisfaction of the fourth condition includes: the value of the brightness data remains within a range less than a preset data range, and the large third amplitude is greater than the small second amplitude;

[0054] In response to detecting that neither the third condition nor the fourth condition is satisfied, decrease the probability of the second state type by a preset large fourth amplitude, where the large fourth amplitude is greater than the small second amplitude, and the large fourth amplitude is greater than, less than, or equal to the large third amplitude.

[0055] In an embodiment, the fall information determination module is further configured to determine the fall type of the terminal device corresponding to the motion state type based on a pre-established correspondence.

[0056] In an embodiment, the type of the alarm information includes at least one of a sound type and a flashlight type.

[0057] In an embodiment, the device further includes:

[0058] A prompt information sending module, configured to send a prompt information for prompting the fall information to a preset communication contact, where the prompt information includes at least one of a fall type, a fall occurrence location, and a fall time.

[0059] According to a third aspect of the embodiments of the present disclosure, there is provided a terminal device, where the device includes:

[0060] A processor and a memory for storing a computer program;

[0061] Wherein, the processor is configured to implement the following when executing the computer program:

[0062] In response to detecting that the current state of the terminal device is a falling state, determine the motion state of the terminal device before the current state;

[0063] Based on the motion state, determine the falling information of the terminal device, where the falling information at least includes the falling type;

[0064] Generate alarm information for prompting the falling information.

[0065] According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the following is implemented:

[0066] In response to detecting that the current state of the terminal device is a falling state, determine the motion state of the terminal device before the current state;

[0067] Based on the motion state, determine the falling information of the terminal device, where the falling information at least includes the falling type;

[0068] Generate alarm information for prompting the falling information.

[0069] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0070] By detecting that the current state of the terminal device is a falling state, determining the motion state of the terminal device before the current state, and based on the motion state, determining the falling information of the terminal device, where the falling information at least includes the falling type, the present disclosure can accurately determine the falling information of the terminal device based on the motion state type of the terminal device before the current state when detecting the falling state of the terminal device. Furthermore, it is beneficial to implement subsequent prompting of the user based on the generated alarm information for prompting the falling information, which can provide an accurate basis for the user to discover and retrieve the terminal device and can improve the user experience.

[0071] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.

[0073] Figure 1It is a flowchart of a method for prompting terminal falling according to an exemplary embodiment of the present disclosure;

[0074] Figure 2 It is a flowchart of a method for prompting terminal falling according to another exemplary embodiment of the present disclosure;

[0075] Figure 3 It is a flowchart of how to determine the motion state of the terminal device before the current state according to an exemplary embodiment of the present disclosure;

[0076] Figure 4 It is a flowchart of how to determine the motion state of the terminal device before the current state according to another exemplary embodiment of the present disclosure;

[0077] Figure 5 It is a flowchart of a method for prompting terminal falling according to another exemplary embodiment of the present disclosure;

[0078] Figure 6 It is a block diagram of a device for prompting terminal falling according to an exemplary embodiment of the present disclosure;

[0079] Figure 7 It is a block diagram of another device for prompting terminal falling according to an exemplary embodiment of the present disclosure;

[0080] Figure 8 It is a block diagram of a terminal device according to an exemplary embodiment of the present disclosure. Detailed implementation

[0081] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0082] Figure 1 It is a flowchart of a method for prompting terminal falling according to an exemplary embodiment; the method of this embodiment can be applied to terminal devices (such as, wearable devices such as smart phones, tablet computers, smart watches, etc.).

[0083] Such as Figure 1 As shown, the method includes the following steps S101 - S103:

[0084] In step S101, in response to detecting that the current state of the terminal device is a falling state, determine the motion state of the terminal device before the current state.

[0085] In this embodiment, the terminal device may determine the motion state of the terminal device before the current state in response to detecting that its current state is a falling state.

[0086] For example, the terminal device may detect whether its current state is a falling state based on its own inertial device (such as an inertial sensor IMU), etc., and then may determine the motion state of the terminal device before the current state when detecting that the current state is a falling state.

[0087] Exemplarily, various motion state types of the terminal device may be set in advance based on actual needs, such as at least one of the following (a) to (d):

[0088] (a) A relatively stable state, such as states of walking, running, cycling, or riding in a vehicle while carrying the terminal device;

[0089] (a) The state of taking the terminal device out of the pocket;

[0090] (b) The state of putting the terminal device into the pocket;

[0091] (c) The state of moving the terminal device onto or into another object (the "other object" is an object other than the pocket).

[0092] On this basis, the terminal device may obtain corresponding sensor data based on its set sensors at a set frequency, and then determine the change of the motion state type of the terminal device over time based on these sensor data. Furthermore, when detecting that the current state of the terminal device is a falling state, the motion state type of the terminal device before the current state may be determined.

[0093] In another embodiment, the method for determining the motion state of the terminal device before the current state may also refer to the following Figure 3 illustrated embodiment, which will not be elaborated here first.

[0094] In step S102, determine the falling information of the terminal device based on the motion state, where the falling information includes at least the falling type.

[0095] In this embodiment, after determining the motion state of the terminal device before the current state, the falling information of the terminal device may be determined based on the motion state, where the falling information includes at least the falling type.

[0096] Among them, the falling information of the terminal device may include the falling type of the terminal device.

[0097] For example, a correspondence between various motion state types and the falling types of the terminal device can be pre - constructed, such as at least one of the following (i) to (iii):

[0098] (i) The state of "taking the terminal device out of the pocket" corresponds to "falling from the hand";

[0099] (ii) The state of "putting the terminal device into the pocket" corresponds to "falling from the pocket";

[0100] (iii) The state of "moving the terminal device onto or into other objects" corresponds to "falling from other places".

[0101] On this basis, after determining the motion state type of the terminal device before the current state, the above - mentioned correspondence can be queried based on the motion state type, so as to determine the falling type corresponding to the motion state type.

[0102] In step S103, an alarm message is generated to prompt the falling information.

[0103] In this embodiment, when the terminal device determines the falling information of the terminal device based on the motion state, an alarm message for prompting the falling information can be generated, so as to prompt the user of the falling information of the terminal device in a timely manner, enabling the user to discover the fall of the terminal device as early as possible.

[0104] It can be understood that the type of the above - mentioned alarm message can be set according to actual needs, such as being set as at least one of the sound type and the flash - light type. This embodiment does not limit this comparison. Among them, the flash - light brightness can also be related to the scene and the current light - sense reading. Exemplarily, based on different falling information of the terminal device, different types of alarm messages can also be set, so that the user can better judge different falling situations of the terminal device.

[0105] As can be seen from the above description, the method of this embodiment determines the motion state of the terminal device before the current state in response to detecting that the current state of the terminal device is a falling state, and determines the falling information of the terminal device based on the motion state. The falling information at least includes the falling type, which can accurately determine the falling information of the terminal device based on the motion state type of the terminal device before the current state when detecting the falling state of the terminal device. Furthermore, it is beneficial to realize subsequent prompting of the user based on the generated alarm message for prompting the falling information, which can provide an accurate basis for the user to discover and retrieve the terminal device and can improve the user experience.

[0106] Figure 2It is a flowchart of a terminal drop prompt method shown according to another exemplary embodiment of the present disclosure; the method of this embodiment can be applied to terminal devices (such as wearable devices such as smart phones, tablets, smart watches, etc.).

[0107] As Figure 2 shown, the method includes the following steps S201 - S204:

[0108] In step S201, based on the inertial sensor IMU data of the terminal device, it is detected whether the current state of the terminal device is a falling state.

[0109] Among them, the main purpose of the IMU (Inertial Measurement Unit) sensor is to detect and measure the acceleration and rotational motion of the terminal device, and its principle is realized by using the law of inertia. Exemplarily, the IMU can include an accelerometer and an angular velocity meter (gyroscope). The accelerometer is a sensor that can detect axial acceleration and convert it into an available output signal, while the gyroscope is a sensor that can detect the angular velocity of the moving body relative to inertial space. On this basis, by obtaining IMU data, the axial acceleration and the angular velocity of the terminal device can be determined, and thus the axial acceleration and the angular velocity can be input into a pre - constructed fall detection model to obtain the detection result of whether the current state of the terminal device is a falling state. Among them, the above - mentioned method based on IMU data and the fall detection model is only for illustrative purposes. In actual applications, other methods can also be used to detect whether the terminal device is in a falling state based on business needs, and the obtained results are also applicable to the subsequent steps of this embodiment.

[0110] It should be noted that the construction and training methods of the above - mentioned fall detection model can refer to the explanations and descriptions in related technologies. Exemplarily, sample data of axial acceleration and angular velocity of the terminal device in the falling state and non - falling state can be obtained in advance, and then a pre - constructed model to be trained can be trained based on this sample data. When it is detected that the training cut - off condition is met, the model training can be stopped, and thus a trained fall detection model can be obtained. Among them, the model to be trained can be a CNN convolutional neural network module, and this embodiment does not limit this.

[0111] In step S202, in response to detecting that the current state of the terminal device is a falling state, the motion state of the terminal device before the current state is determined.

[0112] In step S203, based on the motion state, the fall information of the terminal device is determined, and the fall information at least includes the fall type.

[0113] In step S204, alarm information for prompting the fall information is generated. For the relevant explanations and descriptions of steps S202 - S204, reference can be made to steps S101 - S103 in the above Figure 1 illustrated embodiment, which will not be elaborated here.

[0114] As can be seen from the above description, in this embodiment, by using the inertial sensor IMU data of the terminal device to detect whether the current state of the terminal device is a fall state, it can lay a foundation for determining the motion state of the terminal device before the current state when it is subsequently detected that the current state of the terminal device is a fall state, which is beneficial to accurately determining the fall information of the terminal device based on the type of the motion state of the terminal device before the current state. Furthermore, it is beneficial to realize subsequent prompting of the user based on the generated alarm information for prompting the fall information, which can provide an accurate basis for the user to discover and retrieve the terminal device and can improve the user experience.

[0115] Figure 3 is a flowchart showing how to determine the motion state of the terminal device before the current state according to an exemplary embodiment of the present disclosure; this embodiment takes how to determine the motion state of the terminal device before the current state as an example for exemplary illustration on the basis of the above embodiment. As Figure 3 shown, the determination of the motion state of the terminal device before the current state described in the above step S101 may include the following steps S301 - S302:

[0116] In step S301, in response to determining that the terminal device is in a motion state based on the inertial sensor IMU data of the terminal device, the IMU data is input into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device.

[0117] In this embodiment, when it is detected that the current state of the terminal device is a fall state, it can be determined whether the terminal device is in a motion state (i.e., a non-stationary state) based on the IMU data of the terminal device. Furthermore, when it is determined that the terminal device is in a motion state, the IMU data of the terminal device can be input into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device. That is, the input of this deep neural network model can be the IMU data of the terminal device, and the output of this deep neural network model can be the probabilities of different preset motion state types of the terminal device.

[0118] Among them, the above different preset motion state types may include at least one of the following (a) to (d):

[0119] (a) Relatively stable states, such as the states of walking, running, cycling, or taking a vehicle while carrying a terminal device;

[0120] (a) The state of taking the terminal device out of the pocket;

[0121] (b) The state of putting the terminal device into the pocket;

[0122] (c) The state of moving the terminal device onto or into other objects (the "other objects" are objects other than the pocket).

[0123] In step S302, based on the probabilities of the different preset motion state types, determine the motion state of the terminal device before the current state.

[0124] In this embodiment, when the IMU data is input into a pre-trained deep neural network model and the probabilities of different preset motion state types of the terminal device are obtained, the motion state of the terminal device before the current state can be determined based on the probabilities of the different preset motion state types.

[0125] For example, when the probabilities of different preset motion state types of the terminal device are obtained, the preset state type with the highest probability can be determined as the motion state type of the terminal device before the current state. It can be understood that the method of determining the motion state type based on the preset state type with the highest probability in this embodiment is only for illustrative purposes. In actual applications, when the probabilities of different preset motion state types of the terminal device are obtained, other methods can also be adopted to determine the motion state type of the terminal device before the current state from them, and this embodiment does not limit this.

[0126] As can be seen from the above description, in this embodiment, by responding to determining that the terminal device is in a motion state based on the inertial sensor IMU data of the terminal device, inputting the IMU data into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device, and then determining the motion state of the terminal device before the current state based on the probabilities of the different preset motion state types, it is possible to accurately determine the motion state type of the terminal device before the current state, and further, it is possible to accurately determine the fall information of the terminal device based on the motion state type subsequently, which is beneficial to subsequently prompting the user based on the generated alarm information for prompting the fall information, and can be used as an accurate basis for the user to discover and retrieve the terminal device, thereby improving the user experience.

[0127] Figure 4is a flowchart showing how to determine the motion state of the terminal device before the current state according to another exemplary embodiment of the present disclosure; this embodiment is an exemplary illustration of how to determine the motion state of the terminal device before the current state on the basis of the above embodiment. As Figure 4 shown, the determination of the motion state of the terminal device before the current state in step S101 described above may include the following steps S401-S404:

[0128] In step S401, in response to determining that the terminal device is in a motion state based on the inertial measurement unit (IMU) data of the terminal device, the IMU data is input into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device.

[0129] In step S402, SAR data and the brightness data of the environment where the terminal device is located are respectively obtained based on the SAR sensor and the light sensor on the terminal device.

[0130] In this embodiment, in order to further improve the accuracy of determining the probabilities of different preset motion state types of the terminal device, SAR data and the brightness data of the environment where the terminal device is located can be respectively obtained based on the SAR sensor and the light sensor on the terminal device.

[0131] Specifically, the specific absorption rate (SAR) sensor, abbreviated as SAR sensor. SAR is the electromagnetic wave energy absorption ratio of terminal devices such as mobile phones or wireless products, and its definition is: under the action of an external magnetic field, an induced electromagnetic field will be generated in the human body. Since all organs of the human body are lossy dielectrics, an electric current will be generated in the internal electromagnetic field, resulting in the absorption and dissipation of electromagnetic energy. The significance of SAR is the electromagnetic power absorbed or consumed by a unit mass of human tissue, with the unit of W / kg, where W represents the power unit watt and kg represents the mass unit kilogram. In this embodiment, the SAR data of the terminal device is collected by the SAR sensor, and different terminal devices will have different SAR data values. In addition, the distance between the terminal device and the human body also affects the SAR data. Therefore, in this embodiment, the SAR data of the terminal device can be obtained through the SAR sensor, so as to measure the distance between the terminal device and the human body based on the SAR data.

[0132] The light sensor can be used to detect the brightness data of the environment where the terminal device is located, so as to be used to judge the environment where the terminal device is located, such as whether it is in a pocket, in the user's hand or other environments.

[0133] In step S403, the probabilities of different preset motion state types are adjusted based on the SAR data and the brightness data.

[0134] In this embodiment, after obtaining SAR data and the brightness data of the environment where the terminal device is located based on the SAR sensor and the light sensor on the terminal device respectively, the probabilities of different preset motion state types can be adjusted based on the SAR data and the brightness data.

[0135] In one embodiment, the above different preset motion state types may at least include a first state type and a second state type. The first state type corresponds to taking the terminal device out of the pocket, and the second state type corresponds to putting the terminal device into the pocket. On this basis, if the maximum probability among the above different preset motion state types is the probability of the first state type, the above step S403 may include at least one of the following (1) to (3):

[0136] (1) In response to detecting that the first condition is satisfied, increasing the probability of the first state type by a preset first large amplitude. The satisfaction of the first condition includes: detecting, based on the SAR data, that the state of the terminal device changes from the state of being put into the pocket to the state of being held in the hand and / or detecting that the value of the brightness data changes from small to large;

[0137] (2) In response to detecting that the second condition is satisfied, maintaining the probability of the first state type unchanged or reducing the probability of the first state type by a preset first small amplitude. The satisfaction of the second condition includes: the value of the brightness data remains within a range less than a preset data range;

[0138] (3) In response to detecting that neither the first condition nor the second condition is satisfied, reducing the probability of the first state type by a preset second large amplitude.

[0139] Among them, the above first large amplitude is greater than the first small amplitude, the second large amplitude is greater than the first small amplitude, and the first large amplitude may be greater than, equal to, or less than the second large amplitude.

[0140] In another embodiment, if the maximum probability among the above different preset motion state types is the probability of the second state type, the above step S403 may include at least one of the following (4) to (5):

[0141] (4) In response to detecting that the third condition is satisfied, increasing the probability of the second state type by a preset third large amplitude. The satisfaction of the third condition includes: detecting, based on the SAR data, that the state of the terminal device changes from the state of being held in the hand to the state of being put into the pocket and / or detecting that the value of the brightness data changes from large to small;

[0142] (5) In response to detecting that the fourth condition is met, maintain the probability of the second state type unchanged or decrease the probability of the second state type by a preset second small amplitude. The satisfaction of the fourth condition includes: the value of the brightness data remains within a range less than a preset data range;

[0143] (6) In response to detecting that neither the third condition nor the fourth condition is met, decrease the probability of the second state type by a preset fourth large amplitude.

[0144] Among them, the above-mentioned third large amplitude is greater than the second small amplitude, the fourth large amplitude is greater than the second small amplitude, and the third large amplitude may be greater than, equal to, or less than the fourth large amplitude.

[0145] In step S404, based on the probabilities of the different preset motion state types, determine the motion state of the terminal device before the current state.

[0146] In this embodiment, after adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data, the motion state of the terminal device before the current state can be determined based on the adjusted probabilities of the different preset motion state types.

[0147] Among them, for the relevant explanations and descriptions of step S401 and step S404, reference can be made to steps S301 - S302 in the above-mentioned Figure 3 illustrated embodiment, which will not be elaborated here.

[0148] As can be seen from the above description, in this embodiment, by respectively obtaining the SAR data based on the SAR sensor on the terminal device and the brightness data of the environment where the terminal device is located, and adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data, it is then possible to determine the motion state of the terminal device before the current state based on the adjusted probabilities of the different preset motion state types. On this basis, the fall information of the terminal device can be accurately determined based on the motion state type, which is beneficial for subsequently prompting the user based on the generated alarm information for prompting the fall information, and can be used as an accurate basis for the user to discover and retrieve the terminal device, thereby improving the user experience.

[0149] Figure 5 It is a flowchart of a terminal fall prompt method shown according to another exemplary embodiment of the present disclosure; the method of this embodiment can be applied to terminal devices (such as, wearable devices such as smartphones, tablets, smart watches, etc.).

[0150] Such as Figure 5 shown, the method includes the following steps S501 - S504:

[0151] In step S501, in response to detecting that the current state of the terminal device is a falling state, determine the motion state of the terminal device before the current state.

[0152] In step S502, based on the motion state, determine the falling information of the terminal device, where the falling information at least includes the falling type.

[0153] In step S503, generate alarm information for prompting the falling information.

[0154] Among them, for the relevant explanations and descriptions of steps S501 - S503, reference can be made to steps S101 - S103 in the above Figure 1 illustrated embodiments, which will not be elaborated here.

[0155] In step S504, send a prompt message for prompting the falling information to a preset communication contact.

[0156] In this embodiment, after determining the falling information of the terminal device based on the motion state, a prompt message for prompting the falling information can also be sent to a preset communication contact, where the prompt message includes at least one of the falling type, the falling location, and the falling time of the terminal device.

[0157] For example, the falling type of the above terminal device may include at least one of the following 1) to 3):

[0158] 1) Falling from the hand;

[0159] 2) Falling from the pocket;

[0160] 3) Falling from other places.

[0161] Exemplarily, the above falling location can be obtained based on the positioning device (such as, GPS module) of the terminal device. For example, when it is detected that the terminal device sends a fall, the positioning data currently detected by the GPS module can be obtained and used as the falling location of the terminal device; and, when it is detected that the terminal device sends a fall, the current time can be obtained, and then a prompt message can be generated based on at least one of the above falling type, falling location, and falling time, and sent to a preset communication contact. It should be noted that the above communication contact can be a phone communication contact of the terminal device, or a contact of other instant messaging programs, and this embodiment does not limit this.

[0162] As described above, in this embodiment, after determining the fall information of the terminal device based on the motion state, an alarm message for prompting the fall information is generated and a prompt message for prompting the fall information is sent to a preset communication contact, which is beneficial for the user to discover and retrieve the terminal device as early as possible based on the alarm message generated by the terminal device or the prompt message informed by the communication contact, and can improve the user experience.

[0163] Figure 6 is a block diagram of a terminal fall prompt device shown according to an exemplary embodiment; the device of this embodiment can be applied to terminal devices (such as wearable devices such as smart phones, tablet computers, smart watches, etc.). As Figure 6 shown, the device includes: a motion state determination module 110, a fall information determination module 120, and an alarm information generation module 130, where:

[0164] The motion state determination module 110 is configured to determine the motion state of the terminal device before the current state in response to detecting that the current state of the terminal device is a fall state;

[0165] The fall information determination module 120 is configured to determine the fall information of the terminal device based on the motion state, and the fall information at least includes a fall type;

[0166] The alarm information generation module 130 is configured to generate an alarm message for prompting the fall information.

[0167] As described above, the device of this embodiment determines the motion state of the terminal device before the current state in response to detecting that the current state of the terminal device is a fall state, and determines the fall information of the terminal device based on the motion state, and the fall information at least includes a fall type, so that it can accurately determine the fall information of the terminal device based on the motion state type of the terminal device before the current state when detecting the fall state of the terminal device, and further is beneficial to realizing subsequent prompting of the user based on the generated alarm message for prompting the fall information, and can provide an accurate basis for the user to discover and retrieve the terminal device, and can improve the user experience.

[0168] Figure 7 is a block diagram of a terminal fall prompt device shown according to another exemplary embodiment; the device of this embodiment can be applied to terminal devices (such as wearable devices such as smart phones, tablet computers, smart watches, etc.). Among them, the motion state determination module 210, the fall information determination module 220, and the alarm information generation module 230 have the same functions as the motion state determination module 110, the fall information determination module 120, and the alarm information generation module 130 in the foregoing Figure 6 shown embodiment, and will not be described in detail here. As Figure 7As shown, the device may further include:

[0169] A fall state detection module 240, configured to detect whether the current state of the terminal device is a fall state based on the inertial sensor IMU data of the terminal device.

[0170] In one embodiment, the motion state determination module 210 includes:

[0171] A type probability acquisition unit 211, configured to, in response to determining that the terminal device is in a motion state based on the inertial sensor IMU data of the terminal device, input the IMU data into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device;

[0172] A motion state determination unit 212, configured to determine the motion state of the terminal device before the current state based on the probabilities of different preset motion state types.

[0173] In one embodiment, the above device may further include: a probability adjustment module 250;

[0174] The probability adjustment module 250 may include:

[0175] A data acquisition unit 251, configured to respectively acquire SAR data and the brightness data of the environment where the terminal device is located based on the SAR sensor and the light sensor on the terminal device;

[0176] A probability adjustment unit 252, configured to adjust the probabilities of different preset motion state types based on the SAR data and the brightness data;

[0177] Correspondingly, the motion state determination unit 212 may further be configured to determine the motion state of the terminal device before the current state based on the adjusted probabilities of different preset motion state types.

[0178] In one embodiment, the above different preset motion state types at least include a first state type and a second state type, where the first state type corresponds to taking out the terminal device from a pocket, and the second state type corresponds to putting the terminal device into a pocket;

[0179] In the case where the maximum probability among the different preset motion state types is the probability of the first state type, the probability adjustment unit 252 may further be configured to:

[0180] In response to detecting that the first condition is satisfied, increase the probability of the first state type by a preset first large amplitude. The satisfaction of the first condition includes: detecting, based on the SAR data, that the state of the terminal device changes from the pocket - putting state to the hand - holding state and / or detecting that the value of the brightness data changes from small to large;

[0181] In response to detecting that the second condition is satisfied, maintain the probability of the first state type unchanged or decrease the probability of the first state type by a preset first small amplitude. The satisfaction of the second condition includes: the value of the brightness data remains within a range less than a preset value;

[0182] In response to detecting that neither the first condition nor the second condition is satisfied, decrease the probability of the first state type by a preset second large amplitude, where the second large amplitude is greater than the first small amplitude.

[0183] In one embodiment, when the maximum probability among the different preset motion state types is the probability of the second state type, the probability adjustment unit 252 can also be used for:

[0184] In response to detecting that the third condition is satisfied, increase the probability of the second state type by a preset third large amplitude. The satisfaction of the third condition includes: detecting, based on the SAR data, that the state of the terminal device changes from the hand - holding state to the pocket - putting state and / or detecting that the value of the brightness data changes from large to small;

[0185] In response to detecting that the fourth condition is satisfied, maintain the probability of the second state type unchanged or decrease the probability of the second state type by a preset second small amplitude. The satisfaction of the fourth condition includes: the value of the brightness data remains within a range less than a preset value, and the third large amplitude is greater than the second small amplitude;

[0186] In response to detecting that neither the third condition nor the fourth condition is satisfied, decrease the probability of the second state type by a preset fourth large amplitude, where the fourth large amplitude is greater than the second small amplitude, and the fourth large amplitude is greater than, less than, or equal to the third large amplitude.

[0187] In one embodiment, the fall information determination module 220 can also be used to determine the fall type of the terminal device corresponding to the motion state type based on a pre - constructed correspondence.

[0188] In one embodiment, the type of the alarm information includes at least one of a sound type and a flash - light type.

[0189] In one embodiment, the above - mentioned device may further include:

[0190] A prompt message sending module 260 is configured to send a prompt message for prompting the fall information to a preset communication contact, where the prompt message includes at least one of a fall type, a fall occurrence location, and a fall time.

[0191] Regarding the device in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated herein.

[0192] Figure 8 It is a block diagram of a terminal device shown according to an exemplary embodiment. For example, device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0193] Refer to Figure 8 , device 900 may include one or more of the following components: a processing component 902, a memory 904, a power component 906, a multimedia component 908, an audio component 910, an input / output (I / O) interface 912, a sensor component 914, and a communication component 916.

[0194] The processing component 902 generally controls the overall operation of device 900, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0195] The memory 904 is configured to store various types of data to support the operation of device 900. Examples of these data include instructions for any application or method operating on device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0196] The power component 906 provides power to various components of device 900. The power component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 900.

[0197] The multimedia component 908 includes a screen that provides an output interface between the device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0198] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC) that is configured to receive external audio signals when the device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 further includes a speaker for outputting audio signals.

[0199] The I / O interface 912 provides an interface between the processing component 902 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0200] The sensor component 914 includes one or more sensors for providing a status assessment of various aspects of the device 900. For example, the sensor component 914 can detect the on / off state of the device 900, the relative positioning of components, such as the display and the keypad of the device 900. The sensor component 914 can also detect a change in the position of the device 900 or a component of the device 900, the presence or absence of user contact with the device 900, the orientation or acceleration / deceleration of the device 900, and the temperature change of the device 900. The sensor component 914 can also include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 914 can also include a light sensor, such as a CMOS or a CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 914 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0201] The communication component 916 is configured to facilitate communication between the device 900 and other devices in a wired or wireless manner. The device 900 can access a communication standard-based wireless network, such as WiFi, 2G or 3G, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0202] In an exemplary embodiment, the device 900 can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0203] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions, and the above instructions can be executed by a processor 920 of the device 900 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0204] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the disclosure herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field of the present disclosure that are not disclosed herein. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0205] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A method for terminal fall prompt, characterized in that, the method includes: Responding to detecting that the current state of the terminal device is a fall state, determining the motion state of the terminal device before the current state; Determining the fall information of the terminal device based on the motion state, where the fall information at least includes a fall type; Generating an alarm message for prompting the fall information; The determining the motion state of the terminal device before the current state includes: Responding to determining that the terminal device is in a motion state based on the inertial sensor IMU data of the terminal device, inputting the IMU data into a pre-trained deep neural network model to obtain the probabilities of different preset motion state types of the terminal device; Determining the motion state of the terminal device before the current state based on the probabilities of the different preset motion state types; The method further includes: Obtaining SAR data and the brightness data of the environment where the terminal device is located based on the SAR sensor and the light sensor on the terminal device respectively; Adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data; The determining the motion state of the terminal device before the current state based on the probabilities of the different preset motion state types includes: Determining the motion state of the terminal device before the current state based on the adjusted probabilities of the different preset motion state types.

2. The method according to claim 1, characterized in that, The different preset motion state types at least include a first state type and a second state type. The first state type corresponds to taking the terminal device out of the pocket, and the second state type corresponds to putting the terminal device into the pocket; In the case where the maximum probability among the different preset motion state types is the probability of the first state type, the adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data includes: Responding to detecting that the first condition is satisfied, increasing the probability of the first state type by a preset first large amplitude. The satisfaction of the first condition includes: detecting that the state of the terminal device changes from the state of being put into the pocket to the state of being held in the hand based on the SAR data and / or detecting that the value of the brightness data changes from small to large; Responding to detecting that the second condition is satisfied, maintaining the probability of the first state type unchanged or decreasing the probability of the first state type by a preset first small amplitude. The satisfaction of the second condition includes: the value of the brightness data remains within a preset data range; Responding to detecting that neither the first condition nor the second condition is satisfied, decreasing the probability of the first state type by a preset second large amplitude, where the second large amplitude is greater than the first small amplitude.

3. The method according to claim 2, characterized in that, In the case where the maximum probability among the different preset motion state types is the probability of the second state type, the adjusting the probabilities of the different preset motion state types based on the SAR data and the brightness data includes: In response to detecting that the third condition is met, increase the probability of the second state type by a preset third large amplitude. The satisfaction of the third condition includes: detecting, based on the SAR data, that the state of the terminal device changes from a held state to a state of being put into a pocket and / or detecting that the value of the brightness data changes from large to small; In response to detecting that the fourth condition is met, maintain the probability of the second state type unchanged or decrease the probability of the second state type by a preset second small amplitude. The satisfaction of the fourth condition includes: the value of the brightness data remains within a preset data range smaller than a preset value, and the third large amplitude is greater than the second small amplitude; In response to detecting that neither the third condition nor the fourth condition is met, decrease the probability of the second state type by a preset fourth large amplitude. The fourth large amplitude is greater than the second small amplitude, and the fourth large amplitude is greater than, less than, or equal to the third large amplitude.

4. The method according to claim 1, wherein, the determining the fall information of the terminal device based on the motion state includes: determining the fall type of the terminal device corresponding to the motion state type based on a pre-established correspondence relationship.

5. The method according to claim 1, wherein, the type of the alarm information includes at least one of a sound type and a flashlight type.

6. The method according to claim 1, wherein, the method further includes: sending a prompt message for prompting the fall information to a preset communication contact, and the prompt message includes at least one of a fall type, a fall occurrence location, and a fall time.

7. A terminal fall prompt device, wherein, the device includes: a motion state determination module, configured to determine the motion state of the terminal device before the current state in response to detecting that the current state of the terminal device is a fall state; a fall information determination module, configured to determine the fall information of the terminal device based on the motion state, and the fall information at least includes a fall type; an alarm information generation module, configured to generate alarm information for prompting the fall information; the motion state determination module includes: a type probability acquisition unit, configured to input the IMU data into a pre-trained deep neural network model in response to determining, based on the inertial sensor IMU data of the terminal device, that the terminal device is in a motion state, and obtain the probabilities of different preset motion state types of the terminal device; a motion state determination unit, configured to determine the motion state of the terminal device before the current state based on the probabilities of the different preset motion state types; the device further includes: a probability adjustment module; the probability adjustment module includes: a data acquisition unit, configured to respectively acquire SAR data and the brightness data of the environment where the terminal device is located based on an SAR sensor and a light sensor on the terminal device; a probability adjustment unit, configured to adjust the probabilities of the different preset motion state types based on the SAR data and the brightness data; The motion state determination unit is further configured to determine the motion state of the terminal device before the current state based on the probabilities of different preset motion state types after adjustment.

8. The apparatus according to claim 7, wherein, the different preset motion state types at least include a first state type and a second state type, the first state type corresponds to taking out the terminal device from the pocket, and the second state type corresponds to putting the terminal device into the pocket; when the maximum probability among the different preset motion state types is the probability of the first state type, the probability adjustment unit is further configured to: in response to detecting that a first condition is satisfied, increase the probability of the first state type by a preset first large margin, where the satisfaction of the first condition includes: detecting, based on the SAR data, that the state of the terminal device changes from the state of being put into the pocket to the state of being held in the hand and / or detecting that the value of the brightness data changes from small to large; in response to detecting that a second condition is satisfied, maintain the probability of the first state type unchanged or decrease the probability of the first state type by a preset first small margin, where the satisfaction of the second condition includes: the value of the brightness data remains within a range less than a preset data range; in response to detecting that neither the first condition nor the second condition is satisfied, decrease the probability of the first state type by a preset second large margin, where the second large margin is greater than the first small margin.

9. The apparatus according to claim 8, wherein, when the maximum probability among the different preset motion state types is the probability of the second state type, the probability adjustment unit is further configured to: in response to detecting that a third condition is satisfied, increase the probability of the second state type by a preset third large margin, where the satisfaction of the third condition includes: detecting, based on the SAR data, that the state of the terminal device changes from the state of being held in the hand to the state of being put into the pocket and / or detecting that the value of the brightness data changes from large to small; in response to detecting that a fourth condition is satisfied, maintain the probability of the second state type unchanged or decrease the probability of the second state type by a preset second small margin, where the satisfaction of the fourth condition includes: the value of the brightness data remains within a range less than a preset data range, and the third large margin is greater than the second small margin; in response to detecting that neither the third condition nor the fourth condition is satisfied, decrease the probability of the second state type by a preset fourth large margin, where the fourth large margin is greater than the second small margin, and the fourth large margin is greater than or less than or equal to the third large margin.

10. The apparatus according to claim 7, wherein, the fall information determination module is further configured to determine the fall type of the terminal device corresponding to the motion state type based on a pre-constructed correspondence.

11. The apparatus according to claim 7, wherein, the type of the alarm information includes at least one of a sound type and a flash light type.

12. The apparatus according to claim 7, wherein, the apparatus further includes: A prompt message sending module, configured to send a prompt message for prompting the fall information to a preset communication contact, where the prompt message includes at least one of a fall type, a fall occurrence location, and a fall time.

13. A terminal device, characterized in that the device includes: a processor and a memory for storing a computer program; wherein, the processor is configured to implement the terminal fall prompt method according to any one of claims 1 to 6 when executing the computer program.

14. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements the terminal fall prompt method according to any one of claims 1 to 6.

Images