Abnormal motion state detection method and device, electronic equipment and interaction system
The method and device enhance smart watch functionality by accurately detecting abnormal user movements through real-time motion data analysis, providing timely guardian alerts and improving compatibility and user experience.
Patent Information
- Application Number
- CN202411472069.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-22
- Publication Date
- 2024-12-31
AI Technical Summary
Existing smart watches fail to accurately detect sudden abnormal movement states of users, leading to potential injuries without timely alerts.
A method and device that utilize real-time motion data collection, comparing current and previous data to determine abnormal states, calculating change rates, and sending alerts to guardians when thresholds are exceeded, with options for instantaneous or time-based change rate calculations.
Improves the accuracy of detecting abnormal motion states, ensuring timely guardian notification and enhancing user experience by distinguishing between instantaneous and prolonged abnormal conditions.
Smart Images
Figure CN119214640A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of intelligent terminals, and further to a detection method, device, electronic device and interactive system for abnormal motion state. Background Art
[0002] With the popularity of wearable smart devices in daily life, smart watches have become a popular choice in the market. Although these devices perform well in communication and positioning, they still need to be strengthened in terms of safety. In particular, when users have sudden abnormal movement states, they will be injured, and existing smart watches cannot accurately detect such emergency conditions. Summary of the invention
[0003] In order to solve the above technical problems, the present application provides a method, device, electronic device and interactive system for detecting abnormal motion states, which improve the accuracy of detecting user's injured movements.
[0004] In a first aspect, the present application provides a method for detecting an abnormal motion state, comprising: collecting the user's motion data in real time; if the difference between the first motion data at the current moment and the second motion data at the previous moment is greater than the first motion data threshold, judging that the user is in an abnormal state; calculating the instantaneous change rate of the motion data at the current moment based on the first motion data and the second motion data; recording the abnormal time when the user is in the abnormal state, and judging whether the abnormal time is less than the first time threshold; if the abnormal time is less than the first time threshold, using the instantaneous change rate of the motion data as the first motion data change rate; when the first motion data change rate is greater than the second motion data threshold, determining that the abnormal state is the abnormal motion state, and sending an alarm message to the user's guardian.
[0005] The above abnormal motion state detection method determines whether the user is in an abnormal state based on the difference between the user's first motion data at the current moment and the second motion data at the previous moment. When the user is in an abnormal state, by combining the factor of abnormal time, when the abnormal time is less than the first time threshold, the instantaneous change rate of the motion data is used as the first motion data change rate, and the user is determined to be in an abnormal motion state based on the first motion data change rate of the user in the abnormal state, thereby improving the accuracy of detecting the user's injured movements. When the user is in an abnormal motion state, the wearable smart device sends an alarm message to the user's guardian, so that the user's guardian can understand the user's current state in a timely manner.
[0006] In one implementation, it also includes: if the abnormal time is not less than a first time threshold, calculating an average change rate of the motion data within the abnormal time according to the abnormal time and the motion data within the abnormal time; and using the average change rate of the motion data as the first motion data change rate.
[0007] In the above abnormal motion state detection method, when the abnormal time is not less than the first time threshold, the average change rate of the motion data is used as the first motion data change rate. This allows the processor to determine whether the abnormal motion state occurs instantaneously or for a period of time, thereby improving the compatibility of the solution and the user experience.
[0008] In one implementation, the motion data includes acceleration data and rotational angular velocity data.
[0009] In the second aspect, the present application also provides a detection device for an abnormal motion state, comprising: multiple sensors configured to collect the user's motion data in real time; a microprocessor configured to determine that the user is in an abnormal state if the difference between the first motion data at the current moment and the second motion data at the previous moment is greater than the first motion data threshold; the microprocessor is configured to calculate the instantaneous change rate of the motion data at the current moment based on the first motion data and the second motion data; the microprocessor is configured to record the abnormal time when the user is in the abnormal state, and determine whether the abnormal time is less than the first time threshold; the microprocessor is configured to use the instantaneous change rate of the motion data as the first motion data change rate when the abnormal time is less than the first time threshold; the microprocessor is configured to determine that the abnormal state is the abnormal motion state when the first motion data change rate is greater than the second motion data threshold; a communication module is configured to send an alarm message to the guardian of the user.
[0010] In one implementation, the microprocessor is configured to calculate the average change rate of the motion data within the abnormal time based on the abnormal time and the motion data within the abnormal time if the abnormal time is not less than a first time threshold; the microprocessor is configured to use the average change rate of the motion data as the first motion data change rate.
[0011] In one implementation, it also includes: a power management module configured to send a low-battery reminder message to the user's guardian when the power of the abnormal motion state detection device is less than a preset power value.
[0012] In one implementation, the plurality of sensors include an acceleration sensor and a rotational angular velocity sensor.
[0013] In a third aspect, the present application also provides an electronic device, comprising any of the above-mentioned detection devices for abnormal motion states.
[0014] In one implementation, the electronic device includes a wearable smart device.
[0015] In a fourth aspect, the present application also provides an interactive system, comprising a wearable smart device and a smart terminal, wherein the wearable smart device is configured to execute any of the above-mentioned detection methods for abnormal motion states and send alarm information to the smart terminal for response.
[0016] Compared with the prior art, the present invention has at least one of the following beneficial effects:
[0017] 1. Determine whether the user is in an abnormal state based on the difference between the user's first motion data at the current moment and the second motion data at the previous moment. When the user is in an abnormal state, by combining the factor of abnormal time, when the abnormal time is less than the first time threshold, the instantaneous change rate of the motion data is used as the first motion data change rate, and the user is determined to be in an abnormal motion state based on the change rate of the first motion data of the user in the abnormal state, thereby improving the accuracy of detecting the user's injured movements. When the user is in an abnormal motion state, the wearable smart device sends an alarm message to the user's guardian, so that the user's guardian can understand the user's current state in a timely manner.
[0018] 2. When the abnormal time is not less than the first time threshold, the average change rate of the motion data is used as the first motion data change rate. This allows the processor to determine whether the abnormal motion state occurs instantaneously or for a period of time, thereby improving the compatibility of the solution and the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The preferred implementation modes will be described below in a clear and understandable manner with reference to the accompanying drawings to further illustrate the above-mentioned characteristics, technical features, advantages and implementation methods of the present invention.
[0020] Figure 1 A schematic diagram of the structure of a wearable smart device provided in an embodiment of the present application is shown;
[0021] Figure 2 A flow chart of a method for detecting an abnormal motion state provided by an embodiment of the present application is shown;
[0022] Figure 3 A flow chart of motion data change rate calculation provided by an embodiment of the present application is shown. DETAILED DESCRIPTION
[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the specific implementation methods of the present invention will be described below with reference to the accompanying drawings. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings and other implementation methods can be obtained based on these drawings without creative work.
[0024] In order to simplify the drawings, only the parts related to the invention are schematically shown in each figure, and they do not represent the actual structure of the product. In addition, in order to simplify the drawings and facilitate understanding, in some figures, only one of the parts with the same structure or function is schematically drawn or marked. In this article, "one" not only means "only one", but also means "more than one".
[0025] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0026] In this document, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0027] In addition, in the description of the present application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.
[0028] It should be noted that the above embodiments can be freely combined as needed. The above are only preferred embodiments of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention.
[0029] Wearable smart devices perform different functions in different fields by integrating multiple sensors. For example, wearable smart devices integrate optical heart rate sensors, which monitor heart rate by irradiating the skin with LED light and measuring the changes in light absorption caused by blood flow; for example, wearable smart devices integrate bioelectric impedance sensors, which monitor blood flow by measuring the impedance of biological body, and then calculate heart rate, breathing rate, etc.; for another example, wearable smart devices integrate temperature sensors to detect the temperature of the user's skin, which can be used as a reference for body temperature or other physiological parameters; for another example, wearable smart devices integrate Hall sensors, which are magnetic field sensors based on the Hall effect, used to detect whether the device is worn, and control related functions such as headphone playback. The embodiment of the present application has multiple sensors built into the wearable smart device, and by obtaining the user's motion data and abnormal time, it is determined whether the user is in an abnormal motion state, which can achieve at least one of the following beneficial effects: improving the accuracy of detecting the user's injured movements; or multiple ways to determine whether the user is in an abnormal motion state, and then detect the user's injured movements, thereby improving the compatibility of this solution.
[0030] The following is explained with reference to the accompanying drawings:
[0031] Reference Figure 1 , which shows a schematic diagram of the structure of a wearable smart device provided in an embodiment of the present application. Figure 1 As shown, it includes: a wearable intelligent device 100, an acceleration sensor 110, a gyroscope 120, a processor 130, a memory 140, a communication module 150, and a power management module 160.
[0032] The processor 130 is a circuit with signal processing capability. In one example, the processor may be a circuit with instruction reading and running capability; for example, a central processing unit (CPU), a microcontroller (MCU), a microprocessor (MPU), a graphics processing unit (GPU), or a digital signal processor (DSP). In another example, the processor may realize its processing capability through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable; for example, the processor may be a dedicated processor, such as a processor implemented by an application specific integrated circuit (ASIC), which realizes processing capability by designing the logical relationship of components in the circuit; for another example, a processor implemented by a programmable logic device (PLD) configures the logical relationship between logic devices through a configuration file to realize processing capability; for example, a processor implemented by a field programmable gate array (FPGA). In another example, the processor may be a hardware circuit designed for artificial intelligence, which may be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. This application is not limited by the type of processor.
[0033] The communication module 150 can communicate with the user's guardian's terminal (e.g., a mobile phone, a watch, or a tablet computer, etc.), and the communication method includes, but is not limited to: a wireless sensor network (e.g., Bluetooth, Star Flash, or ZigBee, etc.), a wireless local area network (e.g., WLAN, or WiFi, etc.), a short-range point-to-point communication, a cellular network (e.g., 3G, 4G, 5G, or 6G, etc.), or a near field communication technology (NFC), etc. The memory 140 includes, but is not limited to, a dynamic random-access memory (DRAM); a static random-access memory (SRAM); a flash memory (Flash); a resistive random-access memory (ReRAM); an electrically erasable programmable read-only memory (EEPROM); a spin-transfer torque magnetic random-access memory (STT-MRAM), etc.
[0034] Taking the processor 130 as a microprocessor as an example, the embodiment of the present application collects the user's motion data in real time through the acceleration sensor 110 and the gyroscope 120. The processor 130 determines whether the user is in an abnormal state based on the user's motion data at the current moment and the motion data at the previous moment. When the user is in an abnormal state, the processor 130 calculates the change rate of the first motion data of the user in the abnormal state. When the change rate of the first motion data is not less than the second motion data threshold, the processor 130 determines that the abnormal state of the user is an abnormal motion state, stores the data of the abnormal motion state to the memory 140, and sends an alarm message to the user's guardian through the communication module 150. The power management module 160 is used to send a low power reminder message to the user's guardian when the power of the wearable intelligent device 100 is less than the preset power value, thereby ensuring the normal power supply of the wearable intelligent device 100.
[0035] Reference Figure 2 , which shows a flow chart of a method for detecting abnormal motion state provided by an embodiment of the present application. Figure 2 As shown, including:
[0036] S200, collect user's motion data in real time.
[0037] S210: If the difference between the first motion data at the current moment and the second motion data at the previous moment is greater than the first motion data threshold, it is determined that the user is in an abnormal state, and a change rate of the first motion data of the user in the abnormal state is calculated.
[0038] S220: When the first motion data change rate is greater than the second motion data threshold, determine that the abnormal state is an abnormal motion state, and send an alarm message to the user's guardian.
[0039] After the user starts the wearable smart device, the built-in accelerometer and gyroscope are initialized. The accelerometer and gyroscope collect the user's motion data in real time, and send the motion data to the processor for preprocessing and filtering, thereby eliminating the noise and error of the motion data. The processor performs data analysis on the processed motion data according to a preset algorithm, and calculates the difference between the user's first motion data at the current moment and the second motion data at the previous moment. At the same time, it is determined whether the difference is greater than the preset first motion data threshold. If it is greater than the preset first motion data threshold, it is determined that the user is in an abnormal state (or the wearable smart device enters a fall detection mode). The processor calculates the change rate of the first motion data of the user in an abnormal state by a differential method. The processor determines whether the change rate of the first motion data is greater than the second motion data threshold. When the change rate of the first motion data is greater than the second motion data threshold, the processor determines that the user is in an abnormal motion state (or the user is in a fall state). At this time, the wearable smart device triggers an alarm mechanism, such as but not limited to a vibration reminder or sending an alarm message to the user's guardian through a communication module (the alarm information includes the start time, location, and motion data before and after the abnormal motion state), etc., and the processor will also store the data of the user's abnormal motion state in the memory.
[0040] In the embodiment of the present application, the wearable smart device determines whether the user is in an abnormal state based on the difference between the first motion data of the user at the current moment and the second motion data of the user at the previous moment. When the user is in an abnormal state, the change rate of the first motion data of the user in the abnormal state is used to determine whether the user is in an abnormal motion state, thereby improving the accuracy of detecting the user's injured movements. When the user is in an abnormal motion state, the wearable smart device sends an alarm message to the user's guardian, so that the user's guardian can understand the user's current state in a timely manner.
[0041] In one embodiment of the present application, the time when the user is in an abnormal state can be instantaneous or a period of time. When the change rate of the user's first motion data meets the preset condition, if the time of the abnormal state is less than the first time threshold, the user can be judged to be in an abnormal motion state without considering the time factor; if the time of the abnormal state is not less than the first time threshold, the time factor must be considered to determine whether the user is in an abnormal motion state. For example, refer to the attached Figure 3 , which shows a flow chart of calculating the rate of change of motion data provided by an embodiment of the present application. Figure 3 As shown, including:
[0042] S300, calculating the instantaneous change rate of the motion data at the current moment according to the first motion data and the second motion data.
[0043] S310, recording the abnormal time when the user is in an abnormal state, and determining whether the abnormal time is less than a first time threshold.
[0044] S320: If the abnormal time is less than the first time threshold, the instantaneous change rate of the motion data is used as the first motion data change rate.
[0045] After determining that the user is in an abnormal state, the processor calculates the instantaneous change rate of the user's motion data at the current moment according to the differential method, the first motion data and the second motion data. The abnormal time when the user is in the abnormal state is recorded. When the abnormal time is less than the first time threshold, the time of the abnormal state is determined to be instantaneous. Without considering the time factor, the instantaneous change rate of the motion data can be used as the first motion data change rate. Further, the processor determines whether the first motion data change rate is greater than the second motion data threshold. When the first motion data change rate is greater than the second motion data threshold, the processor determines that the user is in an abnormal motion state. At this time, the communication module sends an alarm message to the user's guardian.
[0046] In one embodiment of the present application, the method further includes: if the abnormal time is not less than the first time threshold, calculating the average change rate of the motion data within the abnormal time according to the abnormal time and the motion data within the abnormal time, and using the average change rate of the motion data as the first motion data change rate.
[0047] After the processor determines that the user is in an abnormal state, when the recorded abnormal state time is not less than the first time threshold, the instantaneous change rate of the motion data cannot be used as the first motion data change rate due to the long duration of the abnormal state. Therefore, the processor calculates the average change rate of the user's motion data during the abnormal time based on the differential method and the user's motion data during the abnormal time, and uses the average change rate of the motion data as the first motion data change rate. Similarly, when the first motion data change rate is greater than the second motion data threshold, the processor determines that the user is in an abnormal motion state. At this time, the communication module sends an alarm message to the user's guardian.
[0048] In the embodiment of the present application, by combining the factor of abnormal time, when the abnormal time is less than the first time threshold, the instantaneous change rate of the motion data is used as the first motion data change rate; when the abnormal time is not less than the first time threshold, the average change rate of the motion data is used as the first motion data change rate. This allows the processor to determine whether the abnormal motion state occurs instantaneously or for a period of time, thereby improving the compatibility of the solution and the user experience.
[0049] In one embodiment of the present application, the motion data may include acceleration data and rotational angular velocity data, wherein the acceleration sensor and the gyroscope are respectively used to collect the acceleration data and the rotational angular velocity data of the user's wrist in real time.
[0050] Similarly, the processor performs data analysis on the acceleration data and rotational angular velocity data of the user in real time according to a preset algorithm, and calculates the difference between the first acceleration data and the first rotational angular velocity data of the user at the current moment and the second acceleration data and the second rotational angular velocity data at the previous moment. It is determined whether the acceleration data difference and the rotational angular velocity data difference are greater than the preset first motion data threshold (the first motion data thresholds corresponding to the acceleration data difference and the rotational angular velocity data difference can be set according to user needs, for example, the first motion data threshold corresponding to the acceleration data difference can be any value from ±1g to ±2g). When the acceleration data difference and / or the rotational angular velocity data difference are greater than the preset first motion data threshold, the processor determines that the user is in an abnormal state. The processor calculates the acceleration data change rate and the rotation angular velocity data change rate when the user is in an abnormal state through a differential method, and when the acceleration data change rate and the rotation angular velocity data change rate are respectively greater than the corresponding second motion data thresholds (the second motion data thresholds corresponding to the acceleration data change rate and the rotation angular velocity data change rate can be set according to user needs, for example, the second motion data threshold corresponding to the acceleration data change rate can be 3g / s, and the second motion data threshold corresponding to the rotation angular velocity data change rate can be 100° / s^2), the processor determines that the user is in an abnormal motion state and sends an alarm message to the user's guardian through the communication module.
[0051] The embodiment of the present application also provides a detection device for abnormal motion state, including a module or means for executing any of the above abnormal motion state detection method steps. The detection device for abnormal motion state includes: multiple sensors, configured to collect the user's motion data in real time; a microprocessor, configured to determine that the user is in an abnormal state if the difference between the first motion data at the current moment and the second motion data at the previous moment is greater than the first motion data threshold, and calculate the change rate of the first motion data of the user in the abnormal state; the microprocessor is configured to determine that the abnormal state is an abnormal motion state when the change rate of the first motion data is greater than the second motion data threshold; a communication module, configured to send an alarm message to the user's guardian.
[0052] In one embodiment of the present application, the microprocessor is configured to calculate the instantaneous change rate of the motion data at the current moment based on the first motion data and the second motion data; the microprocessor is configured to record the abnormal time when the user is in an abnormal state, and determine whether the abnormal time is less than the first time threshold; the microprocessor is configured to use the instantaneous change rate of the motion data as the first motion data change rate when the abnormal time is less than the first time threshold.
[0053] In one embodiment of the present application, the microprocessor is configured to calculate the average change rate of the motion data within the abnormal time based on the abnormal time and the motion data within the abnormal time if the abnormal time is not less than the first time threshold; the microprocessor is configured to use the average change rate of the motion data as the first motion data change rate.
[0054] In one embodiment of the present application, it also includes: a power management module configured to send a low-battery reminder message to the user's guardian when the power of the detection device in the abnormal motion state is less than a preset power value.
[0055] In one embodiment of the present application, the multiple sensors include an acceleration sensor and a rotational angular velocity sensor.
[0056] An embodiment of the present application also provides an electronic device, comprising the device for detecting an abnormal motion state as described in any of the above embodiments.
[0057] An embodiment of the present application also provides an interactive system, including a wearable smart device and a smart terminal, wherein the wearable smart device is configured to execute the abnormal motion state detection method described in any of the above embodiments, and send alarm information to the smart terminal for response.
[0058] It should be noted that the above embodiments can be freely combined as needed. The above are only preferred embodiments of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention.
Claims
1. A method for detecting abnormal motion state, characterized in that: include: Collect user's motion data in real time; If the difference between the first motion data at the current moment and the second motion data at the previous moment is greater than the first motion data threshold, it is determined that the user is in an abnormal state; Calculating the instantaneous change rate of the motion data at the current moment according to the first motion data and the second motion data; Recording the abnormal time that the user is in the abnormal state, and determining whether the abnormal time is less than a first time threshold; If the abnormal time is less than the first time threshold, taking the instantaneous change rate of the motion data as the first motion data change rate; When the first motion data change rate is greater than a second motion data threshold, the abnormal state is determined to be the abnormal motion state, and an alarm message is sent to a guardian of the user.
2. The method for detecting abnormal motion state according to claim 1, characterized in that: Also includes: If the abnormal time is not less than the first time threshold, calculating the average change rate of the motion data within the abnormal time according to the abnormal time and the motion data within the abnormal time; The average change rate of the motion data is used as the first motion data change rate.
3. The method for detecting abnormal motion state according to claim 1 or 2, characterized in that: The motion data includes acceleration data and rotational angular velocity data.
4. A device for detecting abnormal motion state, characterized in that: include: A plurality of sensors are configured to collect the user's motion data in real time; The microprocessor is configured to determine that the user is in an abnormal state if a difference between the first motion data at a current moment and the second motion data at a previous moment is greater than a first motion data threshold; The microprocessor is configured to calculate the instantaneous change rate of the motion data at the current moment based on the first motion data and the second motion data; The microprocessor is configured to record the abnormal time that the user is in the abnormal state, and determine whether the abnormal time is less than a first time threshold; The microprocessor is configured to use the instantaneous change rate of the motion data as the first motion data change rate when the abnormal time is less than the first time threshold; The microprocessor is configured to determine that the abnormal state is the abnormal motion state when the first motion data change rate is greater than a second motion data threshold; The communication module is configured to send an alarm message to the guardian of the user.
5. The abnormal motion state detection device according to claim 4, characterized in that: The microprocessor is configured to calculate an average rate of change of the motion data within the abnormal time according to the abnormal time and the motion data within the abnormal time if the abnormal time is not less than a first time threshold; The microprocessor is configured to use the average change rate of the motion data as the first motion data change rate.
6. The abnormal motion state detection device according to claim 5, characterized in that: Also includes: The power management module is configured to send a low-battery reminder message to the user's guardian when the power of the abnormal motion state detection device is less than a preset power value.
7. The abnormal motion state detection device according to any one of claims 4 to 5, characterized in that: The plurality of sensors include an acceleration sensor and a rotational angular velocity sensor.
8. An electronic device, characterized in that: A detection device for abnormal motion state comprising any one of claims 4-7.
9. The electronic device according to claim 8, characterized in that: The electronic device includes a wearable smart device.
10. An interactive system, characterized in that: The invention comprises a wearable smart device and a smart terminal, wherein the wearable smart device is configured to execute the abnormal motion state detection method according to any one of claims 1 to 3, and send alarm information to the smart terminal for response.