State information processing method and device, processing equipment and storage medium
By using radar signal detection data and state machine algorithms, the problem of inaccurate detection of human falls or tumbles in existing technologies has been solved, enabling accurate detection and timely alarm of human falls or tumbles.
Patent Information
- Application Number
- CN202211462309.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-21
- Publication Date
- 2025-11-21
- Estimated Expiration
- 2042-11-21
AI Technical Summary
In existing technologies, contact devices and infrared sensors cannot detect the static or slightly moving state of a human body in all weather conditions without being detected, which makes it impossible to accurately detect the movement state of a human body falling or dropping.
By using radar signal detection data and determining the state changes of the target object from a stationary state to a descending motion state and back to a stationary state, it can determine whether a preset alarm event has occurred. Combining point cloud data and state machine algorithms improves detection accuracy.
It enables accurate detection of falls or tumbles, reduces misjudgments, and promptly issues alarms to ensure safety.
Smart Images

Figure CN115813375B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of information technology, and in particular to a state information processing method and device, a processing apparatus, and a storage medium. BACKGROUND
[0002] In daily life, the falling and tumbling of the human body can cause physical injury. Especially for the elderly, due to the decline of physical function and the influence of diseases, it is more likely to fall or tumble, and the injury caused by falling or tumbling is very serious, and even threatens life safety. Therefore, it is very important to detect the motion state of the human body falling or tumbling and perform alarm.
[0003] In related technologies, contact devices or infrared sensor devices are often used for human motion state detection, but contact devices are easy to forget to wear, and cannot detect human state all day and without feeling; infrared sensors can only detect the moving state of the human body, and cannot detect the static or micro-motion state of the human body, and cannot determine the specific human motion state. SUMMARY
[0004] Therefore, the present application discloses a state information processing method and device, a processing apparatus, and a storage medium.
[0005] According to a first aspect of the present application, a state information processing method is provided, executed by an electronic device, and the method comprises:
[0006] obtaining detection data based on radar signals;
[0007] determining the state of a target object according to the detection data;
[0008] if it is determined that the state of the target object changes from a first state to a third state through a second state, it is determined that a preset alarm event occurs.
[0009] In one embodiment, the method further comprises: obtaining contour information of the measured object according to the detection data; and determining whether the measured object includes the target object according to the contour information.
[0010] In one embodiment, the method further comprises: if the target object changes from the first state to the second state, determining a first time length during which the target object is in the second state; and if it is determined that the state of the target object changes from the first state to a third state through the second state, it is determined that a preset alarm event occurs, which comprises: if it is determined that the target object enters the third state and the first time length is within a first time length range, it is determined that a preset alarm event occurs.
[0011] In an embodiment, the method further comprises: determining a second time length during which the target object is in the third state if the target object switches from the second state to the third state; and determining that the preset alarm event occurs if it is determined that the state of the target object changes from the first state to the third state via the second state, which comprises: determining that the preset alarm event occurs if it is determined that the target object enters the third state and the third state is within the second time length range.
[0012] In an embodiment, the detection data is obtained based on the radar signal, which comprises: obtaining the detection data based on the radar signal once every predetermined time length; and wherein the predetermined time length is determined according to statistical data of the target object switching from the first state to the third state via the second state.
[0013] In an embodiment, the first state comprises: a stationary state or a motion state of a preset point of the target object at a first position; and the third state comprises: a stationary state of the preset point of the target object at a second position; and a distance between the second position and the ground is less than a distance between the first position and the ground.
[0014] In an embodiment, the second state comprises: a downward motion of the preset point of the target object switching from the first position to the second position.
[0015] According to a second aspect of the embodiments of the present disclosure, a device for processing state information is provided, which comprises:
[0016] An obtaining module is configured to obtain detection data based on a radar signal.
[0017] A determining module is configured to determine a state of a target object according to the detection data.
[0018] If it is determined that the state of the target object changes from a first state to a third state via a second state, it is determined that a preset alarm event occurs.
[0019] In an embodiment, the obtaining module is further configured to obtain contour information of a measured object according to the detection data; and the determining module is further configured to determine whether the measured object is the target object according to the contour information.
[0020] In an embodiment, the determining module is further configured to determine a first time length during which the target object is in the second state if the target object enters the second state from the first state; and determine that the preset alarm event occurs if it is determined that the target object enters the third state and the first time length is within a first time length range.
[0021] In an embodiment, the determining module is further configured to: if the target object switches from the second state to the third state, determine a second time length during which the target object is in the third state; and if it is determined that the target object enters the third state and the third state is within the second time length range, determine that the preset alarm event occurs.
[0022] In an embodiment, the obtaining module is further configured to: obtain the detection data based on radar signals every predetermined time length; and wherein the predetermined time length is determined according to statistical data of the target object switching from the first state to the third state via the second state.
[0023] According to a third aspect of embodiments of the present disclosure, an electronic device is provided, the electronic device comprising:
[0024] a processor;
[0025] a memory for storing instructions executable by the processor;
[0026] wherein the processor is configured to implement the method according to any of the embodiments of the present disclosure when the executable instructions are run.
[0027] According to a fourth aspect of embodiments of the present disclosure, a computer storage medium is provided, the computer storage medium storing a computer executable program, the executable program being executed by a processor to implement the method according to any of the embodiments of the present disclosure.
[0028] The technical solutions provided by the embodiments of the present disclosure can include the following beneficial effects:
[0029] In the embodiments of the present disclosure, an electronic device is configured to: determine a state of a target object according to detection data obtained based on radar signals; and if it is determined that the state of the target object enters a third state from a first state via a second state, determine that a preset alarm event occurs.
[0030] In the embodiments of the present disclosure, the detection data obtained based on radar signals is used to determine the state of the target object, and if it is determined that the state of the target object enters the third state from the first state via the second state, it is determined that the preset alarm event needs to occur. Compared with determining whether the preset alarm event needs to occur based on only a single state of the target object, the accuracy of determining the state of the target object and the preset alarm event that needs to occur can be improved. BRIEF DESCRIPTION OF DRAWINGS
[0031] The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the description, further serve to explain the principles behind the present disclosure.
[0032] Figure 1 A flowchart of a state information processing method according to an exemplary embodiment is shown;
[0033] Figure 2 A flowchart of a state information processing method according to an exemplary embodiment is shown;
[0034] Figure 3 A schematic diagram of a mapping relationship between speed and speed level according to an exemplary embodiment is shown;
[0035] Figure 4 A schematic diagram of a mapping relationship between acceleration and acceleration level according to an exemplary embodiment is shown;
[0036] Figure 5 A schematic diagram of a mapping relationship between motion state, speed level and acceleration level according to an exemplary embodiment is shown;
[0037] Figure 6 A state machine diagram of a state information processing method according to an exemplary embodiment is shown;
[0038] Figure 7 A structural diagram of a state information processing apparatus according to an exemplary embodiment is shown;
[0039] Figure 8 A structural diagram of an electronic device according to an exemplary embodiment is shown. DETAILED DESCRIPTION
[0040] In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings, and the described embodiments should not be regarded as limiting the present application, and all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.
[0041] In the following description, "some embodiments" are described, which describe a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.
[0042] In the following description, the terms "first\second\third" are only to distinguish similar objects, and do not represent a specific order of the objects, and it can be understood that "first\second\third" can be interchanged with a specific order or sequence as allowed, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.
[0043] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application.
[0044] As shown in Figure 1 The embodiments of the present disclosure provide a method for processing state information, executed by an electronic device, and the method comprises:
[0045] In step 110, detection data is obtained based on radar signals.
[0046] In step 120, a state of a target object is determined according to the detection data.
[0047] In step 130, if it is determined that the state of the target object enters a third state from a first state through a second state, it is determined that a preset alarm event occurs.
[0048] In one embodiment, the electronic device can include a device capable of detecting a human motion state according to radar signals. For example, the electronic device can include a device for detecting a falling motion state of a human body. For example, a human presence sensor or a human motion state sensor, etc.
[0049] In one embodiment, the electronic device includes a radar, which transmits and receives radar signals according to the radar. The radar can include a millimeter wave radar, etc. The millimeter wave radar operates in a millimeter wave band, and the operating frequency band is generally 30 GHz-300 GHz, and the wavelength is 1-10 mm, which is between a microwave and a centimeter wave. Compared with a centimeter wave radar, the millimeter wave radar has a smaller volume, is easy to integrate, has a high spatial resolution, and has a higher resolution for detecting a human motion state. Compared with a laser radar, the millimeter wave radar has a lower cost, and at the same time, the millimeter wave radar has a stronger penetration capability for rain, fog, smoke, dust, etc., and can obtain detection data in various indoor and outdoor environments, such as a bathroom or a kitchen, etc.
[0050] In one embodiment, the radar can include a multiple-input multiple-output (MIMO) radar, and according to the multiple-input multiple-output radar, the angle resolution of the radar for a target object can be improved. For example, the radar can use a two-transmit four-receive radar to obtain 8-dimensional detection data.
[0051] In one embodiment, the millimeter wave radar can include a three-dimensional (3D) millimeter wave radar, in which the antennas are arranged in a two-dimensional direction, and the two-dimensional horizontal coordinates and velocity information are detected. The millimeter wave radar can also include a four-dimensional (4D) millimeter wave radar, in which the antennas are arranged in a horizontal and vertical direction, and the three-dimensional coordinates and velocity information are detected.
[0052] In one embodiment, the step 110 can include: receiving a radar echo signal based on the emitted radar signal; and performing an algorithm according to a signal parameter of the radar echo signal to obtain detection data.
[0053] In one embodiment, the detection data can include: a distance of the target object relative to the electronic device, a motion rate of the target object, and / or angle information, etc. In one radar signal sampling, at least one echo radar signal can be reflected according to an object such as a human body or an object in a detection range, and therefore, the detection data can include: a distance of the target object relative to the electronic device, a motion rate of the target object, and / or angle information, etc. which are discretely distributed.
[0054] In one embodiment, the algorithm for processing the radar signal can include a three-dimensional fast Fourier transform algorithm (3DFFT). The 3DFFT algorithm can include: performing a distance dimension Fourier transform on the radar signal to obtain a distance of the target object relative to the electronic device; performing a speed dimension Fourier transform on a signal parameter after the distance dimension processing to obtain a motion speed of the target object; and performing an angle dimension Fourier transform on a signal parameter after the speed dimension processing to obtain angle information.
[0055] In one embodiment, the resolution of the detection data can be increased by increasing a predetermined granularity of the 3DFFT algorithm. The granularity can include a number of processing points in the 3DFFT algorithm.
[0056] In one embodiment, the state of the target object can include: a motion state of the target object and / or a posture of the target object, etc. In one embodiment, the motion state of the target object can include: a coordinate of the target object, a motion time of the target object, a motion trajectory of the target object, a speed of the target object, and / or an acceleration of the target object, etc.
[0057] In one embodiment, the step 120 can include: determining a three-dimensional coordinate and motion information of a preset point of the target object according to the detection data.
[0058] The motion information can include: speed information and / or acceleration information, etc.
[0059] According to the three-dimensional coordinate and the motion information of the preset point of the target object, it is determined whether the state of the target object exists from a first state through a second state to a third state.
[0060] In an embodiment, the preset point of the target object can include: point cloud data constituting the target object; and / or, a preset point obtained by calculation of the point cloud data of the target object, etc. In an embodiment, the preset point obtained by calculation of the point cloud data of the target object can include: a center of gravity of the target object, a human key point of the target object, and / or a clustering point of the target object, etc. Wherein, the human key point can include: a human part key point or a human skeleton key point, etc.
[0061] In an embodiment, the point cloud data is obtained according to the calibration of the detection data; and the three-dimensional coordinates and motion information of the preset point of the target object are obtained according to the point cloud data. The point cloud data obtained according to the calibration of the detection data can include: determining the three-dimensional coordinates of the point position in the point cloud data according to the distance of the target object relative to the electronic device, the angle information and the three-dimensional coordinate system in the detection data; and determining the speed information of the point position in the point cloud data according to the motion rate of the target object.
[0062] In an embodiment, the point cloud data is obtained according to the calibration of the detection data; the boundary is divided according to the point cloud data to obtain one or more point cloud sub-data sets; wherein, the target object can include a point cloud sub-data set; and the three-dimensional coordinates and motion information of the preset point of the target object are determined according to the point cloud sub-data set of the target object.
[0063] In an embodiment, the first state can be a straight-up state or a bent state of the target object, the second state can be a tilted state, and the third state can be a crawling state, a supine state or a kneeling state.
[0064] That is, the posture of the target object can be determined according to the detection data whether it has gone through the above three states in sequence. If it has gone through the above three states in sequence, it can be considered that the preset alarm event which needs to be warned has occurred. If only the first state, the second state and the first state are switched back, etc., it means that the preset alarm event has not occurred.
[0065] In an embodiment, the first state can be used to indicate a stationary state or a straight-up or bent motion state of the target object at a first position. And / or, the second state is used to indicate a downward motion state of the target object switching from the first position to a second position; the distance between the second position and the ground is less than the distance between the first position and the ground; and the third state is used to indicate a stationary state of the target object at the second position.
[0066] In an embodiment, the first state can include a stationary state or a normal motion state of a motion model of the target object. Illustratively, the stationary state or the normal motion state of the motion model of the target object can include a velocity direction of the motion model of the target object being 0 or having two or more velocity directions. The second state can include a falling motion state of the motion model of the target object. Illustratively, the falling motion state of the motion model of the target object can include a velocity direction of the motion model of the target object being one, and the velocity direction having a velocity component toward the ground. The third state can include a stationary state of the target motion model. Here, in the second state of falling, the target object makes a motion close to free fall, and when the target object is a human body, the human body moves rapidly in one direction.
[0067] In an embodiment, in the falling motion state, the first state can include a stationary state in which an angle change of an included angle between the target object and a horizontal direction of the ground is 0 or a normal motion state in which the angle change of the included angle between the target object and the horizontal direction of the ground is within a predetermined angle range within a predetermined time range; the second state can include a motion state in which an angle of the included angle between the target object and the horizontal direction of the ground decreases by a predetermined angle within a predetermined time range; and the third state can include a motion state in which the included angle between the target object and the horizontal direction is less than a predetermined angle.
[0068] In an embodiment, the first state can include a stationary state or a normal motion state of a preset point of the target object being at a first position; the second state includes a falling motion state of the preset point of the target object from the first position to a second position; and the third state is used to indicate a stationary state of the preset point of the target object at the second position. The preset point of the target object can include point cloud data of the target object, a center of gravity of the target object, a human body key point of the target object, and / or a clustering point of the target object, etc.
[0069] In an embodiment, in the first state in the falling motion state, a lowest point of the target object is less than a ground by a predetermined distance; and in the first state in the falling motion state, the lowest point of the target object is higher than the ground by a predetermined distance.
[0070] Illustratively, the falling motion state can include falling from a bed. In the first state of the falling motion state, the target object is on the bed, and the target object as a whole and the lowest point are at a predetermined distance from the ground
[0071] In another embodiment, according to the detection data, a three-dimensional position and motion information of a preset point of the target object is determined; according to the preset point of the target object, a target object model is determined; and according to the target object model, whether a state of the target object exists from a first state through a second state to a third state is determined.
[0072] For example, according to the motion information and / or posture of the target object model, the first state, the second state and the third state of the target object model are determined. For example, by the pitch angle between the target object and the ground, the center of gravity of the target object and / or the motion information of the target object, the state of the target object is determined.
[0073] Here, according to the first state, the second state and the third state, the falling motion state and the falling motion state of the target object such as the human body or the object can be detected. Compared with determining the fall or the fall only according to the falling motion state, the motion state of the object in the environment can be reduced. The interference of the falling motion state reduces the misjudgment of the falling motion state, and improves the accuracy of determining the falling state of the human body.
[0074] In one embodiment, the determination of the occurrence of the preset alarm event can include: sending text or sound alarm information by the electronic device; wherein the text or sound alarm information can be used to prompt the occurrence of the falling or falling event.
[0075] For example, the preset alarm event can include: outputting sound alarm information by the electronic device; outputting text alarm information on the display screen of the electronic device; sending voice or text alarm information to the emergency contact or hospital; and / or sending alarm information to the server, the server being used to send alarm information to the application program of the mobile communication device associated with the electronic device.
[0076] Here, when the falling or falling event occurs, the determination of the occurrence of the preset alarm event can timely notify the surrounding personnel, the emergency contact and / or the medical personnel to help or treat the falling or falling personnel, and ensure the safety of the falling or falling personnel.
[0077] In one embodiment, the method further comprises: according to the detection data, obtaining a measured object; and according to the measured object, determining whether the measured object is the target object.
[0078] In one embodiment, according to the measured object, one or more target objects can be determined.
[0079] In an embodiment, the target object is tracked by a target tracking algorithm to determine position information of the target object at different time instants. Acceleration information of preset points of the target object is obtained according to three-dimensional position and velocity information of the preset points of the target object at predetermined time intervals by the target tracking algorithm. In this way, the motion state detection of multiple target objects can be determined by the tracking algorithm, and the intelligence of the motion state detection can be improved.
[0080] In an embodiment, the step 120 can be processed according to a pre-trained neural network model, which inputs the detection data and outputs whether the state of the target object exists from the first state through the second state to the third state. In an embodiment, the algorithm for training the neural network model can include a support vector machine (SVM) algorithm and the like.
[0081] As shown in Figure 2 The embodiments of the present disclosure provide a state information processing method, and the method further includes:
[0082] In step 210, profile information of the measured object is obtained according to the detection data.
[0083] In step 220, whether the measured object includes the target object is determined according to the profile information.
[0084] In an embodiment, the step 210 can include: calibrating the detection data to obtain the point cloud data; performing boundary division on the point cloud data to obtain one or more point cloud sub-data sets; wherein the measured object can include a set of point cloud data; and determining the profile information of the measured object according to boundary points of the point cloud sub-data set of the measured object.
[0085] The profile information can include outer profile information and / or inner profile information of the target object. The profile information can include shape information of the target object. The inner profile information can include an internal profile inside the outer profile.
[0086] In an embodiment, the step 210 can further include: calibrating the detection data to obtain the point cloud data; determining one or more point cloud sub-data sets of the measured object by a clustering algorithm according to the point cloud data; and determining the profile information of the measured object according to boundary points of the point cloud sub-data set of the measured object. The clustering algorithm can include a clustering algorithm based on division, density or hierarchy.
[0087] In one embodiment, the step 220 can include determining whether the target object exists in the detected object according to whether the contour information of the detected object includes human contour information. If the contour information of the one detected object includes human contour information, the detected object is determined as the target object. If the combined contour information of the multiple detected objects includes human contour information, the combination of the detected objects is determined as the target object. The human contour information can include head contour, torso contour, arm contour, leg contour, etc.
[0088] In one embodiment, the method can further include obtaining a detected object according to the detection data, and determining whether the target object exists in the detected object according to motion information of the detected object.
[0089] For example, if one or more detected objects are within a predetermined distance range, have a motion speed within a predetermined motion speed range, and / or have a motion displacement within a predetermined displacement range, the detected object is determined as the target object.
[0090] In some embodiments, the method further includes:
[0091] If the target object enters the second state from the first state, a first duration in which the target object is in the second state is determined.
[0092] If it is determined that the state of the target object enters a third state from the first state through the second state, a preset alarm event is determined to occur. Determining that a preset alarm event occurs includes:
[0093] If it is determined that the target object enters the third state and the first duration is within a first duration range, a preset alarm event is determined to occur.
[0094] In one embodiment, the first duration can include a first duration in which the target object is in the second state, starting from when the target object enters the second state from the first state, to when the second state enters the third state.
[0095] In one embodiment, a predetermined first duration range is set. For example, in a fall or a drop, the first duration range of the second state in the falling process can be set to 2-4 seconds.
[0096] Herein, the first duration of the target object in the second state is determined, and the first duration is determined to be within a first duration range. Compared with not setting the first duration of the second state, the normal motion state of the target object or the misjudgment of the target object being an object can be reduced, and the accuracy of determining the motion state of the target object falling or falling can be improved. For example, in the case of the target object performing squatting or prone motion at a fast or slow speed, or the target object stopping falling or falling in time during the falling or falling process, or the falling motion process of the object, the duration of the target object in the second state is very short. According to the first duration of the target object in the second state being within the first duration range, the misjudgment of these situations can be reduced.
[0097] In some embodiments, the method further comprises: if the target object switches from the second state to the third state, determining a second duration of the target object in the third state;
[0098] If it is determined that the state of the target object changes from the first state to the third state through the second state, a preset alarm event is determined to occur. Determining that a preset alarm event occurs includes:
[0099] If it is determined that the target object enters the third state and the third state is within the second duration range, it is determined that a preset alarm event occurs.
[0100] In one embodiment, the second duration range of the third state including the stationary state can be set to be greater than or equal to 5 seconds.
[0101] In this way, the second duration of the target object in the third state is determined, and the second duration is determined to be within a second duration range. Compared with not setting the second duration of the third state, the normal motion state of the target object or the misjudgment of the target object being an object can be reduced, and the accuracy of determining the motion state of the target object falling or falling can be improved. For example, the target object is performing a jumping motion; or, the target object is an elastic object; or, there is an elastic material on the ground, such as a trampoline or an air cushion; or the target object still has the ability to move after falling or falling. In this way, the target object is in the third state for a very short time. By determining that the second duration of the target object in the third state is within the second duration range, the misjudgment of these situations can be reduced.
[0102] In some embodiments, the detection data is obtained based on the radar signal, comprising:
[0103] The detection data is obtained based on the radar signal every interval of a predetermined duration. The predetermined duration is determined according to statistical data of the target object switching from the first state to the third state through the second state.
[0104] In one embodiment, the radar information obtains detection data every interval of a predetermined length; according to the predetermined number of detection data, the three-dimensional position and speed information of the preset point of the target object is obtained; according to the speed information of the preset point of the target object of the predetermined number of times, the acceleration information of the preset point of the target object is obtained.
[0105] In one embodiment, the radar information obtains detection data every interval of a predetermined length; according to the predetermined number of detection data, the three-dimensional position and speed information of the preset point of the target object is obtained; according to the speed information of the preset point of the target object of the predetermined number of times, the acceleration information of the preset point of the target object is obtained.
[0106] In one embodiment, the predetermined length is determined according to the statistical data of the target object from the first state to the second state to the third state.
[0107] For example, the time of the first state, the second state and the third state in the falling state or the falling state may be 2-5 seconds respectively, and the switching state time is 1 second, so the interval of the predetermined length of the detection data obtained based on the radar signal can be set to 0.5 seconds.
[0108] In some embodiments, the first state includes: a stationary state or a motion state of the preset point of the target object at the first position;
[0109] The third state includes: a stationary state of the preset point of the target object at the second position; the distance between the second position and the ground is less than the distance between the first position and the ground.
[0110] In some embodiments, the second state includes: a downward motion of the preset point of the target object from the first position to the second position.
[0111] In one embodiment, according to the motion information of the preset point of the target object and the predetermined motion information level, the first state, the second state and the third state of the target object are determined; wherein the motion information can include: speed information and acceleration information, etc.; the predetermined motion information level can include: predetermined speed level and predetermined acceleration level, etc.
[0112] According to the speed information of the point cloud data of the target object and the predetermined speed level, the proportion of the point position data of the predetermined speed level in the target object in the point cloud data of the target object is determined; according to the acceleration information of the point cloud data of the target object and the predetermined acceleration level, the proportion of the point position data of the predetermined acceleration level in the target object in the point cloud data of the target object is determined; and according to the proportion of the point position data of the predetermined speed level and the proportion of the point position data of the predetermined acceleration level, the motion state of the target object is determined.
[0113] For example, a mapping relationship between a speed and the speed level is as shown in FIG. 2. Figure 3 A mapping relationship between an acceleration and the acceleration level is as shown in FIG. 3. Figure 4 A mapping relationship between a human motion state, the speed level and the acceleration level is as shown in FIG. 5.
[0114] In one embodiment, when the proportion of the point position data of the first speed level in the target object is within a predetermined proportion range, and the proportion of the point position data of the first acceleration level in the target object is within a predetermined proportion range, it is determined that the target object is in the static state.
[0115] For example, if the proportion of the point position data of the first speed level in the target object is greater than 90%, and the proportion of the point position data of the first acceleration level in the target object is greater than 90%, it is determined that the target object is in the static state. That is, more than 90% of the point position data has a speed less than 0.2 m / s and an acceleration less than 0.2 m / s. 2 When the speed and the acceleration tend to 0, and each part of the target object remains in a static state, it is determined that the target object is in the static state.
[0116] In one embodiment, if the proportion of the point position data of the same predetermined speed level and the same predetermined acceleration level in the target object is less than a predetermined proportion, it is determined that the motion state of the target object is a normal motion state. The motion speed and the acceleration of each part of the target object in the normal motion state change at any time. For example, the predetermined proportion can be set to 80%, and the proportion of the point position data of the same predetermined speed level and the same predetermined acceleration level in the target object is less than 80%.
[0117] In one embodiment, if the proportion of the point data of the same predetermined speed level in the target object is greater than a predetermined proportion, and the proportion of the point data of the predetermined acceleration level in the target object is greater than a predetermined proportion, the motion state of the target object is determined as a second state. In the process of falling or falling of the target object, the second state includes a free fall state in the falling process, in the second state, the target object as a whole moves in the same direction, and the acceleration of the target object is close to the gravity acceleration. For example, the predetermined proportion can be set to 80%, and more than 80% of the point data remains in the same speed level, and more than 80% of the point data has an acceleration in the seventh acceleration level, that is, the acceleration range is 9.0m / s 2 to 11.0m / s 2 .
[0118] In one embodiment, determining that the target object enters the second state from the first state can include: determining that the target object enters the second state from the first state according to the proportion of the point data of the same predetermined speed level and the same predetermined acceleration level in the target object being greater than a predetermined proportion.
[0119] For example, the predetermined proportion can be set to 80%, and more than 80% of the point data in the target object is in the same predetermined speed level and the same predetermined acceleration level. When the target object suddenly starts to fall or fall, the target object as a whole moves in the same direction, and more than a predetermined proportion of the point data in the target object is in the same predetermined speed level and the same acceleration level.
[0120] In one embodiment, according to the state machine, the target object enters the third state from the first state through the second state, it is determined that a preset alarm event occurs. The state machine can include: a current state, which can represent the current state; condition, also known as event, when the condition is met, trigger an action or execute a state migration; action, the action executed after the condition is met; and / or, substate, the new state migrated after the condition is met.
[0121] In one embodiment, a state machine diagram can be as shown in Figure 6 The state machine can include:
[0122] The initial state of the state machine is the first state; wherein when the state of the target object is the first state, the initial state of the state machine is determined as the first state;
[0123] According to the trigger event, the state of the state machine is switched from the first state to the second state; the trigger event can include: determining that the state of the target object enters the second state from the first state;
[0124] the state machine is the second state; when the state of the target object is the second state, the state machine can be the second state;
[0125] determining whether the first duration of the second state of the target object is within a first duration range; if the first duration of the second state is within the first duration range, continuing to determine whether the state of the target object switches from the second state to the third state; if the state of the target object switches from the second state to the third state, determining that the state machine is a third state;
[0126] determining whether the second duration of the third state of the target object is within a second duration range; if the second duration of the third state is within the second duration range, determining that a preset alarm event occurs;
[0127] if the first duration of the second state is outside the first duration range and / or the second duration is outside the second duration range, determining that the preset alarm event does not occur, and the state machine returns to an initial state.
[0128] In one embodiment, the radar signal is obtained every predetermined duration; a three-dimensional Fourier transform is performed according to the radar signal to obtain detection data at intervals of a predetermined duration; wherein the detection data includes: the distance of the target object relative to the electronic device, the motion rate of the target object and / or angle information; according to the detection data at intervals of a predetermined duration, three-dimensional coordinates and velocity information of point cloud data of the target object are obtained; according to a tracking algorithm and the detection data at intervals of a predetermined duration, acceleration information of the point cloud data of the target object is obtained; according to the velocity information and acceleration information of the point cloud data of the target object and a predetermined velocity level and a predetermined acceleration level, the motion state of the target object is determined; if the target object enters the third state from the first state through the second state, and the first duration of the second state is within the first duration range and the second duration of the third state is within the second duration range, it is determined that a preset alarm event occurs.
[0129] As shown in Figure 7 The embodiment of the present disclosure provides a device for processing state information, and the device comprises:
[0130] The obtaining module 510 is configured to obtain detection data based on a radar signal.
[0131] The determining module 520 is configured to determine the state of a target object according to the detection data.
[0132] If it is determined that the state of the target object enters the third state from the first state through the second state, it is determined that a preset alarm event occurs.
[0133] In an embodiment, the obtaining module 510 is further configured to: obtain contour information of the target object according to the detection data; and the determining module 520 is further configured to: determine whether the target object exists in the target object according to the contour information.
[0134] In an embodiment, the determining module 520 is further configured to: if the target object enters from the first state to the second state, determine a first time length of the target object in the second state; and if it is determined that the target object enters the third state and the first time length is within a first time length range, determine that a preset alarm event occurs.
[0135] In an embodiment, the determining module 520 is further configured to: if the target object switches from the second state to the third state, determine a second time length of the target object in the third state; and if it is determined that the target object enters the third state and the third state is within a second time length range, determine that a preset alarm event occurs.
[0136] In an embodiment, the obtaining module 510 is further configured to: acquire the detection data every interval of a predetermined time length based on radar information; and the predetermined time length is determined according to statistical data of the target object from the first state to the third state through the second state.
[0137] Figure 8 is a block diagram of an electronic device 900 according to an exemplary embodiment. The method of the disclosure can be applied to the electronic device.
[0138] Referring to Figure 8 , the electronic device 900 can include one or more of the following components: a processing component 902, a memory 904, a power supply component 906, a multimedia component 908, an audio component 910, an input / output (I / O) interface 912, a sensor component 914, and a communication component 916.
[0139] The processing component 902 usually controls the overall operation of the electronic device 900, such as operations associated with displaying, making phone calls, data communications, camera operations, and recording operations. The processing component 902 can include one or more processors 950 to execute instructions to complete all or part of the steps of the methods described above. In addition, the processing component 902 can include one or more modules to facilitate interaction between the processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.
[0140] The memory 904 is configured to store various types of data to support the operation of the electronic device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phonebook data, messages, pictures, videos, etc. The memory 904 can be implemented by any type of volatile or nonvolatile memory, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, magnetic disc or optical disc.
[0141] The power supply component 906 supplies power for various components of the electronic device 900. The power supply component 906 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 900.
[0142] The multimedia component 908 includes a screen providing an output interface between the electronic device 900 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and pressure related to the touching or sliding action. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. The front camera and / or the rear camera can receive external multimedia data when the electronic device 900 is in an operation mode, such as a photographing mode or a video mode. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0143] The audio component 910 is configured to output and / or input an audio signal. For example, the audio component 910 includes a microphone (MIC) configured to receive an external audio signal when the electronic device 900 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 904 or transmitted via the communication component 919. In some embodiments, the audio component 910 also includes a speaker for outputting an audio signal.
[0144] The I / O interface 912 provides an interface between the processing component 902 and peripheral interface modules, which can be a keypad, a click wheel, buttons, etc. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.
[0145] The sensor component 914 includes one or more sensors for providing status assessments for various aspects of the electronic device 900. For example, the sensor component 914 can detect an open / closed position of the device 900, relative positioning of components, such as a display and a keypad of the electronic device 900, a change in position of the electronic device 900 or a component of the electronic device 900, presence or absence of user contact with the electronic device 900, orientation or acceleration / deceleration / g-force and temperature of the electronic device 900. The sensor component 914 can include an optical sensor for detecting ambient light, a proximity sensor configured to detect proximity of an object, a motion sensor configured to detect motion of the electronic device 900, a position sensor configured to detect position of the electronic device 900, a temperature sensor configured to detect temperature of the electronic device 900, an acceleration sensor configured to detect acceleration of the electronic device 900, a gyroscope sensor configured to detect orientation of the electronic device 900, an air quality sensor configured to detect air quality, a pressure sensor configured to detect pressure, and / or a humidity sensor configured to detect humidity.
[0146] The communication component 916 is configured to facilitate wired or wireless communication between the electronic device 900 and another device. The electronic device 900 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an example embodiment, the communication component 916 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an example embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technology. In an example embodiment, the communication component 916 further includes a radar module to transmit and receive radar signals.
[0147] In an example embodiment, the electronic device 900 can be implemented using one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic modules to perform the above-described methods.
[0148] In an example embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 904 including instructions, is also provided, which can be executed by the processor 950 of the electronic device 900 to implement any of the above-described methods. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.
[0149] In an exemplary embodiment, the processor 950 can include a microcontroller unit (MCU) and / or a central processing unit (CPU), etc.
[0150] Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
[0151] It is to be understood that the application is not limited to the precise structures hereinabove described and shown in the drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the present application.
Claims
1. A method of state information processing, characterized by, The method is executed by an electronic device, and comprises: obtaining detection data based on a radar signal; wherein the detection data comprises at least one of the following: distance of a target object relative to the electronic device, motion rate of the target object, and angle information; determining a first state, a second state, and a third state of the target object according to motion information of a preset point of the target object and a same predetermined motion information level; wherein the motion information of the preset point of the target object is determined based on the detection data; the motion information comprises speed information and acceleration information; the predetermined motion information level comprises a predetermined speed level and a predetermined acceleration level; if the target object enters from the first state to the second state, determining a first time length during which the target object is in the second state; wherein the first time length can comprise a first time length during which the target object is in the second state from when the target object enters from the first state to the second state to when the target object enters from the second state to the third state; if it is determined that the state of the target object enters from the first state to the third state through the second state, determining that a preset alarm event occurs; the if it is determined that the state of the target object enters from the first state to the third state through the second state, determining that a preset alarm event occurs, comprises: if it is determined that the state of the target object enters from the first state to the third state through the second state, and the first time length is within a first time length range, determining that the preset alarm event occurs.
2. The method of claim 1, wherein, The method further comprises: obtaining contour information of a measured object according to the detection data; determining whether the measured object contains the target object according to the contour information.
3. The method according to claim 1 or 2, characterized in that, The method further comprises: if the target object switches from the second state to the third state, determining a second time length during which the target object is in the third state; the if it is determined that the state of the target object enters from the first state to the third state through the second state, determining that a preset alarm event occurs, comprises: if it is determined that the target object enters the third state and the second time length is within a second time length range, determining that the preset alarm event occurs.
4. The method according to claim 1 or 2, characterized in that, The obtaining detection data based on a radar signal comprises: acquiring the detection data based on the radar signal once every predetermined time length; wherein the predetermined time length is determined according to statistical data of the target object switching from the first state to the third state through the second state.
5. The method of claim 1, wherein: the first state comprises a stationary state or a motion state of a preset point of the target object at a first position; the third state comprises a stationary state of the preset point of the target object at a second position; a distance between the second position and the ground is less than a distance between the first position and the ground.
6. The method of claim 5, wherein, the second state comprises a descending motion of the preset point of the target object from the first position to the second position.
7. An apparatus for state information processing, the apparatus comprising: The apparatus comprises: obtaining a detection data based on the radar signal; wherein the detection data comprises at least one of a distance of a target object relative to the electronic device, a motion rate of the target object, and angle information; determining a state of the target object according to the detection data; the determining the state of the target object according to the detection data comprises determining a first state, a second state, and a third state of the target object according to motion information of a preset point of the target object and a same predetermined motion information level; the motion information comprises speed information and acceleration information; the predetermined motion information level comprises a predetermined speed level and a predetermined acceleration level; if the target object enters from the first state to the second state, determining a first time length of the target object in the second state; wherein the first time length can comprise a first time length of the target object in the second state from the target object entering from the first state to the second state to the target object entering from the second state to the third state; if it is determined that the state of the target object enters from the first state to the third state through the second state, determining that a preset alarm event occurs; the if it is determined that the state of the target object enters from the first state to the third state through the second state, determining that the preset alarm event occurs, comprises: if it is determined that the state of the target object enters from the first state to the third state through the second state, and the first time length is within a first time length range, determining that the preset alarm event occurs.
8. The apparatus of claim 7, wherein the obtaining module is further configured to obtain contour information of the target object according to the detection data; the determining module is further configured to determine whether the target object exists in the target object according to the contour information.
9. The apparatus of claim 7 or 8, wherein the determining module is further configured to determine a second time length of the target object in the third state if the target object switches from the second state to the third state; if it is determined that the target object enters the third state and the second time length is within a second time length range, determining that the preset alarm event occurs.
10. The apparatus of claim 7 or 8, wherein the obtaining module is further configured to acquire the detection data based on the radar signal every predetermined time length; wherein the predetermined time length is determined according to statistical data of the target object switching from the first state to the third state through the second state.
11. An electronic device, comprising: The electronic device comprises a processor and a memory for storing a computer service capable of running on the processor, wherein the processor is configured to run the computer service to implement the method of any one of claims 1 to 6.
12. A storage medium, characterized by The storage medium has computer executable instructions, and the computer executable instructions are executed by the processor to implement the method of any one of claims 1 to 6.
Citation Information
Patent Citations
Fall detection method and device, electronic equipment and storage medium
CN114005247A
Fall detection method and device, equipment and storage medium
CN115005809A