Human body action monitoring method, electronic equipment and storage medium

By collecting and processing short-distance communication data and extracting human motion characteristics, the problems of privacy exposure of video image algorithms and wearable devices in sleep monitoring and the easy device fall off are solved, achieving more accurate sleep monitoring.

CN118921634APending Publication Date: 2024-11-08ZTE CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310512404.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-08
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing sleep monitoring technologies, especially video image algorithms and wearable devices, have problems such as privacy exposure and easy equipment to fall off, resulting in a decrease in the accuracy of sleep monitoring data.

Method used

By collecting short-distance communication data in the perception area, dividing it into amplitude data sequences, and extracting the target data sequences based on the amplitude fluctuation. Based on these data, the human body movements can be monitored to achieve accurate identification of human body movements without exposing user privacy.

Benefits of technology

It improves the accuracy of human body movement recognition, avoids the problem of device falling off, and obtains data in the perceived area without exposing user privacy, enhancing the reliability of sleep monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921634A_ABST
    Figure CN118921634A_ABST
Patent Text Reader

Abstract

The invention provides a human body action monitoring method, electronic equipment and a storage medium, and relates to the technical field of action detection. The method comprises the following steps: collecting short-distance communication data in a sensing area; dividing the short-distance communication data into a plurality of amplitude data sequences according to the data amplitude; extracting a plurality of target data sequences from the plurality of amplitude data sequences according to the amplitude fluctuation degree; and monitoring human body actions based on the plurality of target data sequences. According to the technical scheme, under the condition that user privacy is not exposed, the collected short-distance communication data in the sensing area is processed, the multiple target data sequences are obtained, the human body actions are monitored based on the multiple target data sequences, and the recognition accuracy of the human body actions is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of motion detection, and in particular to a human motion monitoring method, electronic equipment and storage medium. Background Art

[0002] With the development of communication technology and artificial intelligence technology, sleep monitoring has gradually become a monitoring method implemented in the fields of health care, elderly health monitoring, etc. The evaluation and monitoring data of the user's sleep quality can reflect the user's health status.

[0003] Usually, video image algorithms or wearable device technologies are used to monitor the user's sleep quality. However, when using video image algorithms, the camera equipment deployed will expose the user's privacy information and pose a security risk. When the user wears the wearable device to sleep, the device may fall off, reducing the accuracy of the sleep monitoring data. Summary of the invention

[0004] The present application provides a human motion monitoring method, an electronic device and a storage medium.

[0005] An embodiment of the present application provides a method for monitoring human motion, the method comprising: collecting short-distance communication data within a sensing area; dividing the short-distance communication data into multiple amplitude data sequences according to the data amplitude; extracting multiple target data sequences from the multiple amplitude data sequences according to the amplitude fluctuation degree; and monitoring human motion based on the multiple target data sequences.

[0006] An embodiment of the present application provides an electronic device, including: one or more processors; a memory, on which one or more programs are stored. When the one or more programs are executed by one or more processors, the one or more processors implement any one of the human motion monitoring methods in the embodiments of the present application.

[0007] An embodiment of the present application provides a readable storage medium, which stores a computer program. When the computer program is executed by a processor, any one of the human motion monitoring methods in the embodiments of the present application is implemented.

[0008] According to the human motion monitoring method, electronic device and storage medium of the embodiments of the present application, by collecting short-distance communication data in the sensing area, it is possible to obtain data in the sensing area without exposing the user's privacy; the short-distance communication data is divided into multiple amplitude data sequences according to the data amplitude to obtain multiple amplitude data sequences that can reflect the amplitude information; multiple target data sequences are extracted from the multiple amplitude data sequences according to the amplitude fluctuation degree, so that the obtained multiple target data sequences can better reflect the characteristics of human motion; and then human motion is monitored based on the multiple target data sequences to improve the accuracy of recognizing human motion.

[0009] With regard to the above embodiments and other aspects of the present application and their implementation, further description is provided in the accompanying drawings, detailed description and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A flow chart of a human motion monitoring method provided in an embodiment of the present application is shown.

[0011] Figure 2 A schematic diagram showing a sensing area provided in an embodiment of the present application.

[0012] Figure 3 A schematic diagram of training a residual neural network using a preset training set provided in an embodiment of the present application.

[0013] Figure 4 A flowchart of a data collection method during training of a residual neural network provided in an embodiment of the present application.

[0014] Figure 5 A schematic diagram of the process of training a residual neural network provided in an embodiment of the present application.

[0015] Figure 6 A block diagram of the composition of the action recognition system provided in an embodiment of the present application.

[0016] Figure 7 A schematic diagram of a process for identifying human body movements provided in an embodiment of the present application.

[0017] Figure 8 A block diagram showing the composition of the motion recognition device provided in an embodiment of the present application is shown.

[0018] Fig. 9 A structural diagram showing an exemplary hardware architecture of a computing device capable of implementing the human motion monitoring method and apparatus according to an embodiment of the present application. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present application more clear, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features in the embodiments of the present application can be combined with each other arbitrarily without conflict.

[0020] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0021] Usually, the sleep quality of users is monitored using video image algorithms or wearable device technology. When using video image algorithms, cameras are placed around the human body to capture the movements of the human body during sleep; then, each frame of the captured image is processed. By identifying the positions of the main joints of the human body and judging whether the main joints of the human body have changed positions in multiple frames of images, if the video image algorithm captures this position change, it is used to identify the turning over of the human body. However, during the implementation of the above method, it is necessary to deploy equipment for capturing images, which will expose the user's privacy information and reduce the user's safety.

[0022] When monitoring the sleep quality of users through wearable devices, since the wearable devices contain multiple modules such as accelerometers, gyroscopes, and thin-film resistors, when the user wears the wearable device to sleep, if the body turns over, the wearable device will capture the data transmitted by these sensors, and then identify the movement of the head to be recognized based on the data transmitted by these sensors. However, when users wear wearable devices to sleep, there are problems such as the device easily falling off, which not only hinders the user's sleep, but also reduces the accuracy of the captured sleep data.

[0023] The present application provides a human motion monitoring method, an electronic device and a storage medium to at least solve the above-mentioned problems.

[0024] Figure 1 The flowchart of the human motion monitoring method provided by the embodiment of the present application is shown. The human motion monitoring method can be applied to a motion recognition device. Figure 1 As shown, the human motion monitoring method in the embodiment of the present application includes but is not limited to the following steps.

[0025] Step S101, collecting short-range communication data within a sensing area.

[0026] The sensing area may be an area for sensing human body movements that is constructed based on short-distance communication data exchanged between a signal transmitting device and a signal receiving device.

[0027] For example, the signal transmitting device may be a terminal (such as a smart phone, tablet computer, etc.); the signal receiving device may be a network access device (a router, wireless network card, etc.), and the short-distance communication data exchanged between the terminal and the network access device can accurately sense the movements of the human body in the sensing area. In an exemplary embodiment, the size of the sensing area can also be set according to the position and distance between the signal transmitting device and the signal receiving device or according to the needs of the user.

[0028] For another example, the signal transmitting device (or, the signal receiving device) may be any one of the following devices: a wireless network card, a router, a customer premises equipment (Customer Premise Equipment, CPE), a mobile phone, and other devices containing a short-range communication chip.

[0029] Step S102: dividing the short-distance communication data into a plurality of amplitude data sequences according to the data amplitude.

[0030] Step S103, extracting multiple target data sequences from multiple amplitude data sequences according to the amplitude fluctuation degree.

[0031] The amplitude fluctuation degree is used to characterize the degree of change between each data in the amplitude data sequence, and the amplitude fluctuation degree can be characterized by the degree of difference between different data.

[0032] Step S104, monitoring human body movements based on multiple target data sequences.

[0033] In this embodiment, by collecting short-distance communication data within the sensing area, data within the sensing area can be obtained without exposing user privacy; the short-distance communication data is divided into multiple amplitude data sequences according to the data amplitude to obtain multiple amplitude data sequences that can reflect amplitude information; multiple target data sequences are extracted from the multiple amplitude data sequences according to the amplitude fluctuation degree, so that the obtained multiple target data sequences can better reflect the characteristics of human body movements; and then human body movements are monitored based on the multiple target data sequences to improve the accuracy of recognizing human body movements.

[0034] It should be noted that before the signal transmitting device and the signal receiving device perform wireless perception, the signal transmitting device needs to obtain certain attribute parameters of the signal receiving device in advance (such as the network address or media access control address (Media Access Control Address, MAC) of the signal receiving device, etc.). After obtaining the above attribute parameters, the signal transmitting device and the signal receiving device can collect short-distance communication data (such as channel state information (Channel State Information, CSI) data, etc.).

[0035] In some exemplary embodiments, the human body's movements may include: at least one of turning over, leg stretching, hand stretching, head movement, foot movement and hand movement during sleep, or other movements involving any movement of the human body.

[0036] For example, different levels can be set according to the amplitude of the movement. For example, the level of movements with larger amplitudes, such as turning over, leg stretching, and hand stretching, can be set to level one; and the level of movements with smaller amplitudes, such as head movement, foot movement, and hand movement, can be set to level two, so as to facilitate accurate identification of movements of different levels.

[0037] Furthermore, some abnormal actions can be set, such as kicking, leg shaking, hand shaking, etc. The above actions of the human body are only examples, which can be set specifically according to actual needs. Other unexplained actions are also within the scope of protection of this application and will not be repeated here.

[0038] In some exemplary embodiments, the sensing area may be a rectangular area, wherein the length of the rectangular area is the connection distance between the signal transmitting device and the signal receiving device, and the width of the rectangular area is a length determined based on the wavelength of the collected short-range communication signal, a preset adjustment coefficient, and the connection distance between the signal transmitting device and the signal receiving device.

[0039] It should be noted that the signal transmitting device and the signal receiving device can be on a horizontal plane at the same height (for example, the height difference between the position of the signal transmitting device and the position of the signal receiving device can be within a preset range (such as 5 cm, 10 cm, etc.)), and the difference between the horizontal plane and the horizontal height of the human body is within a preset difference range (such as the preset difference range is within 20 cm, etc.).

[0040] For example, Figure 2 A schematic diagram showing the sensing area provided by the embodiment of the present application is shown. Figure 2 As shown, a sensing area 220 is constructed between a signal transmitting device 231 and a signal receiving device 232 based on a short-range communication protocol; wherein the human body is in a central area 211 of an entity 210 (eg, a bed, etc.).

[0041] in accordance with Figure 2 In the device arrangement shown, the distance between the signal transmitting device 231 and the signal receiving device 232 is H, and the distance W / 2 is extended to both sides along the line between the signal transmitting device 231 and the signal receiving device 232. In other words, the width W of the rectangular area can be expressed by formula (1), thereby forming a rectangular sensing area 220.

[0042]

[0043] Among them, H represents the connection distance between the signal transmitting device 231 and the signal receiving device 232, that is, the length of the rectangular area; W represents the width of the rectangular area; λ represents the wavelength of the short-distance communication signal. Generally speaking, for a 2.4 GHz short-distance communication signal, λ is 13 cm; and for a 5 GHz short-distance communication signal, λ is 6 cm.

[0044] Moreover, from a top view, the line connecting the signal transmitting device 231 and the signal receiving device 232 passes through the central area 211. The central area 211 is formed by shrinking 1 / 2 of the side length inward based on the perimeter of the entity 210, that is, the central area 211 is the same as the center point of the entity 210, and the side length of the central area 211 is half of the side length of the entity 210.

[0045] It should be noted that the above-mentioned rectangular area is only used as an example to explain the scope of the perception area 220, so as to monitor the sleeping movements of the human body in the perception area 220 and improve the accuracy of movement recognition. Other unspecified perception areas are also within the protection scope of this application and will not be repeated here.

[0046] In some exemplary embodiments, a signal transmitting device and a signal receiving device perform short-range communication via at least one pair of transceiver antennas, and each pair of transceiver antennas carries multiple subcarriers.

[0047] The short-distance communication may be at least one of WiFi communication, ZigBee communication technology, Bluetooth communication or other short-distance communication. If the signal transmitting device (or, the signal receiving device) includes A transmitting antennas, and the signal receiving device (or, the signal transmitting device) includes B receiving antennas, then the logarithm of the transmitting and receiving antennas is A*B, and A and B are both integers greater than or equal to 1.

[0048] In an exemplary embodiment, dividing the short-distance communication data into multiple amplitude data sequences according to the data amplitude in step S102 may include: collecting channel state data transmitted on multiple subcarriers carried by each pair of transmitting and receiving antennas based on the number of sampling packets; extracting the amplitude data in the channel state data transmitted on the multiple subcarriers respectively, and constructing multiple amplitude data sequences based on the amplitude data in the channel state data transmitted on the multiple subcarriers.

[0049] The channel state data may be CSI data or channel frequency response (CFR) data for identifying human behavior.

[0050] CSI can be used to characterize the channel properties of a communication link, which describes the attenuation factor of a communication signal on each transmission path, such as the value of each element in the channel gain matrix. CFR data refers to the response data generated by a signal receiving device when a pulse signal is sent from a signal transmitting device. Due to multipath delay spread and Doppler shift, signal receiving devices at different locations have different CFR data. CFR data can be used to describe response data in multipath propagation, such as phase-frequency response data and / or amplitude-frequency response data.

[0051] In an exemplary embodiment, the number of amplitude data sequences is the same as the number of subcarriers, the number of sampling packets is a number determined based on a preset sampling duration and a preset sampling frequency, and each pair of transceiver antennas includes a transmitting antenna on a signal transmitting device and a receiving antenna on a signal receiving device.

[0052] For example, if the preset sampling frequency is set to the frequency f of reading the CSI signal, and the preset sampling duration T is the time length of a set of sleep turning monitoring sample data (such as CSI signal data and its corresponding label information, etc.), then the number of sampling packets = T / f.

[0053] It should be noted that by collecting channel state data transmitted on multiple subcarriers based on the number of sampling packets, richer data can be obtained; the amplitude data in the channel state data transmitted on multiple subcarriers are extracted separately, and based on the amplitude data in the channel state data transmitted on multiple subcarriers, multiple amplitude data sequences are constructed, so as to use multiple amplitude data sequences to accurately identify the movements of the human body in the perception area.

[0054] In some exemplary embodiments, performing step S103 of extracting multiple target data sequences from multiple amplitude data sequences according to the amplitude fluctuation degree includes:

[0055] Based on a preset filtering range, outlier data sequences in multiple amplitude data sequences are filtered out to obtain multiple first filtered data sequences; based on a preset filtering method, noise sequences in multiple first filtered data sequences are filtered out to obtain multiple second filtered data sequences; and differential processing is performed on the multiple second filtered data sequences respectively to obtain multiple target data sequences.

[0056] Among them, differential processing can reflect the differences between each data in the second filtered data sequence, and determine whether there is a change in the action through the difference, so that the obtained multiple target data sequences can reflect the change information of the action and improve the accuracy of action recognition.

[0057] In some exemplary embodiments, filtering outlier data sequences from a plurality of amplitude data sequences based on a preset filtering range to obtain a plurality of first filtered data sequences includes:

[0058] Based on a preset filtering range, multiple first data in each amplitude data sequence are screened respectively; when it is determined that the first data is not within the preset filtering range, the first data is determined to be outlier data in the amplitude data sequence; outlier data sequences including at least one outlier data in each amplitude data sequence are cleared respectively to obtain multiple first filtered data sequences.

[0059] Among them, outlier data is used to characterize discrete data that can reflect certain data rules in the amplitude data sequence. For example, there are 5 data in the amplitude data sequence, and 4 of them can reflect an action feature (that is, these 4 data are within the preset filtering range), but the remaining 5th data has completely different action features from the other 4 data (that is, the 5th data is not within the preset filtering range), then it can be determined that the 5th data is an outlier data.

[0060] By removing outlier data sequences including at least one discrete data in each amplitude data sequence, the obtained multiple first filtered data sequences can reflect a unified action feature, thereby improving the accuracy of action recognition.

[0061] In some exemplary embodiments, before filtering multiple first data in each amplitude data sequence based on a preset filtering range, it also includes: constructing a window sequence based on a preset window coefficient and a preset number of adjacent data in the extracted amplitude data sequence; determining a mean corresponding to the window sequence and a standard deviation corresponding to the window sequence based on each data in the window sequence and the number of data in the window sequence; determining a preset filtering range based on the mean corresponding to the window sequence, the standard deviation corresponding to the window sequence and the preset coefficient.

[0062] If the window coefficient is set to x, a preset number of adjacent data in the amplitude data sequence are randomly selected (for example, the i-th data and the x data to the left and right of the i-th data are extracted to obtain a window sequence including 2x+1 data, where i is an integer greater than or equal to 1 and less than m, and m represents the maximum value of the number of sequences included in the amplitude data sequence). In the window sequence, the mean μ of the 2x+1 data and the standard deviation σ of the 2x+1 data are calculated; thus, the preset filtering range can be determined to be [μ-α*σ,μ+α*σ], where α represents the preset coefficient (for example, the preset coefficient can be set to 2, 3, etc.).

[0063] By determining the preset filtering range in the above manner, the boundary value of the data to be filtered can be clearly identified, which facilitates the screening of multiple first data in each amplitude data sequence, thereby improving the accuracy of data screening.

[0064] In some exemplary embodiments, noise sequences in multiple first filtered data sequences are filtered out based on a preset filtering method to obtain multiple second filtered data sequences, including: performing wavelet decomposition on each first filtered data sequence based on a preset wavelet basis function to obtain a multi-layer decomposition sequence corresponding to each first filtered data sequence; screening sub-data sequences in the multi-layer decomposition sequence corresponding to each first filtered data sequence based on a preset coefficient threshold to obtain multiple screened data sequences; and reconstructing the multiple screened data sequences to obtain multiple second filtered data sequences.

[0065] The preset wavelet basis function may be a Haar function, a Daubechies function, a Biorthogonal function, etc. Each layer of decomposition sequence includes at least two sub-data sequences and wavelet coefficients corresponding to the sub-data sequences. In other words, each sub-data sequence corresponds to a wavelet coefficient, and each sub-data sequence can represent a high-pass or low-pass filtering characteristic.

[0066] It should be noted that, in the process of performing wavelet decomposition on each first filtered data sequence based on a preset wavelet basis function, the larger the number of decomposition layers, the more obvious the different characteristics of the noise signal and the useful signal, and the more conducive to separating the noise signal from the useful signal. However, if the number of decomposition layers is set to be larger, the greater the degree of distortion of the multiple second filtered data sequences obtained by reconstructing the multiple filtered data sequences, which will affect the effect of removing the noise signal. Therefore, it is necessary to select a suitable number of decomposition layers. For example, the number of decomposition layers is determined to be N, where N is a number determined based on the frequency band range and sampling frequency of the wavelet decomposition.

[0067] For example, if the N-layer decomposition sequence corresponding to each first filtered data sequence is set, the size of each frequency band is Wherein, Fs represents the sampling frequency corresponding to the first filtered data sequence to be screened. For example, when the sampling frequency corresponding to the first filtered data sequence is determined to be 1000 Hz (hz), it can be known from the sampling theorem that the maximum frequency of the first filtered data sequence pair is 500 Hz; then N can be set equal to 3.

[0068] Among them, the frequency band of the first-layer decomposition sequence is 250~500hz, and the approximate frequency band is less than 250hz; the frequency band of the second-layer decomposition sequence is 125~250hz, and the approximate frequency band is less than 125hz; the frequency band of the third-layer decomposition sequence is about 62.5~125hz, and the approximate frequency band is less than 62.5hz.

[0069] The above implementation method of performing wavelet decomposition on each first filtered data sequence based on a preset wavelet basis function to obtain a multi-layer decomposition sequence corresponding to each first filtered data sequence is only an example, and specific settings can be made according to actual conditions. Other unexplained implementation methods are also within the scope of protection of this application and will not be repeated here.

[0070] Specifically, when it is determined that the wavelet coefficient corresponding to the sub-data sequence is less than a preset coefficient threshold, the sub-data sequence corresponding to the wavelet coefficient is determined to be noise data, and the sub-data sequence (i.e., noise sequence) whose wavelet coefficient is less than the preset coefficient threshold in each layer of decomposition sequence is removed, thereby reducing noise interference.

[0071] Furthermore, the multiple filtered data sequences are reconstructed, for example, based on a preset arrangement order, the multiple filtered data sequences are sorted, so that the obtained multiple second filtered data sequences can not only reflect the characteristics of the original first filtered data sequences, but also eliminate noise interference, thereby facilitating the subsequent acquisition of clean data sequences.

[0072] In some exemplary embodiments, each second filtered data sequence includes m second filtered data, where m is the number of sampling packets; differential processing is performed on the multiple second filtered data sequences to obtain multiple target data sequences, including: for the multiple second data in each second filtered data sequence, based on a preset differential coefficient and a difference between the i-th data and the i-1-th data, determining the i-1th data in the target data sequence corresponding to the second filtered data sequence; repeating the above steps until i is equal to m, to obtain multiple target data sequences.

[0073] Among them, i is an integer greater than or equal to 1 and less than or equal to m; the number of target data sequences is the same as the number of subcarriers carried by each pair of transceiver antennas, the number of data in the target data sequence is m-1, and each pair of transceiver antennas includes a transmitting antenna on a signal transmitting device and a receiving antenna on a signal receiving device.

[0074] For example, the default differential coefficient can be set to 1, and for the form [x0, x1, ..., x m-2 , x m-1 ] is subjected to differential processing on the second filtered data sequence, multiple target data sequences [y0, y1, ..., y m-2 ]. Among them, y0 = x1-x0, y1 = x2-x1, ..., y m-2 =x m-1 -x m-2 .

[0075] The difference between the i-th data and the i-1-th data can reflect the change of the two data, so as to determine whether the human body's movements change at different times.

[0076] In some exemplary embodiments, determining the movement of a human body based on multiple target data sequences in step S104 includes: determining an input sequence of a target neural network based on target data sequences corresponding to multiple subcarriers; inputting the input sequence of the target neural network into the target neural network for recognition to determine the movement of the human body.

[0077] Among them, the target neural network is a network obtained by training the residual neural network through a preset training set, and the training set includes a sample data sequence and action annotation information corresponding to the sample data sequence.

[0078] For example, the target neural network may include residual blocks with multiple skip connections, which can alleviate the gradient vanishing problem caused by increasing the depth in the deep neural network, thereby improving the recognition accuracy of the data sequence.

[0079] In some exemplary embodiments, determining an input sequence of a target neural network based on target data sequences corresponding to a plurality of subcarriers includes: determining standard deviations of target data sequences corresponding to the plurality of subcarriers respectively; sorting the standard deviations of target data sequences corresponding to the plurality of subcarriers to obtain sorting results; based on the sorting results, extracting a preset number of target data sequences as input sequences of the target neural network, and adjusting data dimensions of the preset number of target data sequences so that the data dimensions of the preset number of target data sequences are the same as the data dimensions required by the target neural network;

[0080] Among them, the preset number is less than the maximum number of subcarriers. It should be noted that in the actual communication process, the maximum number of subcarriers can be 256. Processing data on multiple carriers requires a long time for the target neural network. Therefore, the standard deviation of multiple data sequences to be trained transmitted on each subcarrier can be calculated separately, and then the standard deviations of the target data sequences corresponding to the multiple subcarriers are sorted to obtain the sorting result.

[0081] For example, the maximum number of subcarriers is 256, and the preset number can be set to 30, 35, etc., that is, based on the sorting result, the target data sequence corresponding to the first 30 (or, the first 35) subcarriers is selected as the input sequence of the target neural network. This reduces the processing time of the target neural network for data and speeds up the recognition of human body movements.

[0082] For example, if the data dimension of the n target data sequences is set to 4 dimensions (e.g., the number of transmitting antennas of the signal transmitting device, the number of receiving antennas of the signal receiving device, the number of subcarriers, and the number of sampling packets), and the data dimension required by the target neural network is 3 dimensions, the data dimension of the n target data sequences can be adjusted from 4 dimensions to 3 dimensions. For example, the data dimension of the adjusted n target data sequences includes: the number of sampling packets, the number of subcarriers, and the number of pairs of transmitting and receiving antennas. In this way, the data dimension of the n target data sequences is the same as the data dimension required by the target neural network, which facilitates the use of the target neural network to identify the n target data sequences and improves the recognition accuracy of the human body movements to be identified.

[0083] In some exemplary embodiments, before inputting the input sequence of the target neural network into the target neural network for recognition and determining the movement of the human body, it also includes: training the residual neural network through a preset training set to obtain the target neural network.

[0084] The training set includes sample data sequences and action annotation information corresponding to the sample data sequences.

[0085] For example, Figure 3 A schematic diagram of using a preset training set to train a residual neural network provided in an embodiment of the present application. Figure 3 As shown, the sampling module 301, the amplitude extraction module 302, the filtering module 303, the differential processing module 304, the action labeling module 305 and the residual neural network 306 connected in communication can constitute a training system.

[0086] The sampling module 301 is used to collect multiple sample data sequences and use the multiple sample data sequences as data in the training set.

[0087] The amplitude extraction module 302 is used to extract the amplitude of each sample data sequence in the input training set. Since the sampling value of the CSI signal is a complex number, the amplitude value of the CSI signal needs to be extracted as the value in the sample data sequence.

[0088] The filtering module 303 is used to filter the data output by the amplitude extraction module 302 to filter out noise and discrete sequences. For example, Hampel filtering can be used to remove outlier sequences in the data; wavelet filtering can be used to filter out noise in the data, etc.

[0089] The differential processing module 304 is used to suppress the influence of the difference information of the CSI signal values ​​collected in different environments on the final training results, wherein a differential operation is performed on the data output by the filtering module 303 to obtain the change value of the CSI data caused by the change of the human body's movements during sleep, and the differential data sequence is used as the input sequence of the residual neural network 306, so that the residual neural network 306 can obtain a more accurate and reasonable training data sequence.

[0090] At the same time, it is also necessary to input the action annotation information corresponding to the sample data sequence output by the action label module 305 (such as at least one of the annotation information reflecting the turning over action of the human body during sleep, the annotation information of the leg stretching action, the annotation information of the hand stretching action, the annotation information of the head movement, the annotation information of the foot movement and the annotation information of the hand movement) into the residual neural network 306, and perform network model training at the same time, so that the training results (such as the model parameters of the network model obtained by training, etc.) are more accurate and can better reflect the action representation information.

[0091] Figure 4 A flow chart of a data collection method in the process of training a residual neural network provided in an embodiment of the present application. During the data collection process, the signal transmitting device and the signal receiving device need to establish a short-range communication connection (such as establishing a WiFi connection, etc.) throughout the process, and neither device can enter a dormant state. Among them, the signal receiving device can be one or more.

[0092] The data collection method includes but is not limited to the following steps:

[0093] Step S401, setting sampling parameters.

[0094] The sampling parameters may include at least one of the number of sampling packets, sampling duration, sampling interval duration, sampling frequency, and a network address of a signal receiving device. The number of sampling packets is determined based on a preset sampling duration and a transmission frequency of the channel state data.

[0095] For example, if the preset sampling frequency is set to f, and the preset sampling duration T is the time length of a group of sleep turning monitoring sample data (such as CSI signal data and its corresponding label information, etc.), then the number of sampling packets = T / f.

[0096] Step S402, start collecting channel status data.

[0097] For example, the channel state data may be CSI data and / or CFR data, etc.

[0098] Step S403: the sample human body changes its action.

[0099] The sample human body may perform any one or more of the following actions: turning over, leg stretching, hand stretching, head movement, foot movement and hand movement.

[0100] If the sample human body is performing a turning action, the action annotation information corresponding to the data collected during the turning action of the sample human body is the turning action annotation information, and the sample human body in the sensing area performs at least one turning action.

[0101] Similarly, if the sample human body is performing a leg stretching action, the action annotation information corresponding to the data collected during the sample human body's leg stretching action is the leg stretching action annotation information, and the sample human body within the perception area performs the leg stretching action at least once.

[0102] For example, the action annotation information can be represented using one-hot encoding (also known as one-bit effective encoding), where a K-bit state register is used to encode K states, each state has its own independent register bit, and at any time, only one bit is valid, and K is an integer greater than or equal to 1. For example, the set label [0,0,0,0,0,1] represents the turning action, [0,0,0,0,1,0] represents the leg stretching action, [0,0,0,1,0,0] represents the hand stretching action, [0,0,1,0,0,0] represents the head movement, [0,1,0,0,0,0] represents the foot movement, and [1,0,0,0,0,0] represents the hand movement.

[0103] Step S404, determining whether the collection of sampling data is completed.

[0104] If it is determined that the collection of the sampled data is completed, step S405 is executed; otherwise, the process returns to step S402 to continue collecting data.

[0105] Step S405, output the collected data.

[0106] In order to ensure that the actions performed by various groups during sleep can be correctly monitored and identified, the action data of various major groups (such as teenagers, adult males, adult females, the elderly, etc.) need to be collected during the data collection stage.

[0107] After it is determined that the collection of the sampled data is completed, the collected data may be output to a specific processing device (eg, a computer, etc.).

[0108] It should be noted that in the process of executing data collection, it is necessary to make action labels for the collected data. For example, if the action of the sample human body corresponding to the collected data sequence is a turning action, it is necessary to add action annotation information to the data sequence as the annotation information corresponding to the turning action; similarly, if the action of the sample human body corresponding to the collected data sequence is a leg stretching action, it is necessary to add action annotation information to the data sequence as the annotation information corresponding to the leg stretching action, and so on. In order to train the residual neural network based on different action annotation information and its corresponding data sequence, obtain the model parameters corresponding to different actions, and improve the recognition accuracy of different actions.

[0109] Figure 5 A schematic diagram of the process of training a residual neural network provided in an embodiment of the present application. Figure 5 As shown, the method for training the residual neural network includes but is not limited to the following steps.

[0110] Step S501, parsing the data file.

[0111] The data file includes data on multiple subcarriers. The maximum number of subcarriers can be 256. Processing the data on multiple carriers requires a long time for the target neural network. Therefore, the standard deviation of the multiple data sequences to be trained transmitted on each subcarrier can be calculated respectively. For example, the standard deviation is calculated using formula (2), and then the standard deviations of the multiple data sequences to be trained transmitted on the multiple subcarriers are sorted.

[0112]

[0113] in, represents the mean value of the data sequence; σ represents the standard deviation; y represents the data in the data sequence to be trained.

[0114] It should be noted that the standard deviation can characterize the degree of fluctuation of the data sequence to be trained; thus, a subcarrier with a more drastic fluctuation is selected as a target subcarrier for processing.

[0115] For example, the calculated standard deviations of the multiple training data sequences transmitted on the 256 subcarriers are [σ0, σ1, ..., σ 255 ], where, σ0>σ1>σ2…>σ 255 , the subcarrier data corresponding to the first 30 standard deviations can be selected as training data.

[0116] Step S502, extracting the amplitude of the training data sequence to obtain multiple amplitude data sequences.

[0117] The dimensions of the parsed data may include: the number of transmitting antennas of the signal transmitting device, the number of receiving antennas of the signal receiving device, the number of subcarriers, and the number of sampling packets, etc. The number of subcarriers is determined according to the short-range communication protocol (such as WiFi communication protocol, etc.) used between the signal transmitting device and the signal receiving device. In addition, the parsed data is a complex number (for example, the parsed data is represented by: a+bi, where a and b are both real numbers).

[0118] For example, a signal transmitting device and a signal receiving device communicate over a short distance through at least one pair of transceiver antennas, and each pair of transceiver antennas carries multiple subcarriers. The following operations are performed for each pair of transceiver antennas: channel state data transmitted on multiple subcarriers are collected according to the number of sampling packets; amplitude data in the channel state data transmitted on multiple subcarriers are extracted respectively, and multiple amplitude data sequences are constructed based on the amplitude data in the channel state data transmitted on multiple subcarriers.

[0119] Among them, the amplitude value A of the amplitude data (a+bi) can be expressed as: Then the amplitude data sequence can be represented as {A0, A1, ..., A n}, n is an integer greater than or equal to 1.

[0120] Step S503: filtering outlier data sequences from the multiple amplitude data sequences based on the Hampel filtering method to obtain multiple first filtered data sequences.

[0121] First, a window sequence is constructed based on the window coefficient and a preset number of adjacent data in the extracted amplitude data sequence; a mean corresponding to the window sequence and a standard deviation corresponding to the window sequence are determined according to each data in the window sequence and the number of data in the window sequence; a preset filtering range is determined according to the mean corresponding to the window sequence, the standard deviation corresponding to the window sequence and the preset coefficient.

[0122] For example, extract the i-th data in the amplitude data sequence, and the x data around the i-th data (a total of 2x+1 data) together to form a window sequence, where i is an integer greater than or equal to 1 and less than m, m represents the maximum number of sequences included in the amplitude data sequence, and x represents the window coefficient (e.g., the window coefficient can be set to 2, 3, etc.). In the window sequence, calculate the mean μ of 2x+1 data and the standard deviation σ of 2x+1 data; and determine the preset filtering range as [μ-α*σ,μ+α*σ], where α represents the preset coefficient (e.g., the preset coefficient can be set to 2, 3, etc.).

[0123] Based on the preset filtering range of [μ-α*σ,μ+α*σ], multiple first data in each amplitude data sequence are screened respectively, and when it is determined that a certain first data is not within the preset filtering range, the first data is determined to be an outlier data in the amplitude data sequence; the outlier data sequence including at least one discrete data in each amplitude data sequence is cleared respectively, and then the mean value μ is used to replace the above outlier data, so as to obtain multiple first filtered data sequences.

[0124] Step S504: filtering out noise sequences in the plurality of first filtered data sequences based on a wavelet filtering method to obtain a plurality of second filtered data sequences.

[0125] Among them, according to the preset wavelet basis function (such as Haar function, Daubechies function, Biorthogonal function, etc.), each first filtered data sequence is subjected to wavelet decomposition to obtain a multi-layer decomposition sequence (such as a 3-layer decomposition sequence or a 5-layer decomposition sequence, etc.) corresponding to each first filtered data sequence; wherein each layer of decomposition sequence includes at least two sub-data sequences and wavelet coefficients corresponding to the sub-data sequences.

[0126] Based on a preset coefficient threshold (for example, setting the threshold to 0.04, etc.), the sub-data sequences in the multi-layer decomposition sequence corresponding to each first filtered data sequence are screened to obtain multiple filtered data sequences (for example, the sub-data sequences corresponding to the wavelet coefficients greater than the preset coefficient threshold are retained, and the sub-data sequences less than or equal to the preset coefficient threshold are deleted, thereby obtaining multiple filtered data sequences); the multiple filtered data sequences are reconstructed to obtain multiple second filtered data sequences.

[0127] Step S505 , performing differential processing on the plurality of second filtered data sequences respectively to obtain a plurality of data sequences to be trained.

[0128] For example, for a value of the form [x0, x1, ..., x m-2 , x m-1 ], and perform differential processing using formula (3) to obtain multiple training data sequences [y0, y1, ..., y m-2 ].

[0129]

[0130] Wherein, d represents a differential coefficient. For example, d may be a coefficient determined by normalization or calibration. The value of d may be set to 1, 0.3, etc.; m represents the number of sampling packets.

[0131] It should be noted that since the data dimensions of the multiple data sequences to be trained are different from those of the input sequence of the target neural network, it is also necessary to adjust the data dimensions of the multiple data sequences to be trained. For example, the data dimensions of the multiple data sequences to be trained are adjusted to [(m-1)*30*1] so that the data dimensions of the adjusted multiple data sequences to be trained are the same as the data dimensions of the input sequence of the target neural network.

[0132] Step S506, training the residual neural network based on multiple data sequences to be trained to obtain a trained network model.

[0133] It should be noted that the data processing process is the same in the training process of the neural network model and the process of using the trained neural network model (i.e., the target neural network) to identify the human body, and both include data sampling, amplitude extraction, filtering, and differential processing.

[0134] Figure 6 This is a block diagram of the motion recognition system provided in the embodiment of the present application. Figure 6 As shown, the motion recognition system includes but is not limited to the following devices: a signal transmitting device 610 and a signal receiving device 620 .

[0135] The signal transmitting device 610 includes a short-distance communication chip 611 , a processor chip 612 , a storage module 613 and an output module 614 in communication connection; the signal receiving device 620 includes a short-distance communication chip 621 .

[0136] The sensing area 630 can be constructed by communicating and interacting with the short-range communication chip 611 in the signal transmitting device 610 and the short-range communication chip 621 in the signal receiving device 620 .

[0137] The output module 614 is used to output the perception results to a display screen or other interfaces to facilitate transmission of the perception results, and the signal receiving device 620 can be a mobile phone or other device containing a short-range communication chip.

[0138] The signal transmitting device 610 (or the signal receiving device 620) can be any one of the following devices: a wireless network card, a router, a CPE, a mobile phone, and other devices containing a short-range communication chip.

[0139] When both the signal transmitting device 610 and the signal receiving device 620 use short-distance communication signals for communication, their short-distance communication mode can be set to AP-STA mode, and the signal transmitting device and the signal receiving device always need to establish a short-distance communication connection and transmit data. In order to obtain a better action recognition effect, the short-distance communication signal used can be a signal transmitted based on a channel in the 5GHz frequency band.

[0140] Figure 7 Schematic diagram of a process for recognizing human body movements provided in an embodiment of the present application. The method for recognizing human body movements can be applied to the signal transmitting device 610. Figure 7 As shown, the method for identifying human body movements includes but is not limited to the following steps:

[0141] Step S701, setting sampling parameters.

[0142] Step S702, start collecting channel status data.

[0143] Step S703: the human body changes its action.

[0144] For example, the human body's movements change during sleep, such as turning over during sleep, leg stretching during sleep, hand stretching during sleep, head movement during sleep, foot movement during sleep, and hand movement during sleep.

[0145] Step S704, determining whether the sampling period has arrived.

[0146] If it is determined that the sampling period has been reached, step S705 is executed; if it is determined that the sampling period has not been reached, step S702 is continued to be executed.

[0147] Step S705, analyzing the collected data.

[0148] The dimensions of the parsed data may include: the number of transmitting antennas of the signal transmitting device, the number of receiving antennas of the signal receiving device, the number of subcarriers, and the number of sampling packets, etc. The number of subcarriers is determined according to the short-range communication protocol (such as WiFi communication protocol, etc.) used between the signal transmitting device and the signal receiving device. In addition, the parsed data is a complex number (for example, the parsed data is represented by: a+bi, where a and b are both real numbers).

[0149] For example, a signal transmitting device and a signal receiving device communicate over a short distance through at least one pair of transceiver antennas, and each pair of transceiver antennas carries multiple subcarriers. The following operations are performed for each pair of transceiver antennas: channel state data transmitted on multiple subcarriers are collected according to the number of sampling packets; amplitude data in the channel state data transmitted on multiple subcarriers are extracted respectively, and multiple amplitude data sequences are constructed based on the amplitude data in the channel state data transmitted on multiple subcarriers.

[0150] Among them, the amplitude value A of the amplitude data (a+bi) can be expressed as: Then the amplitude data sequence can be represented as {A0, A1, ..., An}, n is an integer greater than or equal to 1.

[0151] Furthermore, based on the Hampel filtering method, outlier data sequences in multiple amplitude data sequences are filtered out to obtain multiple first filtered data sequences. First, a window sequence is constructed based on the window coefficient and a preset number of adjacent data in the extracted amplitude data sequence; the mean corresponding to the window sequence and the standard deviation corresponding to the window sequence are determined according to each data in the window sequence and the number of data in the window sequence; the preset filtering range is determined according to the mean corresponding to the window sequence, the standard deviation corresponding to the window sequence and the preset coefficient.

[0152] For example, extract the i-th data in the amplitude data sequence, and the x data around the i-th data, so as to obtain a window sequence including 2x+1 data, where i is an integer greater than or equal to 1 and less than m, m represents the maximum number of sequences included in the amplitude data sequence, and x represents the window coefficient (e.g., the window coefficient can be set to 2, 3, etc.). In the window sequence, calculate the mean μ of 2x+1 data and the standard deviation σ of 2x+1 data; and determine the preset filtering range as [μ-α*σ,μ+α*σ], where α represents the preset coefficient (e.g., the preset coefficient can be set to 2, 3, etc.).

[0153] Based on the preset filtering range of [μ-α*σ,μ+α*σ], multiple first data in each amplitude data sequence are screened respectively, and when it is determined that a certain first data is not within the preset filtering range, the first data is determined to be an outlier data in the amplitude data sequence; the outlier data sequence including at least one discrete data in each amplitude data sequence is cleared respectively, and then the mean value μ is used to replace the above outlier data, so as to obtain multiple first filtered data sequences.

[0154] Then, according to a preset wavelet basis function (such as Haar function, Daubechies function, Biorthogonal function, etc.), each first filtered data sequence is subjected to wavelet decomposition to obtain a multi-layer decomposition sequence (such as a 3-layer decomposition sequence or a 5-layer decomposition sequence, etc.) corresponding to each first filtered data sequence; wherein each layer of decomposition sequence includes at least two sub-data sequences and wavelet coefficients corresponding to the sub-data sequences.

[0155] Based on a preset coefficient threshold (for example, setting the threshold to 0.04, etc.), the sub-data sequences in the multi-layer decomposition sequence corresponding to each first filtered data sequence are screened to obtain multiple filtered data sequences (for example, the sub-data sequences corresponding to the wavelet coefficients greater than the preset coefficient threshold are retained, and the sub-data sequences less than or equal to the preset coefficient threshold are deleted, thereby obtaining multiple filtered data sequences); the multiple filtered data sequences are reconstructed to obtain multiple second filtered data sequences.

[0156] Then, differential processing is performed on the multiple second filtered data sequences respectively to obtain multiple target data sequences.

[0157] For example, for a value of the form [x0, x1, ..., x n-2 , x n-1 ], and perform differential processing using formula (3) to obtain multiple target data sequences [y0, y1, ..., y n-2 ].

[0158] It should be noted that, since the data dimensions of the multiple target data sequences are different from those of the input sequence of the target neural network, it is also necessary to adjust the data dimensions of the multiple target data sequences, for example, to adjust the data dimensions of the multiple target data sequences to [(n-1)*30*1], so that the data dimensions of the adjusted multiple target data sequences are the same as the data dimensions of the input sequence of the target neural network. Where n represents the number of sampling packets.

[0159] Step S706, input the adjusted multiple target data sequences into the target neural network for recognition to obtain recognition results.

[0160] Among them, in order to improve the data processing efficiency, in an exemplary embodiment, a 10-layer res-net network can be used as the target neural network. In actual use, the level of the target neural network can be set according to actual needs. It is not limited to the res-net network structure. Other unspecified network structures are also within the scope of protection of this application and will not be repeated here.

[0161] Among them, the recognition result can be a label representing the action type, for example, setting the label [0,0,0,0,0,1] to represent a turning over action, [0,0,0,0,1,0] to represent a leg stretching action, [0,0,0,1,0,0] to represent a hand stretching action, [0,0,1,0,0,0] to represent a head movement, [0,1,0,0,0,0] to represent a foot movement, and [1,0,0,0,0,0] to represent a hand movement, etc.

[0162] Furthermore, the recognition result can also be displayed on a display screen, or the recognition result can be transmitted to other devices for use in upper-layer applications on other devices.

[0163] Step S707, determining whether wireless sensing is completed.

[0164] If it is determined that the wireless sensing is completed, the process ends; if it is determined that the wireless sensing is not completed, step S702 is continued.

[0165] In this embodiment, based on the short-distance communication protocol, a sensing area for sensing human body movements is constructed between the signal transmitting device and the signal receiving device. Without exposing the user's privacy, the collected short-distance communication data in the sensing area is processed to obtain multiple amplitude data sequences, so that the acquired amplitude data sequences are more complete and accurate; further, the multiple amplitude data sequences are pre-processed based on the differential method, so that the obtained multiple target data sequences can better reflect the characteristics of human body movements and match the input sequence of the target neural network; and then the multiple target data sequences are input into the target neural network for identification, human body movements are determined, and the recognition accuracy of human body movements is improved. In addition, there is no need to worry about the device falling off, and compared with the technical solution of using wearable devices to monitor movements during sleep, more accurate movement recognition can be performed.

[0166] The human motion monitoring method in the present application can quantify the number of turning over movements of a human body during sleep, which can not only be used as one of the data for evaluating personal sleep quality, but also can be used as an important reference data for diagnosing certain diseases; it can also be applied to monitor the turning over movements of the elderly and / or infants during sleep, and then report the monitoring results to the guardian to prevent the human body from falling off the bed, etc.

[0167] The following is a detailed description of the device according to the embodiment of the present application in conjunction with the accompanying drawings. Figure 8 FIG. 1 is a block diagram showing the composition of the motion recognition device provided by the embodiment of the present application. Figure 8 As shown, the motion recognition device 800 includes but is not limited to the following modules.

[0168] The collection module 801 is configured to collect short-range communication data within the sensing area.

[0169] The data processing module 802 is configured to divide the short-distance communication data into a plurality of amplitude data sequences according to the data amplitude.

[0170] The extraction module 803 is configured to extract multiple target data sequences from multiple amplitude data sequences according to the amplitude fluctuation degree.

[0171] The recognition module 804 is configured to monitor human body movements based on multiple target data sequences.

[0172] It should be noted that the motion recognition device 800 in this embodiment can implement any human motion monitoring method in the embodiments of the present application.

[0173] According to the device of the embodiment of the present application, the short-distance communication data within the perception area is collected by the acquisition module, so that the data within the perception area can be obtained without exposing the user's privacy; the short-distance communication data is divided into multiple amplitude data sequences according to the data amplitude to obtain multiple amplitude data sequences that can reflect the amplitude information; multiple target data sequences are extracted from the multiple amplitude data sequences according to the amplitude fluctuation degree, so that the obtained multiple target data sequences can better reflect the characteristics of human body movements; and then the human body movements are monitored based on the multiple target data sequences to improve the accuracy of recognizing human body movements.

[0174] It should be clear that the present application is not limited to the specific configurations and processes described in the above embodiments and shown in the figures. For the convenience and brevity of description, a detailed description of the known methods is omitted here, and the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, which will not be repeated here.

[0175] Fig. 9 A structural diagram showing an exemplary hardware architecture of a computing device capable of implementing the human motion monitoring method and apparatus according to an embodiment of the present application.

[0176] like Fig. 9 As shown, the computing device 900 includes an input device 901, an input interface 902, a central processing unit 903, a memory 904, an output interface 905, and an output device 906. The input interface 902, the central processing unit 903, the memory 904, and the output interface 905 are connected to each other via a bus 907, and the input device 901 and the output device 906 are connected to the bus 907 via the input interface 902 and the output interface 905, respectively, and then connected to other components of the computing device 900.

[0177] Specifically, the input device 901 receives input information from the outside and transmits the input information to the central processing unit 903 through the input interface 902; the central processing unit 903 processes the input information based on the computer executable instructions stored in the memory 904 to generate output information, temporarily or permanently stores the output information in the memory 904, and then transmits the output information to the output device 906 through the output interface 905; the output device 906 outputs the output information to the outside of the computing device 900 for user use.

[0178] In one embodiment, Fig. 9 The computing device shown can be implemented as an electronic device, which may include: a memory configured to store a program; a processor configured to run the program stored in the memory to execute the human motion monitoring method described in the above embodiment.

[0179] In one embodiment, Fig. 9 The computing device shown can be implemented as a system, which may include: a memory configured to store a program; a processor configured to run the program stored in the memory to execute the human motion monitoring method described in the above embodiment.

[0180] The above is only an exemplary embodiment of the present application and is not intended to limit the scope of protection of the present application. In general, various embodiments of the present application can be implemented in hardware or special circuits, software, logic or any combination thereof. For example, some aspects can be implemented in hardware, while other aspects can be implemented in firmware or software that can be executed by a controller, a microprocessor or other computing device, although the present application is not limited thereto.

[0181] Embodiments of the present application may be implemented by executing computer program instructions by a processor of the motion recognition device, for example in a processor entity, or by hardware, or by a combination of software and hardware. The computer program instructions may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages.

[0182] The block diagram of any logic flow in the accompanying drawings of the present application can represent program steps, or can represent interconnected logic circuits, modules and functions, or can represent a combination of program steps and logic circuits, modules and functions. The computer program can be stored on a memory. The memory can have any type suitable for the local technical environment and can be implemented using any suitable data storage technology, such as but not limited to read-only memory (ROM), random access memory (RAM), optical memory device and system (digital versatile disc DVD or CD disc), etc. Computer-readable media may include non-transient storage media. The processor can be any type suitable for the local technical environment, such as but not limited to a general-purpose computer, a special-purpose computer, a microprocessor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a programmable logic device (FGPA) and a processor based on a multi-core processor architecture.

[0183] By way of exemplary and non-limiting examples, a detailed description of exemplary embodiments of the present application has been provided above. However, various modifications and adjustments to the above embodiments will be apparent to those skilled in the art when considered in conjunction with the accompanying drawings and claims, but will not depart from the scope of the present application. Therefore, the proper scope of the present application will be determined according to the claims.

Claims

1. A human motion monitoring method, characterized in that: The method comprises: Collect short-range communication data within the sensing area; Dividing the short-distance communication data into a plurality of amplitude data sequences according to the data amplitude; Extracting multiple target data sequences from the multiple amplitude data sequences according to the amplitude fluctuation degree; The human body motion is monitored based on the multiple target data sequences.

2. The method according to claim 1, characterized in that: The sensing area is an area for sensing the human body motion, which is constructed based on the short-distance communication data interacting between the signal transmitting device and the signal receiving device.

3. The method according to claim 2, characterized in that The method of dividing the short-distance communication data into a plurality of amplitude data sequences according to the data amplitude includes: According to the number of sampling packets, channel state data transmitted on multiple subcarriers carried by each pair of transceiver antennas are collected, wherein the number of sampling packets is a number determined based on a preset sampling duration and a preset sampling frequency, and each pair of transceiver antennas includes a transmitting antenna on the signal transmitting device and a receiving antenna on the signal receiving device; The amplitude data in the channel state data transmitted on the multiple subcarriers are respectively extracted, and the multiple amplitude data sequences are constructed based on the amplitude data in the channel state data transmitted on the multiple subcarriers, wherein the number of the amplitude data sequences is the same as the number of the subcarriers.

4. The method according to claim 1, characterized in that The step of extracting a plurality of target data sequences from the plurality of amplitude data sequences according to the amplitude fluctuation degree comprises: Filter outlier data sequences from the plurality of amplitude data sequences based on a preset filtering range to obtain a plurality of first filtered data sequences; Filter out noise sequences in the plurality of first filtered data sequences based on a preset filtering method to obtain a plurality of second filtered data sequences; The plurality of second filtered data sequences are differentially processed to obtain a plurality of target data sequences.

5. The method according to claim 4, characterized in that The step of filtering out outlier data sequences from the plurality of amplitude data sequences based on a preset filtering range to obtain a plurality of first filtered data sequences comprises: Based on a preset filtering range, respectively filter the plurality of first data in each of the amplitude data sequences; In a case where it is determined that the first data is not within the preset filtering range, determining that the first data is outlier data in the amplitude data sequence; Outlier data sequences including at least one outlier data in each of the amplitude data sequences are removed respectively to obtain a plurality of the first filtered data sequences.

6. The method according to claim 4, characterized in that Before filtering the plurality of first data in each of the amplitude data sequences based on the preset filtering range, the human motion monitoring method further includes: Constructing a window sequence based on a preset window coefficient and a preset number of adjacent data extracted from the amplitude data sequence; Determine a mean value corresponding to the window sequence and a standard deviation corresponding to the window sequence according to each data in the window sequence and the amount of data in the window sequence; The preset filtering range is determined according to a mean value corresponding to the window sequence, a standard deviation corresponding to the window sequence, and a preset coefficient.

7. The method according to claim 4, characterized in that The filtering out noise sequences in the plurality of first filtered data sequences based on a preset filtering method to obtain a plurality of second filtered data sequences includes: Based on a preset wavelet basis function, performing wavelet decomposition on each of the first filtered data sequences to obtain a multi-layer decomposition sequence corresponding to each of the first filtered data sequences, wherein each layer of the decomposition sequence includes at least two sub-data sequences and wavelet coefficients corresponding to the sub-data sequences; Based on a preset coefficient threshold, sub-data sequences in the multi-layer decomposition sequence corresponding to each first filtered data sequence are screened to obtain a plurality of screened data sequences; The multiple filtered data sequences are reconstructed to obtain multiple second filtered data sequences.

8. The method according to claim 4, characterized in that Each of the second filtered data sequences includes m second filtered data, where m is the number of sampling packets; The performing differential processing on the plurality of second filtered data sequences respectively to obtain the plurality of target data sequences comprises: For each of the plurality of second data in the second filtered data sequence, determine the i-1th data in the target data sequence corresponding to the second filtered data sequence according to a preset differential coefficient and a difference between the i-th data and the i-1th data, where i is an integer greater than or equal to 1 and less than or equal to m; Repeat the above steps until i is equal to m, and obtain multiple target data sequences; The number of the target data sequences is the same as the number of subcarriers carried by each pair of transceiver antennas, the number of data in the target data sequence is m-1, and each pair of transceiver antennas includes a transmitting antenna on a signal transmitting device and a receiving antenna on a signal receiving device.

9. The method according to claim 8, characterized in that The determining of the human body's motion based on the multiple target data sequences comprises: Determining an input sequence of a target neural network based on a target data sequence corresponding to the plurality of subcarriers; Inputting the input sequence of the target neural network into the target neural network for recognition to determine the movement of the human body; The target neural network is a network obtained by training the residual neural network with a preset training set, wherein the training set includes a sample data sequence and action labeling information corresponding to the sample data sequence.

10. The method according to claim 9, characterized in that The step of determining an input sequence of a target neural network based on a target data sequence corresponding to the plurality of subcarriers comprises: respectively determining standard deviations of target data sequences corresponding to the plurality of subcarriers; Sorting standard deviations of target data sequences corresponding to the plurality of subcarriers to obtain a sorting result; Based on the sorting result, extract a preset number of the target data sequences as input sequences of the target neural network, and adjust the data dimensions of the preset number of target data sequences so that the data dimensions of the preset number of target data sequences are the same as the data dimensions required by the target neural network; The preset number is smaller than the maximum number of subcarriers.

11. The method according to claim 2, characterized in that The sensing area is a rectangular area. Among them, the length of the rectangular area is the connection distance between the signal transmitting device and the signal receiving device, the width of the rectangular area is the length determined based on the wavelength of the collected short-distance communication signal, the preset adjustment coefficient and the connection distance between the signal transmitting device and the signal receiving device, the signal transmitting device and the signal receiving device are on a horizontal plane at the same height, and the height difference between the horizontal plane and the horizontal level of the human body is within a preset difference range.

12. An electronic device, characterized in that: include: one or more processors; A memory having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a human motion monitoring method as described in any one of 1 to 11.

13. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the human body motion monitoring method as described in any one of 1 to 11 is implemented.