Low-power-consumption system device for human motion state detection

Abstract

The utility model relates to a low-power-consumption system device for human body motion state detection, which belongs to the technical field of motion state monitoring, comprises an information acquisition device and a data processing and display device, is a human body motion state detection device combining a sensor and a micro-control unit, and is used for timely identifying and timely feeding back a human body motion state. And through the ergonomic design, the device is convenient to wear by human bodies. The information acquisition device is used for acquiring motion data and wirelessly transmitting the acquired data to the data processing and display device, the data processing and display device is used for processing and displaying the acquired data, and the information acquisition device and the data processing and display device are in Bluetooth signal connection to transmit data information. All-dimensional multi-angle motion detection of the human body can be achieved, the recognition range is wide, accuracy is high, wearing is convenient, and the application prospect is wide.

Description

Technical Field

[0001] The invention belongs to the technical field of motion state monitoring, and in particular relates to a low-power consumption system device for detecting the motion state of a human body. Background Art

[0002] Early human motion gait recognition technology mainly relied on positioning marker recognition technology and ground pressure device recognition technology, but the cost of related instruments and consumables was high, which was not conducive to large-scale routine use.

[0003] At present, the research on motion pattern detection at home and abroad mainly focuses on gait recognition through vision, and also uses sensors to collect specific motion values ​​and human body conditions and other data for processing to establish a system. For example, Tang Biao, Fan Qirun, Sun Kaixin, etc. Application of human posture recognition algorithm in visual human-computer interaction [J] uses dual cameras as a device for collecting human motion devices, but it is limited by the limited field of view and angle coverage of the camera, dependence on position and angle, and susceptibility to ambient light and conditions. It is difficult to realize all-round and multi-angle motion detection of the human body. Therefore, in recent years, many scholars have proposed using sensors as human motion information collection devices, and equipped with neural network algorithms to realize human motion detection. For example, in 2022, Xu Ran, Xu Youxiong, Zheng Xuanyu, etc. published a paper entitled "Research on human motion state recognition and monitoring based on acceleration sensors", but the recognition method mentioned in the paper is to collect information with the help of sensors and then use computer matlab for calculation. This recognition method is difficult to implement in life. Summary of the invention

[0004] Technical problem to be solved: In order to avoid the shortcomings of the prior art, the present invention provides a low-power system device for detecting human motion status, which is a human motion status detection device that combines a sensor with a microcontroller unit, and is used for timely identification and timely feedback of human motion status, and is ergonomically designed to be easy for human body to wear.

[0005] The technical solution of the present invention is: a low-power system device for detecting human motion state, comprising an information collection device and a data processing and display device; the information collection device is used to collect motion data and wirelessly transmit the collected data to the data processing and display device; the data processing and display device is used to process and display the collected data; the information collection device and the data processing and display device are connected by Bluetooth signals;

[0006] The information acquisition device comprises: a main shell, a first system board installed in the main shell, a first physical switch, a first Bluetooth module, a first battery, a first voltage conversion module, a first display screen, a sub-shell, and a first six-axis sensor; the main shell is worn on the waist of the user, and the first system board is fixed to the inner cavity of the main shell for controlling the information acquisition device; the first battery is electrically connected to the input end of the first voltage conversion module, and the output end of the first voltage conversion module is electrically connected to the first system board, the first display screen, the first Bluetooth module, and the first six-axis sensor respectively to supply power to them; the first physical switch, the first Bluetooth module, and the first display screen are all electrically connected to the first system board, wherein the first physical switch is used to turn on or off the first system board, the first Bluetooth module is used for the first system board to receive and transmit data, and the first display screen is used for information display of the first system board; the sub-shell is worn above the knee joint of the user, and the first six-axis sensor is installed in the sub-shell and electrically connected to the first system board for collecting human leg data and transmitting the data to the first system board;

[0007] The data processing and display device comprises: a shell, a second system board installed in the shell, a second physical switch, a second Bluetooth module, a second battery, a second voltage conversion module, a second display screen, a second six-axis sensor, and a heart rate blood oxygen sensor; the shell is worn on the wrist of the user, and the second system board is fixed to the inner cavity of the shell for controlling the data processing and display device; the second battery is electrically connected to the input end of the second voltage conversion module, and the output end of the second voltage conversion module is electrically connected to the second system board, the second display screen, the second Bluetooth module, the second six-axis sensor, and the heart rate blood oxygen sensor respectively to supply power for them; the second physical switch, the second Bluetooth module, the second display screen, the second six-axis sensor, and the heart rate blood oxygen sensor are all electrically connected to the second system board, wherein the second physical switch is used to turn on or off the second system board, the second Bluetooth module is used for the second system board to receive and transmit data, the second display screen is used for information display of the second system board, the second six-axis sensor is used to collect human wrist data and transmit the data to the second system board, and the heart rate blood oxygen sensor is used to collect user heart rate blood oxygen data and transmit the data to the second system board.

[0008] A further technical solution of the present invention is: the first system board is an STM32F407ZGT6 system board, the first six-axis sensor is an MPU6050 six-axis sensor, the first Bluetooth module is an HC-05 Bluetooth module, and the first display screen is a TFT LCD display screen.

[0009] A further technical solution of the present invention is: the first battery is a 3V battery, and the first voltage conversion module is provided with a 5V boost module and a 3.3V boost module, the output end of the 5V boost module is connected to the power port of the first system board to supply power thereto; the output end of the 3.3V boost module is respectively electrically connected to the power ports of the first display screen, the first Bluetooth module, and the first six-axis sensor to supply power thereto.

[0010] A further technical solution of the present invention is: the PF1 serial port of the first system board is connected to the SCL serial port of the first six-axis sensor as a clock line for synchronous data transmission; the PF0 serial port of the first system board is connected to the SDA serial port of the first six-axis sensor as a data line for transmitting the data collected by the first six-axis sensor to the first system board; the PB5 serial port of the first system board is connected to the SDI serial port of the first display screen for writing the SPI bus data signal of the first display screen; the SDO serial port of the first display screen is connected to the PB4 serial port of the first system board for reading the SPI bus data signal of the first display screen; the TXD serial port of the first Bluetooth module is connected to the PB11 serial port of the first system board for the first Bluetooth module to send data to the first system board; the PB10 serial port of the first system board is connected to the RXD serial port of the first Bluetooth module for the first system board to send command data to the first Bluetooth module.

[0011] A further technical solution of the present invention is: the first six-axis sensor is used to collect the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, the angular velocity in the X-axis direction, the angular velocity in the Y-axis direction, and the angular velocity in the Z-axis direction of the human body's legs.

[0012] A further technical solution of the present invention is: the second system board is an STM32F407VET6 system board, the second Bluetooth module is an HC-05 Bluetooth module, the second display is a color TFT LCD display GC9A01, the second six-axis sensor is an MPU6050 six-axis sensor, and the heart rate blood oxygen sensor is MAX30102.

[0013] A further technical solution of the present invention is: the second battery is a 3V battery, and the second voltage conversion module is provided with a 5V boost module and a 3.3V boost module, the output end of the 5V boost module is connected to the power port of the second system board to supply power thereto; the output end of the 3.3V boost module is respectively electrically connected to the power ports of the second display screen, the second Bluetooth module, the second six-axis sensor, and the heart rate and blood oxygen sensor to supply power thereto.

[0014] A further technical solution of the present invention is: the A8 serial port of the second system board is connected to the SCL serial port of the second six-axis sensor as a clock line for synchronous data transmission; the SDA serial port of the second six-axis sensor is connected to the C9 serial port of the second system board as a data line for transmitting the data collected by the second six-axis sensor to the second system board; the A8 serial port of the second system board is connected to the SCL serial port of the heart rate and blood oxygen sensor as a clock line for synchronous data transmission; the SDA serial port of the heart rate and blood oxygen sensor is connected to the C9 serial port of the second system board as a data line for transmitting the data collected by the heart rate and blood oxygen sensor to the second system board. The data is transmitted to the second system board; the B9 serial port of the second system board is connected to the SCL serial port of the second display screen as a clock line for synchronous data transmission; the SDA serial port of the second display screen is connected to the B8 serial port of the second system board as a data line for transmitting the display information of the second system board to the second display screen; the TXD serial port of the second Bluetooth module is connected to the B11 serial port of the second system board, which is used for the second Bluetooth module to send data to the second system board; the B10 serial port of the second system board is connected to the RXD serial port of the second Bluetooth module, which is used for the second system board to send command data to the second Bluetooth module.

[0015] A further technical solution of the present invention is: the second six-axis sensor is used to collect the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, the angular velocity in the X-axis direction, the angular velocity in the Y-axis direction, and the angular velocity in the Z-axis direction of the human wrist, and calculates the collected data into the cumulative number of steps and transmits it to the second system board.

[0016] A further technical solution of the present invention is: the first Bluetooth module acts as a slave, and the second Bluetooth module acts as a host. When the information collection device, the data processing and display device are turned on, the second Bluetooth module is paired and connected with the first Bluetooth module, and the second Bluetooth module receives the data transmitted by the first Bluetooth module.

[0017] Beneficial Effects

[0018] The beneficial effects of the present invention are as follows: the low-power system device for detecting human motion state described in the present invention is based on the construction and implementation of a multi-sensor fusion network of STM32MCU, and a multi-sensor fusion network is constructed using an STM32 microcontroller unit (MCU), which can simultaneously receive and integrate data from different sensors, such as a six-axis sensor, a heart rate blood oxygen sensor, an accelerometer, a gyroscope, a magnetometer, etc., to obtain comprehensive human motion information. Based on the low-power consumption characteristics of STM32MCU, the information collection device, data processing and display device constructed have low energy consumption and are convenient for practical use.

[0019] The first system board and the second system board of the present invention adopt STM32 microcontroller units, making the entire device an open system. As the current mainstream industrial chip, STM32 MCU can be used for most power-assisted exoskeleton devices. The device reserves some IO ports in advance, which can be connected to other devices to achieve interconnection with other devices. For example, it can be applied to power-assisted exoskeletons for motion recognition and human motion trend prediction, realizing close coupling between the human body and wearable devices.

[0020] The present invention is based on the integrated design of wearable product system of ergonomics. The designed information collection device, data processing and display device are worn on the user's body to realize real-time monitoring and data collection of human body movement status. The main shell, sub-shell and outer shell are all made of 3D printing, and the structural shape conforms to the ergonomic design. By matching the corresponding straps, they are worn on the user's waist, legs and wrists respectively to ensure good wearing comfort and stability. The parts in each shell also follow the ergonomic design to ensure that it can be worn for a long time without causing discomfort. The structure of the present invention is lightweight, beautiful and easy to wear.

[0021] The first system board and the second system board in the present invention are based on the BP neural network artificial intelligence algorithm, which can accurately identify key information such as the stride, step frequency, heel and toe landing time, movement mode and movement phase of human movement, and the recognition range is more accurate. Compared with the existing human movement monitoring equipment on the market that can only do simple step count statistics, the present invention collects and calibrates a certain scale of human movement sample information, and realizes a high-accuracy human movement perception and recognition algorithm by building and optimizing the algorithm structure and parameters.

[0022] Compared with the existing technology, the present invention can realize all-round and multi-angle motion detection of the human body, with a wide recognition range and high accuracy. As an open system, it can also be compatible with other requirements and has high practicality. The device of the present invention has the characteristics of miniaturization, integration, and intelligence, and is used in many fields such as daily motion monitoring of the general public and human motion perception of wearable systems, and has broad application prospects. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 This is an exploded schematic diagram of the information collection device of the present invention;

[0024] Figure 2 This is a schematic diagram of the appearance of the information collection device of the present invention;

[0025] Figure 3 It is an exploded schematic diagram of the data processing and display device of the present invention;

[0026] Figure 4 This is a schematic diagram of the appearance of the data processing and display device of the present invention;

[0027] Figure 5 It is the system principle diagram of the present invention;

[0028] Figure 6 This is a serial port connection diagram of the information collection device of the present invention;

[0029] Figure 7 This is a serial port connection diagram of the data processing and display device of the present invention;

[0030] Figure 8 It is the BP neural network training diagram of the present invention;

[0031] Fig. 9 This is a data processing framework diagram for the system of the present invention.

[0032] Description of reference numerals:

[0033] 1. Information collection device, 11. Main housing, 11-1. Shell cover of the main housing, 12. First system board, 13. First physical switch, 14. First Bluetooth module, 15. First battery, 16. First voltage conversion module, 17. First display screen, 18. Secondary housing, 18-1. Shell cover of the secondary housing, 19. First six-axis sensor;

[0034] 2. Data processing and display device, 21. Casing, 21-1. Casing cover, 22. Second system board, 23. Second physical switch, 24. Second Bluetooth module, 25. Second battery, 26. Second voltage conversion module, 27. Second display screen, 28. Second six-axis sensor, 29. Heart rate and blood oxygen sensor. DETAILED DESCRIPTION

[0035] The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, but should not be construed as limiting the present invention.

[0036] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0037] The low-power system device for detecting human motion status described in the present invention is a human motion status detection device that combines a sensor with a microcontroller unit, can realize timely recognition and feedback of all-round and multi-angle human motion, and is easy to wear by the human body through the ergonomic design of the device.

[0038] See also Figure 1-9 , a low-power system device for detecting human motion status described in the present invention includes an information collection device 1 and a data processing and display device 2. The main body of the information collection device 1 is worn on the user's waist, and the motion sensor therein is worn on the user's leg. The information collection device 1 is used to collect human motion data and wirelessly transmit the collected data to the data processing and display device 2. The data processing and display device 2 is worn on the user's wrist, and can be worn on the left or right wrist according to the user's habits. The data processing and display device 2 is used to process the collected data and display the user's motion status. The information collection device 1 and the data processing and display device 2 are connected via a Bluetooth signal, and data is transmitted between the two. See. Figure 5 Schematic diagram of the system of the present invention.

[0039] See also Figure 1 The information collection device 1 includes: a main shell 11 worn around the waist of the user through a belt, a first system board 12, a first physical switch 13, a first Bluetooth module 14, a first battery 15, a first voltage conversion module 16, and a first display screen 17 installed in the main shell 11, a sub-shell 18 worn 10 cm above the knee joint of the user through a belt, and a first six-axis sensor 19 installed in the sub-shell 18.

[0040] The first system board 12 is fixed to the inner cavity of the main housing 11. The first system board 12 adopts the STM32F407ZGT6 system board and is used for the overall control of the information collection device 1. Figure 6 The first battery 15 adopts a 3V battery box, and the output end of the first battery 15 is equipped with a first voltage conversion module 16, which is used to increase the 3V voltage to 3.3V and 5V, wherein the output end of the 5V voltage is electrically connected to the power port of the first system board 12 to power it; the output end of the 3.3V voltage is electrically connected to the power ports of the first display screen 17, the first Bluetooth module 14, and the first six-axis sensor 19 respectively to power them.

[0041] The first physical switch 13, the first Bluetooth module 14, and the first display screen 17 are all electrically connected to the first system board 12, wherein the first physical switch 13 is used to turn on or off the first system board 12, and a first physical switch 13 button is provided on the shell cover 11-1 of the main shell 11, which is used to operate the first physical switch 13. The first Bluetooth module 14 adopts an HC-05 Bluetooth module, which is used for the first system board 12 to receive and transmit data. The first display screen 17 adopts a 2.4-inch TFT LCD display screen, which is used to display information of the first system board 12. In order to facilitate viewing the display information of the first system board 12, a display window is provided on the shell cover 11-1 of the main shell 11, and the display window matches the first display screen 17.

[0042] The auxiliary housing 18 is worn above the left knee joint or the right knee joint of the user. The auxiliary housing 18 is provided with a housing cover 18-1. The first six-axis sensor 19 is installed in the auxiliary housing 18. Figure 2 , the power port of the first six-axis sensor 19 is connected to the output end of the 3.3V voltage in the main housing 11 through a power line to supply power to it; the first six-axis sensor 19 is electrically connected to the first system board 12, and is used to transmit the human leg data collected by the first six-axis sensor 19 to the first system board 12, and the first six-axis sensor 19 receives the control command of the first system board 12. Specifically, the first six-axis sensor 19 adopts the MPU6050 six-axis sensor, and the sensor will collect six data each time, namely, the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, the angular velocity in the X-axis direction, the angular velocity in the Y-axis direction, and the angular velocity in the Z-axis direction of the human leg. The sensor adopts the XYZ space coordinate system, and the origin and the X-axis, Y-axis, and Z-axis directions adopt the default definition of the sensor. By transmitting these six data to the first system board 12, the first system board 12 will define the collected six data as independent variables, and substitute them into the pre-trained BP neural network algorithm for calculation. The algorithm will output any one of the four values ​​0, 1, 2, and 3 (where 0 represents a stationary state, 1 represents a walking state, 2 represents a running state, and 3 represents a going up and down stairs state). Then, the first system board 12 will use the first Bluetooth module 14 to transmit the calculated value to the data processing and display device 2 via Bluetooth transmission.

[0043] See also Figure 6 The serial port connection mode of each module in the information acquisition device 1 is as follows: the PF1 serial port of the first system board 12 is connected to the SCL serial port of the first six-axis sensor 19 as a clock line for synchronous data transmission. The PF0 serial port of the first system board 12 is connected to the SDA serial port of the first six-axis sensor 19 as a data line for transmitting data between devices, and the data collected by the first six-axis sensor 19 is transferred to the first system board 12.

[0044] The PB5 serial port of the first system board 12 is connected to the SDI (MOSI) serial port of the first display screen 17, which is used for the SPI bus data write signal of the first display screen 17; the SDO (MISO) serial port of the first display screen 17 is connected to the PB4 serial port of the first system board 12, which is used for the SPI bus data read signal of the first display screen 17. The LED serial port of the first display screen 17 is connected to the PB13 serial port of the first system board 12, which is used for the backlight control signal transmission of the first display screen 17; the SCK serial port of the first display screen 17 is connected to the PB3 serial port of the first system board 12, which is used for the SPI bus clock signal transmission of the first display screen 17; the DC serial port of the first display screen 17 is connected to the PB14 serial port of the first system board 12, which is used for the data or command control signal transmission of the first display screen 17; the RESET serial port of the first display screen 17 is connected to the PB12 serial port of the first system board 12, which is used for the reset control signal transmission of the first display screen 17; the CS serial port of the first display screen 17 is connected to the PB15 serial port of the first system board 12, which is used for the chip select control signal transmission of the first display screen 17.

[0045] The TXD serial port of the first Bluetooth module 14 is connected to the PB11 serial port of the first system board 12, so as to send data from the first Bluetooth module 14 to the first system board 12; the PB10 serial port of the first system board 12 is connected to the RXD serial port of the first Bluetooth module 14, so as to send instruction data from the first system board 12 to the first Bluetooth module 14; the PF6 serial port of the first system board 12 is connected to the EN serial port of the first Bluetooth module 14, so as to enable or disable the first Bluetooth module 14; the PC0 serial port of the first system board 12 is connected to the STATE serial port of the first Bluetooth module 14, so as to read the status of the first Bluetooth module 14.

[0046] See also Figure 3-4 The data processing and display device 2 includes: a shell 21 worn on the wrist of the user through a strap, a second system board 22 installed in the shell 21, a second physical switch 23, a second Bluetooth module 24, a second battery 25, a second voltage conversion module 26, a second display screen 27, a second six-axis sensor 28, and a heart rate and blood oxygen sensor 29.

[0047] The housing 21 is provided with a detachable housing cover 21 - 1 , and the second system board 22 is fixed to the inner cavity of the housing 21 . The second system board 22 uses the STM32F407VET6 minimum system board for data processing and control of the display device 1 . Figure 7The second battery 25 adopts a 3V battery box, and the output end of the second battery 25 is equipped with a second voltage conversion module 26. The second voltage conversion module 26 is used to increase the 3V voltage to 3.3V and 5V, wherein the output end of the 5V voltage is electrically connected to the power port of the second system board 22 to power it; the output end of the 3.3V voltage is electrically connected to the power ports of the second display screen 27, the second Bluetooth module 24, the second six-axis sensor 28, and the heart rate blood oxygen sensor 29 respectively to power them.

[0048] The second physical switch 23, the second Bluetooth module 24, the second display screen 27, the second six-axis sensor 28, and the heart rate blood oxygen sensor 29 are all electrically connected to the second system board 22, wherein the second physical switch 23 is used to turn on or off the second system board 22, and a button for the second physical switch 23 is provided on the outer shell cover 21-1, so as to facilitate the operation of the second physical switch 23. The second Bluetooth module 24 adopts the HC-05 Bluetooth module, which is used for the second system board 22 to receive and transmit data. When working, the second Bluetooth module 24 acts as a host, and the first Bluetooth module 14 acts as a slave. When the information collection device 1 and the data processing and display device 2 are turned on, the second Bluetooth module 24 is paired with the first Bluetooth module 14, and the second Bluetooth module 24 receives the data transmitted by the first Bluetooth module 14, that is, the motion state data processed by the first system board 12 in the information collection device 1: 0, 1, 2, 3. The second system board 22 will convert the data 0, 1, 2, 3 into its corresponding motion state, including stillness, walking, running, going up and down stairs, and display it on the second display screen 27 in Chinese characters. The second display screen 27 adopts a 1.28-inch circular color TFT LCD display screen GC9A01, which is used to display information of the second system board 22. At the same time, a viewing window matching the second display screen 27 is provided on the outer shell cover 21-1, which is convenient for displaying information. The second six-axis sensor 28 adopts an MPU6050 six-axis sensor, which is used to collect human wrist data and transmit the data to the second system board 22. Specifically, the second six-axis sensor 28 collects the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, the angular velocity in the X-axis direction, the angular velocity in the Y-axis direction, and the angular velocity in the Z-axis direction of the human wrist. The microprocessor module of the second six-axis sensor 28 itself will directly calculate the cumulative number of steps and transmit it to the second system board 22, and then the second system board 22 will display the step information on the second display screen 27. The heart rate and blood oxygen sensor 29 uses MAX30102. The heart rate and blood oxygen sensor 29 collects light signals and directly converts them into specific heart rate and blood oxygen data, and transmits the data to the second system board 22. The second system board 22 then displays the user's heart rate and blood oxygen data on the second display screen 27.

[0049] See also Figure 7, the serial port connection mode of each module in the data processing and display device 2 is as follows: the A8 serial port of the second system board 22 is connected to the SCL serial port of the second six-axis sensor 28 as a clock line for synchronous data transmission; the SDA serial port of the second six-axis sensor 28 is connected to the C9 serial port of the second system board 22 as a data line for transmitting data between devices, and the user step data collected by the second six-axis sensor 28 is transferred to the second system board 22. The heart rate blood oxygen sensor 29 and the second six-axis sensor 28 share the IO serial port of the second system board 22, and the A8 serial port of the second system board 22 is connected to the SCL serial port of the heart rate blood oxygen sensor 29 as a clock line for synchronous data transmission; the SDA serial port of the heart rate blood oxygen sensor 28 is connected to the C9 serial port of the second system board 22 as a data line for transmitting data between devices, and the data collected by the heart rate blood oxygen sensor 29 is transferred to the second system board 22.

[0050] The B9 serial port of the second system board 22 is connected to the SCL serial port of the second display screen 27 as a clock line for synchronous data transmission; the SDA serial port of the second display screen 27 is connected to the B8 serial port of the second system board 22 as a data line for transmitting data between devices and transferring the display information of the second system board 22 to the second display screen 27; the BLK serial port of the second display screen 27 is connected to the B5 serial port of the second system board 22 for backlight control signal transmission of the second display screen 27; the CS serial port of the second display screen 27 is connected to the B4 serial port of the second system board 22 for chip select control signal transmission of the second display screen 27; the DC serial port of the second display screen 27 is connected to the B7 serial port of the second system board 22 for data / command control signal transmission of the second display screen 27; the RES serial port of the second display screen 27 is connected to the B6 serial port of the second system board 22 for reset control signal transmission of the second display screen 27.

[0051] The TXD serial port of the second Bluetooth module 24 is connected to the B11 serial port of the second system board 22, which is used for the second Bluetooth module 24 to send data to the second system board 22; the B10 serial port of the second system board 22 is connected to the RXD serial port of the second Bluetooth module 24, which is used for the second system board 22 to send command data to the second Bluetooth module 24; the C0 serial port of the second system board 22 is connected to the STATE serial port of the second Bluetooth module 24, which is used to read the status of the second Bluetooth module 24; the D0 serial port of the second system board 22 is connected to the EN serial port of the second Bluetooth module 24, which is used to enable or disable the second Bluetooth module 24.

[0052] The present invention realizes the perception and recognition of human motion based on the BP neural network artificial intelligence algorithm. The BP neural network is used as the core of the artificial intelligence algorithm. By training a large amount of human motion sample data, the system can accurately recognize key information such as the stride, step frequency, heel and toe landing time, motion mode and motion phase of human motion. Figure 8-9 When the human motion state detection device of the present invention is working, the first system board 12 first reads the data set collected by the first six-axis sensor 19, wherein the input data is the speed and acceleration measured by the first six-axis sensor 19, and the output data is four motion states. The data set is divided into a training set and a test set. After initializing the training parameters, the program starts to enter forward propagation. The sigmoid activation function is used in the hidden layer for regularization. In order to achieve multi-classification, the softmax activation function is used in the output layer to mark the output data as a quaternion vector, wherein [1,0,0,0] represents walking, [0,1,0,0] represents running, [0,0,1,0] represents going upstairs, and [0,0,0,1] represents going downstairs. After each forward propagation, the cross entropy loss value is calculated, which is used as the basis for judging the convergence of the program. After each forward propagation, the gradient descent method is used to update the neural network weights and biases until the loss value converges. At this time, the iteration stops, and the weights and biases updated for the last time are used as the final parameters, and the neural network training is completed. After the neural network training is completed, the algorithm will automatically calculate the human body's motion state in real time based on the data collected by the first six-axis sensor 19. After starting the program, the human body motion posture data collected by the first six-axis sensor 19 is first received in real time. If there are no abnormal values ​​in the input data, the program will first normalize the real-time data, and then the data will be forward propagated along the BP neural network. After reaching the hidden layer, the sigmod activation function of the hidden layer will regularize the data once. After reaching the output layer, the softmax function will output a four-dimensional probability vector, and the sum of the probabilities of these four data is 1. The neural network predicts the motion state of which category based on the position where the data with the highest probability appears. The second six-axis sensor 28 and the heart rate blood oxygen sensor 29 do not need to be calculated and processed. After collecting the data, these two sensors have their own microprocessing modules, which can directly perform simple processing on the collected signals, and the processed data is the required data.

[0053] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations on the present invention. A person skilled in the art may change, modify, replace and modify the above embodiments within the scope of the present invention without departing from the principles and intent of the present invention.

Claims

1. A low-power system device for detecting human motion status, characterized in that: It includes an information collection device and a data processing and display device; the information collection device is used to collect human body motion data and transmit the collected data to the data processing and display device; the data processing and display device is used to process and display the collected data; A Bluetooth signal connection between the information collection device and the data processing and display device; The information acquisition device comprises: a main shell, a first system board installed in the main shell, a first physical switch, a first Bluetooth module, a first battery, a first voltage conversion module, a first display screen, a sub-shell, and a first six-axis sensor; the main shell is worn on the waist of the user, and the first system board is fixed to the inner cavity of the main shell for controlling the information acquisition device; the first battery is electrically connected to the input end of the first voltage conversion module, and the output end of the first voltage conversion module is electrically connected to the first system board, the first display screen, the first Bluetooth module, and the first six-axis sensor respectively to supply power to them; the first physical switch, the first Bluetooth module, and the first display screen are all electrically connected to the first system board, wherein the first physical switch is used to turn on or off the first system board, the first Bluetooth module is used for the first system board to receive and transmit data, and the first display screen is used for information display of the first system board; the sub-shell is worn above the knee joint of the user, and the first six-axis sensor is installed in the sub-shell and electrically connected to the first system board for collecting human leg data and transmitting the data to the first system board; The data processing and display device comprises: a shell, a second system board installed in the shell, a second physical switch, a second Bluetooth module, a second battery, a second voltage conversion module, a second display screen, a second six-axis sensor, and a heart rate blood oxygen sensor; the shell is worn on the wrist of the user, and the second system board is fixed to the inner cavity of the shell for controlling the data processing and display device; the second battery is electrically connected to the input end of the second voltage conversion module, and the output end of the second voltage conversion module is electrically connected to the second system board, the second display screen, the second Bluetooth module, the second six-axis sensor, and the heart rate blood oxygen sensor respectively to supply power for them; the second physical switch, the second Bluetooth module, the second display screen, the second six-axis sensor, and the heart rate blood oxygen sensor are all electrically connected to the second system board, wherein the second physical switch is used to turn on or off the second system board, the second Bluetooth module is used for the second system board to receive and transmit data, the second display screen is used for information display of the second system board, the second six-axis sensor is used to collect human wrist data and transmit the data to the second system board, and the heart rate blood oxygen sensor is used to collect user heart rate blood oxygen data and transmit the data to the second system board.

2. The low-power system device for detecting human motion state according to claim 1, characterized in that: The first system board is an STM32F407ZGT6 system board, the first six-axis sensor is an MPU6050 six-axis sensor, the first Bluetooth module is an HC-05 Bluetooth module, and the first display screen is a TFT LCD display screen.

3. The low-power system device for detecting human motion state according to claim 2, characterized in that: The first battery is a 3V battery, and the first voltage conversion module is provided with a 5V boost module and a 3.3V boost module. The output end of the 5V boost module is connected to the power port of the first system board to supply power thereto; the output end of the 3.3V boost module is respectively electrically connected to the power ports of the first display screen, the first Bluetooth module, and the first six-axis sensor to supply power thereto.

4. The low-power consumption system device for detecting human motion state according to claim 2, characterized in that: The PF1 serial port of the first system board is connected to the SCL serial port of the first six-axis sensor as a clock line for synchronous data transmission; the PF0 serial port of the first system board is connected to the SDA serial port of the first six-axis sensor as a data line for transmitting the data collected by the first six-axis sensor to the first system board; The PB5 serial port of the first system board is connected to the SDI serial port of the first display screen, and is used for the SPI bus data write signal of the first display screen; the SDO serial port of the first display screen is connected to the PB4 serial port of the first system board, and is used for the SPI bus data read signal of the first display screen; The TXD serial port of the first Bluetooth module is connected to the PB11 serial port of the first system board, so that the first Bluetooth module sends data to the first system board; the PB10 serial port of the first system board is connected to the RXD serial port of the first Bluetooth module, so that the first system board sends command data to the first Bluetooth module.

5. The low-power consumption system device for detecting human motion state according to claim 2, characterized in that: The first six-axis sensor is used to collect the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, the angular velocity in the X-axis direction, the angular velocity in the Y-axis direction, and the angular velocity in the Z-axis direction of the human body's legs.

6. The low-power consumption system device for detecting human motion state according to claim 1, characterized in that: The second system board is the STM32F407VET6 system board, the second Bluetooth module is the HC-05 Bluetooth module, the second display is the color TFT LCD display GC9A01, the second six-axis sensor is the MPU6050 six-axis sensor, and the heart rate blood oxygen sensor is the MAX30102.

7. The low-power consumption system device for detecting human motion state according to claim 6, characterized in that: The second battery is a 3V battery, and the second voltage conversion module is provided with a 5V boost module and a 3.3V boost module. The output end of the 5V boost module is connected to the power port of the second system board to supply power thereto; the output end of the 3.3V boost module is respectively electrically connected to the power ports of the second display screen, the second Bluetooth module, the second six-axis sensor, and the heart rate and blood oxygen sensor to supply power thereto.

8. The low-power consumption system device for detecting human motion state according to claim 6, characterized in that: The A8 serial port of the second system board is connected to the SCL serial port of the second six-axis sensor as a clock line for synchronous data transmission; the SDA serial port of the second six-axis sensor is connected to the C9 serial port of the second system board as a data line for transmitting the data collected by the second six-axis sensor to the second system board; the A8 serial port of the second system board is connected to the SCL serial port of the heart rate and blood oxygen sensor as a clock line for synchronous data transmission; the SDA serial port of the heart rate and blood oxygen sensor is connected to the C9 serial port of the second system board as a data line for transmitting the data collected by the heart rate and blood oxygen sensor to the second system board. Second system board; the B9 serial port of the second system board is connected to the SCL serial port of the second display screen as a clock line for synchronous data transmission; the SDA serial port of the second display screen is connected to the B8 serial port of the second system board as a data line for transmitting the display information of the second system board to the second display screen; the TXD serial port of the second Bluetooth module is connected to the B11 serial port of the second system board, for the second Bluetooth module to send data to the second system board; the B10 serial port of the second system board is connected to the RXD serial port of the second Bluetooth module, for the second system board to send command data to the second Bluetooth module.

9. The low-power consumption system device for detecting human motion state according to claim 6, characterized in that: The second six-axis sensor is used to collect the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, the angular velocity in the X-axis direction, the angular velocity in the Y-axis direction, and the angular velocity in the Z-axis direction of the human wrist, and calculates the collected data into the cumulative number of steps and transmits it to the second system board.

10. The low-power consumption system device for detecting human motion state according to claim 6, characterized in that: The first Bluetooth module acts as a slave, and the second Bluetooth module acts as a host. When the information collection device and the data processing and display device are turned on, the second Bluetooth module is paired and connected with the first Bluetooth module, and the second Bluetooth module receives data transmitted by the first Bluetooth module.

Images