Old people travel navigation system based on Beidou positioning system

Abstract

The invention discloses an old people travel navigation system based on a Beidou positioning system. The system is composed of an intelligent waist bag, a server and a WeChat applet. The intelligent waist bag is integrated with a main controller STM32F407, a Beidou positioning module, a three-axis acceleration sensor, a heart rate blood oxygen module, a voice module and a key module, data such as acceleration and heart rate are processed through a Kalman filtering algorithm, and falling early warning is achieved in combination with a falling detection algorithm. The server carries an AI model to provide chat accompanying service, and can call a Baidu navigation API to generate a travel path. The WeChat applet displays the position, the heart rate and the blood oxygen data in real time, and the fall emergency response is supported. The system innovatively adopts double-color physical keys, voice recognition and TTS synthesis technologies, the equipment use threshold is effectively reduced, a'terminal monitoring-cloud service-family affection interconnection 'closed loop is constructed, and the problems that old people are difficult to go out, and intelligent equipment is complex to operate are effectively solved.

Description

Technical Field

[0001] The present invention discloses an elderly travel navigation system based on the Beidou positioning system, belonging to the technical field of intelligent elderly care. Background Art

[0004] In order to improve the travel experience of the elderly and solve the problems of difficult travel for the elderly and complex operation of intelligent devices to the greatest extent, especially considering the deficiencies of existing solutions. The present invention proposes an elderly travel navigation system based on the Beidou positioning system. Summary of the Invention

[0005] The object of the present invention is to propose an elderly travel navigation system based on the Beidou positioning system to solve the problems of difficult travel for the elderly and complex operation of intelligent devices to the greatest extent and further improve the travel experience of the elderly.

[0006] Specifically, the present invention includes the following steps:

[0007] Ⅰ The system mainly includes an intelligent waist pack, a server and a WeChat mini-program; the intelligent waist pack includes a main controller STM32F407, a communication module, a power module, and a data acquisition module;

[0008] Ⅱ The data acquisition module includes a Beidou positioning module, a three-axis acceleration sensor, a heart rate and blood oxygen sensor, a button module and a voice module for collecting position data, acceleration, pitch angle, heart rate data, blood oxygen data and audio data;

[0009] Ⅲ The communication module is responsible for data communication between the main controller STM32F407, the server and the WeChat mini-program;

[0010] Ⅳ The main controller STM32F407 processes the collected data, judges whether the elderly person has fallen; detects whether the blue (or green) button is pressed; transmits the fall detection result, button detection result and processed data to the server through the communication module;

[0011] Ⅴ The server is equipped with an AI model for providing chat services; in addition, the Baidu Navigation API is called on the server to provide high-quality travel route planning services;

[0012] Ⅵ The WeChat mini-program retrieves data from the server and displays the position data, heart rate data and blood oxygen data of the elderly; after the system judges that the elderly person has fallen, it forcibly enters the emergency mode, and at the same time establishes a connection between the elderly person and their family members on the WeChat mini-program.

[0013] Among them, the main controller STM32F407 processes the collected data to determine whether the elderly person has fallen; detects whether the blue (or green) button is pressed; and transmits the fall detection result, button detection result, and processed data to the server through the communication module. It at least further includes the following steps:

[0014] The main controller STM32F407 uses Kalman filtering to filter the collected acceleration data, pitch angle, heart rate data, and blood oxygen data, aiming to eliminate the noise in the original data and make the data smoother and more accurate; performs normalization processing on the collected acceleration data, pitch angle, heart rate data, and blood oxygen data to eliminate the influence of different dimensions to a certain extent and maintain the differences of data with different indicators;

[0015] The main controller STM32F407 performs noise reduction processing, sampling rate and format standardization, frame segmentation and lengthening, and normalization processing on the collected audio data;

[0016] The main controller STM32F407 adopts a fall detection algorithm based on SVM, calculates the resultant acceleration |a| and the parameter b representing the data dispersion degree using the filtered acceleration data, and performs static detection and normal activity detection by setting the resultant acceleration threshold, data dispersion degree threshold, and angular velocity threshold to determine whether the elderly person has fallen;

[0017] Detects whether the blue (or green) button is pressed through the external interrupt of the main controller STM32F407;

[0018] Finally, transmits the processed data, fall detection judgment result, and button detection result to the server through the communication module;

[0019] Among them, the server in step Ⅴ is equipped with an AI model for providing a chatting service; in addition, the Baidu Navigation API is called on the server to provide a high-quality travel route planning service. It at least further includes the following steps:

[0020] If the server receives a green button instruction, it starts the chat mode of the system; calls the Baidu Speech Recognition API to convert the received audio data into speech text data; then, inputs the speech text into the function that calls the AI model to obtain the feedback speech text data; finally, transmits the speech text data to the main controller STM32F407 through the communication module, and the main controller STM32F407 controls the speech module to perform voice broadcast.

[0021] If the server receives a blue button instruction, it starts the navigation mode of the system; calls the Baidu Speech Recognition API to convert the received audio data into speech text data; then, inputs the speech text into the function that calls the Baidu Navigation API to obtain the result of path planning; finally, transmits the result of path planning to the main controller STM32F407 through the communication module, and the main controller STM32F407 controls the speech module to perform voice broadcast;

[0022] Among them, in step VI, the WeChat mini-program retrieves data from the server and displays the location data, heart rate data, and blood oxygen data of the elderly; after the system determines that the elderly has fallen, it forcibly enters the emergency mode, and at the same time establishes a connection between the elderly and their family members on the WeChat mini-program. It should at least further include the following steps:

[0023] The location data, heart rate data, and blood oxygen data of the elderly can be viewed in real time on the WeChat mini-program;

[0024] When the system detects that the elderly has fallen, it interrupts any currently executing state and forcibly enters the emergency mode;

[0025] Through the speech module, it broadcasts "Falling detected, notifying relatives"; at the same time, it sends a push to the elderly's family members on the WeChat mini-program and controls the phone to vibrate to remind the family members;

[0026] Establish a connection between the elderly and their family members on the WeChat mini-program; BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is the workflow diagram of the present invention;

[0028] Figure 2 is the data transmission diagram of the present invention;

[0029] Figure 3 is the workflow diagram of step IV of the present invention;

[0030] Figure 4 is the workflow diagram of step V of the present invention;

[0031] Figure 5 is the workflow diagram of step VI of the present invention;

[0032] Figure 6 is the effect diagram of the WeChat mini-program of the present invention; SPECIFIC IMPLEMENTATION METHOD

[0034] The present invention will be described in detail below with reference to the accompanying drawings. The description in this part is only exemplary and explanatory, and should not have any restrictive effect on the protection scope of the present invention. In addition, those skilled in the art can make corresponding combinations of the features in the embodiments and different embodiments in this document according to the description of this document.

[0035] Figure 1 This is the workflow diagram of the present invention. The specific implementation steps are as follows:

[0036] Ⅰ The system mainly includes an intelligent waist pack, a server, and a WeChat mini-program. The intelligent waist pack includes a main controller STM32F407, a communication module, a power supply module, and a data acquisition module.

[0037] Ⅱ The data acquisition module includes a Beidou positioning module, a three-axis acceleration sensor, a heart rate and blood oxygen sensor, a button module, and a voice module for collecting position data, acceleration, pitch angle, heart rate data, blood oxygen data, and audio data.

[0038] Ⅲ The communication module is responsible for data communication between the main controller STM32F407, the server, and the WeChat mini-program.

[0039] Ⅳ The main controller STM32F407 processes the collected data to determine whether the elderly person has fallen; detects whether the blue (or green) button is pressed; and transmits the fall detection result, button detection result, and processed data to the server through the communication module.

[0040] Ⅴ The server is equipped with an AI model for providing chat services. In addition, the Baidu Navigation API is called on the server to provide high-quality travel route planning services.

[0041] Ⅵ The WeChat mini-program retrieves data from the server and displays the location data, heart rate data, and blood oxygen data of the elderly person. After the system determines that the elderly person has fallen, it forcibly enters the emergency mode, and at the same time establishes a connection between the elderly person and their family members on the WeChat mini-program.

[0042] Among them, in step Ⅳ, the main controller STM32F407 processes the collected data to determine whether the elderly person has fallen; detects whether the blue (or green) button is pressed; and transmits the fall detection result, button detection result, and processed data to the server through the communication module. It at least further includes the following steps:

[0043] The main controller STM32F407 uses Kalman filtering to filter the collected acceleration data, pitch angle, heart rate data, and blood oxygen data, aiming to remove the noise in the original data and make the data smoother and more accurate; performs normalization processing on the collected acceleration data, pitch angle, heart rate data, and blood oxygen data to eliminate the influence of different dimensions to a certain extent and maintain the difference of different index data.

[0044] The main controller STM32F407 performs noise reduction processing, sampling rate and format standardization, frame splitting and lengthening, and normalization processing on the collected audio data.

[0045] The main controller STM32F407 adopts a fall detection algorithm based on SVM to calculate the resultant acceleration a and the dispersion b;

[0046] The calculation formula for the resultant acceleration |a| is:

[0047]

[0048] where a x、 a y、 a z are the acceleration values of the X, Y, and Z axes respectively;

[0049] The calculation formula for the dispersion is:

[0050] b = σ(a) / μ(a)

[0051] where σ(a) refers to the standard deviation of a, and μ(a) refers to the mean value of a;

[0052] By setting the resultant acceleration threshold, dispersion threshold, and angular velocity threshold, static detection and normal activity detection are performed to determine whether the elderly person has fallen;

[0053] The EXTI external interrupt of the main controller STM32F407 is used to detect whether the blue (or green) button is pressed;

[0054] Finally, the processed data, fall detection results, and button detection results are transmitted to the server through the communication module;

[0055] Among them, the server carries an AI model for providing chat services; in addition, the Baidu Navigation API is called on the server to provide high-quality travel route planning services, and at least the following steps are also included:

[0056] The server carries a lightweight AI model (ERNIE3.0Tiny), which supports multi-round conversations and context understanding;

[0057] After the server receives the green button instruction, it starts the chat mode of the system;

[0058] Initialize the dialogue context container to store multi-round dialogue information and provide context support for the subsequent AI model;

[0059] Send a start signal to the main controller STM32F407 to make the main controller STM32F407 control the voice module to broadcast "The chat mode has been started";

[0060] Call the Baidu Speech Recognition API to convert the received audio data into speech text data. If the recognition fails, send a control instruction to the main controller STM32F407 to make the main controller STM32F407 control the speech module to broadcast "Speech recognition failed, please try again"; at the same time, detect whether the speech instruction "End chat" to end the chat mode is recognized, and end the current chat mode if detected;

[0061] Input the recognized speech text into the dialogue context container, and input the text containing context information into the function that calls the AI model (ERNIE3.0Tiny) to obtain the feedback speech text data. If it is detected that the AI model (ERNIE3.0Tiny) responds correctly, control the speech module to broadcast "Thinking, please wait a moment" through the main controller STM32F407 and add the feedback result to the dialogue context container. Otherwise, control the speech module to broadcast "Sorry, I can't give a reply for the moment. Please try again later" through the main controller STM32F407; at the same time, retain the current context and wait for the next input;

[0062] Finally, call the Baidu Text-to-Speech API to convert the feedback speech text data into TTS speech, return the binary audio stream, transmit the data to the main controller STM32F407 through the communication module, and the main controller STM32F407 controls the speech module to perform speech broadcast;

[0063] If the server receives the blue button instruction, start the navigation mode of the system. The server sends a start signal to the main controller STM32F407 to make the main controller STM32F407 control the speech module to broadcast "Navigation has been enabled. Please tell me your destination";

[0064] Subsequently, call the Baidu Speech Recognition API to convert the received audio data into speech text data; if the termination instruction "Exit navigation mode" is recognized, the server exits the navigation mode. The server sends a termination instruction to the main controller STM32F407, and the main controller STM32F407 controls the speech module to broadcast "The current navigation has ended", and then stops the speech broadcast; if the speech recognition fails, the server sends a control instruction to the main controller STM32F407 to make the main controller STM32F407 control the speech module to broadcast "Speech recognition failed, please try again";

[0065] Then, input the speech text into the function that calls the Baidu Navigation API to obtain navigation instructions, and the navigation instructions will be continuously updated according to the location data of the elderly;

[0066] Finally, convert the navigation instructions into TTS voice, return the binary audio stream, and transmit the data to the main controller STM32F407 through the communication module. The main controller STM32F407 controls the voice module to play the voice;

[0067] It should be added that: at each stage of navigation, the system is detecting the voice instruction "stop navigation" to terminate navigation. When this instruction is detected, the server immediately stops operations such as API calls and data processing related to navigation. The main controller STM32F407 controls the voice module to announce "the current navigation has ended", and finally stops the announcement;

[0068] Among them, the WeChat mini-program retrieves data from the server and displays the location data, heart rate data, and blood oxygen data of the elderly. After the system determines that the elderly has fallen, it forcibly enters the emergency mode. At the same time, it establishes a connection between the elderly and their family members on the WeChat mini-program. It at least further includes the following steps:

[0069] Realtime display the location data, heart rate data, and blood oxygen data of the elderly on the WeChat mini-program;

[0070] When the system detects that the elderly has fallen, interrupt any currently executing state and forcibly enter the emergency mode;

[0071] Announce through the voice module "fall detected, notifying relatives"; at the same time, push a strong reminder (red pop-up window and continuous vibration) to the elderly's family members on the WeChat mini-program, and display the location data, heart rate data, blood oxygen data, and the timestamp of the fall of the elderly;

[0072] Establish a connection between the elderly and their family members on the WeChat mini-program. The family members directly send voice text to the server on the WeChat mini-program. After the server converts the text data into a binary audio stream, it is transmitted to the main controller STM32F407 through the communication module. The main controller STM32F407 controls the voice module to play the announcement; at the same time, the main controller STM32F407 controls the voice module to collect the voice information emitted by the elderly and upload it to the server. The server calls the Baidu speech recognition API to convert the audio data into voice text, and after processing, the text is pushed to the WeChat mini-program for display.

[0073] Compared with the prior art, the advantages of the above embodiments of the present invention are as follows:

[0074] The elderly travel navigation system based on Beidou positioning proposed by the present invention realizes the deep integration of age-friendly interaction design and intelligent safety monitoring by constructing a bimodal system of voice interaction and navigation services. The intelligent waist pack carried by the system integrates a multi-sensor array, uses the Kalman filtering algorithm to denoise the acceleration and pitch angle data, and combines with the SVM fall detection model to achieve fall detection. The innovative voice interaction system integrates Baidu speech recognition and TTS synthesis technology, and cooperates with two-color physical buttons (blue for navigation and green for chatting), reducing the learning cost of the device and effectively solving the problem of operating intelligent devices for the elderly; a three-level emergency response system is constructed through a WeChat mini-program: when a fall is detected, the system automatically triggers voice alarms, strong WeChat reminders (red pop-up windows and continuous vibrations), and direct voice connections with family members, and synchronously uploads location data, heart rate data, and blood oxygen data, effectively improving the fall response efficiency. Through multi-modal data fusion technology, this system upgrades the traditional single health monitoring to a three-dimensional guardianship system of "safety + companionship + service", constructs a complete ecological closed-loop of "terminal monitoring - cloud service - family connection", and provides an innovative solution for solving the travel problems of the elderly.

[0075] Finally, it should be noted that the above are only the preferred embodiments of the present invention and are not used to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An elderly travel navigation system based on the Beidou positioning system, characterized in that, It includes the following steps: Ⅰ The system mainly includes an intelligent waist pack, a server, and a WeChat mini-program; the intelligent waist pack includes a main controller STM32F407, a communication module, a power module, and a data acquisition module; Ⅱ The data acquisition module includes a Beidou positioning module, a three-axis acceleration sensor, a heart rate and blood oxygen sensor, a button module, and a voice module for collecting position data, acceleration, pitch angle, heart rate data, blood oxygen data, and audio data; Ⅲ The communication module is responsible for data communication between the main controller STM32F407, the server, and the WeChat mini-program; Ⅳ The main controller STM32F407 processes the collected data to determine whether the elderly person has fallen; detects whether the blue (or green) button is pressed; and transmits the fall detection result, button detection result, and processed data to the server through the communication module; Ⅴ The server is equipped with an AI model for providing chat services; in addition, the Baidu Navigation API is called on the server to provide high-quality travel route planning services; Ⅵ The WeChat mini-program retrieves data from the server and displays the location data, heart rate data, and blood oxygen data of the elderly person; after the system determines that the elderly person has fallen, it forcibly enters the emergency mode, and at the same time establishes a connection between the elderly person and their family members on the WeChat mini-program.

2. The elderly travel navigation system based on the Beidou positioning system according to claim 1, wherein In step Ⅳ, the main controller STM32F407 processes the collected data to determine whether the elderly person has fallen; detects whether the blue (or green) button is pressed; and transmits the fall detection result, button detection result, and processed data to the server through the communication module, and at least further includes the following steps: The main controller STM32F407 uses Kalman filtering to filter the collected acceleration data, pitch angle, heart rate data, and blood oxygen data, aiming to eliminate the noise in the original data and make the data smoother and more accurate; normalizes the collected acceleration data, pitch angle, heart rate data, and blood oxygen data to eliminate the influence of different dimensions to a certain extent and maintain the difference of different index data; The main controller STM32F407 performs noise reduction processing, sampling rate and format standardization, frame splitting and lengthening, and normalization processing on the collected audio data; The main controller STM32F407 adopts a fall detection algorithm based on SVM, calculates the resultant acceleration |a| and the parameter b representing the data dispersion degree using the filtered acceleration data, and determines whether the elderly person has fallen by setting the resultant acceleration threshold, data dispersion degree threshold, and angular velocity threshold for static detection and normal activity detection; Detects whether the blue (or green) button is pressed through the external interrupt of the main controller STM32F407; Finally, the processed data, fall detection result, and button detection result are transmitted to the server through the communication module.

3. The elderly travel navigation system based on the Beidou positioning system according to claim 1, characterized in that, In step Ⅴ, the server is equipped with an AI model for providing chat services; in addition, the Baidu Navigation API is called on the server to be responsible for providing high-quality travel route planning services, and at least further includes the following steps: If the server receives a green button instruction, it starts the chat mode of the system; calls the Baidu Speech Recognition API to convert the received audio data into speech text data; then, inputs the speech text into the function that calls the AI model to obtain the feedback speech text data; finally, transmits the speech text data to the main controller STM32F407 through the communication module, and the main controller STM32F407 controls the speech module to perform voice broadcast; If the server receives a blue button instruction, it starts the navigation mode of the system; calls the Baidu Speech Recognition API to convert the received audio data into speech text data; then, inputs the speech text into the function that calls the Baidu Navigation API to obtain the result of path planning; finally, transmits the result of path planning to the main controller STM32F407 through the communication module, and the main controller STM32F407 controls the speech module to perform voice broadcast.

4. The elderly travel navigation system based on the Beidou positioning system according to claim 1, characterized in that, The step VI that the WeChat mini-program retrieves data from the server and displays the location data, heart rate data, and blood oxygen data of the elderly should at least further include the following steps: On the WeChat mini-program, the location data, heart rate data, and blood oxygen data of the elderly can be viewed in real time; When the system detects that the elderly person has fallen, it interrupts any currently executing state and forces the system to enter the emergency mode; Through the speech module, it broadcasts "Fall detected, notifying relatives"; at the same time, it sends a push to the elderly person's family on the WeChat mini-program and controls the mobile phone to vibrate to remind the family; Establish a connection between the elderly person and the family on the WeChat mini-program.

Images