Indoor and outdoor pedestrian positioning navigation system and human motion trajectory recognition algorithm thereof

Abstract

The present invention aims to overcome the limitations of the traditional positioning technology in a specific environment, such as dependence on an external signal source and sensitivity to environmental changes, and provides an indoor and outdoor pedestrian positioning navigation system and a human motion trajectory recognition algorithm thereof. The system uses active sensing technology, and focuses on the estimation of the state of a person rather than the sensing of an external environment. The technical solution used in the human motion trajectory recognition algorithm is that a sensing device that swings with the body is fitted to the human body, and the recognition algorithm comprises a gait recognition algorithm, a direction recognition algorithm, and a height recognition algorithm. The positioning navigation system further comprises a wearable terminal, an initial positioning method, a display terminal, and a server end. The wearable terminal is fitted to the human body, and a sensing device is provided in the wearable terminal to sense the motion posture and amplitude of the human body. The present invention uses active sensing technology and pedestrian dead reckoning (PDR) technology, and achieves high-precision indoor and outdoor positioning by analyzing data from an IMU sensor worn on the human body without the support of an external signal source and under strong interference to an external environment for navigation.

Description

Pedestrian indoor and outdoor positioning and navigation system and its human motion trajectory recognition algorithm Technical Field

[0001] This invention belongs to the field of computer software algorithms, specifically involving a seamless indoor and outdoor positioning and navigation system for pedestrians based on the perception of the static and dynamic states of the human body, and an algorithm for recognizing human movement trajectories. Background Technology

[0002] With the widespread adoption of smart devices and the continuous improvement of automation levels, the demand for high-precision positioning technology is also increasing. Existing positioning technologies cover both people and machines, and the positioning scenarios include both indoor and outdoor environments. In the field of outdoor positioning, although the Global Positioning System (GPS) can provide global positioning services outdoors, its positioning accuracy is severely affected in indoor environments or when outdoor signals are subject to electromagnetic interference or physical obstructions. Existing indoor navigation technologies often rely on short-range communication methods, focusing on the perception of the external environment, such as positioning systems based on Wi-Fi, Bluetooth, fingerprint signals, and UWB (Ultra-Wideband).

[0003] For example, Chinese Patent Publication No. CN111919476B discloses an invention patent entitled "Indoor Positioning Method, Server, and Positioning System." This invention includes receiving environmental information sent by a terminal to be positioned within a positioning area; acquiring an environmental fingerprint database (UWB signal and magnetometer information) corresponding to the positioning area; the environmental fingerprint database includes at least one target positioning fingerprint, which includes target environmental information and target location information; and acquiring the positioning coordinates corresponding to the environmental information in the environmental fingerprint database. This solution relies on the collection of an external fingerprint database. Although it improves collection efficiency, it cannot avoid the need for prior environmental data collection and calibration. In many unknown scenarios without Wi-Fi or Bluetooth fingerprint signals, or in situations where there is no outdoor fingerprint database, it cannot provide accurate positioning services for the terminal.

[0004] For example, Chinese Patent Publication No. CN104837118B discloses an invention patent entitled "Indoor Fusion Positioning System and Method Based on WiFi and Bluetooth." It performs fusion positioning by collecting WiFi signals and Bluetooth node information from the environment. This solution first designs a signal node deployment system, requiring deployment in the scene according to a specified deployment plan (fixed intervals or distribution). Simultaneously, the corresponding terminal system transmits data back to the server for positioning by collecting WiFi and Bluetooth signal strength. This type of solution requires pre-deployment of equipment in the indoor scene, making it not "plug and play." Furthermore, environmental modifications are not supported under many conditions; for example, the WiFi deployment plan requires providing independent power supplies (sockets) at certain intervals, resulting in high costs for indoor scene modifications.

[0005] Besides the aforementioned wireless short-range positioning solutions, some other solutions employ vision- or radar-based systems. While these solutions do not require external environmental deployment, they rely on perception and feature analysis of the external environment, limiting their applicability to certain scenarios. For example, Chinese Patent Publication No. CN111024066B, entitled "An Indoor Positioning Method for UAVs Based on Visual-Inertial Fusion," describes a method that uses a multi-source fusion scheme combining vision and IMU (Indoor Unit) to analyze visual feature points and scale information in the scene for positioning. However, this solution heavily relies on visual information, making positioning impossible in low light / nighttime conditions. Furthermore, image flickering caused by changes in lighting conditions during indoor / outdoor transitions severely interferes with positioning performance.

[0006] Existing hardware terminal products for human motion navigation include smartwatches, fitness trackers, GPS trackers, and other common outdoor navigation and motion tracking devices. In the specific application of these outdoor navigation and motion tracking devices, various factors often lead to positioning deviations and signal loss.

[0007] The main reasons for its positioning deviation include:

[0008] 1) GPS satellite signal reception capability is weak. In complex environments (such as strong electromagnetic fields, tall buildings, and forests), the signal is easily interfered with, and the positioning error can reach more than 20 meters.

[0009] 2) Environmental obstructions affect signal quality. In metal structure buildings, indoors, tunnels, or densely built-up areas, GPS signals are severely attenuated (error > 50 meters), which may lead to trajectory drift or positioning failure and fail to provide effective positioning.

[0010] 3) Accelerometers and gyroscopes are used for basic motion tracking, but they can misjudge the number of steps and the stride distance (e.g., arm swaying interference, wrist swing and the body's center of mass movement are not synchronized, resulting in gait analysis deviations (e.g., climbing stairs is misjudged as flat walking, with an error of >30% in climbing height).

[0011] 4) While optical heart rate monitoring is becoming more widespread, data drift is significant in dynamic environments (such as high-intensity exercise). During high-speed exercise (such as cycling >25km / h), the low sampling frequency (mainly 1Hz) leads to jagged tracks and distance measurement errors as high as 10%.

[0012] 5) Simple threshold-based algorithms result in limited motion pattern recognition (e.g., inability to distinguish between running and cycling). Most wristbands use linear Kalman filtering, which is difficult to handle complex motion patterns (e.g., intermittent pauses, variable speed running), leading to trajectory "breakpoints" or "jumps". In the football shuttle run test, the turning point positioning loss rate was about 15%. Summary of the Invention

[0013] To address the aforementioned problems in existing technologies, this invention provides a pedestrian indoor and outdoor positioning and navigation system and its human motion trajectory recognition algorithm. It aims to overcome the limitations of traditional positioning technologies in specific environments, such as reliance on external signal sources and sensitivity to environmental changes. This system employs active sensing technology, focusing on estimating the user's own motion state rather than perceiving the external environment. It requires no environmental deployment and is unaffected by environmental factors such as lighting, enabling stable positioning in complex and changing environments. More importantly, compared to GPS and other traditional positioning technologies, this invention achieves sub-meter level positioning accuracy in both indoor and outdoor environments, providing a more accurate and reliable positioning solution for various application scenarios.

[0014] The technical solution adopted by the human motion trajectory recognition algorithm of the present invention is that a sensing device that swings with the body is attached to the ankle of the human body, and the recognition algorithm includes a gait recognition algorithm, a direction recognition algorithm and a height recognition algorithm.

[0015] Specifically, the gait recognition algorithm includes stride length recognition and gait frequency recognition. Stride length recognition obtains the current stride distance value (i.e., stride length) using stride length data from a pre-established human height-stride length mapping table. The sensing device collects the human body's motion frequency signal, and Fourier transforms the frequency domain characteristics of acceleration and / or angular velocity in the motion signal. The time domain signal of the frequency domain characteristics is then converted into a frequency domain signal using a Fourier transform to obtain the gait frequency value (i.e., gait frequency recognition). The walking speed, distance, and position data of the human body are calculated by multiplying the stride length value and the gait frequency value.

[0016] Specifically, the orientation recognition algorithm involves the system receiving human motion state signals collected by different sensors in the attitude heading reference system (AHRS) of the sensing device, and calculating the orientation of the sensor device through a complementary filtering algorithm. By continuously correcting the changes in the orientation information, gravity information and tilt angle information of the sensing device, the system calculates the azimuth and angle data of the human motion direction.

[0017] Specifically, the altitude recognition algorithm uses the baseline air pressure information of the ground as a reference value. The sensing device measures the real-time air pressure value at its altitude. The system calculates the current altitude data of the sensing device by the air pressure difference between the baseline air pressure and the real-time air pressure of the sensing device, and then estimates the current altitude of the human body relative to the ground.

[0018] Furthermore, the human motion trajectory recognition algorithm of the present invention also includes a posture recognition algorithm. When the sensing device is stationary, the system analyzes and corrects the data deviation of the accelerometer and gyroscope collected by the IMU (Inertial Measurement Unit) of the sensing device during the swinging period, and determines the orientation of the sensing device by combining the orientation data of the magnetometer (compass) of the sensing device. The orientation of the human body and the initial direction of movement are estimated by the orientation of the sensing device.

[0019] Furthermore, the human motion trajectory recognition algorithm of the present invention also includes any one of the following algorithms: beacon fusion algorithm, map fusion algorithm, and GPS fusion algorithm, or a combination of two or more of the following algorithms: beacon fusion algorithm, map fusion algorithm, and GPS fusion algorithm.

[0020] Specifically, the beacon fusion algorithm fuses beacon location data with sensor device positioning data. After the sensor device positioning data and beacon location data are predicted, corrected and optimized by Kalman filtering, the system recalculates the sensor device positioning information in the dynamic environment, thereby identifying the current location data of the human body.

[0021] Specifically, the map fusion algorithm involves the system generating a large number of random particles based on the historical motion trajectory information and the current location information of the sensing device. Each particle simulates and predicts different target motion states based on the motion information. The particle filtering algorithm matches the simulation results with the map to eliminate erroneous particle estimates. By continuously eliminating erroneous particle predictions, the estimation converges, the specific location of the current sensing device is identified, and the current location data of the human body is calculated.

[0022] Specifically, the GPS fusion algorithm uses a Kalman filter to combine the positioning data provided by the GPS sensor with the sensor data from the inertial measurement unit (IMU) built into the sensor. The Kalman filter dynamically adjusts the IMU sensor error by weighted fusion of the GPS and IMU data, ultimately accurately sensing the position information of the sensor and calculating the current position data of the human body.

[0023] Furthermore, in the human motion trajectory recognition algorithm of the present invention, the height recognition algorithm may be a combination of two or more recognition modes, such as static vertical rise and fall recognition, dynamic vertical motion recognition, static angle rise and fall recognition, dynamic angle motion recognition, or static vertical rise and fall recognition, dynamic vertical motion recognition, static angle rise and fall recognition, and dynamic angle motion recognition.

[0024] Specifically, the static vertical ascent and descent recognition means that when the gait values, posture values, and position data in the system's monitoring sensor are in a static state while the height value is changing, the system identifies the vertical ascent and descent state of the human body based on the change in the height value of the sensor, and at the same time, the system calculates the change in the height value of the human body.

[0025] Specifically, in the dynamic vertical motion recognition, when the position data of the monitoring sensor is in a static state while the gait value, posture value, and height value are changing, the system identifies the vertical up-and-down motion state of the human body based on the changes in the gait value, posture value, and height value, and at the same time, the system calculates the change in the height of the human body.

[0026] Specifically, in the static angle rise and fall recognition, when the gait and posture values ​​in the monitoring sensor are in a static state while the position and height values ​​are changing, the system identifies the human body as being in a static oblique angle rise and fall state based on the changes in position and height values. Simultaneously, the system calculates the changes in the human body's position and height.

[0027] Specifically, in the dynamic angle motion recognition, when the gait value, posture value and height data in the sensing device are simultaneously changing, the system identifies the oblique angle motion state of the human body under movement based on the changes in the gait value, posture value and height data of the sensing device, and at the same time calculates the position and height change values ​​of the human body.

[0028] This invention discloses an indoor and outdoor pedestrian positioning and navigation system, comprising any one of the aforementioned human motion trajectory recognition algorithms and a combination of two of the aforementioned human motion trajectory recognition algorithms. The positioning and navigation system further includes a wearable terminal, an initial positioning method, a display terminal, and a server terminal. The wearable terminal is fitted to the ankle and contains sensors to detect the human's posture and amplitude of movement. The server terminal is a local server or a cloud server, which is connected to a positioning and navigation scene. The positioning and navigation scene connected to the local server or cloud server corresponds to the real-world positioning and navigation scene where the human is moving. The display terminal is used to receive and display the positioning and movement trajectory data of the wearable terminal within the real-world positioning and navigation scene.

[0029] Specifically, the initial positioning method includes the following steps;

[0030] The S1 server terminal receives human posture, direction, height, and position information collected by the wearable terminal, and uses a posture recognition algorithm to confirm the human standing direction and infer the initial movement direction.

[0031] The S2 server imports the data information received from the wearable terminal into its positioning and navigation scenario.

[0032] The S3 server sends the wearable terminal data imported in step S2 to the display terminal.

[0033] Furthermore, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, the positioning and navigation scene is any one or a combination of two or more scenes among map scene, building 3D model scene and workplace 3D model scene, and the corresponding positioning and navigation real scene is any one or a combination of two or more real scenes among map real scene, building real scene and workplace real scene.

[0034] Furthermore, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, the map scene is any one of online map scene, offline map scene and simulated map scene, or a combination of two or more scenes.

[0035] Furthermore, in the pedestrian indoor and outdoor positioning and navigation system described in this invention, the 3D model scene of the building is generated by real-world 3D scanning of the building or by computer 3D modeling.

[0036] Furthermore, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, the 3D model scene of the work site is generated by real-world 3D scanning of the work site or by computer 3D modeling.

[0037] Furthermore, the pedestrian indoor and outdoor positioning and navigation system of the present invention further includes a positioning beacon deployed within the positioning and navigation real-world scene. The positioning beacon establishes a wireless connection with the wearable terminal via Bluetooth, and the data collected by its built-in barometer and accelerometer is transmitted outward via Bluetooth broadcast signals.

[0038] Optionally, in the indoor and outdoor motion positioning and navigation system of the present invention, the display terminal is a fixed display terminal, and the positioning and motion trajectory of the wearable terminal are displayed externally through the fixed display terminal.

[0039] Optionally, in the indoor and outdoor motion positioning and navigation system described in this invention, the display terminal is a mobile display terminal. The mobile display terminal and the wearable terminal are carried and used simultaneously by one person, or carried and used separately by two people. The positioning and movement trajectory of the wearable terminal are displayed externally through the mobile display terminal.

[0040] Optionally, in the indoor and outdoor motion positioning and navigation system described in this invention, the display terminal includes a fixed display terminal and a mobile display terminal. The fixed display terminal either displays the positioning and motion trajectory of the wearable terminal alone, or displays the positioning and motion trajectory of both the wearable terminal and the mobile display terminal simultaneously, within the positioning and navigation system.

[0041] Furthermore, in the indoor and outdoor motion positioning and navigation system described in this invention, the positioning and navigation system further includes an identification and authentication module consisting of an electronic tag, a reading device, and a computing program loaded in a server. The electronic tag is installed in the wearable terminal, and the reading device is installed in the positioning and navigation real-world scene to read the data information of nearby electronic tags. After the system identifies and authenticates the electronic tag data information, it sends instructions to the wearable terminal and the display terminal.

[0042] Furthermore, in the indoor and outdoor motion positioning and navigation system of the present invention, the positioning and navigation system also includes a danger warning module.

[0043] As an optional hazard warning module, it specifically defines a dangerous area within the positioning and navigation real-world scene or sets up an electronic fence within the positioning and navigation scene. When the system detects that the wearable terminal is approaching or entering the dangerous area or electronic fence, the system sends a warning signal to the wearable terminal, mobile display terminal, or fixed display terminal through the server terminal.

[0044] As an optional danger warning module, when the system detects that the human movement gait, direction, posture and height data in the wearable terminal have not been updated for a long time, the system sends a warning signal to the wearable terminal, mobile display terminal or fixed display terminal through the server terminal.

[0045] As an optional danger warning module, the system uses AI algorithms to analyze, record, and store data on the gait, posture, and trajectory of the wearable terminal user under normal conditions. When the wearable terminal user's above-mentioned motion data deviates from the motion data recorded and stored by the system, the system will send a warning signal to the wearable terminal, mobile display terminal, or fixed display terminal through the server terminal.

[0046] As an optional hazard warning module, when the system detects that the electronic tag data information sent by the reading device is inconsistent with the data stored in the system, the system sends a warning signal and location information to the mobile display terminal or fixed display terminal through the server terminal; or the system monitors the duration of the wearable terminal user's stay in the location navigation scene in real time through location data, and if the stay time exceeds the system's preset time safety limit threshold, the system sends a warning signal to the wearable terminal, mobile display terminal or fixed display terminal through the server terminal.

[0047] Furthermore, in the indoor and outdoor motion positioning and navigation system described in this invention, the positioning and navigation system also includes an alarm and rescue module.

[0048] As an optional alarm and rescue module, when the system cannot detect the wearable terminal signal, or the wearable terminal signal suddenly disappears or the wearable terminal signal vibrates violently, the system sends the wearable terminal location information and rescue signal to security personnel, management personnel, or other users of nearby mobile display terminals through the service terminal.

[0049] As an optional alarm and rescue module, after the wearable terminal receives a warning signal that it has entered a dangerous area or electronic fence, if the system detects that the wearable terminal's gait, direction, posture, and height data have no change or fluctuate drastically, the system will send the wearable terminal's location information and rescue signal to security personnel, management personnel, or other users of nearby mobile display terminals through the service terminal.

[0050] Furthermore, in the indoor and outdoor motion positioning and navigation system of the present invention, the positioning and navigation system further includes a data storage and analysis module.

[0051] As an optional data storage and analysis module, the system automatically counts the number of wearable terminals in the real-world location and navigation scene, and analyzes the flow and density information of wearable terminal users in the area.

[0052] As an optional data storage and analysis module, the system stores historical motion data from several wearable terminals, generates motion trajectory and behavioral preference data for each wearable terminal user through big data analysis, and then provides customized personalized services for wearable terminal users.

[0053] As an optional data storage and analysis module, the system monitors the specific times when users enter and leave the location navigation scene through the real-time positioning information of the wearable terminal, calculates the user's attendance coefficient and working hours based on this time data, and further analyzes the work efficiency of the wearable terminal users.

[0054] In the indoor and outdoor motion positioning and navigation system of the present invention, the wearable terminal is attached to the human body to collect human motion data, the server terminal receives and stores the human motion data collected by the wearable terminal, and the display terminal displays the human motion data and location information collected by the wearable terminal. Through one-way or two-way communication between the wearable terminal, server terminal, and display terminal, the deficiencies of existing hardware terminal products for human motion navigation pointed out in the background art can be effectively solved.

[0055] Specifically, the wearable terminal is attached to the joints of the human body to monitor human dynamics and position information. The wearable terminal housing is equipped with a PCB integrated circuit board and a positioning and posture initialization recognition unit, a gait recognition unit, a wireless communication unit and a power supply unit electrically connected to the PCB integrated circuit board.

[0056] The positioning and attitude initialization recognition unit of the wearable terminal includes a GPS module and an IMU inertial measurement module. The gait recognition unit includes an accelerometer, a gyroscope, a magnetometer, and a barometer. The wireless communication unit includes one or more modules such as an NB-IoT narrowband Internet of Things module, a Bluetooth communication module, a cellular mobile communication module, a LoRa module, and a Wi-Fi module. The power supply unit includes a power management chip, a switch, a battery, and a charging element electrically connected to the PCB integrated circuit board. The charging element includes a wireless receiving coil disposed inside the wearable terminal housing or a charging port disposed on the wearable terminal housing.

[0057] Furthermore, in the inventor's indoor and outdoor motion positioning and navigation system, the server terminal is equipped with a wireless communication unit that matches the wearable terminal. The server terminal and the wearable terminal establish an interactive communication connection through the wireless communication unit and receive and store the user's positioning, posture, gait, movement trajectory and location information monitored by the wearable terminal.

[0058] Furthermore, in the inventor's indoor and outdoor motion positioning and navigation system, the data storage and analysis module is integrated into the server terminal.

[0059] Optionally, the data storage and analysis module automatically counts the number of wearable terminals in the positioning and navigation area, and analyzes the flow and density information of wearable terminal users in the area.

[0060] Optionally, the data storage and analysis module stores the historical motion data of several wearable terminals in the positioning and navigation area, and generates motion trajectory and behavioral preference data of each wearable terminal user in the positioning and navigation area through big data analysis, thereby formulating corresponding management methods or motion constraint modes for wearable terminal users.

[0061] Optionally, the data storage and analysis module monitors the specific times when a user enters and leaves the positioning and navigation area using the real-time location information of the wearable terminal. Based on this time data, it calculates the user's attendance coefficient and working hours, and further analyzes the work efficiency of the wearable terminal user.

[0062] Furthermore, in the inventor's indoor and outdoor sports positioning and navigation system, the display terminal is equipped with a wireless communication unit that matches the wearable terminal. The display terminal establishes a communication connection with the server terminal through the wireless communication unit or data cable and displays the gait, movement, trajectory and location information of the wearable terminal user received and stored by the server terminal.

[0063] Furthermore, in the inventor's indoor and outdoor motion positioning and navigation system, the wearable terminal is equipped with a beacon identification unit composed of a Bluetooth SOC chip. The Bluetooth SOC chip is electrically connected to the PCB integrated circuit board of the wearable terminal, and the wearable terminal communicates unidirectionally with the beacon body set in the navigation area via Bluetooth signal. The wearable terminal sends the location information of the beacon body to the server through a wireless communication unit to further determine the location information of the wearable terminal.

[0064] Furthermore, in the inventor's indoor and outdoor motion positioning and navigation system, the wearable terminal is equipped with an electronic tag unit consisting of a coupling element and an RFID chip. The coupling element and the RFID chip are electrically connected to the PCB integrated circuit board of the wearable terminal. The wearable terminal and the reading device set in the map scene achieve spatial coupling of radio frequency signals through the coupling element, thereby completing the data transmission and data exchange.

[0065] Furthermore, in the inventor's indoor and outdoor motion positioning and navigation system, the wearable terminal is equipped with a warning unit consisting of one or more of the following components: a buzzer, an alarm light, a vibration motor, and a running light, all electrically connected to the PCB integrated circuit board.

[0066] Furthermore, in the inventor's indoor and outdoor motion positioning and navigation system, the wearable terminal is equipped with a distress unit consisting of a call button and a speaker, or a combination of both, that are electrically connected to the PCB integrated circuit board.

[0067] Furthermore, in the inventor's indoor and outdoor sports positioning and navigation system, the wearable terminal is equipped with a health monitoring unit consisting of a PPG sensing element and an ECG sensing element electrically connected to the PCB integrated circuit board.

[0068] The beneficial effects of the pedestrian indoor and outdoor positioning and navigation system and its human motion trajectory recognition algorithm of this invention are as follows:

[0069] 1. The present invention provides an indoor and outdoor positioning and navigation system for pedestrians, which adopts active sensing technology and pedestrian trajectory estimation (PDR) technology. In the absence of external signal source support and under conditions of strong interference in the external navigation environment, it achieves high-precision indoor and outdoor positioning by analyzing the sensor data of the IMU (Inertial Measurement Unit) carried by the human body.

[0070] 2. The human motion trajectory recognition algorithm of this invention combines gait recognition algorithm, direction recognition algorithm and height recognition algorithm to achieve high-precision three-dimensional spatial positioning in indoor and outdoor XYZ axes, meeting the needs of pedestrians for accurate navigation in the above-ground shopping malls and underground parking garages of large commercial complexes.

[0071] 3. The human motion trajectory recognition algorithm of this invention integrates with traditional beacon, map and GPS positioning algorithms. Compared with GPS and other traditional two-dimensional positioning and navigation technologies, it can achieve sub-meter level three-dimensional spatial accuracy positioning in XYZ three axes in complex and ever-changing indoor and outdoor environments, thus meeting the precise positioning needs of workers in large industrial and mining enterprises in complex factory areas and underground facilities.

[0072] 4. The pedestrian indoor and outdoor positioning and navigation system of the present invention is further equipped with a danger warning module and an alarm and rescue module. By combining the above two modules with a wearable terminal, the positioning and navigation system can provide danger warning services to users while providing three-dimensional spatial positioning. When the user cannot receive a danger warning or cannot respond to a danger warning, the positioning and navigation system can proactively provide alarm and rescue services to the user.

[0073] 5. The pedestrian indoor and outdoor positioning and navigation system of the present invention is also equipped with a data storage and analysis module. By combining the data storage and analysis module with the wearable terminal, the positioning and navigation system can provide three-dimensional spatial positioning and, at the same time, 1) provide customized and personalized exercise management services for individual users, and 2) provide work efficiency analysis services such as employee attendance for users of large industrial and mining enterprises.

[0074] 6. The wearable terminal adopts a dual-module design, which includes a positioning and attitude initialization recognition unit and a gait recognition unit. The positioning and attitude initialization recognition unit (IMU inertial measurement module) and the gait recognition unit (including an accelerometer, gyroscope, magnetometer and barometer) work together to make the wearable terminal of this invention more accurate in positioning and collecting human motion dynamic data.

[0075] 7. The wearable terminal has spatial XYZ three-axis positioning function. The GPS module and IMU inertial measurement module of the wearable terminal are used for XY axis positioning, and the barometer of the wearable terminal is used for Z axis positioning. The server terminal can calculate the height of the wearable terminal and the floor of the building where the human is located by monitoring the barometer value.

[0076] 8. With the help of the positioning and posture initialization recognition unit and gait recognition unit installed in the wearable terminal attached to the human body's joints (such as the ankle), the wearable terminal can effectively identify and distinguish various movement states such as running, jumping, climbing, and cycling.

[0077] The beneficial effects of the present invention are not limited to this description. For better understanding, a more detailed description is provided in the Detailed Embodiments section. Attached Figure Description

[0078] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0079] Figure 1 is a mind map diagram of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0080] Figure 2 is a flowchart of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0081] Figure 3 is a schematic diagram of a 3D model scene of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0082] Figure 4 is a schematic diagram of parallel human motion in a 3D model scene of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0083] Figure 5 is a schematic diagram of the static angular motion and dynamic angular motion of the human body in the 3D model scene of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0084] Figure 6 is a schematic diagram of the static vertical lifting and lowering motion of a human body in the 3D model scene of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0085] Figure 7 is a schematic diagram of the dynamic vertical motion of the human body in the 3D model scene of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0086] Figure 8 is a logical connection diagram of the wearable terminal, server terminal and display terminal of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0087] Figure 9 is a three-dimensional exploded view (I) of the wearable terminal of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0088] Figure 10 is a three-dimensional exploded view (II) of the wearable terminal of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0089] Figure 11 is a three-dimensional exploded view (III) of the wearable terminal of the pedestrian indoor and outdoor positioning and navigation system of the present invention.

[0090] Figure 12 is a three-dimensional exploded view (IV) of the wearable terminal of the pedestrian indoor and outdoor positioning and navigation system of the present invention. Detailed Implementation

[0091] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0092] Therefore, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the invention without inventive effort are within the scope of protection of the invention.

[0093] The pedestrian indoor and outdoor positioning and navigation system and its human motion trajectory recognition algorithm provided by this invention employs active sensing technology and pedestrian dead reckoning (PDR) technology. This algorithm enables accurate three-dimensional spatial positioning and motion trajectory recognition of the human body without the support of an external signal source. The IMU (Inertial Measurement Unit) sensor, a key component of this system, is integrated with the human body and captures detailed information about the human body's state (such as walking, standing still, running, jumping, and climbing). The IMU sensor provides real-time motion data through integrated accelerometers and gyroscopes. By analyzing the data from the IMU sensor and combining it with unscented Kalman filtering (UKF) for pedestrian dead reckoning (PDR), precise three-dimensional spatial positioning and motion trajectory recognition of the human body are achieved.

[0094] The pedestrian indoor and outdoor positioning and navigation system and its human motion trajectory recognition algorithm provided by the present invention are based on the human motion trajectory recognition algorithm. The recognition algorithm, combined with the sensing devices, display terminals and server terminals in the system, realizes accurate positioning and navigation of pedestrians in indoor and outdoor three-dimensional scenes.

[0095] The human motion trajectory recognition algorithm of the present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0096] The human motion trajectory recognition algorithm of this invention actively senses information from a sensing device attached to and moving with the human body. As shown in Figure 1, the recognition algorithm specifically includes a gait recognition algorithm, a direction recognition algorithm, and a height recognition algorithm. The gait recognition algorithm includes stride frequency recognition and stride length recognition.

[0097] The system pre-establishes a data mapping table that matches human height with stride length. Users input their current height, leg length, and other relevant data into the system. The system then uses this height and leg length data to compare with the stride length mapping table to obtain the distance traveled by the user for each step. Identifying the distance traveled by a human body in each step during movement is the stride length recognition in the motion trajectory recognition algorithm described in this invention.

[0098] During human movement, the sensing devices attached to the body exhibit regular and periodic undulating movements. The system collects the motion frequency information from these sensing devices and analyzes the motion frequency features—acceleration, angular velocity, or both—through Fourier transform. After converting the time-domain signal of these motion frequency features into a frequency-domain signal, the system identifies key gait-related step frequency features. These step frequency features are then calculated and converted into human motion step frequency data. Recognizing the human motion frequency information collected by the sensing devices as step frequency data during human movement constitutes the step frequency recognition in the motion trajectory recognition algorithm described in this invention.

[0099] The walking speed, walking distance, stance position, and endpoint location are calculated by multiplying stride length and cadence data. Simultaneously, mean filtering is used to suppress noise in the sensor data, ensuring the accuracy of cadence and stride length, thus yielding an accurate walking speed. This method, combining frequency domain analysis with height characteristics, provides a high-precision computational foundation for gait detection.

[0100] The orientation recognition algorithm actively senses motion state signals such as orientation, pitch, and roll angles generated by sensing devices that are attached to and move with the human body.

[0101] During human movement, the sensors attached to the body generate dynamic signals such as magnetic pole direction, pitch angle, roll angle, and roll angle. The system receives motion state signals collected by different sensors in the Attitude and Heading Reference System (AHRS) set within the sensors, and calculates, identifies, and corrects the attitude changes and gravity direction changes of the sensors through a complementary filtering algorithm. The accelerometer measures the gravity direction of the sensors, and the gyroscope measures the angular velocity of the device. The attitude changes measured by the accelerometer are corrected by the attitude changes measured by the gyroscope, and the gravity direction changes are corrected by the angular velocity measured by the gyroscope.

[0102] Complementary filtering combines the short-term stability of the gyroscope with the long-term stability of the accelerometer and magnetometer to correct angle drift. The gyroscope provides angular velocity data for short-term angle change estimation, while the accelerometer and magnetometer are used for long-term orientation and gravity reference. By continuously correcting the drift error generated by the gyroscope, the system achieves accurate heading angle estimation by continuously correcting changes in orientation, gravity, and tilt angle information from the sensors attached to the human body. The system then calculates the azimuth and angle data of the human body's movement direction.

[0103] The altitude recognition algorithm actively senses altitude signals from sensors attached to and moving with the body.

[0104] Using the baseline air pressure information as a reference value, the system receives the real-time air pressure value measured by the sensor at its altitude, and calculates the current altitude data of the sensor by the air pressure difference between the baseline air pressure and the real-time air pressure of the sensor, thereby estimating the current altitude of the human body relative to the ground.

[0105] The system imports the position information, direction recognition, and altitude information of the sensing device that is attached to the human body into the positioning and navigation scene, and generates motion trajectory information with positioning point, motion direction and altitude in the navigation scene for external display and storage. This is the basic form of the human motion trajectory recognition algorithm system described in this invention.

[0106] As shown in Figure 1, the human motion trajectory recognition algorithm described in this invention, based on the gait recognition algorithm, direction recognition algorithm, and height recognition algorithm, also includes a posture recognition algorithm. The posture recognition algorithm refers to the direction of the body's face when standing during a human movement interval, or the initial direction of the human body when initially positioned by the navigation system.

[0107] The system analyzes and corrects data deviations from the accelerometer and gyroscope data collected by the IMU (Inertial Measurement Unit) during the stationary phase of the sensing device. The IMU contains three single-axis accelerometers and three single-axis gyroscopes. The accelerometers detect the acceleration signals of the sensing device along three independent axes in the spatial coordinate system, while the gyroscopes detect the angular velocity signals of the sensing device relative to the navigation spatial coordinate system. By measuring the angular velocity and acceleration of the sensing device in three-dimensional space, the system calculates the object's attitude. Simultaneously, the system combines the orientation data from the magnetometer (compass) of the sensing device to determine its orientation in three-dimensional space. Based on the orientation of the sensing device, the system estimates the orientation of the human body's position and initial direction of motion in the navigation scenario.

[0108] To enhance the compatibility of the human motion trajectory recognition algorithm described above and further improve the accuracy of human positioning and trajectory recognition during movement, as shown in Figure 1, the trajectory recognition algorithm can be further enhanced by incorporating one or more positioning and trajectory recognition fusion algorithms from beacon, map, and GPS positioning.

[0109] Specifically, the beacon fusion algorithm.

[0110] The system fuses beacon location data with positioning data from sensors attached to the ankle. The beacon's location information, acquired by the sensors via Bluetooth or other short-range communication methods, provides high-precision positioning data within a local area. The sensor positioning data and beacon location data are then used in conjunction with a Kalman filter algorithm for prediction, correction, and optimization to filter out noise and improve positioning accuracy. In dynamic environments, the system recalculates the positioning information from the sensors attached to the ankle to identify the user's current location. This fusion process enables the system to obtain more stable and accurate positioning results in dynamic environments, making it particularly suitable for complex indoor or obstacle-ridden environments.

[0111] Administrators deploy beacons within the navigation view based on system-recommended locations. Once deployed, the beacons and sensors establish a wireless connection via Bluetooth. This connection method ensures stable, low-power, and wide-coverage communication between the beacons and the server. The system monitors the status of each beacon in real time to ensure all beacons are functioning correctly and performs maintenance or adjustments as needed to guarantee the efficient operation of the positioning system.

[0112] Specifically, map fusion algorithms.

[0113] Map fusion algorithms match historical human movement trajectory data with existing maps and utilize particle filtering algorithms to optimize positioning accuracy. Particle filtering is a probabilistic algorithm. The system generates a large number of random particles based on the historical movement trajectory information and the current location information of the sensor. Each particle simulates and predicts different target movement states based on the motion information. The particle filtering algorithm matches the simulation results with the map to eliminate erroneous particle estimates, continuously eliminating incorrect particle predictions until the estimation converges. Then, by matching with map information, such as roads, buildings, or other geographical features, the weight of each particle is calculated, representing its degree of correspondence with the actual location. The particle filtering algorithm continuously updates and resamples the particle swarm, retaining particles with higher weights and eliminating particles that do not match the actual location, ultimately determining the most probable location of the sensor. The system then calculates the current location data of the human body based on the specific location of the current sensor. Through this method, the system can effectively fuse historical human movement trajectories and map information in complex environments, improving positioning accuracy and reducing errors.

[0114] Specifically, GPS fusion algorithms.

[0115] GPS data and sensor information are fused using a Kalman filter algorithm. The Kalman filter combines the GPS positioning data received by the sensor with the data from the inertial measurement unit (IMU) sensor built into the sensor. By weighted fusion of the GPS and IMU data, the Kalman filter algorithm dynamically adjusts the IMU sensor error, enabling the system to perform high-precision position tracking of the sensor under different environments and motion states. Ultimately, it accurately senses the position information of the sensor and calculates the current position data of the human body.

[0116] GPS typically provides relatively accurate location information, but due to its low sampling frequency, it may fail to capture subtle dynamic changes at certain times. While sensors such as IMUs provide high-frequency data, they are prone to drift errors. Kalman filtering dynamically adjusts sensor errors by weighted fusion of these two types of data, providing smooth and accurate location information from the sensing device.

[0117] In the beacon fusion algorithm and GPS fusion algorithm of the human motion trajectory recognition algorithm described above in this invention, the Kalman filtering algorithm is a pedestrian dead reckoning (PDR) based on unscented Kalman filtering (UKF). Compared with standard Kalman filtering, the core idea of ​​UKF is to approximate the state distribution of nonlinear systems through unscented transformation, which can better handle nonlinear systems and is particularly suitable for sensor data fusion problems in pedestrian positioning. UKF can effectively solve the fusion of nonlinear sensor data (such as accelerometer, gyroscope, etc.), thereby providing more accurate pedestrian location information.

[0118] Furthermore, like the standard Kalman filter, the UKF algorithm includes a prediction phase and an update phase, but its state propagation and update are based on a nonlinear transformation of a set of Sigma points. The steps of the UKF-PDR algorithm are as follows;

[0119] 1. State Vector Definition: The state vector of a UKF can be defined as follows:

[0120] Where x n ,y n v represents the current coordinates of the pedestrian. n Θ represents the pedestrian's current speed. n b is the pedestrian's current heading angle. θ,nThis represents gyroscope bias, used to correct sensor drift errors. For the UKF-PDR algorithm, the sigma point is generated as follows:

[0121] in The sigma point X is generated at time n-1. n-1 It is the mean of the previous states, P n-1 It is the covariance matrix from before, where L is the dimension of the state vector and λ is a scaling parameter that determines the distribution of sigma.

[0122] 2. The predicted state is propagated to the Sigma point through the state transition function f(x), and the mean and covariance of the predicted state are calculated:

[0123] in It is a non-linear motion model used to describe the state transitions of pedestrians. The predicted state mean is:

[0124] Predicted covariance is

[0125] in, and These are the weights of the mean and covariance, and Q is the process noise covariance matrix.

[0126] 3. In the update phase, the sensor measurements are propagated to the measurement space using unscented transformation to update the state: First, the projection of the Sigma point through the measurement model h(x) is calculated:

[0127] The predicted measurement mean is:

[0128] Measurement covariance matrix:

[0129] Where R is the measurement noise covariance matrix. Therefore, the cross-covariance between the state and the measurement is:

[0130] In summary, the Kalman gain of the UKF-PDR is K. n =P xz *P zz -1 ,

[0131] After updating the state using Kalman gain, we can obtain: The covariance matrix is ​​updated as follows: P n =P n|n-1 -K n *P zz *Kn -1 ,

[0132] The advantages of using the UKF-PDR algorithm are as follows:

[0133] Handling nonlinear problems: UKF uses unscented transformation, which can process nonlinear sensor data (such as gyroscope and accelerometer data) in PDR more accurately.

[0134] Multi-sensor fusion: UKF can process data from multiple sensors simultaneously (such as accelerometers, gyroscopes, and magnetometers), making pedestrian trajectory prediction more accurate.

[0135] High robustness: UKF has a strong ability to adapt to nonlinear errors in the model and sensor noise, and is suitable for complex indoor environments and pedestrian movement patterns.

[0136] As shown in Figure 1, in the human motion trajectory recognition algorithm of the present invention, the height recognition algorithm is one or a combination of two or more recognition modes, namely static vertical rise and fall recognition, dynamic vertical motion recognition, static angle rise and fall recognition and dynamic angle motion recognition.

[0137] Specifically, for static vertical ascent and descent identification, the system monitors the gait values, attitude values, and dynamic signals such as the magnetic pole direction, pitch angle, roll angle, and rotation angle of the inertial measurement unit (IMU) in the human ankle sensor. When the human is in a static state while the height value of the sensor is changing, the system identifies the human being in a static vertical ascent and descent state based on the change in the height value of the sensor, and at the same time calculates the change in the human's height.

[0138] Referring to Figure 6, the static vertical lift recognition algorithm is used in the human motion trajectory recognition algorithm of this invention for three-dimensional spatial positioning of a human (user A) riding a vertical elevator B in a positioning and navigation scenario. By measuring the change in height value of the sensing device, the algorithm can accurately locate which floor of the building the human (user A) has reached by riding the vertical elevator B (Z-axis coordinate positioning). The inertial measurement unit (IMU) and attitude heading reference system (AHRS) can accurately locate which area of ​​the vertical elevator B the human (user A) is located in (XY-axis coordinate positioning).

[0139] Specifically, for dynamic vertical motion recognition, the system monitors dynamic signals such as magnetic pole direction, pitch angle, roll angle, and roll angle of the attitude heading reference system (AHRS) in the sensor device when the static vertical ascent and descent recognition or dynamic angular movement recognition is in a static state, while the gait value, attitude value, and height value of the inertial measurement unit (IMU) are changing. Based on the changes in the height value of the sensor device and the gait and attitude values ​​of the inertial measurement unit (IMU), the system identifies the vertical ascent and descent state of the human body under movement, and at the same time calculates the change in the height value of the human body.

[0140] Referring to Figure 7, the dynamic vertical lifting and lowering recognition algorithm is used in the human motion trajectory recognition algorithm of this invention for three-dimensional spatial positioning of a human (user A) climbing a straight ladder C in a positioning and navigation scenario. By changing the height value of the sensing device, the algorithm can accurately locate which floor of the building the human (user A) climbs the straight ladder C to (Z-axis coordinate positioning). The inertial measurement unit (IMU) and attitude heading reference system (AHRS) can accurately locate which area of ​​the straight ladder C the human (user A) climbs (XY-axis coordinate positioning).

[0141] Specifically, for static angle rise and fall recognition, the system monitors the gait and attitude values ​​of the inertial measurement unit (IMU) within the sensor device when it is stationary, and the dynamic signals such as the magnetic pole direction, pitch angle, roll angle, and roll angle of the attitude heading reference system (AHRS) and the altitude value of the sensor device are changing. Based on the changes in the altitude value of the sensor device and the attitude heading reference system (AHRS) value, the system identifies the oblique angle rise and fall state of the human body when it is stationary, and at the same time calculates the position and altitude change values ​​of the human body.

[0142] Referring to Figure 5, the static angle rise and fall recognition algorithm is used in the human motion trajectory recognition algorithm of this invention for three-dimensional spatial positioning of a human (user A) riding an electric escalator D in a positioning and navigation scenario. By sensing the change in height value, the algorithm can accurately locate which floor of the building the human (user A) is riding the electric escalator D to (Z-axis coordinate positioning). The attitude heading reference system (AHRS) can accurately locate which area of ​​the building the human (user A) is riding the electric escalator D to (XY-axis coordinate positioning).

[0143] The dynamic angle motion recognition system monitors the gait and attitude values ​​of the inertial measurement unit (IMU) within the sensing device, dynamic signals such as the magnetic pole direction, pitch angle, roll angle, and roll angle of the attitude heading reference system (AHRS), and the altitude value of the sensing device. When all three are in a state of change, the system identifies the oblique angle rise and fall state of the human body under movement based on the changes in the altitude value of the sensing device, the gait and attitude values ​​of the inertial measurement unit (IMU), and the attitude heading reference system (AHRS). At the same time, the system calculates the position and altitude change values ​​of the human body.

[0144] Referring to Figure 5, the dynamic angle motion recognition algorithm is used in the human motion trajectory recognition algorithm of this invention for three-dimensional spatial positioning of a human (user A) walking up stairs E in a positioning and navigation scenario. By changing the height value of the sensing device, the algorithm can accurately locate which floor of the building the human (user A) is walking up stairs E to (Z-axis coordinate positioning). The inertial measurement unit (IMU) and attitude heading reference system (AHRS) can accurately locate which area of ​​the building the human (user A) is walking on stairs E (XY-axis coordinate positioning).

[0145] The pedestrian indoor and outdoor positioning and navigation system of the present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0146] As shown in Figures 1 and 2, the pedestrian indoor and outdoor positioning and navigation system of the present invention further includes a wearable terminal, an initial positioning method, a display terminal, and a server terminal, based on the human motion trajectory recognition algorithm described above.

[0147] The wearable terminal is equipped with sensors. During the positioning and navigation system application, the wearable terminal is attached to the ankle and uses these sensors to detect the amplitude of leg movements. Different sensors are installed within the wearable terminal to detect the posture and amplitude information of the legs during movement.

[0148] As shown in Figures 1 and 2, the server terminal is a local server or a cloud server. The server terminal stores real-world location and navigation information from maps or buildings, and also internally stores a location and navigation scene model. Motion trajectory recognition algorithms are written to and stored on the server terminal. The location and navigation scene model can be generated by importing a 3D scan of a map or building's actual location and navigation scene into the server terminal, or it can be generated by importing a virtual model created using software. The location and navigation scene model is identical to the real-world location and navigation information stored on the server terminal.

[0149] The display terminal is used to receive and display the positioning and motion trajectory data of the wearable terminal in the positioning and navigation scene model. The positioning and navigation scene model displayed by the display terminal is the same as the real positioning and navigation scene in which the human body is located.

[0150] As shown in Figure 1, the initial positioning method includes the following steps;

[0151] The first step is for the server terminal to receive the user's human motion posture, amplitude, and GPS location information collected by the wearable terminal's sensors, and to confirm the human's standing direction and initial movement direction through the posture recognition algorithm in the human motion trajectory recognition algorithm.

[0152] The second step is for the server to import the data information received from the wearable terminal into its internal positioning and navigation scene model.

[0153] The third step involves the server sending the wearable terminal motion data and location information imported in step two to the display terminal. The positioning and navigation scene model collected by the server terminal and the positioning information of the wearable terminal in the positioning and navigation scene model are then displayed on the display terminal.

[0154] Referring to Figures 3 and 4, after user A powers on the wearable terminal, it is attached to the ankle or shoe. When user A moves into the real-world map or building location navigation scene recorded by the server terminal, the server terminal receives the wearable terminal's communication signal and imports the wearable terminal's specific location into its built-in location navigation scene through a motion trajectory recognition algorithm. The wearable terminal user A's position and trajectory information in the location navigation scene are simulated by the server terminal in the navigation scene model and displayed on the display terminal.

[0155] Referring to Figure 3, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, the internally stored positioning and navigation scene model is any one of a map scene, a 3D building scene, and a 3D workplace scene, or a combination of two or more scenes. Correspondingly, the positioning and navigation real-world scene where the wearable terminal and its user A are located is any one of a map scene, a building scene, and a workplace scene, or a combination of two or more scenes.

[0156] Furthermore, in the pedestrian indoor and outdoor positioning and navigation system described in this invention, the aforementioned map scene is any one of the online map scene, offline map scene, and simulated map scene, or a combination of two or more scenes.

[0157] In the positioning and navigation system of this invention, the map scene is mainly used for the positioning and navigation of human beings in urban three-dimensional road traffic (interchanges). The urban interchange model in the map scene is a 3D model scene of interchanges generated by proportional real-scene scanning or software modeling of interchanges in the map scene.

[0158] Referring to Figure 3, the 3D building scene in the positioning and navigation system of this invention is mainly used for the positioning and navigation of human beings in large urban commercial complexes (shopping malls). The large urban commercial complex in the 3D building scene is generated by proportional scanning of the actual building scene (shopping mall) or software modeling.

[0159] The 3D workplace scene in the positioning and navigation system of this invention is mainly used for the positioning and navigation of human beings in large industrial and mining areas. The factory buildings and large equipment in the 3D workplace scene are generated by proportional real-scene scanning or software modeling of the factory buildings and large equipment in the actual workplace scene.

[0160] Referring to Figure 2, to improve the accuracy of pedestrian positioning in the indoor and outdoor positioning and navigation system of this invention, the system also includes positioning beacons. Through the positioning and navigation scene, the system automatically identifies and analyzes the layout of the real-world scene, intelligently calculates and suggests the optimal beacon placement points. Several positioning beacons are deployed on roads, buildings, factories, and large equipment within the real-world scene. The positioning beacons establish a wireless connection with the wearable terminal via Bluetooth. The positioning beacons periodically send broadcast information. When the wearable terminal, attached to the ankle, moves into the signal coverage area of ​​the beacon, it scans these Bluetooth signals and acquires the broadcast packets, calculating the distance to the beacon based on the signal strength. Accuracy is improved by collecting the signal strength values ​​of multiple positioning beacons and performing a weighted average. The wearable terminal sends the calculated distance data to the server terminal, which further processes and analyzes the received distance data to ultimately determine the real-time location of the wearable terminal user.

[0161] Referring further to Figures 1 and 2, the pedestrian indoor and outdoor positioning and navigation system of the present invention includes a display terminal that can be a mobile display terminal, a fixed display terminal, or a combination of a mobile display terminal and a fixed display terminal. The mobile display terminal is a portable device such as a mobile phone or tablet computer, and the APP installed on the mobile phone or tablet computer establishes a communication connection with the server terminal in the positioning and navigation system. The fixed display terminal is a wall-mounted large screen, a desktop monitor, or other portable device with a display function.

[0162] In the pedestrian indoor and outdoor positioning and navigation system of the present invention, referring to Figure 2, the mobile display terminal and the wearable terminal are simultaneously carried and used by the same user. The user of the wearable terminal can display their specific location and movement trajectory in the navigation scene through the mobile display terminal. The fixed display terminal displays the location and movement trajectory of the wearable terminal in the navigation scene separately in the positioning and navigation system. Alternatively, the fixed display terminal can simultaneously display the location and movement trajectory of both the wearable terminal and the mobile display terminal in the navigation scene.

[0163] In the pedestrian indoor and outdoor positioning and navigation system of the present invention, referring to Figure 2, the wearable terminal is carried by the user, and the mobile display terminal is carried by security personnel and management personnel respectively. Security personnel and management personnel can display the specific location and movement trajectory of the user in the navigation scene through the mobile display terminal. The fixed display terminal in the positioning and navigation system either displays the location and movement trajectory of the wearable terminal alone, or displays the location and movement trajectory of both the wearable terminal and the mobile display terminal simultaneously. This embodiment is applied to the positioning and movement trajectory tracking of adults accompanying minors into public places. The mobile display terminal is carried by the adult (manager), and the wearable terminal is attached to the ankle of the minor (user). The adult (manager) can monitor the location and movement trajectory information of the minor (user) at any time in crowded public places through the mobile display terminal.

[0164] In the pedestrian indoor and outdoor positioning and navigation system of the present invention, referring to Figure 2, one or more mobile display terminals can simultaneously display the specific location and movement trajectory of several wearable terminal users (workers) in the navigation real-world scene. This embodiment is applied to the positioning and movement trajectory tracking of several wearable terminal users (workers) in the real-world scene of the work site within a large industrial and mining area. The mobile display terminals are carried by management or security personnel within the factory area, and several wearable terminals are attached to the ankles of their corresponding users. Security or management personnel can monitor the positioning and movement trajectory information of workers at any time within the large industrial and mining area through the mobile or fixed display terminals.

[0165] The pedestrian indoor and outdoor positioning and navigation system of this invention also includes an identification and authentication module, which consists of an electronic tag, a reading device, and a computing program loaded in a server terminal. The electronic tag is installed in the wearable terminal, and the reading device is installed in the positioning and navigation real-world scene. When a user of the wearable terminal enters the area where the reading device is installed in the positioning and navigation real-world scene, the reading device reads the data information of nearby electronic tags. After the system identifies and authenticates the electronic tag data information, it sends instructions to the wearable terminal and the display terminal.

[0166] The pedestrian indoor and outdoor positioning and navigation system of this invention has an identification and authentication module primarily used to authenticate and identify the specific identity information of wearable terminal users entering large industrial and mining areas. The wearable terminal device is equipped with an RFID electronic tag, which stores the user's identification information. The server terminal's processing program records the identity information of all RFID electronic tags authorized to enter the factory area. When a wearable terminal user enters the factory area, the reading device reads the user's RFID electronic tag identification information and uploads it to the server terminal. Factory management personnel can then perform a one-to-one matching between all RFID electronic tag information recorded on the server terminal and the wearable terminal user's identity information. Through this process, the system can accurately associate devices with individuals, achieving identification and location tracking for each wearable terminal user. Factory management personnel can manage and query the binding status of RFID electronic tags with wearable terminal users through the server terminal, ensuring that the wearable terminal accurately reflects the real-time location information of the corresponding user during positioning and monitoring. This improves the accuracy and management efficiency of wearable terminal users within the pedestrian indoor and outdoor movement positioning system of this invention.

[0167] The pedestrian indoor and outdoor positioning and navigation system of the present invention also includes a hazard warning module. Specifically, the hazard warning module has several implementation methods in specific applications of the positioning and navigation system.

[0168] Example 1;

[0169] The system delineates danger zones within the real-world location and navigation scene. When the system detects a wearable device approaching or entering a danger zone, it sends a warning signal to the wearable device, mobile display terminal, or fixed display terminal via the server terminal. Users of the wearable device are prompted to leave the danger zone via the warning signal on the wearable device or mobile display terminal. Management and security personnel, upon receiving the warning signal, supervise or urge users to leave the danger zone via the mobile display terminal or fixed display terminal.

[0170] Example 2;

[0171] The system sets up an electronic fence within the positioning and navigation scenario. When the system detects a wearable device approaching or entering the electronic fence, it sends a warning signal to the wearable device, mobile display terminal, or fixed display terminal via the server terminal. Users of the wearable device are prompted to leave the electronic fence area via the warning signal on their wearable device or mobile display terminal. Management and security personnel, upon receiving the warning signal, supervise or urge users to leave the electronic fence area via the mobile display terminal or fixed display terminal.

[0172] Example 3;

[0173] When the system detects that the wearable terminal user's gait, heading, posture, and altitude data have not been updated for an extended period, the system sends a warning signal to the wearable terminal, mobile display terminal, or fixed display terminal via the server terminal. In the operation of this pedestrian indoor and outdoor positioning and navigation system, prolonged lack of updates by the wearable terminal often manifests as the wearable terminal detaching from the user's body, or the user remaining in a single, inactive posture for an extended period. When the wearable terminal detaches from the user's body, the user can detect and locate the detached device through the warning signal on the mobile display terminal, or with the assistance of management and security personnel, through the warning signals on both the mobile and fixed display terminals. When the user remains inactive for an extended period, after receiving the warning signal through the wearable terminal or mobile display terminal, the user can adjust their movement or provide feedback to the system through the wearable terminal or mobile display terminal indicating that they are in a safe state.

[0174] Example 4;

[0175] The system records and stores gait, posture, and trajectory data of wearable device users under normal conditions. During daily use, when anomalies occur in the user's movement data, the system uses AI algorithms to analyze the differences between the abnormal information and the recorded gait, posture, and trajectory data under normal conditions. Once the system identifies the anomaly, it sends a warning signal to the wearable device, mobile display, or fixed display via the server terminal. The user receives the warning signal on the wearable device and adjusts their posture or stops exercising. Upon receiving the warning signal, managers and security personnel supervise or urge the user to adjust their posture or stop exercising via the mobile and fixed display terminals.

[0176] Example 5;

[0177] When the system detects that the data information of the electronic tag in the wearable terminal sent by the reading device set in the navigation reality scene is inconsistent with the data information stored in the system, the system sends a warning signal to the wearable terminal, mobile display terminal or fixed display terminal through the server terminal. The wearable terminal user is prompted to leave the area where the reading device is set in the navigation reality scene or stop moving through the warning signal of the wearable terminal or mobile display terminal. After receiving the warning signal, the management personnel and security personnel supervise or urge the wearable terminal user to leave the area where the reading device is set in the navigation reality scene or stop moving through the mobile display terminal or fixed display terminal.

[0178] Example 6;

[0179] The system monitors the duration of movement of wearable device users within a specific area of ​​the navigation view in real time using location data. If the movement duration exceeds the system's preset safety threshold, the system sends a warning signal to the wearable device, mobile display terminal, or fixed display terminal via the server terminal. Users of the wearable device are prompted to leave the designated area within the navigation view or stop moving based on the warning signal received on the wearable device or mobile display terminal. Management and security personnel, upon receiving the warning signal, can supervise or urge users to leave the designated area within the navigation view or stop moving via the mobile display terminal or fixed display terminal.

[0180] Example 7;

[0181] The positioning beacon transmits data collected by its built-in barometer and accelerometer via Bluetooth broadcast signals. When the system detects changes in the beacon's barometer and accelerometer data through the wearable terminal, the fixed beacon transmits its built-in barometer and accelerometer data in real-time via Bluetooth broadcast signals. The fixed beacon continuously monitors its own status with the help of the wearable terminal. When the beacon is in a normal fixed state, the readings of its internal barometer and accelerometer remain stable. Once the positioning beacon is moved or experiences abnormal displacement, the wearable terminal receives a warning signal indicating significant movement or vibration changes in the beacon's barometer or accelerometer, thus identifying that the positioning beacon may have been moved or damaged.

[0182] In the aforementioned specific embodiments one to six of the pedestrian indoor and outdoor positioning and navigation system of the present invention, the location and trajectory information of the wearable terminal user and the location and trajectory information of the management personnel or security personnel carrying the mobile display terminal are further displayed on the fixed display terminal. After receiving the warning signal, the management personnel and security personnel can check the specific status of the wearable terminal user on-site through the location information of the wearable terminal user displayed on the mobile display terminal or the fixed display terminal.

[0183] The pedestrian indoor and outdoor positioning and navigation system of the present invention also includes an alarm and rescue module. Specifically, the alarm and rescue module has the following various implementations in the specific application of the positioning and navigation system.

[0184] Example 1;

[0185] When the system cannot detect the wearable terminal signal, or the wearable terminal signal suddenly disappears, or the wearable terminal signal fluctuates violently, the system sends location information and a rescue signal through the server terminal to back-end administrators, security personnel, other nearby wearable terminal users, or mobile display terminal users. Administrators, security personnel, other nearby wearable terminal users, or mobile display terminal users can then use the location information displayed on their mobile or fixed display terminals to receive the rescue signal and proceed to the scene to rescue and assist the wearable terminal user.

[0186] Example 2;

[0187] When the system receives a warning signal that a wearable terminal has entered a dangerous area or electronic fence, and continues to monitor the wearable terminal's gait, heading, posture, and altitude data without change, or when these data fluctuate drastically, the system sends location information and a rescue signal via the server terminal to backend administrators, security personnel, other nearby wearable terminal users, or mobile display terminal users. Administrators, security personnel, other nearby wearable terminal users, or mobile display terminal users can then use the location information displayed on their mobile or fixed display terminals to receive the rescue signal and proceed to the scene to rescue and assist the wearable terminal user.

[0188] The pedestrian indoor and outdoor positioning and navigation system of the present invention also includes a data storage and analysis module. Specifically, the data storage and analysis module has the following various implementations in specific applications of the positioning and navigation system.

[0189] Example 1;

[0190] The system automatically counts the number of wearable devices within the real-world location and navigation scene, and analyzes the number of devices to determine the flow and density of users within the area. Managers can use this data to control pedestrian traffic in real time via a server terminal, while security personnel can use it to enhance real-time patrols of specific controlled areas.

[0191] Example 2;

[0192] The system stores historical exercise data from several wearable devices through service terminals, and generates exercise trajectory and behavioral preference data for each wearable device user through big data analysis. Managers can then provide customized and personalized exercise management services based on the exercise trajectory and behavioral preference data of wearable device users recorded by the system.

[0193] Example 3;

[0194] The system monitors the real-time location information of wearable devices to track the exact times when users enter and leave the real-world navigation scene. Based on this time data, the system calculates the user's attendance coefficient and working hours, further analyzing their work efficiency. Managers can then adjust user salaries and additional bonuses based on the attendance coefficient and working hours recorded by the server.

[0195] The wearable terminal of the pedestrian indoor and outdoor positioning and navigation system of the present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0196] As shown in Figure 8, the pedestrian indoor and outdoor positioning and navigation system of the present invention has a wearable terminal that is attached to the joints of the human body to monitor and acquire human dynamics in real time. The optimal solution is to attach and fix it near the elbow joint, knee joint, and ankle joint of the human body and move with the swing of the human limbs. Various sensor modules are installed in the system to monitor and acquire human dynamics in real time and upload the acquired human dynamic information to the server terminal.

[0197] Referring to Figure 9, the wearable terminal A's outer shell 1 contains a PCB integrated circuit board 2 and a positioning and posture initialization recognition unit 3, a gait recognition unit 4, a wireless communication unit 5, and a power supply unit 6, all electrically connected to the PCB integrated circuit board 2. The outer shell 1 consists of an upper shell 1a and a lower shell 1b.

[0198] As shown in Figure 10, the positioning and attitude initialization recognition unit 3 is used for the initial positioning and initial attitude recognition of the wearable terminal after it is attached to the human body and powered on. It includes a GPS module 3a and an IMU inertial measurement module 3b set on the PCB integrated circuit board 2.

[0199] The hardware terminal receives satellite signals through the GPS module 3a installed on the wearable terminal and reads the GPS data of the wearable terminal through the map loading module of the server terminal, thereby achieving accurate positioning of the wearable terminal and real-time monitoring and tracking of the user's location. Furthermore, the GPS module can be a low-power satellite chip integrating GNSS dual-frequency positioning (such as L1+L5 bands).

[0200] Human posture initialization is performed through the IMU (Inertial Measurement Unit) module 3b, as shown in Figure 10. The IMU module 3b is a six-axis multi-sensor fusion system, which includes an integrated three-axis gyroscope 3b1 and a three-axis accelerometer 3b2. After the IMU has been stationary for a period of time, the system can measure the acceleration and angular velocity information of the wearable terminal A by analyzing the data from the accelerometer 3b2 and the gyroscope 3b1 to determine the absolute orientation of the wearable terminal A, calculate and identify the relative posture of the wearable terminal A and the human body's joints (such as the ankles), and the server terminal calculates the human body's motion posture based on the posture of the wearable terminal A (refer to Figure 8), providing accurate orientation and motion information for subsequent positioning or trajectory analysis.

[0201] As shown in Figure 10, the gait recognition unit 4 is used by the wearable terminal A to recognize the stride frequency, stride distance, direction of movement, and height changes of human movement. It includes an accelerometer 4a, a gyroscope 4b, a magnetometer 4c, and a barometer 4d, which are separately mounted on the PCB integrated circuit board 2 and independent of the IMU inertial measurement module 1b.

[0202] The accelerometer 4a collects acceleration data of repetitive gait movements during walking. The system uses the accelerometer 4a to collect acceleration data during walking and performs spectral analysis on this data to identify periodic peaks in the acceleration signal. Each peak corresponds to the completion of one step, and the time interval between peaks reflects the speed of the step. By analyzing the frequency of the peaks, the system can accurately determine the gait frequency. The system estimates the gait length using a preset individual height, and then calculates the walking speed by adding the gait frequency to the gait length.

[0203] The gyroscope 4b identifies the relative angular velocity information of human motion, and the magnetometer 4c provides reference information for the absolute direction of human motion. The system uses a Kalman filter algorithm to fuse the data from both. The Kalman filter can effectively filter out noise during dynamic changes and estimate the absolute angle and absolute direction values ​​of the current wearable terminal A, thereby achieving accurate identification of the orientation information of the human body under different motion states.

[0204] The magnetometer 4c achieves navigation and positioning functions by detecting the strength and direction of the magnetic field. It utilizes the principles of anisotropic magnetoresistive force, Hall effect, or Lorentz force to calculate the direction, azimuth, and orientation angle of the wearable terminal on the human body's joints (such as the ankle) by sensing changes in the electromagnetic field. The server terminal calculates the orientation and angle of the wearable terminal user's body in motion or at rest based on the direction and azimuth angle of the wearable terminal A.

[0205] The barometer 4d is used to provide information on the relative height of human movement. The system first acquires reference sea-level air pressure data as a benchmark. Then, by combining the current barometer reading of barometer 4d with a physical model of atmospheric pressure and altitude (such as the international standard atmospheric model), the height of wearable terminal A relative to sea level can be accurately calculated, further providing real-time monitoring information on changes in human height.

[0206] Referring to Figures 9 and 10, the invention provides an indoor and outdoor positioning and navigation system for pedestrians. This system uses the GPS module 3a of the positioning and attitude initialization recognition unit 3 of the wearable terminal A and the barometer 4b of the gait recognition unit 4 to achieve positioning and navigation in three-dimensional space within roads, buildings, factories, and mining areas. The GPS module 3a is used for XY axis coordinate positioning, and the barometer 4b is used for Z axis coordinate positioning.

[0207] As shown in Figures 8 and 9, the wireless communication unit 5 is used for data communication between the wearable terminal A, the server terminal B, and the display terminal C. As shown in Figure 3, it comprises one or more modules, including an NB-IoT narrowband IoT module 5a, a Bluetooth communication module 5b, a cellular mobile communication module 5c, a LoRa module 5d, and a Wi-Fi module 5e.

[0208] Referring to Figures 8 and 10, the wearable terminal A establishes data communication connections with server terminal B, and server terminal B establishes data communication connections with display terminal C through NB-IoT narrowband Internet of Things module 5a, cellular mobile communication module 5c, LoRa module 5d, and Wi-Fi module 5e. Wearable terminal A establishes data communication connections with other hardware facilities through Bluetooth communication module 5b.

[0209] As shown in Figure 9, the power supply unit 6 provides the power required for the wearable terminal A in standby or working states. As shown in Figures 11 and 12, the power supply unit 6 includes a power management chip 6a, a switch 6b, a battery 6c, and a charging element that are electrically connected to the PCB integrated circuit board 2.

[0210] As further shown in Figure 9, the charging element includes a wireless receiving coil 61 disposed inside the housing 1a of the wearable terminal.

[0211] As shown in Figure 11, the charging element 6d includes a charging port 62 disposed on the housing 1a of the wearable terminal.

[0212] As shown in Figures 8 and 9, the server terminal B is equipped with a wireless communication unit 4 that matches the wearable terminal A. The server terminal B and the wearable terminal A establish an interactive communication connection through the wireless communication unit 4 and receive and store the user's positioning, posture, gait, movement trajectory and location information monitored by the wearable terminal A.

[0213] Referring to Figures 8 and 10, server terminal B is responsible for receiving data from multiple wearable terminals A and display terminal C. Each wearable terminal A establishes a communication connection with server terminal B via NB-IoT 5a, cellular mobile communication 5c, module 5d, or Wi-Fi module 5e, and uploads real-time human motion information (including acceleration, direction, position, etc.) sensor data to server terminal B via an encrypted internet connection. Server terminal B seamlessly integrates with mainstream online map positioning and navigation systems.

[0214] Referring to Figure 8, the positioning and navigation area within server terminal B consists of an accessed online map, imported 3D scene models of buildings, and 3D scene models of factories and mines. The 3D scene models of buildings and factories / mines are generated by panoramic scanning or 3D modeling of actual buildings and factories / mines, and then imported into server terminal B. Server terminal B can simultaneously process data streams from multiple wearable terminals A, ensuring real-time data reception and processing even under high load, and supporting parallel positioning of multiple wearable terminals A in road, commercial area, and factory / mine area scenarios.

[0215] Online map platforms provide accurate geographic reference coordinates and real-time navigation data. During positioning system operation, the server retrieves geographic information within the scene from map services and combines it with the user's real-time location to generate personalized navigation routes. This functionality allows users to navigate easily in complex environments such as ships, buildings, or industrial sites, helping managers and operators move efficiently across a wide range of work scenarios.

[0216] 3D model scenes of buildings and factories / mines are particularly suitable for multi-layered, multi-functional shipbuilding or large industrial scenarios. By interfacing with the 3D models, the server can present a 3D visualization scene on a map display terminal, showcasing multi-layered building structures and the real-time distribution of personnel positions within them. This 3D modeling technology provides managers with a clearer global view, facilitating real-time monitoring of personnel's work status and activity trajectories, and is especially suitable for emergency management and dispatching in complex scenarios.

[0217] Furthermore, in the pedestrian indoor and outdoor positioning and navigation system described in this invention, the data storage and analysis module is integrated into the server terminal.

[0218] As shown in Figure 8, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, the display terminal C is used to display the gait, movement trajectory and location information of the wearable terminal A user received and stored by the server terminal B. Referring to Figure 9, the display terminal C is equipped with a wireless communication unit 4 that matches the wearable terminal A.

[0219] As shown in Figure 8, display terminal C establishes a communication connection with server terminal B via wireless communication unit 4 or a data cable, and displays information such as the gait, movement trajectory, and location of wearable terminal A user within the positioning and navigation area in real time. Display terminal C can synchronize data with wearable terminal A through server terminal B, displaying the current location information of wearable terminal A user in real time. The location of each user is displayed as an icon within the positioning and navigation area, allowing managers to clearly see their distribution throughout the workplace. This function is particularly important in complex scenarios such as ships and construction sites, helping managers quickly identify personnel in key locations and make appropriate deployments.

[0220] As shown in Figure 8, the display terminal C is a fixed display screen C1 or a mobile display screen C2. Preferably, the display terminal includes a fixed display screen C1 and a mobile display screen C2.

[0221] Referring to Figure 8, the fixed display screen C1 is generally a large display screen fixed on an indoor wall, or it can be a computer monitor on a desktop. The fixed display screen C1 is connected to the server terminal B and the wearable terminal A via wireless communication technology or a data cable for data synchronization. The location and trajectory of each wearable terminal A user are displayed in the location navigation area in the form of icons, and the current location and trajectory information of the wearable terminal A user in the location navigation area are displayed in real time.

[0222] Referring to Figure 8, the mobile display C2 is generally a mobile phone or tablet computer, but can also be a portable handheld display with human-computer interaction capabilities. The mobile display C2 connects to the server terminal B via wireless communication technology to synchronize data with the wearable terminal A and displays the current location and trajectory information of the wearable terminal A user within the positioning and navigation area in real time. The location and trajectory of each wearable terminal A user are displayed as icons within the positioning and navigation area.

[0223] As further shown in Figure 8, when the display terminal C includes a fixed display screen C1 and a mobile display screen C2, the fixed display screen C1 and the mobile display screen C2 are simultaneously connected to the server terminal B and the wearable terminal A through wireless communication technology or data cable to synchronize data. The fixed display screen C1 and the mobile display screen C2 simultaneously display the current location and trajectory information of the wearable terminal A user in the positioning and navigation area in real time.

[0224] Referring to Figure 8, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, the mobile display C2 and the wearable terminal A are simultaneously carried and used by the same user. The user of wearable terminal A can display their specific location and movement trajectory within the positioning and navigation area through the mobile display C2. The fixed display screen C1 displays the location and movement trajectory of wearable terminal A within the positioning and navigation area separately in the positioning and navigation system. Alternatively, the fixed display screen C1 can simultaneously display the location and movement trajectory of both wearable terminal A and mobile display C2 within the positioning and navigation area in the positioning and navigation system.

[0225] Referring to Figure 8, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, the wearable terminal A is carried by the user, and the mobile display C2 is carried by security personnel and management personnel respectively. Security personnel and management personnel can display the specific location and movement trajectory of the user (wearable terminal A) within the positioning and navigation area through the mobile display C2. The fixed display screen C1 either displays the location and movement trajectory of the wearable terminal A alone in the positioning and navigation system, or displays the location and movement trajectory of both the wearable terminal A and the mobile display C2 simultaneously. This embodiment is applied to the positioning and movement trajectory tracking of minors brought into public places by adults. The mobile display C2 is carried by the adult (manager), and the wearable terminal A is attached to the minor's (user's) joints (such as the ankle). The adult (manager) can monitor the location and movement trajectory information of the minor (user) at any time in crowded public places through the mobile display C2.

[0226] Referring to Figure 8, in the pedestrian indoor and outdoor positioning and navigation system of the present invention, one or more mobile displays C2 can simultaneously display the specific location and movement trajectory of several wearable terminal A users (workers) within the positioning and navigation area. This embodiment is applied to the positioning and movement trajectory tracking of several wearable terminal A users (workers) in a large factory or mining area. The mobile displays C2 are carried by management or security personnel within the factory area, and several wearable terminals A are attached to the corresponding user's joints (such as ankles). Security or management personnel can monitor the location and movement trajectory information of workers in the large factory or mining area at any time through the mobile displays C2 or the fixed display screen C1.

[0227] To make the pedestrian indoor and outdoor positioning and navigation system of this invention more compatible and to further improve its accuracy in positioning and trajectory recognition of the human body during movement.

[0228] As shown in Figures 8 and 10, the hardware terminal also includes a beacon identification unit. The beacon identification unit comprises a Bluetooth SOC chip 7b (shown in Figure 10) and a beacon body (shown in Figure 8). The Bluetooth SOC chip 7b is disposed within the wearable terminal A and electrically connected to the PCB integrated circuit board 2. The beacon body is disposed within the positioning and navigation area. The Bluetooth SOC chip 7b disposed within the wearable terminal A communicates unidirectionally with the beacon bodies in the map view, building view, and factory / mining area view via the Bluetooth communication module 5b.

[0229] As shown in Figure 8, the administrator of hardware terminal A deploys beacons within the positioning and navigation area according to the system's recommended locations. Once deployed, the beacons establish a wireless connection with wearable terminal A via Bluetooth. Server terminal B merges the beacon location data with the wearable terminal A's positioning data. The location information provided by the beacons is obtained by wearable terminal A via Bluetooth communication. This beacon location information provides high-precision positioning data within the positioning and navigation area of ​​server terminal B. Wearable terminal A then transmits the beacon location information to server terminal B via wireless communication to further determine the user's location.

[0230] To expand the commercial management functions of the pedestrian indoor and outdoor positioning and navigation system of the present invention, and to enable its wearable terminal to have user identity information identification and management functions, the hardware terminal also includes an electronic tag.

[0231] Referring to Figures 8 and 10, the electronic tag includes a coupling element 8b (shown in Figure 10), an RFID chip 8c, and a reading device (shown in Figure 8). The coupling element 8b and RFID chip 8c are disposed within the wearable terminal A and electrically connected to the PCB integrated circuit board 2. The reading device is disposed within the positioning and navigation area. The server terminal 2 contains a computational program. When the user of wearable terminal A enters the area where the reading device is located within the map view, building view, or factory / mining area view, the coupling element 8b in wearable terminal A establishes a data connection with the reading device. The reading device reads the data information from the RFID chip 8c of wearable terminal A. After the system identifies and authenticates the RFID chip 8c data information, it sends identification information to the server terminal B, which further authenticates and confirms the information.

[0232] Referring to Figures 8 and 10, the electronic tags of the hardware terminal are mainly used to authenticate and identify the specific identity information of the wearable terminal A user entering the large factory / mining area. Wearable terminal A is equipped with an RFID electronic tag chip 8c, which stores the user's identification information. The processing program in server terminal B records the identity information of all RFID electronic tag chips 8c that are authorized to enter the factory area. When a user of wearable terminal A enters the factory area, the reading device reads the user's RFID electronic tag chip 8c identification information and uploads it to server terminal B. Factory management personnel can then perform a one-to-one matching between the RFID electronic tag chip 8c information recorded by server terminal B and the user's identity information. Through this process, the system can accurately associate wearable terminal A with users, achieving identification and location tracking for each user. Factory management personnel can manage server terminal B and query the binding status of RFID electronic tag chips 8c with wearable terminal A users, ensuring that wearable terminal A accurately reflects the real-time location information of the corresponding user during positioning and monitoring. This improves the positioning accuracy and management efficiency of wearable terminal A users.

[0233] The pedestrian indoor and outdoor positioning and navigation system of the present invention further includes a warning unit composed of one or more of the following: a buzzer, an alarm light, a vibration motor, and a running light.

[0234] Referring to Figures 9 and 10, the buzzer 9a, alarm light 9b, vibration motor 9c, and scrolling light 9d are mounted on the wearable terminal A and electrically connected to the PCB integrated circuit board 2. When the program in the server terminal B determines that the user of the wearable terminal A is in a dangerous state, the server terminal B drives the buzzer 9a in the wearable terminal A to emit a buzzing sound, or drives the alarm light 9b in the wearable terminal A to flash, or drives the vibration motor 9c in the wearable terminal A to vibrate, or drives the scrolling light 9d in the wearable terminal A to flash.

[0235] Example 1 of the warning unit's operation (refer to Figure 8);

[0236] The server terminal delineates hazardous areas or electronic fences within the positioning and navigation area and issues real-time alerts to wearable terminal users entering the area via warning units. When the system within the server terminal detects a wearable terminal approaching or entering a hazardous area or electronic fence, the system sends a warning signal to the wearable terminal or display terminal (fixed display screen or mobile monitor). Wearable terminal users are prompted to leave the hazardous area via the warning signal. Managers and security personnel, upon receiving the alarm signal, supervise or urge wearable terminal users to leave the hazardous area or electronic fence via the display terminal (fixed display screen or mobile monitor). This function is suitable for scenarios such as shipbuilding, construction sites, and warehouses. By pre-defining hazardous areas (such as high-voltage areas, hazardous work areas, and construction sites), the server terminal can monitor whether personnel have entered these areas and send notifications or alarms to relevant personnel and managers via terminal devices. This function significantly improves personnel safety management efficiency and reduces the occurrence of safety accidents.

[0237] Example 2 of the warning unit operation (refer to Figure 8);

[0238] When the server terminal system detects that the wearable user's gait, heading, posture, and altitude data have not been updated for an extended period, or when the server terminal system monitors the wearable user's movement in a specific area within the real-time positioning and navigation scene for a duration exceeding the system's preset time safety threshold, the server terminal sends a warning signal to the wearable terminal and the display terminal (fixed display screen or mobile display). The wearable user receives the warning signal through the wearable terminal and adjusts their posture or stops moving. Upon receiving the warning signal, management and security personnel supervise or urge the wearable user to adjust their posture or stop moving through the fixed display screen or mobile display.

[0239] Example 3 of the warning unit operation (refer to Figure 8);

[0240] The server terminal system records and stores data on the wearable terminal user's gait, posture, and trajectory under normal conditions. When the real-time motion data received by the server terminal is inconsistent with the gait, posture, and trajectory data recorded and stored by the server terminal system, the server terminal sends a warning signal to the wearable terminal or display terminal (fixed display screen or mobile monitor). The wearable terminal user receives the warning signal and adjusts their posture or stops exercising. After receiving the warning signal, managers and security personnel supervise or urge the wearable terminal user to adjust their posture or stop exercising through the display terminal (fixed display screen or mobile monitor).

[0241] Example 4 of the warning unit operation (refer to Figure 8);

[0242] When the server terminal system detects inconsistencies between the electronic tag data transmitted by the reading devices installed within the map view, building view, and factory / mining area view and the data stored internally, or when the server terminal system monitors in real-time via location data that the user's movement time in a specific area within the map view, building view, or factory / mining area view exceeds the system's preset time safety threshold, the server terminal sends a warning signal to the wearable terminal or display terminal (fixed display screen or mobile display). The user is prompted by the warning signal to leave the area where the reading device is installed or the specific area within the navigation view, or to stop moving. Upon receiving the warning signal, management and security personnel supervise or urge the user to leave the area where the reading device is installed or the specific area within the navigation view, or to stop moving, through the display terminal (fixed display screen or mobile display).

[0243] In the pedestrian indoor and outdoor positioning and navigation system of the present invention, in the above-described specific embodiments one to four of its warning unit (referring to Figure 8), the location and trajectory information of the wearable terminal user, the management personnel carrying the mobile display, and the security personnel are further displayed on a fixed display terminal. After receiving the warning signal, the management personnel and security personnel can check the specific status of the wearable terminal user on-site through the location information of the wearable terminal user displayed on the mobile display or the fixed display screen.

[0244] The pedestrian indoor and outdoor positioning and navigation system of the present invention, as shown in Figures 10, 11, and 12, further includes a distress unit consisting of a call button 9e and a speaker 9f, or a combination of both. The call button 9e and the speaker 9f are electrically connected to the PCB integrated circuit board 2.

[0245] Referring to Figure 8, when the wearable terminal user is in the scenario described in Embodiments 1 to 4 of the above-described warning unit, the user can send a distress signal to management and security personnel via the call button on the wearable terminal. Management and security personnel will receive the distress signal via a portable display and rush to the scene to rescue the wearable terminal user. During the rescue, management and security personnel can communicate with the wearable terminal user via a speaker on the wearable terminal.

[0246] Referring to Figure 8, when the wearable terminal user is in the scenario described in the first to fourth embodiments of the warning unit, the server terminal can send out a voice distress signal through the speaker of the wearable terminal to request others to help the wearable terminal user.

[0247] The pedestrian indoor and outdoor positioning and navigation system of the present invention, as shown in Figure 11, includes a health monitoring unit composed of a PPG sensing element 10a and an ECG sensing element 10b in the wearable terminal A. The PPG sensing element 10a and the ECG sensing element 10b are electrically connected to the PCB integrated circuit board 2. As shown in Figure 12, a transparent hole 1ba is provided on the lower housing 1b of the wearable terminal A. The PPG sensor 10aa at the front end of the PPG sensing element 10a (shown in Figure 11) passes through the transparent hole 1ba on the lower housing 1b and is in contact with the skin of the human body's joints (such as the ankle).

[0248] Referring to Figures 11 and 12, the wearable terminal is attached to point A at a joint of the human body. The PPG sensor 10a emits red and green light, which is absorbed by the blood and tissues of the leg and reflected outwards. The sensor detects the different intensities of the reflected light after absorption by the blood and tissues. Different intensities of reflected light are converted into different electrical signals. These different electrical signals are analyzed by the PPG sensor algorithm to obtain the corresponding heart rate information, recording the changes in blood vessel volume during the cardiac cycle, and calculating the heart rate from the obtained pulse waveform. The server terminal transmits the heart rate information calculated by the PPG sensor to the display terminal for external display.

[0249] Wearable devices are attached to the body's joints (such as the ankles). ECG sensors measure and record the heart's electrical activity by contacting the skin, providing information about heart function and health. ECG sensors typically consist of multiple electrodes attached to the leg via a wearable device. When the heart beats, the electrodes detect the weak electrical currents generated by the heart and convert them into voltage signals. These signals are then recorded by the sensor and connected to a server terminal for analysis and displayed on a display terminal.

[0250] The pedestrian indoor and outdoor positioning and navigation system described in this invention can comprehensively understand the heart health status of the wearable terminal user through the PPG sensor and ECG sensor installed on the wearable terminal, promptly detect potential heart problems, and take appropriate measures to protect heart health.

[0251] The above is a detailed description of the pedestrian indoor and outdoor positioning and navigation system and its human motion trajectory recognition algorithm provided by the embodiments of the present invention. For those skilled in the art, based on the ideas of the embodiments of the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be construed as a limitation of the present invention, and any changes made in accordance with the design ideas of the present invention are within the protection scope of the present invention.

Claims

1. A human motion trajectory recognition algorithm, characterized in that, A sensing device that moves with the body is attached to the body, and the recognition algorithm includes: Gait recognition algorithms include stride length recognition and gait frequency recognition. Stride length recognition obtains the current stride distance (i.e., stride length) from a pre-established human height-stride length mapping table. Sensors collect the human body's motion frequency signals, and Fourier transforms the frequency domain characteristics of acceleration and / or angular velocity in the motion signals. The time-domain signal of these frequency domain characteristics is then converted to a frequency domain signal using a Fourier transform to obtain the gait frequency (i.e., gait frequency). The walking speed, distance, and position data are calculated by multiplying the stride length and gait frequency values. Direction recognition algorithm; The system receives human motion state signals collected by different sensors in the attitude heading reference system (AHRS) of the sensing device, and calculates the attitude of the sensor device through a complementary filtering algorithm. By continuously correcting the changes in the orientation information, gravity information and tilt angle information of the sensing device, the system calculates the orientation and angle data of the human motion direction. High-resolution recognition algorithm; Using the baseline air pressure information as a reference value, the sensor measures the real-time air pressure value at its altitude. The system calculates the current altitude data of the sensor by the air pressure difference between the baseline air pressure and the real-time air pressure of the sensor, and then estimates the current altitude of the human body relative to the ground.

2. The human motion trajectory recognition algorithm according to claim 1, characterized in that, The recognition algorithm also includes a posture recognition algorithm; The system analyzes and corrects the data deviations of the accelerometer and gyroscope collected by the IMU (Inertial Measurement Unit) of the sensor device during the oscillation period while the sensor device is stationary, and determines the orientation of the sensor device by combining the orientation data of the magnetometer (compass) of the sensor device. The orientation of the human body and the initial direction of motion are estimated by the orientation of the sensor device.

3. The human motion trajectory recognition algorithm according to claim 1, characterized in that, The identification algorithm also includes any one or a combination of two or more of the following algorithms: beacon fusion algorithm, map fusion algorithm, and GPS fusion algorithm; The beacon fusion algorithm fuses beacon location data with sensor positioning data. After the sensor positioning data and beacon location data are predicted, corrected and optimized by Kalman filtering, the system recalculates the sensor positioning information in the dynamic environment, thereby identifying the current location data of the human body. The map fusion algorithm is a system that generates a large number of random particles based on the historical motion trajectory information and the current position information of the sensing device. Each particle simulates and predicts different target motion states based on the motion information. The particle filtering algorithm will match the simulation results with the map to eliminate erroneous particle estimates. By continuously eliminating erroneous particle predictions, the estimation converges, identifies the specific position of the current sensing device, and then calculates the current position data of the human body. The GPS fusion algorithm, using a Kalman filter, combines the positioning data provided by the GPS sensor with the data from the inertial measurement unit (IMU) sensor built into the sensor. By weightedly fusing the GPS and IMU data, the Kalman filter dynamically adjusts the IMU sensor error to accurately determine the position information of the sensor and then calculates the current position data of the human body.

4. The human motion trajectory recognition algorithm according to claim 1, characterized in that, The height recognition algorithm is one of the following recognition algorithm modes: static vertical rise and fall recognition, dynamic vertical motion recognition, static angle rise and fall recognition, and dynamic angle motion recognition, or a combination of two or more recognition algorithm modes. Static vertical ascent and descent recognition means that when the gait values, posture values, and position data in the sensor are in a static state while the height value is changing, the system recognizes the vertical ascent and descent state of the human body in a static state based on the change in the height value of the sensor, and at the same time the system calculates the change in the height value of the human body. Dynamic vertical motion recognition: When the position data of the monitoring sensor is in a static state while the gait, posture and height values ​​are changing, the system identifies the vertical up-and-down motion of the human body based on the changes in gait, posture and height values. At the same time, the system calculates the change in the human body's height. Static angle rise and fall recognition: When the gait and posture values ​​in the monitoring sensor are in a static state while the position and height values ​​are changing, the system can identify the oblique angle rise and fall state of the human body while it is stationary based on the changes in position and height values. At the same time, the system can calculate the changes in the human body's position and height. Dynamic angle motion recognition: When the gait, posture and height data of the sensor are changing simultaneously, the system identifies the oblique angle motion state of the human body based on the changes in the gait, posture and height data of the sensor. At the same time, the system calculates the position and height change values ​​of the human body.

5. A pedestrian indoor and outdoor positioning and navigation system, comprising the human motion trajectory recognition algorithm as described in any one of claims 1-4, characterized in that, It also includes wearable terminals with built-in sensors, initial positioning methods, display terminals, and server terminals; The wearable terminal is attached to the human body and senses the human body's movement posture and amplitude. The server terminal is a local server or cloud server connected to a positioning and navigation scene. The positioning and navigation scene corresponds to the positioning and navigation real scene where the human body is moving. The display terminal is used to receive and display the positioning and movement trajectory data of the wearable terminal in the positioning and navigation real scene. The initial positioning method includes the following steps: The S1 server terminal receives human posture, orientation, and GPS location information collected by the wearable terminal, and uses a posture recognition algorithm to confirm the human standing orientation and infer the initial movement direction. The S2 server imports the data information received from the wearable terminal into its positioning and navigation scenario; The S3 server sends the wearable terminal data imported in step S2 to the display terminal.

6. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The positioning and navigation scene is any one of the following: map scene, building 3D model scene, and workplace 3D model scene, or a combination of two or more scenes. The corresponding positioning and navigation real scene is any one of the following: map real scene, building real scene, and workplace real scene, or a combination of two or more real scenes. The map scene can be any one of the online map scene, offline map scene, and simulated map scene, or a combination of two or more scenes; The 3D model scene of the building is obtained by scanning the actual building or by computer 3D modeling or generation, and the 3D model scene of the workplace is obtained by scanning the actual workplace or by computer 3D modeling or generation.

7. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The positioning and navigation system also includes positioning beacons deployed within the positioning and navigation real-world scene; The positioning beacon establishes a wireless connection with the wearable terminal via Bluetooth, and the data collected by its built-in barometer and accelerometer is transmitted outward via Bluetooth broadcast signals.

8. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The display terminal includes a mobile display terminal and / or a fixed display terminal; The mobile display terminal and the wearable terminal are carried and used by one person at the same time, or by two people respectively. The fixed display terminal in the positioning and navigation system may display the positioning and movement trajectory of the wearable terminal alone, or simultaneously display the positioning and movement trajectory of both the wearable terminal and the mobile display terminal.

9. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The positioning and navigation system also includes an identification and authentication module consisting of electronic tags, a reading device, and a computing program loaded in a server. The electronic tags are installed in the wearable terminal, and the reading device is installed in the positioning and navigation real-world scene to read data information from nearby electronic tags. After the system identifies and authenticates the electronic tag data information, it sends instructions to the wearable terminal and the display terminal.

10. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The positioning and navigation system also includes a hazard warning module; Within the real-world positioning and navigation scene, a danger zone is designated or an electronic fence is set up. When the system detects that a wearable terminal is approaching or entering the danger zone or electronic fence, the system sends a warning signal to the wearable terminal, mobile display terminal, or fixed display terminal via the server terminal; or When the system detects that the human movement gait, direction, posture, and height data within the wearable terminal have not been updated for an extended period, the system sends a warning signal to the wearable terminal, mobile display terminal, or fixed display terminal via the server terminal; or The system uses AI algorithms to analyze, record, and store data on the wearable device user's gait, posture, and trajectory under normal conditions. When a discrepancy is detected between the user's data and the data recorded and stored by the system, the system sends a warning signal to the wearable device, mobile display terminal, or fixed display terminal via the server terminal; or When the system detects that the electronic tag data sent by the reading device is inconsistent with the data stored in the system, the system sends a warning signal and location information to the mobile display terminal or fixed display terminal through the server terminal; or the system monitors the duration of the wearable terminal user's stay in the location navigation scene in real time through the location data. If the stay time exceeds the system's preset time safety limit threshold, the system sends a warning signal to the wearable terminal, mobile display terminal or fixed display terminal through the server terminal.

11. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The positioning and navigation system also includes an alarm and rescue module; When the system cannot detect the wearable terminal signal, or the wearable terminal signal suddenly disappears, or the wearable terminal signal fluctuates violently, the system sends the wearable terminal location information and rescue signal to security personnel, management personnel, or other users of nearby mobile display terminals through the service terminal; or After receiving a warning signal that it has entered a dangerous area or an electronic fence, if the system detects that the wearable terminal's gait, direction, posture, and height data have no change or fluctuate drastically, the system will send the wearable terminal's location information and rescue signal to security personnel, managers, or other users of nearby mobile display terminals through the service terminal.

12. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The positioning and navigation system also includes a data storage and analysis module installed in the server terminal; The system automatically counts the number of wearable devices within the real-world location and navigation scene, and analyzes the number to determine the flow and density of users of these devices in the area; or The system stores historical motion data from several wearable devices, and generates motion trajectory and behavioral preference data for each wearable device user through big data analysis, thereby providing customized personalized services for wearable device users; or The system monitors the specific times when users enter and leave the location navigation scene through the real-time positioning information of the wearable terminal. Based on this time data, it calculates the user's attendance coefficient and working hours, and further analyzes the work efficiency of the wearable terminal users.

13. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The wearable terminal housing contains a PCB integrated circuit board and is electrically connected to the PCB integrated circuit board. The positioning and attitude initialization identification unit consists of a GPS module and an IMU inertial measurement module; The gait recognition unit consists of an accelerometer, a gyroscope, a magnetometer, and a barometer. A wireless communication unit consisting of one or more modules, including NB-IoT narrowband Internet of Things module, Bluetooth communication module, cellular mobile communication module, LoRa module, and Wi-Fi module; The power supply unit consists of a power management chip, a switch, a battery, and charging components that are electrically connected to the PCB integrated circuit board.

14. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The server terminal is equipped with a wireless communication unit that is compatible with the wearable terminal. The server terminal and the wearable terminal establish an interactive communication connection through a wireless communication unit and receive and store the user's positioning, posture, gait, movement trajectory and location information monitored by the wearable terminal.

15. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The wearable terminal is equipped with a beacon identification unit consisting of a Bluetooth SOC chip; The Bluetooth SOC chip is electrically connected to the PCB integrated circuit board of the wearable terminal, and the wearable terminal communicates unidirectionally with the positioning beacon via Bluetooth signal; The wearable device sends location information from a positioning beacon to the server terminal via a wireless communication unit to further determine the wearable device's real-time location.

16. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The wearable terminal is equipped with an electronic tag unit consisting of a coupling element, an RFID chip, and a reading device located in the navigation area. The coupling element and RFID chip are electrically connected to the PCB integrated circuit board of the wearable terminal. The wearable terminal and the reading device set in the navigation area achieve spatial coupling of radio frequency signals through the coupling element, thereby completing the data transmission and data exchange.

17. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The wearable terminal is equipped with a warning unit consisting of one or more of the following components: a buzzer, an alarm light, a vibration motor, and a scrolling light, all electrically connected to the PCB integrated circuit board.

18. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The wearable terminal is equipped with a distress unit consisting of a call button and a speaker, or a combination of both, which are electrically connected to the PCB integrated circuit board.

19. The pedestrian indoor and outdoor positioning and navigation system according to claim 5, characterized in that, The wearable terminal is equipped with a health monitoring unit consisting of a PPG sensing element and an ECG sensing element that are electrically connected to the PCB integrated circuit board.

Images