Navigation method based on intelligent glasses

Abstract

The invention relates to the technical field of artificial intelligence, and discloses a navigation method based on intelligent glasses. The method comprises the steps that a user starts navigation through a wake-up word and a voice instruction, after a destination is input, intelligent glasses automatically recognize and search a path result, the path result is broadcasted through voice for the user to select, the intelligent glasses obtain a high-precision virtual blind sidewalk map of a city where the user is located, and an optimal path is generated through a path planning algorithm. The intelligent glasses convert the path distance into the individualized step number of the user, start the environment perception and path correction functions, optimize the navigation route in real time, and enhance the direction perception and improve the navigation accuracy and accessibility by adopting a voice and vibration dual feedback mode. According to the method, high-precision positioning, intelligent path correction, multi-mode feedback and path presentation with the step number as the unit can be realized.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a navigation method based on smart glasses. Background Art

[0002] With the continuous development of smart wearable device technology, navigation functions based on smart glasses are gradually being applied to daily travel. Especially for the visually impaired, traditional navigation methods such as mobile maps, paper road maps, or voice guide tools still have many limitations in terms of interactivity, real-time performance, and environmental adaptability, making it difficult to meet their needs for efficient and safe travel in complex urban environments.

[0003] Existing navigation devices mostly rely solely on GPS positioning to provide route information, which struggles to cope with signal weakness in tall buildings or indoor environments, resulting in inaccurate positioning. Furthermore, traditional path planning algorithms fail to fully consider specific requirements such as connectivity for blind paths, obstacle avoidance, and road safety. Furthermore, existing devices lack close coordination between voice announcements and tactile feedback, making it difficult for users to accurately grasp navigation directions in noisy environments or with hearing impairments. Furthermore, navigation route distances are typically measured in meters or kilometers, which hinders the ability of blind users to perceive and pace themselves.

[0004] Therefore, there is an urgent need for a smart glasses navigation method that can achieve high-precision positioning, intelligent path correction, multimodal feedback, and present the path in units of "steps" to improve the autonomous travel ability and safety of visually impaired users in actual scenarios. Summary of the Invention

[0005] In view of this, the present invention proposes a navigation method based on smart glasses, which can achieve high-precision positioning, intelligent path correction, multimodal feedback, and present the path in units of "steps".

[0006] The navigation method based on smart glasses proposed in the present invention includes: The user uses a wake-up word to wake up the smart glasses. After the smart glasses wake up, the user uses voice commands to input the destination name, causing the smart glasses to enter navigation mode. After entering navigation mode, the smart glasses automatically recognize the destination name input by the user and search, obtaining a route result to the destination; The route results of the destination are broadcasted to the user by voice. The user selects one of the routes from the route results of the destination and provides feedback. After receiving the feedback, the smart glasses load a high-precision virtual blind path map of the city from the cloud server. The smart glasses use a path planning algorithm to obtain the optimal route. Smart glasses convert the kilometers in the optimal route into steps based on the length corresponding to the user's steps. At the same time, smart glasses activate the environmental perception function and path correction function to make real-time corrections to the optimal route. Smart glasses continue to provide voice guidance during navigation.

[0007] Furthermore, the wake-up words include glasses power on, glasses start; The voice instructions include start navigating to a certain place, navigate to a certain place, and I want to go to a certain place.

[0008] Furthermore, after the smart glasses enter the navigation mode, they automatically recognize the destination name entered by the user and search for it, and obtain the route result to the destination. The specific content is: the smart glasses locate the current user's precise coordinates through GPS. If the GPS signal is weak, they switch to Wi-Fi fingerprint positioning and Bluetooth beacon assisted positioning. After obtaining the current user's precise coordinates, they determine how many paths there are between the current user's precise coordinates and the destination, and output the route result to the destination.

[0009] Furthermore, the smart glasses use GPS to locate the precise coordinates of the current user. If the GPS signal is weak, it switches to Wi-Fi fingerprint positioning and Bluetooth beacon-assisted positioning. The specific content is: first, the smart glasses detect the GPS signal strength. When the signal strength is lower than the preset threshold, the positioning mode switching mechanism is automatically triggered. At this time, the smart glasses call the built-in Wi-Fi module to scan the BSSID and signal strength information of the surrounding wireless networks, and match them with the local cache or cloud-based Wi-Fi fingerprint database to quickly estimate the user's location. At the same time, if there are supported Bluetooth low-power beacons deployed nearby, the smart glasses will combine the beacon's unique ID and the received signal strength indication to further correct the positioning result.

[0010] Furthermore, the route results of the destination are voice broadcast to the user, and the user selects one of the routes from the route results of the destination for feedback. The specific content is: when the destination name entered by the user has multiple possible matches in the smart glasses, the smart glasses system will automatically identify all target locations, and generate corresponding multiple route results based on geographic location information, hotspot frequency, and user historical access records. The smart glasses will broadcast the name, area, surrounding landmarks and corresponding route number of each candidate destination one by one in voice form. The user can determine the target location through voice commands. After receiving the feedback, the smart glasses will set the selected route as the target navigation path and enter the real-time guidance mode.

[0011] Furthermore, after receiving feedback, the smart glasses load a high-precision virtual tactile road map of the city from the cloud server. The smart glasses use a path planning algorithm to obtain the optimal path. Specifically, after receiving the destination feedback confirmed by the user, the smart glasses immediately connect to the cloud server through the network, retrieve and load high-precision virtual tactile road map data of the corresponding area in the city where the user is located. After obtaining the map data, the smart glasses use a modified A* algorithm to generate an optimal path by comprehensively considering the tactile road connectivity, path slope, obstacle avoidance capability, traffic light control time, ambient lighting conditions and path accessibility.

[0012] Furthermore, the virtual tactile road map is constructed based on lidar mapping, street view data, urban management database and crowdsourced data, and includes detailed road contours, tactile road locations, zebra crossings, ground warning signs, obstacles, uphill and downhill slopes, intersection types, traffic light layouts, and auxiliary facilities.

[0013] Furthermore, the smart glasses change the kilometers in the optimal path into steps based on the length corresponding to the user's steps. The specific content is: after completing the optimal path planning, the smart glasses call the user walking model built into the smart glasses to convert the total distance of the path into an estimated value of the user's individualized step count. The conversion is based on the average stride length information recorded when the user first uses the device or in the historical wearing data. The stride length information is calculated based on height, cadence, and walking rhythm, and can be dynamically adjusted to match the user's current gait.

[0014] Furthermore, the smart glasses activate the environmental perception function and the path correction function to correct the optimal path in real time. The specific contents are as follows: during the navigation process, the smart glasses simultaneously activate the environmental perception function and the path correction function. The environmental perception function relies on multi-sensor fusion technology, including cameras, laser ranging, depth vision modules, IMUs and microphone arrays, to perform real-time perception and semantic recognition of the surrounding environment. When the environmental perception function determines that the current path is not suitable for passage, the smart glasses will automatically trigger the path correction function, call the local path update algorithm and the cloud map incremental update service, and recalculate the alternative path based on the current position according to safety. The corrected new path will be re-planned with the principle of minimum change. During the path correction process, the smart glasses guide the user to complete the turning, avoidance or return to the original route through audio broadcast and vibration feedback prompts to ensure that the correction process is natural and smooth.

[0015] Furthermore, the smart glasses continuously perform voice broadcasts during the navigation process, and the smart glasses have vibration feedback to enhance direction perception, so that the user can clearly understand the specific content of the path direction: the smart glasses activate the multimodal guidance mechanism in the navigation mode, in which voice broadcasts are the dominant prompt method, and continuously provide key node information of the path, including the turning point to be reached, the remaining distance, the characteristics of the intersection, the obstacle reminder and the destination approaching prompt. In order to further enhance the user's ability to perceive the path direction in a complex environment, the smart glasses integrate a micro vibration feedback module, which is usually located on both sides of the temples, corresponding to the left and right directions of the user respectively.

[0016] Compared with the prior art, the present invention has the following beneficial effects: In environments where GPS signals are weak or unavailable, the smart glasses-based navigation method automatically switches to Wi-Fi fingerprint positioning and Bluetooth beacon-assisted positioning, improving positioning accuracy and stability and ensuring positioning continuity. The method supports multiple route plans for the same destination, allowing users to confirm their route through voice feedback, preventing incorrect destination selection and improving navigation accuracy. The method incorporates a city-level virtual tactile path map, considers multi-dimensional factors such as tactile path connectivity, slope, obstacle avoidance, and lighting, and uses an improved A* path planning algorithm to generate safer and more reasonable travel routes, particularly suitable for users with low vision or who require assisted travel. The method converts total route kilometers into steps through a personalized stride length model, enhancing users' perception of the remaining distance and improving the intuitiveness and controllability of navigation. The method integrates multiple sensors such as cameras, laser ranging, depth vision, and IMUs to achieve real-time analysis of the surrounding environment, allowing timely correction of the navigation route when encountering obstacles or road closures, ensuring uninterrupted navigation. The method combines voice announcements with a temple vibration feedback mechanism to provide synchronized prompts when the user turns, changes direction, or at key nodes, enhancing directional perception, particularly suitable for users with hearing or visual limitations. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present invention. The same reference symbols are used throughout the drawings to represent the same components. In the drawings: Figure 1 The figure is a flowchart of a navigation method based on smart glasses according to an embodiment of the present invention. DETAILED DESCRIPTION

[0018] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art. It should be noted that, unless there is a conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

[0019] See Figure 1 As shown, an embodiment of the present invention provides a navigation method based on smart glasses, including: S1: The user uses a wake-up word to wake up the smart glasses. After the smart glasses wake up, the user uses a voice command to input the destination name, causing the smart glasses to enter navigation mode. After entering navigation mode, the smart glasses automatically recognize the destination name input by the user and search, obtaining a route result to the destination; S2: The route results for the destination are announced to the user by voice. The user selects one of the routes from the destination and provides feedback. After receiving the feedback, the smart glasses load a high-precision virtual blind path map of the city from the cloud server and use a path planning algorithm to determine the optimal route. S3: The smart glasses change the kilometers in the optimal route to steps based on the length corresponding to the user's steps. At the same time, the smart glasses use the environmental perception function and path correction function to make real-time corrections to the optimal route. S4: The smart glasses continuously broadcast voice instructions during the navigation process, and the smart glasses have vibration feedback to enhance direction perception, allowing users to clearly understand the direction of the path.

[0020] Furthermore, the wake-up words include glasses power on, glasses startup; Voice commands include start navigating to a certain place, navigate to a certain place, and I want to go to a certain place.

[0021] Furthermore, after entering the navigation mode, the smart glasses automatically recognize the destination name entered by the user and search for it, and obtain the route result to the destination. The specific content is: the smart glasses locate the current user's precise coordinates through GPS. If the GPS signal is weak, it switches to Wi-Fi fingerprint positioning and Bluetooth beacon assisted positioning. After obtaining the current user's precise coordinates, it determines how many paths there are between the current user's precise coordinates and the destination, and outputs the route result to the destination.

[0022] Furthermore, the smart glasses use GPS to locate the precise coordinates of the current user. If the GPS signal is weak, it switches to Wi-Fi fingerprint positioning and Bluetooth beacon-assisted positioning. The specific contents are as follows: First, the smart glasses detect the GPS signal strength. When the signal strength is lower than the preset threshold (such as urban canyons, subway station entrances, underground passages or shopping malls and other GPS signal blocking environments), the positioning mode switching mechanism is automatically triggered. At this time, the smart glasses call the built-in Wi-Fi module to scan the BSSID (ie MAC address) and signal strength (RSSI) information of the surrounding wireless networks and other parameters, and match them with the local cache or cloud-based Wi-Fi fingerprint database to quickly estimate the user's location. At the same time, if there are supported Bluetooth low-power beacons deployed nearby, the smart glasses will combine the beacon's unique ID with the received signal strength indication to further correct the positioning results.

[0023] It should be noted that the above method can significantly improve positioning reliability in scenarios with weak GPS signals (such as indoors, underground, and in areas with high-rise buildings), ensure the accuracy of navigation starting point data, enhance positioning through the fusion of Wi-Fi fingerprints and Bluetooth beacons, and provide meter-level or even sub-meter-level positioning accuracy. It can ensure that path planning is based on the actual starting point location, avoid navigation path deviation or misleading, improve travel safety for visually impaired users, and support automatic switching of multiple positioning modes, improve system robustness and adaptability, so that smart glasses can maintain navigation consistency and stability in different usage scenarios.

[0024] Furthermore, the route results of the destination are broadcast to the user by voice, and the user selects one of the routes from the route results of the destination for feedback. The specific content is: when the destination name entered by the user has multiple possible matches in the smart glasses, the smart glasses system will automatically identify all target locations, and generate corresponding multiple route results based on geographic location information, hotspot frequency, and user historical access records. The smart glasses will broadcast the name, area, surrounding landmarks and corresponding route number of each candidate destination one by one in voice form. The user can determine the target location through voice commands. After receiving the feedback, the smart glasses will set the selected route as the target navigation path and enter the real-time guidance mode. At the same time, to prevent misselection, the smart glasses support changing the route selection in a short time to ensure that the destination finally confirmed by the user is consistent with the navigation.

[0025] Specifically, when the destination name input by the user through voice has multiple possible matches in the smart glasses system (such as duplicate places, ambiguous place names, or store names with multiple branches), the system will automatically activate the fuzzy matching and multi-target recognition mechanism, and comprehensively generate multiple possible route results based on factors such as the user's current location, geographic location relevance, the destination's popularity ranking in the city (such as visit frequency), the user's historical travel records and personalized preferences.

[0026] Each route result includes the candidate destination name, the area (e.g., street, business district, administrative division), nearby landmarks (e.g., bus stops, hospitals, shopping malls, schools), and a unique voice-guided route number. Leveraging speech synthesis technology, the smart glasses announce each candidate to the user, ensuring visually impaired users can clearly hear and accurately identify each candidate.

[0027] Users can quickly select a target route using voice feedback commands (e.g., "Select the second route," "I'll go to the third route"). Upon receiving the user's command, the system immediately sets the selected route as the current navigation target and enters real-time guidance mode.

[0028] In order to avoid misselections caused by voice recognition bias, user misunderstanding, etc., the system has also designed a short-term change mechanism: within a short time window (for example, 10 seconds) after the user selects the target, the system continues to monitor user input and allows them to confirm path modifications through instructions (such as "return to the previous option" or "reselect the destination"), further enhancing the flexibility and fault tolerance of the navigation process.

[0029] It should be noted that the implementation of the above mechanism significantly enhances the navigation accuracy and fault tolerance of smart glasses when faced with polysemous input or ambiguous place names. This is particularly applicable to common situations such as duplicate roads, chain organizations, and similar landmarks within the same city. For example, the destination "People's Hospital" may have multiple branches in a city. The system can effectively distinguish the districts to which they belong and, based on the user's past behavior of visiting "South District People's Hospital", prioritize it at the top of the candidate list, achieving personalized recommendation priority sorting.

[0030] By announcing the name, area, landmark, and number of each route through voice, not only does the clarity of voice interaction improve, but it also reduces the pressure on visually impaired users to memorize complex information in a short period of time. This is especially user-friendly without screen assistance. The numbering mechanism (such as "Route One" and "Route Two") enhances the clarity of route selection instructions and the accuracy of feedback, effectively avoiding incorrect selections caused by ambiguous user expressions.

[0031] The "short-term change" mechanism supported by smart glasses (for example, allowing re-specification within 10 seconds) further reflects the humanized design. Even if the user hesitates or finds that the selection is wrong after the first route selection, they can immediately adjust it through voice commands, avoiding the interruption of the entire navigation or the wrong path guidance due to incorrect selection, thereby significantly improving the robustness and operational safety of the navigation interaction process.

[0032] Furthermore, after receiving feedback, the smart glasses load a high-precision virtual tactile road map of the city from the cloud server. The smart glasses use a path planning algorithm to obtain the optimal path. The specific content is: after receiving the destination feedback confirmed by the user, the smart glasses immediately connect to the cloud server through the network, retrieve and load the high-precision virtual tactile road map data of the corresponding area in the user's city. After obtaining the map data, the smart glasses use a comprehensive consideration of the tactile road connectivity, path slope, obstacle avoidance ability, traffic light control time, ambient lighting conditions and path accessibility, and use an improved A* algorithm to generate an optimal path.

[0033] Specifically, based on the traditional A path planning algorithm, a multi-dimensional environmental factor evaluation model suitable for blind navigation scenarios is introduced. By setting a multi-objective cost function, a weighted evaluation is performed on each node in the path, comprehensively considering factors such as the connectivity weight of the blind path, the cost of obstacle detours, the gentleness of the slope, the safety lighting level, the signal wait time, and the user's personal walking preferences (such as a tendency to avoid crowded areas or complex intersections). The improved algorithm incorporates a dynamic adaptive adjustment mechanism into the heuristic function, which can automatically adjust the path cost estimate based on real-time environmental perception data (such as temporary inaccessibility of a certain section of the path due to construction) or the user's navigation history. The algorithm also supports a local path replanning mechanism, which can quickly respond to environmental changes or user deviations from the planned path, ensuring continuous navigation with minimal path cost increments.

[0034] It's important to note that the introduction of this mechanism significantly improves the accuracy and adaptability of smart glasses in navigation route planning. By loading high-precision virtual tactile pathway map data of the user's city from a cloud server in real time, smart glasses not only avoid redundant local storage resources but also ensure that the acquired route data includes the latest city road structure, construction information, and tactile pathway change records, ensuring real-time and timely route planning.

[0035] The tactile path map integrates lidar mapping, street view image processing, urban infrastructure database, and crowdsourced correction data. It has centimeter-level spatial resolution and can present in detail various micro-elements including the material, starting and ending points, continuity, intersection type, obstacle layout, etc. of the tactile path, thus providing a solid data foundation for route planning.

[0036] During the path calculation stage, the improved A* path planning algorithm called by the smart glasses has stronger multi-factor parallel processing capabilities than traditional path algorithms. It can comprehensively consider key factors such as the connectivity of the blind path (avoiding breakpoints or unpaved areas), path slope and slope changes (facilitating movement stability), obstacle density and distribution (optimizing obstacle avoidance logic), traffic light control duration and waiting time (improving traffic efficiency), environmental lighting conditions (such as nighttime illumination), and overall path accessibility, to form an optimal path that takes into account safety, feasibility, and traffic efficiency.

[0037] Furthermore, the virtual tactile path map is constructed based on lidar mapping, street view data, urban management database and crowdsourced data, and contains detailed road contours, tactile path locations, zebra crossings, ground warning signs, obstacles, uphill and downhill slopes, intersection types, traffic light layout, and auxiliary facilities such as handrails and tactile path paving material information.

[0038] It should be noted that the construction of this virtual tactile path map is based on a multi-source heterogeneous data fusion mechanism. LiDAR mapping provides high-precision three-dimensional spatial geometric information, street view data supplements visual semantic information, and the urban management database provides authoritative infrastructure data support. Crowdsourced data is continuously corrected and supplemented in real time through actual user feedback, forming a highly refined and dynamically updated digital tactile path map system.

[0039] The road contour information contained in the map can help the navigation algorithm clearly identify the traversable boundaries and prevent deviation from the safe area; the location and connectivity data of the tactile paths are used to ensure that path guidance always follows the physical tactile paths, ensuring the path continuity and spatial stability of visually impaired users when they rely on the tactile paths; zebra crossing and intersection type information is used to formulate safety strategies during the navigation process, such as identifying traversable sections of road and evaluating the timing of crossing the street.

[0040] Ground warning signs and obstacle data can be used for path obstacle avoidance judgment and warning triggering, enabling smart glasses to perceive potential obstacles such as construction fences, utility poles, billboards, etc. in advance during navigation, and provide timely reminders through voice or vibration; uphill and downhill slope information is particularly important for action assistance. The system can avoid steep slopes to ensure action safety and gait stability; traffic light layout information allows the system to synchronize signal cycles, thereby optimizing the waiting logic for crossing the street and improving travel efficiency.

[0041] The map also integrates information on auxiliary facilities, such as handrail locations, tactile paving material types, and wear and tear, providing a crucial basis for subsequent path comfort assessment and intelligent feedback adjustments. With this detailed data support, smart glasses can achieve more accurate and realistic path planning and scene adaptation, greatly improving the feasibility, reliability, and user safety of the navigation process.

[0042] Furthermore, the smart glasses change the kilometers in the optimal path into steps based on the length corresponding to the user's steps. The specific content is: after completing the optimal path planning, the smart glasses call the user walking model built into the smart glasses to convert the total distance of the path into an estimated value of the user's individualized step count. The conversion is based on the average stride length information recorded when the user first uses the device or in the historical wearing data. The stride length information is calculated based on height, cadence, and walking rhythm, and can be dynamically adjusted to match the user's current gait.

[0043] Specifically, after completing optimal path planning, the smart glasses use a built-in user walking model to perform a personalized calculation of the path length. This model uses initial physical data collected when the user first uses the device (such as height, age, and gender), combined with walking behavior characteristics automatically recorded during daily use (including cadence, stride length, acceleration characteristics, start-stop reaction, etc.) to calculate an individual's unique dynamic average stride length.

[0044] This model converts the total kilometer length of the route into steps, which the smart glasses present as "estimated steps" when displaying navigation distance information, helping users more intuitively understand the quantification of the remaining distance. Furthermore, this step conversion process can be adaptively adjusted in real time during navigation. For example, if the user's walking pace fluctuates significantly throughout the day (such as increasing or decreasing cadence), the smart glasses detect the change in stride length through the IMU and inertial navigation sensors and immediately adjust the conversion parameters to maintain accurate route estimation.

[0045] It should be noted that this function is of great significance to visually impaired users. Compared with abstract units such as "meters" or "kilometers", step feedback is closer to the user's subjective perception, which facilitates rhythm control, psychological expectation establishment and remaining distance judgment. At the same time, this personalized step feedback mechanism can also be linked with the vibration guidance frequency to achieve rhythmic navigation prompts based on stride rhythm, enhance the naturalness and sense of synchronization of guidance, and improve navigation comfort and travel confidence.

[0046] Furthermore, the smart glasses activate the environmental perception function and the path correction function to make real-time corrections to the optimal path. The specific contents are as follows: During the navigation process, the smart glasses simultaneously activate the environmental perception function and the path correction function. The environmental perception function relies on multi-sensor fusion technology, including cameras, laser ranging, depth vision modules, IMUs, and microphone arrays, to perform real-time perception and semantic recognition of the surrounding environment. Once the environmental perception function determines that the current path is not suitable for travel, the smart glasses will automatically trigger the path correction function, call the local path update algorithm and the cloud map incremental update service, and recalculate an alternative path with higher accessibility and greater safety based on the current position. The corrected new path will be re-planned based on the principle of minimum change. During the path correction process, the smart glasses use audio broadcast and vibration feedback prompts to guide the user to complete the turning, avoidance or return to the original route to ensure that the correction process is natural and smooth.

[0047] Furthermore, the smart glasses continuously provide voice broadcasts during the navigation process, and the smart glasses have vibration feedback to enhance direction perception, so that users can clearly understand the specific content of the path direction: the smart glasses activate the multimodal guidance mechanism in navigation mode, in which voice broadcasts are the dominant prompt method, and continuously provide key node information of the path, including the upcoming turning point, remaining distance, intersection features, obstacle reminders and destination approaching prompts. In order to further enhance the user's perception of path direction in complex environments, the smart glasses integrate a micro vibration feedback module, which is usually located on both sides of the temples, corresponding to the left and right directions of the user respectively.

[0048] It should be noted that the multimodal interaction mechanism can still ensure the accurate transmission of navigation instructions in noisy, dimly lit or difficult language recognition environments, significantly improving navigation stability and fault tolerance. Especially for visually impaired users, vibration guidance can greatly reduce their dependence on external sounds, effectively reduce the risk of path deviation due to hearing interference or environmental noise, enhance their understanding of spatial direction, and improve travel safety and independence. At the same time, the vibration system can also be linked with the path correction mechanism. In special circumstances such as temporary route changes, obstacle detours, temporary stops, etc., it will promptly issue vibration prompts of different frequencies to help users complete path adjustments or decision responses in the first time without the participation of visual information, thereby improving navigation response efficiency and user experience.

[0049] In this embodiment, smart glasses are coupled to the cognitive network through the communication network to monitor the movement of people with disabilities and avoid affecting the transportation network. Specifically, the smart glasses have a built-in positioning function, which transmits the location, movement speed and direction of disabled users to the city cognitive network (AI transportation hub) in real time through the communication network. When the cognitive network detects that the density of disabled users in a specific area (such as a subway station exit or hospital entrance) exceeds the threshold, it immediately sends warning coordinates to the traffic management platform. The command center can remotely dispatch volunteers or activate backup channels to prevent local paralysis.

[0050] It should be noted that the above function can issue early warnings before the surge in pedestrian / vehicle traffic pressure at key nodes (such as subway station exits and hospital entrances), avoiding the chain reaction and larger-scale congestion caused by the formation of "blocking points". Through early warning and intervention, it avoids the waste of resources caused by the need to deploy more police forces, vehicles or large-scale traffic control due to local paralysis. Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered by the scope of protection of the claims of the present invention.

Claims

1. A navigation method based on smart glasses, characterized in that: include: The user uses a wake-up word to wake up the smart glasses. After the smart glasses wake up, the user uses voice commands to input the destination name, causing the smart glasses to enter navigation mode. After entering navigation mode, the smart glasses automatically recognize the destination name input by the user and search, obtaining a route result to the destination; The route results of the destination are broadcasted to the user by voice. The user selects one of the routes from the route results of the destination and provides feedback. After receiving the feedback, the smart glasses load a high-precision virtual blind path map of the city from the cloud server. The smart glasses use a path planning algorithm to obtain the optimal route. Smart glasses convert the kilometers in the optimal route into steps based on the length corresponding to the user's steps. At the same time, smart glasses activate the environmental perception function and path correction function to make real-time corrections to the optimal route. Smart glasses continue to provide voice guidance during navigation.

2. The navigation method based on smart glasses according to claim 1, characterized in that: The wake-up words include glasses power on and glasses startup; The voice instructions include start navigating to a certain place, navigate to a certain place, and I want to go to a certain place.

3. The navigation method based on smart glasses according to claim 2, characterized in that: After the smart glasses enter the navigation mode, they automatically recognize the destination name entered by the user and search for it, and obtain the route result to the destination. Specifically, the smart glasses locate the current user's precise coordinates through GPS. If the GPS signal is weak, they switch to Wi-Fi fingerprint positioning and Bluetooth beacon assisted positioning. After obtaining the current user's precise coordinates, they determine how many paths there are between the current user's precise coordinates and the destination, and output the route result to the destination.

4. The navigation method based on smart glasses according to claim 3, characterized in that: The smart glasses use GPS to locate the current user's precise coordinates. If the GPS signal is weak, they switch to Wi-Fi fingerprint positioning and Bluetooth beacon-assisted positioning. The specific content is: first, the smart glasses detect the GPS signal strength. When the signal strength is lower than the preset threshold, the positioning mode switching mechanism is automatically triggered. At this time, the smart glasses call the built-in Wi-Fi module to scan the BSSID and signal strength information of the surrounding wireless networks, and match them with the local cache or cloud-based Wi-Fi fingerprint database to quickly estimate the user's location. At the same time, if there are supported Bluetooth low-power beacons deployed nearby, the smart glasses will combine the beacon's unique ID and the received signal strength indication to further correct the positioning results.

5. The navigation method based on smart glasses according to claim 4, characterized in that: The route results of the destination are voice broadcast to the user, and the user selects one of the routes from the route results of the destination for feedback. The specific content is: when the destination name entered by the user has multiple possible matches in the smart glasses, the smart glasses system will automatically identify all target locations, and generate corresponding multiple route results based on geographic location information, hotspot frequency, and user historical access records. The smart glasses will broadcast the name, area, surrounding landmarks and corresponding route number of each candidate destination one by one in voice form. The user can determine the target location through voice commands. After receiving the feedback, the smart glasses will set the selected route as the target navigation path and enter the real-time guidance mode.

6. The navigation method based on smart glasses according to claim 5, characterized in that: After receiving feedback, the smart glasses load a high-precision virtual tactile road map of the city from a cloud server. The smart glasses use a path planning algorithm to obtain the optimal path. Specifically, after receiving the destination feedback confirmed by the user, the smart glasses immediately connect to the cloud server via the network, retrieve and load high-precision virtual tactile road map data for the corresponding area of ​​the city where the user is located. After obtaining the map data, the smart glasses use an improved A* algorithm to generate an optimal path by comprehensively considering the tactile road connectivity, path slope, obstacle avoidance capability, traffic light control time, ambient lighting conditions and path accessibility.

7. The navigation method based on smart glasses according to claim 6, characterized in that: The virtual tactile road map is constructed based on lidar mapping, street view data, urban management database and crowdsourced data, and includes detailed road contours, tactile road locations, zebra crossings, ground warning signs, obstacles, uphill and downhill slopes, intersection types, traffic light layout, and auxiliary facilities.

8. The navigation method based on smart glasses according to claim 7, characterized in that: The smart glasses convert the kilometers in the optimal path into steps based on the length corresponding to the user's steps. The specific content is: after completing the optimal path planning, the smart glasses call the user walking model built into the smart glasses to convert the total distance of the path into an estimated value of the user's individualized step count. The conversion is based on the average stride length information recorded when the user first uses the device or in historical wearing data. The stride length information is calculated based on height, cadence, and walking rhythm, and can be dynamically adjusted to match the user's current gait.

9. The navigation method based on smart glasses according to claim 8, characterized in that: The smart glasses activate the environmental perception function and the path correction function to correct the optimal path in real time. The specific contents are as follows: during the navigation process, the smart glasses simultaneously activate the environmental perception function and the path correction function. The environmental perception function relies on multi-sensor fusion technology, including cameras, laser ranging, depth vision modules, IMUs and microphone arrays, to perform real-time perception and semantic recognition of the surrounding environment. When the environmental perception function determines that the current path is not suitable for passage, the smart glasses will automatically trigger the path correction function, call the local path update algorithm and the cloud map incremental update service, and recalculate the alternative path based on the current position according to safety. The corrected new path will be re-planned with the principle of minimum change. During the path correction process, the smart glasses guide the user to complete the turning, avoidance or return to the original route through audio broadcast and vibration feedback prompts to ensure that the correction process is natural and smooth.

10. The navigation method based on smart glasses according to claim 9, characterized in that: The smart glasses continuously provide voice broadcasts during the navigation process, and the smart glasses have vibration feedback to enhance direction perception, so that the user can clearly understand the specific content of the path direction: the smart glasses activate the multimodal guidance mechanism in navigation mode, in which voice broadcasts are the dominant prompt method, and continuously provide key node information of the path, including the upcoming turning point, remaining distance, intersection features, obstacle reminders and destination approaching prompts. In order to further enhance the user's ability to perceive the path direction in complex environments, the smart glasses integrate micro vibration feedback modules, which are usually located on both sides of the temples, corresponding to the user's left and right directions respectively.

Images