Head-mounted display device and navigation method for assisting navigation
By using image matching and positioning data tagging technology from head-mounted display devices, the navigation difficulties caused by weak signals in mountainous and forested areas have been solved, enabling reliable navigation in environments with unstable signals.
Patent Information
- Application Number
- CN202211421901.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-14
- Publication Date
- 2026-02-03
- Estimated Expiration
- 2042-11-14
AI Technical Summary
In areas with weak network and GPS signals, such as mountains and forests, users find it difficult to navigate effectively, and existing smartphones cannot provide reliable navigation support.
The head-mounted display device for assisted navigation includes a processor, wireless communication components, satellite positioning components, and an image acquisition unit. It uses theoretical environmental images to match actual environmental images to determine directional markers, marks positioning data on a map, and provides feasible routes.
Even in situations with unstable signals or positioning failures, it can still provide navigation references for users, improving the reliability of navigation in mountainous and forested areas and preventing them from getting lost.
Smart Images

Figure CN115790569B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of augmented reality technology, and in particular to a head-mounted display device and navigation method for assisting navigation. Background Technology
[0002] With the rapid development of society, people's lives are becoming more and more colorful, and more and more people are choosing to travel as a way to relax after work.
[0003] During their travels, users may choose to explore scenic mountain forests. However, due to the vastness of the forests and the similarity of the trees and scenery, users risk getting lost. Furthermore, these areas often have incomplete or no network signal coverage, and even GPS (Global Positioning System) signals are extremely weak. Smartphones use mobile networks for communication, and in densely wooded forests, smartphones may lack signal, preventing users from using their smartphones for navigation or communication.
[0004] It is evident that improving the reliability of navigation for users in mountainous and forested areas is a problem that needs to be solved by those skilled in the art. Summary of the Invention
[0005] The purpose of this application is to provide a head-mounted display device and navigation method for assisting navigation, which can improve the reliability of navigation for users in mountainous and forested areas.
[0006] To address the aforementioned technical problems, this application provides a head-mounted display device for assisted navigation, comprising a processor, a wireless communication component, a satellite positioning component, an image acquisition unit, and a storage component; the storage component stores maps and theoretical environment images.
[0007] The processor is connected to the wireless communication component and the satellite positioning component respectively, and is used to control the satellite positioning component to perform periodic positioning at a set time interval and mark the positioning data on the map when the signal strength of the network signal or positioning signal does not meet the set signal strength requirements.
[0008] The processor is connected to the image acquisition unit and is used to acquire the actual environmental image of the current environment of the head-mounted display device acquired by the image acquisition unit; the actual environmental image is matched with the theoretical environmental image to determine the direction marker, so that the user can determine a feasible route based on the map with marked positioning data and the direction marker.
[0009] Optionally, the theoretical environment image includes a theoretical starry sky image; correspondingly, the actual environment image includes an actual starry sky image.
[0010] The processor is used to match the acquired actual starry sky image with the theoretical starry sky image to determine the target constellations contained in the actual starry sky image for guiding direction; wherein, the target constellations include Polaris or Southern Cross; based on the target constellations, the direction is determined and the direction marker is displayed on the visualization interface of the head-mounted display device.
[0011] Optionally, the theoretical environment image includes a plant image;
[0012] The processor is used to match the acquired actual environment image with the plant image to determine the target plant contained in the actual environment image; based on the plant category and foliage density of each target plant in the actual environment image, the processor determines the direction and displays the direction indicator on the visualization interface of the head-mounted display device.
[0013] Optionally, the processor is used to display the category information of the target plant on the visualization interface of the head-mounted display device.
[0014] Optionally, the theoretical environment image may also include animal images;
[0015] The processor is used to match the acquired actual environment image with the animal image to determine the target animal contained in the actual environment image; and to display the category information of the target animal on the visualization interface of the head-mounted display device.
[0016] Optionally, it also includes an acceleration sensor;
[0017] The accelerometer is connected to the processor and is used to transmit the collected acceleration data of the head-mounted display device to the processor.
[0018] The processor is configured to determine the motion state of the head-mounted display device based on the acceleration data; and, when the head-mounted display device is in motion and the signal strength of the network signal or positioning signal does not meet the set signal strength requirement for a duration that reaches a set time threshold, control the satellite positioning component to perform periodic positioning at a set time interval.
[0019] Optionally, it also includes a prompting component connected to the processor;
[0020] The processor is configured to control the prompting component to issue an alarm when the head-mounted display device is in a mobile state and the signal strength of the network signal or positioning signal does not meet the set signal strength requirement for a duration that reaches a set time threshold.
[0021] Optionally, the processor is used to control the visual interface of the head-mounted display device to play a set virtual image.
[0022] Optionally, the head-mounted display device is AR glasses.
[0023] This application also provides a navigation method for a head-mounted display device used in any of the above-described assisted navigation methods, the navigation method comprising:
[0024] If the signal strength of the network signal or positioning signal does not meet the set signal strength requirements, the satellite positioning component is controlled to perform periodic positioning at set time intervals and the positioning data is marked on the stored map.
[0025] Acquire the actual environmental image of the head-mounted display device's current location, captured by the image acquisition device;
[0026] The actual environment image is matched with the stored theoretical environment image to determine the direction markers, so that the user can determine a feasible route based on the map of the marked location data and the direction markers.
[0027] As can be seen from the above technical solution, the head-mounted display device for assisted navigation includes a processor, a wireless communication component, a satellite positioning component, an image acquisition unit, and a storage component; the storage component stores maps and theoretical environment images. The wireless communication component relies on network signals to achieve positioning, while the satellite positioning component relies on positioning signals. The processor is connected to both the wireless communication component and the satellite positioning component. When the signal strength of the network signal or positioning signal does not meet the set signal strength requirements, it indicates that the network signal or positioning signal of the environment where the head-mounted display device is located is affected, resulting in a weak received signal. In this case, the processor can control the satellite positioning component to perform periodic positioning at set time intervals and mark the positioning data on the map. By marking the positioning data on the map, the user can infer the approximate location of the user based on the marked positioning data when the network signal or positioning signal fails, thereby determining the walking route. The processor is connected to the image acquisition unit and can acquire the actual environment image of the environment where the head-mounted display device is currently located, collected by the image acquisition unit; by matching the actual environment image with the theoretical environment image, the direction of the environment where the head-mounted display device is currently located can be determined. To facilitate the user's intuitive understanding of the direction, direction markers can be set. Users can determine feasible routes based on maps marked with location data and directional markers. In this technical solution, the head-mounted display device promptly marks location data on the map when a weak signal is detected, making it easier for users to understand their walking route. Furthermore, based on analysis of the actual environmental imagery, the orientation of the user's current environment can be determined. Even in cases of unstable signal or positioning failure, reference routes and directions can be provided to the user, preventing them from getting lost in the current environment and effectively improving the reliability of navigation in mountainous areas. Attached Figure Description
[0028] To more clearly illustrate the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0029] Figure 1 This is a schematic diagram of the structure of a head-mounted display device for assisted navigation provided in an embodiment of this application;
[0030] Figure 2 A flowchart illustrating a navigation method provided in an embodiment of this application. Detailed Implementation
[0031] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the protection scope of this application.
[0032] The terms “comprising” and “having” in the specification, claims, and accompanying drawings of this application, and any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may include steps or units not listed.
[0033] To enable those skilled in the art to better understand the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments.
[0034] Next, we will describe in detail a head-mounted display device for assisted navigation provided in the embodiments of this application. Figure 1 This is a schematic diagram of the structure of a head-mounted display device for assisted navigation provided in an embodiment of this application. The head-mounted display device includes a processor 11, a wireless communication component 12, a satellite positioning component 13, an image acquisition unit 14, and a storage component 15; the storage component 15 stores maps and theoretical environment images.
[0035] The wireless communication component 12 determines the position of the smart terminal device in the set reference coordinate system through network signals.
[0036] The wireless communication component 12 can be a 4G (4th Generation mobile communication technology) module or a 5G (5th Generation Mobile Communication Technology) module. In this embodiment, the specific form of the wireless communication component 12 is not limited.
[0037] The satellite positioning component 13 determines the location of the head-mounted display device through two-way communication with the satellite.
[0038] In practical applications, the signal strength of network signals and positioning signals is easily affected by the external environment. For example, in densely vegetated forests, the signal strength is often weak due to the obstruction of vegetation, which is not conducive to accurate positioning.
[0039] In practical applications, the processor 11 can be connected to both the wireless communication component 12 and the satellite positioning component 13. The processor 11 can detect the strength of the network signal received by the wireless communication component 12 and the strength of the satellite signal received by the satellite positioning component 13. If the signal strength of the network signal or the positioning signal does not meet the set signal strength requirements, the satellite positioning component 13 can be controlled to perform periodic positioning at set time intervals and mark the positioning data on the map.
[0040] Signal strength requirements can include a minimum signal strength value. In specific implementations, minimum signal strength values can be set for network signals and positioning information, respectively. If the signal strength of the network signal is less than its corresponding minimum signal strength value, or the signal strength of the positioning signal is less than its corresponding minimum signal strength value, the positioning cycle time of the satellite positioning component 13 can be reduced.
[0041] The set time interval can be less than the original cycle time of the satellite positioning component 13. For example, if the original satellite positioning cycle time is 5 minutes, the set time interval can be 1 minute. The satellite positioning component originally performs positioning every 5 minutes, but when the signal strength is weak, the satellite positioning component can perform positioning every 1 minute.
[0042] Location data can include location coordinates and location time.
[0043] The satellite positioning component 13 is deployed on the head-mounted display device. By reducing the positioning cycle time of the satellite positioning component 13, the positioning frequency of the head-mounted display device is increased. Even if the signal is weak and positioning fails, the user can infer the approximate location of the user based on the marked positioning coordinates and positioning time, and thus determine the desired path using an offline map.
[0044] The processor 11 is connected to the image acquisition unit 14 and is used to acquire the actual environmental image of the current environment of the head-mounted display device acquired by the image acquisition unit 14; the actual environmental image is matched with the theoretical environmental image to determine the direction marker, so that the user can determine the feasible route based on the map of the marked positioning data and the direction marker.
[0045] In this embodiment of the application, the theoretical environment image can be an image of the user's current environment. The direction of the user's current environment, such as east, south, west, and north, is identified based on the theoretical environment image.
[0046] Taking nighttime environments as an example, theoretical environment images can include theoretical starry sky images; correspondingly, actual environment images include actual starry sky images.
[0047] In a specific implementation, the processor 11 can match the acquired actual starry sky image with the theoretical starry sky image to determine the target star image contained in the actual starry sky image for guiding direction; wherein, the target star image may include Polaris or Southern Cross.
[0048] The North Star is used to indicate due north, and the Southern Cross is used to indicate due south.
[0049] Based on the target constellations, the processor 11 can determine the direction. To help users understand the direction of their current environment, the direction markers can be displayed on the visual interface of the head-mounted display device.
[0050] Head-mounted display devices can include AR glasses, AR helmets, and so on. Taking AR glasses as an example, directional markers can be displayed on the lenses of AR glasses.
[0051] The directional indicators can be arrows pointing east, south, west, north, etc., or text indicating the direction directly in front of the user. In this embodiment, the specific form of the directional indicators is not limited; the aim is to allow users to intuitively understand the direction of their current environment.
[0052] Taking a daytime environment as an example, theoretical environmental images can include plant images.
[0053] Considering that different plants grow differently in different directions, the direction can be determined based on these differences. For example, sun-loving plants often have more lush foliage on their south-facing branches than on their north-facing branches.
[0054] In a specific implementation, the processor 11 can match the acquired actual environment image with the plant image to determine the target plant contained in the actual environment image; based on the plant category and the density of branches and leaves of each target plant in the actual environment image, the direction is determined and the direction indicator is displayed on the visualization interface of the head-mounted display device.
[0055] Plant categories can be used to distinguish different plants. Plant categories can include sun-loving plants and shade-loving plants. Sun-loving plants can include sunflowers, portulaca, periwinkles, canna lilies, and trumpet vines, among others.
[0056] The storage component 15 of the head-mounted display device can store plant images of different plant categories. By matching the acquired actual environment image with the pre-stored plant images, it is possible to determine which plant categories are included in the actual environment image.
[0057] Different plant categories have different leaf density in different directions. Therefore, after determining the plant category, the direction can be determined based on the leaf density of that plant.
[0058] Taking AR glasses as an example, directional markers can be displayed on the lenses of AR glasses.
[0059] To help users intuitively understand which plants are present in their current environment, the processor 11 can display the category information of the target plant on the visualization interface of the head-mounted display device. For example, the plant category corresponding to each plant in different locations can be displayed on the lenses of AR glasses.
[0060] Given that mountainous and forested areas are often inhabited by animals, some of which may be aggressive or venomous, accidental contact by users could pose a threat to their safety.
[0061] Some animals are colored similarly to the plants in the forest, such as snakes and insects. Users often cannot accurately identify them with the naked eye alone. Even if a user can recognize the animal's presence, they may not know its specific species.
[0062] Therefore, in this embodiment of the application, the theoretical environment image may include an animal image, and the processor 11 may match the acquired actual environment image with the animal image to determine the target animal contained in the actual environment image; and display the category information of the target animal on the visualization interface of the head-mounted display device.
[0063] Taking AR glasses as an example, the lenses of the AR glasses can display the animal category corresponding to each animal in different locations. For animals that are aggressive or toxic, warning messages can be displayed on the lenses of the AR glasses to attract the user's attention and prevent the user from accidentally touching these animals and causing danger.
[0064] As can be seen from the above technical solution, the head-mounted display device for assisted navigation includes a processor, a wireless communication component, a satellite positioning component, an image acquisition unit, and a storage component; the storage component stores maps and theoretical environment images. The wireless communication component relies on network signals to achieve positioning, while the satellite positioning component relies on positioning signals. The processor is connected to both the wireless communication component and the satellite positioning component. When the signal strength of the network signal or positioning signal does not meet the set signal strength requirements, it indicates that the network signal or positioning signal of the environment where the head-mounted display device is located is affected, resulting in a weak received signal. In this case, the processor can control the satellite positioning component to perform periodic positioning at set time intervals and mark the positioning data on the map. By marking the positioning data on the map, the user can infer the approximate location of the user based on the marked positioning data when the network signal or positioning signal fails, thereby determining the walking route. The processor is connected to the image acquisition unit and can acquire the actual environment image of the environment where the head-mounted display device is currently located, collected by the image acquisition unit; by matching the actual environment image with the theoretical environment image, the direction of the environment where the head-mounted display device is currently located can be determined. To facilitate the user's intuitive understanding of the direction, direction markers can be set. Users can determine feasible routes based on maps marked with location data and directional markers. In this technical solution, the head-mounted display device promptly marks location data on the map when a weak signal is detected, making it easier for users to understand their walking route. Furthermore, based on analysis of the actual environmental imagery, the orientation of the user's current environment can be determined. Even in cases of unstable signal or positioning failure, reference routes and directions can be provided to the user, preventing them from getting lost in the current environment and effectively improving the reliability of navigation in mountainous areas.
[0065] When a head-mounted display device moves, it may shift from an area with a strong signal to an area with a weak signal, leading to inaccurate positioning or positioning failure. Therefore, in this embodiment, the time interval for the satellite positioning component to perform positioning can be adjusted based on the movement of the head-mounted display device and changes in signal strength.
[0066] In a practical implementation, an accelerometer can be installed on the head-mounted display device. The accelerometer is connected to the processor 11 and can transmit the collected acceleration data from the head-mounted display device to the processor 11.
[0067] The processor 11 is used to determine the motion state of the head-mounted display device based on acceleration data; when the head-mounted display device is in motion and the signal strength of the network signal or positioning signal does not meet the set signal strength requirement for a duration that reaches a set time threshold, the processor 11 can control the satellite positioning component 13 to perform periodic positioning according to a set time interval.
[0068] In this embodiment of the application, a prompting component connected to the processor 11 may be provided on the head-mounted display device.
[0069] When the head-mounted display device is in motion and the signal strength of the network signal or positioning signal does not meet the set signal strength requirement for a duration that reaches a set time threshold, the processor 11 can control the prompting component to issue an alarm prompt.
[0070] The duration can be set based on actual needs; for example, it can be set to 5 minutes.
[0071] If the head-mounted display device is in motion for 5 consecutive minutes and the strength of its positioning signal does not meet the set signal strength requirements, it indicates that the user is moving in an area with a weak signal and has no tendency to move to an area with a strong signal. In order to prevent the user from moving to an area with a weak signal, the processor can control the prompting component to issue an alarm to attract the user's attention.
[0072] The prompting component can be a voice player or a vibrator, etc.
[0073] Considering that users may travel alone in practical applications, in order to increase the fun of the journey, the processor 11 of the head-mounted display device can control the visual interface of the head-mounted display device to play the set virtual images.
[0074] Virtual images can be images of people the user is familiar with, or images of cartoon characters the user likes. By playing virtual images on a visual interface, the travel experience can be enhanced, and users can watch virtual images when visiting areas with similar scenery or areas that are not of interest to them, thus avoiding aesthetic fatigue.
[0075] Figure 2 A flowchart of a navigation method provided in an embodiment of this application, the method comprising:
[0076] S201: If the signal strength of the network signal or positioning signal does not meet the set signal strength requirements, control the satellite positioning component to perform periodic positioning at set time intervals and mark the positioning data on the stored map.
[0077] Network signals can be signals received by wireless communication components. Positioning signals can be signals received by satellite positioning components.
[0078] In areas with abundant vegetation or complex terrain, the signal strength of network and location signals is easily affected, resulting in weaker signals.
[0079] Compared to network signals, location signals offer higher signal stability. In this embodiment, to prevent a sudden weakening or disappearance of signal strength that could prevent positioning, the satellite positioning component can be controlled to perform periodic positioning at set time intervals when the signal strength is detected to be below the set requirement. The positioning data is then marked on a stored map. The set time interval is shorter than the original time interval for periodic positioning by the satellite positioning component.
[0080] Location data can include location coordinates and location time.
[0081] By using higher frequency positioning and marking the positioning data on the map, even if the signal becomes weak and positioning fails, users can still infer their approximate location based on the marked positioning data on the map, and thus use the offline map to determine the subsequent travel path.
[0082] S202: Acquire the actual environmental image of the current environment of the head-mounted display device, captured by the image acquisition device.
[0083] In densely vegetated mountainous areas, users can easily lose their way. Therefore, in this application, the processor of the head-mounted display device can analyze the actual environment image in which the user is currently located to determine the orientation of the environment.
[0084] S203: Match the actual environment image with the stored theoretical environment image to determine the direction markers, so that the user can determine a feasible route based on the map and direction markers of the marked location data.
[0085] Theoretical environment images can include theoretical starry sky images and plant images. Correspondingly, actual environment images can include actual starry sky images and ground environment images. Ground environment images can include plant images specific to the user's environment.
[0086] Using actual star images as an example, we can compare them with theoretical star images to determine which celestial bodies are included in the actual image, such as Polaris or the Southern Cross. Based on these included celestial bodies, we can determine the direction.
[0087] In practical applications, the processor can display the map with location data and direction markers on the visual interface of the head-mounted display device, so that users can determine feasible routes.
[0088] Figure 2 For a description of the features in the corresponding embodiments, please refer to Figure 1 The relevant descriptions of the corresponding embodiments will not be repeated here.
[0089] As can be seen from the above technical solution, when the signal strength of the detected network signal or positioning signal does not meet the set signal strength requirements, it indicates that the network signal or positioning signal of the environment in which the head-mounted display device is located is affected, resulting in a weak received signal. At this time, the processor can control the satellite positioning component to perform periodic positioning at set time intervals and mark the positioning data on the stored map. By marking the positioning data on the map, users can infer their approximate current location based on the marked positioning data when network signal or positioning signal fails, thus determining their walking route. The actual environmental image of the environment in which the head-mounted display device is currently located is acquired by the image acquisition device; by matching the actual environmental image with the stored theoretical environmental image, the direction of the environment in which the head-mounted display device is currently located can be determined. To facilitate users' intuitive understanding of the direction, direction markers can be set. Users can determine feasible routes based on the map marked with positioning data and direction markers. In this technical solution, when the head-mounted display device detects a weak signal, it promptly marks the positioning data on the map, making it easier for users to understand their walking route. Furthermore, based on the analysis of the actual environmental image, the direction of the user's current environment can be determined. Even in situations where the signal is unstable or positioning fails, it can still provide users with reference routes and directions, thereby preventing users from getting lost in the current environment and effectively improving the reliability of navigation in mountainous and forested areas.
[0090] The foregoing has provided a detailed description of a head-mounted display device and navigation method for assisted navigation, as provided in the embodiments of this application. The various embodiments are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.
[0091] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0092] The above provides a detailed description of a head-mounted display device and navigation method for assisted navigation provided in this application. Specific examples have been used to illustrate the principles and implementation methods of the invention. The descriptions of the embodiments above are merely for the purpose of helping to understand the method and core ideas of the invention. It should be noted that those skilled in the art can make various improvements and modifications to this application without departing from the principles of the invention, and these improvements and modifications also fall within the protection scope of the claims of this application.
Claims
1. A head-mounted display device for assisted navigation, characterized in that, It includes a processor, a wireless communication component, a satellite positioning component, an image acquisition unit, and a storage component; the storage component stores maps and theoretical environment images. The processor is connected to both the wireless communication component and the satellite positioning component, and is used to control the satellite positioning component to perform periodic positioning at a set time interval and mark the positioning data on the map when the signal strength of the network signal or positioning signal does not meet the set signal strength requirements; the set time interval is less than the original periodic time of the satellite positioning component. The processor is connected to the image acquisition unit and is used to acquire the actual environmental image of the current environment of the head-mounted display device acquired by the image acquisition unit; the actual environmental image is matched with the theoretical environmental image to determine the direction marker, so that the user can determine a feasible route based on the map with marked positioning data and the direction marker; Signal strength requirements include the minimum signal strength for both network signals and positioning information. If the signal strength of the network signal is less than its corresponding minimum signal strength, or the signal strength of the positioning signal is less than its corresponding minimum signal strength, the positioning cycle time of the satellite positioning component should be reduced.
2. The head-mounted display device for assisted navigation according to claim 1, characterized in that, The theoretical environment image includes a theoretical starry sky image; correspondingly, the actual environment image includes an actual starry sky image. The processor is used to match the acquired actual starry sky image with the theoretical starry sky image to determine the target constellations contained in the actual starry sky image for guiding direction; wherein, the target constellations include Polaris or Southern Cross; based on the target constellations, the direction is determined and the direction marker is displayed on the visualization interface of the head-mounted display device.
3. The head-mounted display device for assisted navigation according to claim 1, characterized in that, The theoretical environment image includes plant images; The processor is used to match the acquired actual environment image with the plant image to determine the target plant contained in the actual environment image; based on the plant category and foliage density of each target plant in the actual environment image, the processor determines the direction and displays the direction indicator on the visualization interface of the head-mounted display device.
4. The head-mounted display device for assisted navigation according to claim 3, characterized in that, The processor is used to display the category information of the target plant on the visualization interface of the head-mounted display device.
5. The head-mounted display device for assisted navigation according to claim 1, characterized in that, The theoretical environment images also include animal images; The processor is used to match the acquired actual environment image with the animal image to determine the target animal contained in the actual environment image; and to display the category information of the target animal on the visualization interface of the head-mounted display device.
6. The head-mounted display device for assisted navigation according to claim 1, characterized in that, It also includes an accelerometer; The accelerometer is connected to the processor and is used to transmit the collected acceleration data of the head-mounted display device to the processor. The processor is configured to determine the motion state of the head-mounted display device based on the acceleration data; and, when the head-mounted display device is in motion and the signal strength of the network signal or positioning signal does not meet the set signal strength requirement for a duration that reaches a set time threshold, control the satellite positioning component to perform periodic positioning at a set time interval.
7. The head-mounted display device for assisted navigation according to claim 5, characterized in that, It also includes a prompting component connected to the processor; The processor is configured to control the prompting component to issue an alarm when the head-mounted display device is in a mobile state and the signal strength of the network signal or positioning signal does not meet the set signal strength requirement for a duration that reaches a set time threshold.
8. The head-mounted display device for assisted navigation according to claim 1, characterized in that, The processor is used to control the visual interface of the head-mounted display device to play preset virtual images.
9. The head-mounted display device for assisted navigation according to any one of claims 1 to 8, characterized in that, The head-mounted display device is AR glasses.
10. A navigation method, characterized in that, The head-mounted display device for assisted navigation according to any one of claims 1 to 9, wherein the navigation method comprises: If the signal strength of the network signal or positioning signal is not met, the satellite positioning component is controlled to perform periodic positioning at a set time interval and the positioning data is marked on the stored map; the set time interval is less than the original periodic time of the satellite positioning component. Acquire the actual environmental image of the head-mounted display device's current location, captured by the image acquisition device; The actual environment image is matched with the stored theoretical environment image to determine the direction markers, so that the user can determine a feasible route based on the map and direction markers of the marked location data; Signal strength requirements include the minimum signal strength for both network signals and positioning information. If the signal strength of the network signal is less than its corresponding minimum signal strength, or the signal strength of the positioning signal is less than its corresponding minimum signal strength, the positioning cycle time of the satellite positioning component should be reduced.
Citation Information
Patent Citations
Pre-warning method and device based on wearable device
CN105632049A
Head-mounted smart wearable device, positioning system, and positioning method
CN108955673A
Navigation calibration method and electronic equipment
CN111093266A
All-weather hiking auxiliary system and method based on deep learning and big data
CN114152253A