A navigation method, device and medium based on smart glasses

Abstract

The present application discloses a navigation method, device and medium based on smart glasses, the method includes: the smart glasses construct a first navigation path according to the target position information determined by the wearer, and according to the target position information and the current position information; generate indication information according to the orientation information, the current position information and the first navigation path, and update the indication information in real time according to the current position information, calculate the optimal imaging distance of the indication information in real time, and project the indication information onto the lens of the smart glasses at the optimal imaging distance through the projection device on the smart glasses. Provide accurate navigation for the wearer, facilitate the wearer to view the indication information through the lens, and then reach the destination. At the same time, the projection distance of the indication information is designed accordingly to ensure the best experience of the user and avoid the discomfort caused by the user switching the viewing distance back and forth.

Description

Technical Field

[0001] The present application relates to the technical field of smart glasses, and in particular to a navigation method, device and medium based on smart glasses. Background Art

[0002] With the rapid development of wearable smart devices, wearable smart devices have more and more types and functions. Take smart glasses as an example. Smart glasses can combine projection and virtual reality technology to project images onto the lenses of smart glasses, and provide relevant information to the wearer in combination with the surrounding environment, so that the wearer can obtain information more conveniently.

[0003] Navigation is an important function of smart glasses. When wearers use smart glasses, the most common usage scenario is navigation. When existing smart glasses navigate users, it is difficult to combine various data about the wearer and the real environment to provide the wearer with more accurate and user-friendly navigation. Summary of the invention

[0004] In order to solve the above problem, that is, to solve the problem that existing smart glasses are difficult to combine various data of the wearer and the real environment when navigating the user, and provide the wearer with more accurate and humanized navigation, the present application proposes a navigation method, device and medium based on smart glasses, including:

[0005] In the first aspect, the present application proposes a navigation method based on smart glasses, including: the smart glasses construct a first navigation path according to target position information determined by the wearer, and according to the target position information and the current position information of the smart glasses; real-time acquisition of current orientation information through an angular velocity sensor on the smart glasses, real-time acquisition of speed information through an accelerometer on the smart glasses, and real-time acquisition of image information through an image acquisition device on the smart glasses; generating indication information according to the orientation information, the current position information and the first navigation path, and updating the indication information in real time according to the current position information, wherein the indication information is a graphical direction indication mark; real-time calculation of the optimal imaging distance of the indication information according to the speed information, the image information, the current position information and the first navigation path, and projecting the indication information at the optimal imaging distance onto the lenses of the smart glasses through a projection device on the smart glasses.

[0006] In one example, according to the speed information, the image information, the current position information and the first navigation path, the optimal imaging distance of the indication information is calculated in real time, and the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance through a projection device on the smart glasses, specifically including: obtaining an initial imaging distance according to the speed information, wherein the initial imaging distance is proportional to the speed corresponding to the speed information; projecting the indication information onto the lenses of the smart glasses at the initial imaging distance through a projection device, and setting the imaging position of the indication information at the center of the lenses; determining that there is a turning point ahead according to the first navigation path, and projecting the indication information onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses; The method comprises the steps of: obtaining the image information of the smart glasses, calibrating the turning point to obtain the calibrated position of the turning point on the lens, and adjusting the imaging position of the indication information to the calibrated position, wherein the turning point is the turning position in the first navigation path; obtaining a first distance between the current position of the smart glasses and the turning point according to the current position information and the image information, and determining that the first distance is less than the initial imaging distance; adjusting the initial imaging distance in real time to make the initial imaging distance equal to the first distance as the optimal imaging distance; projecting the indication information onto the lens at the optimal imaging distance through the projection device, and setting the imaging position of the indication information to the calibrated position.

[0007] In one example, indication information is generated according to the orientation information, the current position information and the first navigation path, and the indication information is updated in real time according to the current position information, specifically including: obtaining first indication information according to the current position information and the first navigation path, the first indication information including: moving forward, turning left, turning right, and turning around; judging whether the minimum angle between the current orientation of the smart glasses and the direction to be traveled is less than a first preset threshold according to the orientation information; if so, using the first indication information as the indication information; if not, generating pre-indication information according to the minimum angle, the pre-indication information including: turning left and turning right; determining that a turning point has been passed according to the current position information and the first navigation path, and determining that the orientation information has changed, wherein the turning point is the turning position in the first navigation path; obtaining second indication information according to the current position information and the first navigation instruction, the second indication including: moving forward, turning left, turning right, and turning around; updating the indication information to the second indication information.

[0008] In one example, after the optimal imaging distance of the indication information is calculated in real time according to the speed information, the image information, the current location information and the first navigation path, and the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses, the method further includes: obtaining current environment brightness information according to the image information, and collecting eye data of the wearer through the image acquisition device, wherein the eye data includes at least one of the following: pupil morphology data and iris morphology data; obtaining a pupil area change value of the wearer within a preset time range according to the pupil morphology data, so as to obtain the pupil area change value of the wearer within a preset time range. and determining the iris status of the patient within the preset time range according to the iris morphology data, the iris status including: iris dilation and iris contraction; inputting the pupil area change value and the iris status into a pre-trained first adjustment model to obtain a first brightness value; inputting the current brightness environment information into a pre-trained second adjustment model to obtain a second brightness value; performing weighted processing on the first brightness value and the second brightness value according to a pre-stored weight coefficient to obtain a weighted brightness value; and adjusting the projection device according to the weighted brightness value so that the display brightness of the indication information is consistent with the weighted brightness value.

[0009] In one example, the first brightness value and the second brightness value are weighted according to a pre-stored weight coefficient to obtain a weighted brightness value, specifically including: weighting the brightness value with a larger value between the first brightness value and the second brightness value according to a pre-stored first weight, and; weighting the brightness value with a smaller value between the first brightness value and the second brightness value according to a pre-stored second weight, wherein the first weight is smaller than the second weight; to obtain the weighted brightness value.

[0010] In one example, the smart glasses construct a first navigation path based on target location information determined by a wearer and based on the target location information and current location information of the smart glasses, specifically including: the smart glasses obtain the target location information and the current location information, and collect an initial navigation path through the Internet based on the target location information and the current location information; obtain the altitude difference between the target location and the current location based on the target location information and the current location information, and obtain the jump-layer location information with a sudden change in altitude value based on the altitude difference and the initial navigation path; query the navigation feature corresponding to the jump-layer location information, and add the navigation feature to the initial navigation path to reconstruct the initial navigation path, wherein the navigation feature includes at least one of the following: entrance location information, exit location information, elevator entrance location information, signboard location information; obtain the first navigation path.

[0011] In one example, based on the speed information, the image information, the current position information and the first navigation path, the optimal imaging distance of the indication information is calculated in real time, and the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses. The method also includes: recording the wearer's travel path in real time, and marking the travel path at different levels according to the identification factor to obtain multiple marked target points; wherein the identification factor includes at least one of the following: the length of stay, the rate of change of the orientation information, and the rate of change of the indication information; obtaining a control instruction, and selecting one of the multiple target points according to the control instruction, and constructing a second navigation path according to the current position information and the target point.

[0012] In one example, based on the speed information, the image information, the current position information and the first navigation path, the optimal imaging distance of the indication information is calculated in real time, and the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses. The method further includes: collecting eye data of the wearer through the image acquisition device, and the eye data includes at least one of the following: pupil morphology data and iris morphology data; based on the eye data, determining that the wearer has stared at the indication information for a preset time, and turning off the projection device; determining that the indication information has been updated, or determining that a projection instruction issued by the wearer has been received, then starting the projection device, and projecting the indication information onto the lenses of the smart glasses at the optimal imaging distance through the projection device.

[0013] On the other hand, the present application also provides a navigation device based on smart glasses, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the following instructions: construct a first navigation path according to the target position information determined by the user, and according to the target position information and the current position information of the smart glasses; collect the user's current orientation information in real time through the angular velocity sensor on the smart eyes, collect speed information in real time through the accelerometer on the smart eyes, and collect image information in real time through the image acquisition device on the smart eyes; generate indication information according to the orientation information, the current position information and the first navigation path, and update the indication information in real time according to the current position information, wherein the indication information is graphical direction indication information; calculate the optimal imaging distance of the indication information in real time according to the speed information, the image information, the current position information and the first navigation path, and project the indication information at the optimal imaging distance onto the lenses of the smart glasses through the projection device on the smart eyes.

[0014] On the other hand, the present application also proposes a non-volatile computer storage medium storing computer executable instructions, wherein the computer executable instructions are configured to: construct a first navigation path based on target position information determined by a user, and based on the target position information and the current position information of the smart glasses; collect the user's current orientation information in real time through an angular velocity sensor on the smart eyes, collect speed information in real time through an accelerometer on the smart eyes, and collect image information in real time through an image acquisition device on the smart eyes; generate indication information based on the orientation information, the current position information and the first navigation path, and update the indication information in real time based on the current position information, wherein the indication information is graphical direction indication information; calculate the optimal imaging distance of the indication information in real time based on the speed information, the image information, the current position information and the first navigation path, and project the indication information onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart eyes.

[0015] The navigation method, device and medium based on smart glasses proposed in the present application can bring the following beneficial effects: provide accurate navigation for the wearer, facilitate the wearer to view the instruction information through the lenses, and then reach the destination. At the same time, the projection distance of the instruction information is designed accordingly to ensure the best experience for the user, avoiding the discomfort caused by the user switching the viewing distance back and forth. At the same time, corresponding navigation path design is made for special terrain to ensure that the user can accurately go to the destination. At the same time, it can provide the user with the function of reverse query of the path they have traveled, ensuring that the user can return to search when they forget the path they have traveled. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0017] Figure 1 A flowchart of a navigation method based on smart glasses in an embodiment of the present application;

[0018] Figure 2 This is a schematic diagram of a navigation device based on smart glasses in an embodiment of the present application. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0020] First of all, it should be noted that the navigation method based on smart glasses described in this application can be stored in the system in the form of a program or algorithm, and the system can be stored in the smart glasses. To support the system, the smart glasses should be equipped with corresponding components, such as a processor, a memory, a communication module, etc., to support the above program or algorithm. At the same time, the smart glasses should include other hardware to support the corresponding functions, such as an angular velocity sensor, an accelerometer, an image acquisition device, a projection device, etc.

[0021] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0022] like Figure 1 As shown, a navigation method based on smart glasses provided in an embodiment of the present application includes:

[0023] S101: The smart glasses construct a first navigation path according to target location information determined by a wearer and according to the target location information and current location information of the smart glasses.

[0024] Specifically, the wearer of the smart glasses can send corresponding instructions to the smart glasses so that the smart glasses can determine the target location information, that is, the latitude and longitude or other coordinate information of the target location. The wearer can send the corresponding instructions to the smart glasses in the form of voice, and can also send the corresponding instructions to the smart glasses through the smart terminal according to the Bluetooth or other forms of wireless communication connection between the smart glasses and the smart terminal.

[0025] Furthermore, the smart glasses can determine the current location information, that is, the latitude and longitude or other coordinate information of the current location, based on the built-in positioning module, and collect the initial navigation path through the Internet based on the target location information and the current location information.

[0026] It should be noted that the initial navigation path here means that the smart glasses send the current location information and the target location information to the Internet navigation software or system, and obtain the corresponding navigation path in this way.

[0027] Furthermore, the smart glasses obtain the altitude difference between the target location and the current location based on the target location information and the current location information, which can be obtained through the Internet, a built-in memory, or a remote database. Then, based on the altitude difference and the initial navigation path, the location information of the jump layer with a sudden change in altitude is obtained.

[0028] It should be noted that the jump layer location information is the latitude and longitude or other coordinates corresponding to the location where the altitude changes suddenly. For example, in Chongqing, due to the mountainous geographical characteristics, there are often jumps between streets, that is, one street is directly above another street. To solve this problem, it is necessary to determine the jump layer location information corresponding to the jump layer position through the above technical means.

[0029] Furthermore, the smart glasses can query the navigation features corresponding to the jump floor location information, and add the navigation features to the initial navigation path to reconstruct the initial navigation path, wherein the navigation features include at least one of the following: entrance location information, exit location information, elevator entrance location information, and signboard location information.

[0030] That is, when the user goes to the target location, he or she may need to take an elevator or climb stairs. By querying the navigation features at the jump location information, the user can more easily find the entrance location, exit location, elevator entrance location or sign location and other signs.

[0031] The reconstruction method includes but is not limited to: obtaining an image corresponding to the navigation feature and adding the image to the initial navigation path. When the image acquisition device determines that the user is approaching the corresponding image, the corresponding indication information can be displayed in the lens to facilitate the user to find the location.

[0032] That is, the first navigation path is obtained.

[0033] It should be noted that the above embodiments are only designed for navigation paths in areas such as Chongqing or other areas with jumps. For navigation path planning on flat roads, there is no need to adopt the technical solutions described in the above embodiments, and the navigation path can be planned using conventional technical solutions.

[0034] S102: collecting current orientation information in real time through an angular velocity sensor on the smart glasses, collecting speed information in real time through an accelerometer on the smart glasses, and collecting image information in real time through an image acquisition device on the smart glasses.

[0035] Specifically, the smart glasses should be provided with an angular velocity sensor, an accelerometer, and an image acquisition device.

[0036] The angular velocity sensor can be used to collect current orientation information, that is, the current orientation of the smart glasses, including but not limited to: east, west, south, north, etc.

[0037] The accelerometer can be used to collect speed information, that is, the current moving speed of the smart glasses.

[0038] The image acquisition device can acquire image information, that is, the surroundings of the smart glasses and the corresponding images of the wearer's eyes. It should be noted that the image acquisition device includes but is not limited to: a camera with corresponding clarity, an infrared camera, etc.

[0039] S103: Generate indication information according to the orientation information, the current location information and the first navigation path, and update the indication information in real time according to the current location information, wherein the indication information is graphical direction indication information.

[0040] Specifically, the smart glasses obtain first indication information according to the current position information and the first navigation path, and the first indication information includes: forward, left turn, right turn, and U-turn.

[0041] Furthermore, the smart glasses determine the minimum angle between the current orientation of the smart glasses and the direction to be traveled based on the orientation information, and determine whether the minimum angle is less than a first preset threshold.

[0042] If so, the first indication information is used as the indication information; if not, the pre-indication information is generated according to the minimum angle; the pre-indication information may include: turn left, turn right.

[0043] Since the current orientation of the wearer when wearing the smart glasses is not necessarily the direction to be traveled, a pre-indication information can be set.

[0044] However, if the minimum angle between the wearer's current orientation (i.e., the current orientation of the smart glasses) and the direction to be traveled is small, the current orientation is very close to the direction to be traveled. At this time, if the pre-indication information is displayed, the wearer will make a wrong judgment. Therefore, when it is judged that the minimum angle is less than the first preset threshold, the first indication information can be directly displayed as the indication information. The first preset threshold here can be set to 40°.

[0045] If the minimum angle is greater than the first preset threshold, it means that the current direction deviates greatly from the direction to be traveled, so the preceding indication information is introduced. For example, if the direction to be traveled is on the right side of the current direction, the preceding indication information is displayed as a right turn; if the direction to be traveled is on the left side of the current direction, the preceding indication information is displayed as a left turn.

[0046] Afterwards, after determining that the current direction is consistent with the direction to be traveled, or the minimum angle is less than the first preset threshold, the first indication information continues to be used as the indication information.

[0047] Furthermore, the smart glasses can determine that a turning point has been passed based on the current position information and the first navigation path, and determine that the direction information has changed, and then obtain second indication information based on the current position and the first navigation instruction. The second indication information includes: go forward, turn left, turn right, and U-turn.

[0048] It should be noted that the turning point is the turning position in the first navigation path. The turning position is not limited to a 90° turn, and can be identified as long as the route undergoes corresponding changes.

[0049] Further, the smart glasses update the indication information to second indication information.

[0050] Through the above technical solution, it can be ensured that the indication information of the smart glasses is updated in real time along with the first navigation path.

[0051] S104: Calculate the optimal imaging distance of the indication information in real time according to the speed information, the image information, the current position information and the first navigation path, and project the indication information onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses.

[0052] Specifically, the smart glasses obtain an initial imaging distance according to the speed information, wherein the initial imaging distance is proportional to the speed corresponding to the speed information.

[0053] It should be noted that in order to avoid frequent switching of the wearer's pupils, in the embodiment of the present application, the indication information is not completely projected in front of the wearer's eyes, but is projected forward at a certain imaging distance. The projected image is at a certain distance from the lens and is reflected by the lens for the wearer to see. In this way, the wearer can see the indication information on the visual distance while looking at the road, and the pupils do not need to switch between near and far.

[0054] In addition, according to the structure of the human eye, the visual distance of the human eye is different at different travel speeds. For example, when the travel speed is 15km / h, the visual distance is generally 30 meters, and when the travel speed is 80km / h, the visual distance is generally 120 meters.

[0055] Therefore, the smart glasses can calculate the initial imaging distance based on the speed information.

[0056] Furthermore, the smart glasses project the indication information onto the lenses of the smart glasses at an initial imaging distance through a projection device, and set the imaging position of the indication information at the center of the lens.

[0057] Furthermore, the smart glasses determine that there is a turning point ahead according to the first navigation path, and calibrate the turning point through image information to obtain a calibrated position of the turning point on the lens, and calibrate the imaging position adjustment value of the indication information.

[0058] When there is a turning point ahead, adjusting the imaging position of the indication information to the calibrated position of the corresponding lens can help the wearer pay more attention to the turning point, that is, the current first goal is to go to the turning point, which is conducive to providing the wearer with more accurate guidance.

[0059] Furthermore, the smart glasses obtain the first distance between the current position information of the smart glasses and the turning point according to the current position information and the image information, and determine that the first distance is smaller than the initial imaging distance.

[0060] Then, the initial imaging distance is adjusted in real time so that the initial imaging distance is equal to the first distance as the optimal imaging distance.

[0061] Since the imaging position of the indication information is at the calibrated position, if the initial imaging distance remains unchanged and the first distance between the wearer and the turning point is less than the initial imaging distance, the display distance of the indication information exceeds the turning point in front, which can easily mislead the user.

[0062] To avoid this situation, the above technical solution is designed to update the initial imaging distance in real time and make it consistent with the first distance as the optimal imaging distance, that is, the imaging position and imaging distance of the indication information can be locked to the turning point.

[0063] Finally, the indication information is projected onto the lens at an optimal imaging distance through a projection device, and the imaging position of the indication information is set to the above-mentioned calibration position.

[0064] In one embodiment, the projection brightness of the indication information also requires additional attention, that is, in order to provide the user with the best experience, the projection brightness needs to be adjusted.

[0065] Specifically, after the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance by the projection device on the smart glasses, it is also possible to:

[0066] The smart glasses obtain current environment brightness information according to the image information, and collect eye data of the wearer through an image acquisition device, and the eye data includes at least one of the following: pupil morphology data and iris morphology data.

[0067] Furthermore, the smart glasses obtain the pupil area change value of the wearer within a preset time range based on the pupil morphology data, and determine the iris state of the patient within a preset time range based on the iris morphology data, and the iris state includes: iris dilation and iris contraction.

[0068] That is, the wearer's pupil area change value and iris state can both indicate whether the user currently has eye discomfort.

[0069] Furthermore, the pupil area change value and the iris state are input into a pre-trained first adjustment model to obtain a first brightness value. The first brightness value here is the most comfortable first brightness value under the user's current eye data obtained by performing corresponding calculations based on the through hole area change value and the iris state.

[0070] Furthermore, the current environment brightness information is input into the pre-trained second adjustment model to obtain a second brightness value. The second brightness value here is calculated according to the current environment brightness information to obtain the most suitable second brightness value under the current brightness condition.

[0071] Furthermore, the first brightness value and the second brightness value are weighted according to the pre-stored weight coefficient to obtain a weighted brightness value, so as to ensure that the weighted brightness value can be combined with the first brightness value and the second brightness value to obtain the most appropriate brightness value.

[0072] Specifically, the brightness value with a larger value between the first brightness value and the second brightness value is weighted according to a pre-stored first weight, and; the brightness value with a smaller value between the first brightness value and the second brightness value is weighted according to a pre-stored second weight, wherein the first weight is smaller than the second weight, to obtain a weighted brightness value.

[0073] Since the wearer's eye data may not be completely accurate, or may change accordingly due to the stimulation of ambient light, it is necessary to reduce the weight of the first brightness value and increase the weight of the second brightness value. In this embodiment of the present application, the first weight value is set to 0.3 and the second weight value is set to 0.7.

[0074] Finally, the smart glasses adjust the projection device according to the weighted brightness value so that the display brightness of the indication information is consistent with the weighted brightness value, that is, the process of adjusting the display brightness of the indication information.

[0075] In one embodiment, after the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance by the projection device on the smart glasses, the following can also be performed:

[0076] The smart glasses record the wearer's path in real time, and mark the path at different levels according to the recognition factor to obtain multiple marked target points, wherein the recognition factor includes at least one of the following: duration of stay, rate of change of orientation information, and rate of change of indication information.

[0077] It should be noted that if the user has corresponding activities such as parking or shopping, he or she may forget the parking location or shopping location. In order to avoid this situation, the present application designs this technical solution.

[0078] That is, according to the recognition factor, multiple target points are obtained after being marked. The recognition factor is to judge whether the user has abnormal conditions at the target point, such as staying for a long time, the direction information is constantly changing, and the indication information is constantly changing. In this case, the user is likely to park or shop or do other behaviors, so the target point needs to be marked. At the same time, according to the recognition factor, different levels of marking can also be performed to avoid difficulty in subsequent user inquiries.

[0079] Furthermore, the smart glasses can obtain the control instructions of the wearer, select one of the multiple target points according to the control instructions, and construct a second navigation path according to the current position information and the target point. That is, the wearer returns to the process of path finding.

[0080] In one embodiment, after the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance by the projection device on the smart glasses, the method further includes:

[0081] The eye data of the wearer is collected by an image acquisition device, and the eye data includes at least one of the following: pupil morphology data and iris morphology data.

[0082] The smart glasses determine, based on the eye data, that the wearer has been staring at the indication information for a preset time and turn off the projection device.

[0083] Since the indication information may interfere with the wearer and cause a certain degree of danger to the wearer's movement, when it is determined that the wearer has been staring at the indication information for a preset time, it can be determined that the wearer knows the current direction of travel and the turning point ahead, and the projection device can be turned off.

[0084] Furthermore, when the smart glasses determine that the indication information has been updated, or determine that a projection instruction issued by the wearer has been received, the projection device is activated, and the indication information is projected onto the lenses of the smart glasses at an optimal imaging distance through the projection device.

[0085] When the indication information is updated, the wearer needs to be instructed, so the projection device is restarted, or the projection device can be restarted after receiving the user's projection instruction. The wearer can issue projection instructions including but not limited to: voice instructions, instructions issued through a smart terminal wirelessly connected to the smart glasses.

[0086] In one embodiment, Figure 2 As shown, the present application also provides a navigation device based on smart glasses, including:

[0087] at least one processor; and,

[0088] a memory communicatively connected to the at least one processor; wherein,

[0089] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the following instructions:

[0090] Constructing a first navigation path according to target location information determined by a user and according to the target location information and current location information of the smart glasses;

[0091] The user's current orientation information is collected in real time through the angular velocity sensor on the smart eye, the speed information is collected in real time through the accelerometer on the smart eye, and the image information is collected in real time through the image acquisition device on the smart eye;

[0092] Generate indication information according to the orientation information, the current location information and the first navigation path, and update the indication information in real time according to the current location information, wherein the indication information is graphical direction indication information;

[0093] According to the speed information, the image information, the current position information and the first navigation path, the optimal imaging distance of the indication information is calculated in real time, and the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses.

[0094] In one embodiment, the present application further provides a non-volatile computer storage medium storing computer executable instructions, wherein the computer executable instructions are configured as follows:

[0095] Constructing a first navigation path according to target location information determined by a user and according to the target location information and current location information of the smart glasses;

[0096] The user's current orientation information is collected in real time through the angular velocity sensor on the smart eye, the speed information is collected in real time through the accelerometer on the smart eye, and the image information is collected in real time through the image acquisition device on the smart eye;

[0097] Generate indication information according to the orientation information, the current location information and the first navigation path, and update the indication information in real time according to the current location information, wherein the indication information is graphical direction indication information;

[0098] According to the speed information, the image information, the current position information and the first navigation path, the optimal imaging distance of the indication information is calculated in real time, and the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses.

[0099] Each embodiment in this application is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0100] The devices and media provided in the embodiments of the present application correspond one-to-one to the methods. Therefore, the devices and media also have similar beneficial technical effects as the corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the devices and media will not be repeated here.

[0101] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0102] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0103] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0104] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0105] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0106] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0107] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0108] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0109] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A navigation method based on smart glasses, characterized in that: include: The smart glasses construct a first navigation path according to the target location information determined by the wearer and according to the target location information and the current location information of the smart glasses; The current orientation information is collected in real time by using an angular velocity sensor on the smart glasses, the speed information is collected in real time by using an accelerometer on the smart glasses, and the image information is collected in real time by using an image acquisition device on the smart glasses; Generate indication information according to the orientation information, the current location information and the first navigation path, and update the indication information in real time according to the current location information, wherein the indication information is a graphical direction indication mark; According to the speed information, the image information, the current position information and the first navigation path, the optimal imaging distance of the indication information is calculated in real time, and the indication information is projected onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses, specifically including: obtaining an initial imaging distance according to the speed information, wherein the initial imaging distance is proportional to the speed corresponding to the speed information; projecting the indication information onto the lenses of the smart glasses at the initial imaging distance through the projection device, and setting the imaging position of the indication information at the center of the lenses; determining that there is a turning point ahead according to the first navigation path, and projecting the indication information onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the image information , calibrating the turning point to obtain a calibrated position of the turning point on the lens, and adjusting the imaging position of the indication information to the calibrated position, wherein the turning point is a turning position in the first navigation path; obtaining a first distance between the current position of the smart glasses and the turning point according to the current position information and the image information, and determining that the first distance is less than the initial imaging distance; adjusting the initial imaging distance in real time so that the initial imaging distance is equal to the first distance as the optimal imaging distance; projecting the indication information onto the lens at the optimal imaging distance through the projection device, and setting the imaging position of the indication information to the calibrated position; The method further includes: obtaining current environment brightness information according to the image information, and collecting eye data of the wearer through the image acquisition device, wherein the eye data includes at least one of the following: pupil morphology data and iris morphology data; obtaining a pupil area change value of the wearer within a preset time range according to the pupil morphology data, and determining an iris state of the patient within the preset time range according to the iris morphology data, wherein the iris state includes: iris dilation and iris contraction; inputting the pupil area change value and the iris state into a pre-trained first adjustment model to obtain a first brightness value; inputting the current environment brightness information into a pre-trained second adjustment model to obtain a second brightness value; weighting the brightness value with a larger value between the first brightness value and the second brightness value according to a pre-stored first weight, and weighting the brightness value with a smaller value between the first brightness value and the second brightness value according to a pre-stored second weight, wherein the first weight is less than the second weight, to obtain a weighted brightness value; adjusting the projection device according to the weighted brightness value so that the display brightness of the indication information is consistent with the weighted brightness value.

2. A navigation method based on smart glasses according to claim 1, characterized in that: Generating indication information according to the orientation information, the current location information, and the first navigation path, and updating the indication information in real time according to the current location information, specifically includes: Obtaining first indication information according to the current location information and the first navigation path, wherein the first indication information includes: forward, left turn, right turn, and U-turn; According to the orientation information, determining whether a minimum angle between the current orientation of the smart glasses and the direction to be traveled is less than a first preset threshold; If yes, taking the first indication information as the indication information; If not, generating pre-indication information according to the minimum angle, the pre-indication information including: turn left, turn right; Determining that a turning point has been passed according to the current position information and the first navigation path, and determining that the direction information has changed, wherein the turning point is a turning position in the first navigation path; Obtaining second instruction information according to the current location information and the first navigation instruction, wherein the second instruction includes: forward, left turn, right turn, and U-turn; The indication information is updated to the second indication information.

3. The navigation method based on smart glasses according to claim 1, characterized in that: The smart glasses construct a first navigation path according to the target location information determined by the wearer and according to the target location information and the current location information of the smart glasses, specifically including: The smart glasses obtain target location information and current location information, and collect an initial navigation path through the Internet according to the target location information and the current location information; According to the target position information and the current position information, the altitude difference between the target position and the current position is obtained, and according to the altitude difference and the initial navigation path, the jump layer position information where the altitude change value has a sudden change is obtained; Querying a navigation feature corresponding to the jump-floor location information, and adding the navigation feature to the initial navigation path to reconstruct the initial navigation path, wherein the navigation feature includes at least one of the following: entrance location information, exit location information, elevator entrance location information, signboard location information; and obtaining a first navigation path.

4. The navigation method based on smart glasses according to claim 1, characterized in that: After calculating the optimal imaging distance of the indication information in real time according to the speed information, the image information, the current position information and the first navigation path, and projecting the indication information onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses, the method further includes: The wearer's travel path is recorded in real time, and the travel path is marked at different levels according to the identification factor to obtain multiple marked target points; wherein the identification factor includes at least one of the following: the length of stay, the change rate of the orientation information, and the change rate of the indication information; A control instruction is obtained, and one of the multiple target points is selected according to the control instruction, and a second navigation path is constructed according to the current position information and the target point.

5. The navigation method based on smart glasses according to claim 1, characterized in that: After calculating the optimal imaging distance of the indication information in real time according to the speed information, the image information, the current position information and the first navigation path, and projecting the indication information onto the lenses of the smart glasses at the optimal imaging distance through the projection device on the smart glasses, the method further includes: Collecting eye data of the wearer through the image acquisition device, wherein the eye data includes at least one of the following: pupil morphology data and iris morphology data; Determining, based on the eye data, that the wearer has gazed at the indication information for a preset time period, and turning off the projection device; When it is determined that the indication information has been updated, or when it is determined that a projection instruction issued by the wearer has been received, the projection device is started, and the indication information is projected onto the lenses of the smart glasses at an optimal imaging distance through the projection device.

6. A navigation device based on smart glasses, characterized in that: include: at least one processor; as well as, A memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute a navigation method based on smart glasses as described in any one of claims 1-5.

7. A non-volatile computer storage medium storing computer executable instructions, characterized in that: The computer executable instructions are configured to execute a navigation method based on smart glasses as described in any one of claims 1-5.

Images