Navigation method, device, equipment and storage medium for augmented reality

Abstract

The embodiments of the present application provide a navigation method, apparatus, device and storage medium for augmented reality. The navigation device can obtain the road image data in front of the vehicle and the driving direction data of the vehicle, and then generate virtual navigation guidance data based on the driving direction data and the body parameters of the vehicle. At the same time, the lane in which the vehicle should travel is identified based on the road image data, and the virtual navigation guidance data is finally superimposed and displayed on the real lane, which means that AR technology is applied to the navigation scene, and the user can control the vehicle according to the navigation guidance data. It can be seen that in the above-mentioned navigation method, the driving direction data and the body parameter data are introduced in the process of generating the navigation guidance data, so that the generated navigation guidance data matches the driving status of the vehicle and the body of the vehicle, making the navigation guidance data realistic and improving the effect of AR navigation guidance.

Description

Technical Field

[0001] The present application relates to the field of augmented reality technology, and in particular to a navigation method, apparatus, device and storage medium for augmented reality. Background Art

[0002] Augmented reality (AR) technology has been widely used in numerous scenarios, including retail, tourism, and education. For example, in retail settings, AR allows users to see how clothes will look on them before purchasing them, essentially providing a "try-on" experience. Another example is tourism, where text descriptions of tourist attractions can be superimposed on images, providing users with a better travel experience.

[0003] In addition to the above scenarios, as people's travel needs increase, more and more travel service providers have begun to focus on applying AR technology to travel scenarios, especially combining AR with map navigation. The inventors have found that when AR is combined with map navigation, the realism of the navigation guidance data superimposed on the real road image plays an important role in improving the user experience. Therefore, how to obtain realistic navigation guidance data is a problem that technical personnel in this field need to solve. Summary of the Invention

[0004] In view of this, embodiments of the present application provide a navigation method, apparatus, device, and storage medium for augmented reality, so as to ensure that navigation guidance data has a sense of reality and guarantee navigation effect.

[0005] In a first aspect, an embodiment of the present application provides a navigation method for augmented reality, comprising:

[0006] Acquiring image data of a road ahead of a vehicle and driving direction data of the vehicle;

[0007] generating navigation guidance data according to the driving direction data and the body parameter data of the vehicle;

[0008] The navigation guidance data is superimposed on a lane in which the vehicle should travel, which is identified based on the road image data, and displayed to instruct the vehicle to travel according to the displayed navigation guidance data.

[0009] In a second aspect, an embodiment of the present application provides a navigation device for augmented reality, comprising:

[0010] A visual acquisition module is used to obtain image data of the road in front of the vehicle;

[0011] A driving data acquisition module, used to obtain driving direction data of the vehicle;

[0012] A navigation data generating module, configured to generate navigation guidance data based on the driving direction data and the vehicle body parameter data;

[0013] The display module is used to superimpose the navigation guidance data on the lane where the vehicle should travel, which is identified based on the road image data, to instruct the vehicle to travel according to the displayed navigation guidance data.

[0014] In a third aspect, embodiments of the present application provide an electronic device comprising a processor and a memory, wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the augmented reality navigation method described in the first aspect. The electronic device may also include a communication interface for communicating with other devices or a communication network.

[0015] In a fourth aspect, an embodiment of the present application provides a non-transitory machine-readable storage medium having executable code stored thereon. When the executable code is executed by a processor of an electronic device, the processor can at least implement the navigation method for augmented reality as described in the first aspect.

[0016] The embodiment of the present application provides a navigation method for augmented reality. The navigation device can obtain the road image data in front of the vehicle and the driving direction data of the vehicle, and then generate virtual navigation guidance data based on the driving direction data and the body parameters of the vehicle. At the same time, the lane in which the vehicle should travel is identified based on the road image data. Finally, the virtual navigation guidance data is superimposed and displayed on the real lane, which means that AR technology is applied to the navigation scene. The user can control the vehicle according to the navigation guidance data. It can be seen that in the above-mentioned navigation method, the driving direction data and the body parameter data are introduced in the process of generating the navigation guidance data, so that the generated navigation guidance data matches the driving status of the vehicle and the body of the vehicle, making the navigation guidance data realistic and improving the effect of AR navigation guidance. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0018] Figure 1 A flowchart of a navigation method for augmented reality provided in an embodiment of the present application;

[0019] Figure 2aA schematic diagram of a navigation interface during a vehicle steering process;

[0020] Figure 2b A schematic diagram of another navigation interface during vehicle steering;

[0021] Figure 3 An optional display style for navigation wheel tracks;

[0022] Figure 4a A schematic diagram of a navigation interface when a vehicle is traveling straight ahead;

[0023] Figure 4b This is a schematic diagram of another navigation interface when the vehicle is traveling straight;

[0024] Figure 5 A flowchart of another navigation method for augmented reality provided in an embodiment of the present application;

[0025] Figure 6a A schematic diagram of a navigation interface when a vehicle crosses a line;

[0026] Figure 6b A schematic diagram of a navigation interface when the vehicle does not cross the line;

[0027] Figure 7a A schematic diagram of a scenario corresponding to the navigation method for augmented reality provided in an embodiment of the present application;

[0028] Figure 7b A schematic diagram of another scenario corresponding to the navigation method for augmented reality provided in an embodiment of the present application;

[0029] Figure 8 A schematic structural diagram of a navigation device for augmented reality provided in an embodiment of the present application;

[0030] Figure 9 For Figure 8 A schematic structural diagram of an electronic device corresponding to the navigation device for augmented reality provided by the illustrated embodiment. DETAILED DESCRIPTION

[0031] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0032] The terms used in the examples of this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms "a," "the," and "the" used in the examples of this application and the appended claims are also intended to include plural forms, and unless the context clearly indicates otherwise, "a plurality" generally includes at least two, but does not exclude the inclusion of at least one.

[0033] It should be understood that the term "and / or" as used herein is merely a description of the relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document generally indicates that the associated objects are in an "or" relationship.

[0034] As used herein, the words “if” and “if” may be interpreted as “at the time of” or “when” or “in response to determining” or “in response to identifying,” depending on the context. Similarly, the phrases “if it is determined” or “if (stated condition or event) is identified” may be interpreted as “when it is determined” or “in response to determining” or “when identifying (stated condition or event)” or “in response to identifying (stated condition or event),” depending on the context.

[0035] It should also be noted that the terms "include," "comprises," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a product or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such product or system. In the absence of further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the product or system comprising the element.

[0036] As mentioned in the background technology, when AR technology is applied to the field of vehicle navigation, the virtual navigation guidance data generated by the navigation device can be superimposed and displayed with the real road markings on the driving road. According to this intuitive guidance effect, the user can drive smoothly to the destination.

[0037] Based on the above description, some embodiments of the present application are described in detail below with reference to the accompanying drawings. In the absence of conflicts between the embodiments, the following embodiments and the features therein may be combined with each other. In addition, the step timings in the following method embodiments are merely examples and are not strictly limiting.

[0038] Figure 1 This is a flowchart of a navigation method for augmented reality provided in an embodiment of the present application. Figure 1 As shown, the method includes the following steps:

[0039] S101, acquiring image data of the road ahead of the vehicle and driving direction data of the vehicle.

[0040] S102: Generate navigation guidance data based on the driving direction data and the vehicle body parameter data.

[0041] When driving, users can use map navigation applications to plan navigation routes, and then drive to their destination along the planned navigation route based on the guidance of the map navigation application. Currently, map navigation applications are divided into mobile phone versions installed on smartphones, car machine versions installed in the vehicle multimedia system, and car box versions installed in smart car boxes, etc. Among them, map navigation applications can support map navigation mode and augmented reality navigation mode (i.e., AR navigation mode), and users can switch navigation modes through the interface provided by the map navigation application.

[0042] However, regardless of which version, the technical solutions provided in the embodiments of this application can be adopted. That is, the execution subject of the navigation method provided in the embodiments of this application is a device installed with a map navigation application (hereinafter referred to as a navigation device). It should also be noted that the map navigation application referred to in this application can be an independent application software, that is, an independent APP, or a map navigation applet or map navigation service capability integrated into other applications.

[0043] After enabling AR navigation mode, the navigation device can obtain road image data and vehicle direction data. The direction data reflects the vehicle's direction of travel. Optionally, the direction data can specifically be steering wheel angle data. Furthermore, the navigation device can also obtain vehicle body parameter data. Optionally, the body parameter data can specifically be vehicle width. The vehicle width can be the vehicle's body width or the entire width of the vehicle, including the rearview mirror.

[0044] Next, based on the enabled AR navigation mode, the navigation device can generate navigation guidance data based on the acquired road image data and vehicle body parameter data. Specifically, the navigation device can first determine the vehicle's wheel trajectory based on the driving direction data, and then generate navigation guidance data based on the wheel trajectory and the vehicle's width.

[0045] S103 , superimposing the navigation guidance data on the lane that the vehicle should travel in, which is identified based on the road image data, to instruct the vehicle to travel according to the displayed navigation guidance data.

[0046] Ultimately, the navigation device overlays the navigation guidance data on the lane the vehicle should travel in, thereby realizing AR navigation.

[0047] Specifically, the navigation device first identifies the road markings contained in the acquired road image data, including the lane markings of the vehicle's intended lane. It then overlays the generated navigation guidance data with the lane markings. The user then sees both the virtual navigation guidance data and the actual lane markings on the navigation interface, allowing the user to drive according to the navigation guidance data.

[0048] In this embodiment, the navigation device can obtain the road image data in front of the vehicle and the driving direction data of the vehicle, and then generate virtual navigation guidance data based on the driving direction data and the vehicle body parameters. At the same time, the lane in which the vehicle should travel is identified based on the road image data. Finally, the virtual navigation guidance data is superimposed and displayed on the real lane, which means that AR technology is applied to the navigation scene. The user can control the vehicle according to this navigation guidance data. It can be seen that in the above-mentioned navigation method, the driving direction data and the vehicle body parameter data are introduced in the process of generating the navigation guidance data, so that the generated navigation guidance data matches the driving status of the vehicle and the vehicle body, making the navigation guidance data realistic and improving the effect of AR navigation guidance.

[0049] In practical applications, when the vehicle is in a turning state, the generated navigation guidance data can also be called turning guidance data. This data can be expressed in various forms. For example, it can contain two navigation wheel tracks, such as Figure 2a For example, it can also be a specific guide pattern, such as Figure 2b Optionally, the navigation interface may also display other prompt information, such as current driving speed, estimated arrival time, estimated driving time, etc.

[0050] like Figure 2a As shown, the width of each navigation wheel track can be a first preset value, and the distance between two navigation wheel tracks can be a second preset value. The above two preset values ​​can theoretically be any size, but are usually set to be smaller than the second preset value.

[0051] In addition, considering the guiding effect of the navigation wheel track, optionally, the first preset value is usually the tire width of the vehicle, and the second preset value is usually the width of the vehicle. Optionally, the specific display style of the navigation wheel track can be a tire pattern.

[0052] like Figure 2b As shown, the steering guidance data can be a specific arrow pattern. The width of the arrow pattern can be a third preset value, which can be any size. Also from the perspective of guidance effect, optionally, the third preset value can be equal to the width of the vehicle.

[0053] For example, when the vehicle is in a turning state, the navigation guidance data with the wheel pattern can be as follows: Figure 3 shown.

[0054] When the vehicle is in a straight-moving state, the generated navigation guidance data may also be referred to as straight-moving guidance data. Figure 4a As shown in , the straight-line guidance data can be expressed as two navigation wheel tracks with tire tread patterns, and the distance between the two navigation wheel tracks is the width of the vehicle. Figure 4b As shown, the straight travel guidance data may be expressed as an arrow pattern, and the width of the arrow pattern is also the width of the vehicle.

[0055] according to Figure 1 As can be seen from the embodiment shown, in the process of implementing AR navigation, the navigation device needs to obtain road image data, driving direction data and vehicle body parameter data. Optionally, the following methods can be used to obtain these data:

[0056] The road image data can be collected in real time by a visual acquisition module. Optionally, the visual acquisition module can be a camera, which can be a camera on a mobile phone, a camera of a driving recorder, or an independent camera.

[0057] When the navigation device is a mobile phone, the road image data taken by the mobile phone camera can be directly obtained, and the road image data taken by the driving recorder or camera connected to the mobile phone can also be obtained. When the navigation device is a car box or a car computer, the navigation device can obtain the road image data taken by the driving recorder or an independent camera or a mobile phone camera connected thereto. Among them, the connection method between the aforementioned devices can be a wireless connection method (such as hotspot, wifi or Bluetooth, etc.) or a wired connection method (such as a USB data cable, etc.). The road image data taken by the camera can also be understood as the actual driving environment seen by the user during the vehicle's driving.

[0058] Regarding driving direction data, if permissions are set for the vehicle's body system data, preventing the map navigation application from directly obtaining driving direction data collected by the vehicle's sensors, an alternative approach is for the navigation device to identify objects contained in each image based on multiple road images captured by the camera to obtain the vehicle's driving direction data. Specifically, for multiple road images, the navigation device can perform object recognition on two adjacent road images and estimate the vehicle's steering wheel rotation angle based on the difference in objects between the two adjacent road images, thereby indirectly obtaining the vehicle's driving direction data.

[0059] If the vehicle's body system data is provided to the map navigation application developer, another option is for the navigation device to directly obtain driving direction data, that is, the vehicle's steering wheel rotation angle data, through the data interface provided by the vehicle system. This rotation angle data can be directly collected by the vehicle's steering angle sensor.

[0060] It should be noted that both of the above two methods can obtain the vehicle's driving direction data, that is, the rotation angle data of the vehicle's steering wheel, but the two acquisition methods are essentially different: one is directly collected by the sensor, and the other is indirectly obtained through image recognition.

[0061] Based on the above description, when the navigation device can directly obtain the driving direction data collected by the sensor, that is, the steering wheel rotation angle data, because the vehicle body system data has not set permissions, it can directly generate navigation guidance data based on the driving direction data to achieve AR navigation. When the navigation device cannot directly obtain the driving direction data due to permission restrictions, the driving direction data can be estimated through image recognition, and further navigation guidance data can be generated to achieve AR navigation. However, it should be noted that compared to the driving direction data estimated by image recognition, the data directly collected by the sensor is often more accurate, therefore, making AR navigation more accurate.

[0062] One alternative method for acquiring vehicle body parameter data is to automatically acquire the data after the navigation device is installed on the vehicle, or to manually input the data. Another alternative method is for the navigation device to acquire road image data captured by the vehicle while driving. The road image data is then recognized, and the body parameter data is determined based on the number and positional relationships of objects contained in the image.

[0063] It's also important to note that compared to user input, the accuracy of vehicle body parameter data obtained through image recognition is generally lower, thus affecting navigation accuracy. However, in actual applications, different methods can be used to obtain vehicle width based on the required navigation accuracy.

[0064] Furthermore, when using driving direction data obtained through image recognition for AR navigation, the accuracy of image recognition directly impacts the accuracy of the driving direction data. Inaccurate driving direction data can lead to inaccurate navigation guidance data, further resulting in poor navigation results. Inaccurate navigation guidance data has a greater impact on navigation results during turns than during straight-ahead travel.

[0065] Therefore, taking the vehicle steering process as an example, if the user follows this unrealistic navigation guidance data, there is a high probability that the steering will fail or even result in a dangerous situation. Furthermore, during the steering process, the driving direction data is constantly changing. Ideally, the generated navigation guidance data should change with the driving direction data. That is, the user's steering wheel rotation action should be synchronized with the steering wheel rotation angle determined by the navigation device. However, given the time required for image recognition, it is easy for the user to control the steering wheel to achieve the rotation angle A, but the navigation device's image recognition process has not yet completed, making it impossible to obtain the driving direction data (i.e., rotation angle A). In other words, the determination of the steering wheel rotation angle lags behind the user's steering wheel rotation action. This lag can also lead to unsuccessful steering and even dangerous situations.

[0066] To avoid the aforementioned issues, users can optionally configure their navigation device to automatically acquire driving direction data. This can be done through the navigation interface of the device, enabling the device to automatically acquire driving direction data. Once this function is enabled, if the navigation device has direct access to driving direction data collected by sensors through the data interface, the data collected by the sensors will be prioritized for AR navigation.

[0067] Optionally, depending on actual needs, such as in scenarios where navigation accuracy is not a high requirement, users can also disable the aforementioned data acquisition function. With this function disabled, the navigation device can obtain driving direction data through image recognition, thereby enabling AR navigation.

[0068] The above embodiment has described the process of AR navigation for a vehicle in a turning state. However, it is easy to understand that compared to turning, the more common driving state of a vehicle is straight driving. Therefore, when the vehicle is in a straight driving state, that is, the vehicle is driving in a straight direction, Figure 5 This is a flowchart of another navigation method provided in an embodiment of the present application. Figure 5 As shown, after step 103, the method may further include the following steps:

[0069] S201, identifying lane markings of a lane where a vehicle is located in road image data.

[0070] S202: Generate lane marking prompt information based on the positional relationship between the lane marking and the two navigation wheel tracks.

[0071] After step 103, the navigation device has generated navigation guidance data based on the road image data, driving direction data and vehicle body parameter data, and this navigation guidance data is also superimposed and displayed on the lane where the vehicle is currently located, thereby realizing AR navigation.

[0072] Furthermore, to ensure safe driving, the navigation system can also detect whether the vehicle crosses the lane while traveling straight ahead. Specifically, the area between two lane markings constitutes a lane. Based on the positional relationship between the lane markings and the navigation guidance data, the system can determine whether the vehicle crosses the lane. If the vehicle crosses the lane, the navigation system generates a lane crossing warning message.

[0073] Navigation guidance data (i.e. straight guidance data) can be expressed as Figure 6a or Figure 6b When the straight guidance data is two navigation wheel tracks, if any of the two navigation wheel tracks intersects with the lane marking of the lane where the vehicle is located, indicating that the vehicle has crossed the lane, a crossing prompt message is generated, such as Figure 6a More specifically, if any navigation wheel track line intersects with the lane marking near the end of the vehicle, indicating that the vehicle has crossed the lane, a lane crossing prompt message is generated.

[0074] When the straight guidance data is a specific guidance pattern, such as an arrow pattern, if the distance between the center line of the arrow pattern and the lane marking is greater than or equal to the preset distance range, it means that the vehicle is driving in the center of the lane and there is no lane crossing behavior, then no lane crossing prompt information will be generated. Figure 6b Otherwise, the navigation device generates a line-crossing prompt. Optionally, the line-crossing prompt information can be displayed in text form on the navigation interface or can be broadcasted in voice form.

[0075] In this embodiment, when the vehicle is in a straight-line driving process, a line crossing detection can be provided for the vehicle to ensure that the vehicle can drive in the middle of the lane and ensure driving safety.

[0076] For ease of understanding, the specific implementation process of the navigation method for virtual reality provided in the above embodiments is exemplified in combination with a specific navigation scenario.

[0077] Users can trigger a setup operation on a navigation device with a map navigation app installed. In response to this user-triggered operation, the map navigation app can enable the acquisition of vehicle direction data. This enabled state is saved, meaning that data acquisition will be automatically enabled upon the next launch of the map navigation app.

[0078] When the vehicle is in motion and the user needs AR navigation, they can trigger the mode selection operation to turn on AR navigation mode. During the vehicle's motion, a camera will capture image data in front of the vehicle. This camera can be a camera on a mobile phone, a camera in a driving recorder, or a standalone camera.

[0079] When the body system data is not authorized, the navigation device can directly obtain the driving direction data collected by the sensor through the vehicle system data interface, that is, the vehicle's steering wheel rotation angle data, and generate navigation guidance data based on this rotation angle data and the vehicle's body parameter data. Finally, the navigation device superimposes this navigation guidance data with the real road markings in the vehicle's driving environment, which is to achieve AR navigation of the vehicle. The above content can be combined with Figures 2a to 4b as well as Figure 7a (1) Understanding.

[0080] When the vehicle body system data is set with permissions, the navigation device can estimate the driving direction data by identifying multiple road image data taken by the vehicle during driving, and generate navigation guidance data based on the driving direction data and the vehicle body parameter data. Finally, the navigation guidance data and the lane markings of the lane the vehicle should drive are superimposed and displayed to achieve AR navigation. The above content can be combined with Figures 2a to 4b as well as Figure 7a (2) Understanding.

[0081] In the process of implementing AR navigation, when the vehicle is in a straight-moving state, the navigation device can also recognize the road image data captured by the vehicle during the straight-moving process to identify the lane markings where the vehicle is currently located, and determine whether the vehicle is crossing the lane based on the positional relationship between the lane markings and the navigation guidance data.

[0082] In this case, taking the straight guidance data as two navigation wheel tracks as an example, if any of the navigation wheel tracks intersects with the lane marking, it is determined that the vehicle has crossed the lane, and a crossing prompt message is generated. Figure 6a as well as Figure 7b (1) Understanding.

[0083] Taking the straight-line guidance data as an arrow pattern as an example, if the distance between the center line of the arrow pattern and the lane marking is greater than or equal to the preset distance, the vehicle does not cross the lane and no crossing prompt information is generated. Figure 6b as well as Figure 7b (2) Understanding.

[0084] The following describes in detail one or more embodiments of the navigation device for augmented reality. Those skilled in the art will appreciate that these navigation devices can be constructed using commercially available hardware components and configured according to the steps taught in this solution.

[0085] Figure 8 A structural diagram of a navigation device for augmented reality provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, the device includes:

[0086] The visual acquisition module 11 is used to acquire image data of the road ahead of the vehicle.

[0087] The driving data acquisition module 12 is used to obtain the driving direction data of the vehicle.

[0088] The navigation data generating module 13 is configured to generate navigation guidance data according to the driving direction data and the vehicle body parameter data.

[0089] The display module 14 is configured to superimpose the navigation guidance data on the lane in which the vehicle should travel, identified based on the road image data, to instruct the vehicle to travel according to the displayed navigation guidance data.

[0090] Optionally, the driving data acquisition module 12 is specifically configured to obtain, through a data interface provided by a vehicle system, rotation angle data of a steering wheel of the vehicle as the driving direction data.

[0091] Optionally, the driving data acquisition module 12 is specifically configured to determine the driving direction data of the vehicle based on the acquired image data of the road in front of the vehicle.

[0092] Optionally, the navigation data generation module 13 is specifically used to: determine the travel trajectory of the vehicle's wheels based on the driving direction data; and generate navigation guidance data consisting of two navigation wheel tracks based on the travel trajectory of the wheels and the width of the vehicle, and the distance between the two navigation wheel tracks is equal to the width of the vehicle.

[0093] The vehicle body parameter data includes the width of the vehicle, and the display style of the navigation wheel trace is the tire pattern.

[0094] Optionally, the device further includes: an identification module 21 and a prompt information generation module 22.

[0095] The recognition module 21 is configured to recognize lane markings of the lane where the vehicle is located in the road image data.

[0096] The prompt information generating module 22 is used to generate lane marking prompt information according to the positional relationship between the lane marking and the two navigation wheel tracks.

[0097] Optionally, the prompt information generating module 22 is specifically configured to generate the lane crossing prompt information if any of the navigation wheel traces intersects with the lane marking.

[0098] Figure 8 The device shown can perform Figures 1 to 7b For the method of the embodiment shown in FIG. 1 , reference may be made to the description of the part not described in detail in the embodiment. Figures 1 to 7bThe implementation process and technical effects of this technical solution can be found in Figures 1 to 7b The description in the illustrated embodiment will not be repeated here.

[0099] The above describes the internal functions and structure of the navigation device for augmented reality. In a possible design, the structure of the navigation device can be implemented as an electronic device, which can be a navigation device installed with a map navigation application. Figure 9 As shown, the electronic device may include: a processor 31 and a memory 32. The memory 32 is used to store the data that supports the electronic device to execute the above Figures 1 to 7b In the illustrated embodiment, the program of the navigation method for augmented reality is provided, and the processor 31 is configured to execute the program stored in the memory 32 .

[0100] The program includes one or more computer instructions, wherein the one or more computer instructions, when executed by the processor 31, can implement the following steps:

[0101] Acquiring image data of a road ahead of a vehicle and driving direction data of the vehicle;

[0102] generating navigation guidance data according to the driving direction data and the body parameter data of the vehicle;

[0103] The navigation guidance data is superimposed on a lane in which the vehicle should travel, which is identified based on the road image data, and displayed to instruct the vehicle to travel according to the displayed navigation guidance data.

[0104] Optionally, the processor 31 is further configured to execute the aforementioned Figures 1 to 7b All or part of the steps in the illustrated embodiments.

[0105] The structure of the electronic device may further include a communication interface 33 for the electronic device to communicate with other devices or a communication network.

[0106] In addition, the embodiment of the present application provides a computer storage medium for storing computer software instructions used by the above electronic device, which includes instructions for executing the above Figures 1 to 7b The procedures involved in the navigation method for augmented reality in the method embodiment shown.

[0107] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A navigation method for augmented reality, wherein: include: Acquiring image data of a road ahead of a vehicle and driving direction data of the vehicle; generating navigation guidance data according to the driving direction data and the vehicle body parameter data, wherein the navigation guidance data includes turning guidance data or straight-ahead guidance data, and the navigation guidance data includes two navigation wheel track lines; The navigation guidance data is superimposed on a lane in which the vehicle should travel, which is identified based on the road image data, and displayed to instruct the vehicle to travel according to the displayed navigation guidance data.

2. The method according to claim 1, wherein Acquiring the driving direction data of the vehicle, including: The rotation angle data of the steering wheel of the vehicle is obtained as the driving direction data through a data interface provided by the vehicle system.

3. The method according to claim 1, wherein Acquiring the driving direction data of the vehicle, including: Based on the acquired image data of the road ahead of the vehicle, the driving direction data of the vehicle is determined.

4. The method according to any one of claims 1 to 3, wherein The vehicle body parameter data includes the width of the vehicle. Generating navigation guidance data according to the driving direction data and the vehicle body parameter data includes: determining a travel trajectory of the wheels of the vehicle based on the travel direction data; According to the travel track of the wheel and the width of the vehicle, navigation guidance data including two navigation wheel tracks is generated, and the distance between the two navigation wheel tracks is equal to the width of the vehicle.

5. The method according to claim 4, wherein The display style of the navigation wheel trace is the pattern of the tire.

6. The method according to claim 4, wherein: The vehicle is traveling in a straight direction, and the method further includes: identifying lane markings of a lane in which the vehicle is located in the road image data; Generate lane marking prompt information based on the positional relationship between the lane marking and the two navigation wheel track lines.

7. The method according to claim 6, wherein: Generating lane marking prompt information according to the positional relationship between the lane marking in the road image data and the two navigation wheel track lines, including: If any of the navigation wheel traces intersects with the lane marking, the lane crossing prompt information is generated.

8. A navigation device for augmented reality, wherein: include: A visual acquisition module is used to obtain image data of the road in front of the vehicle; A driving data acquisition module, used to obtain driving direction data of the vehicle; a navigation data generating module, configured to generate navigation guidance data according to the driving direction data and the vehicle body parameter data, wherein the navigation guidance data includes turning guidance data or straight-ahead guidance data, and the navigation guidance data includes two navigation wheel track lines; The display module is used to superimpose the navigation guidance data on the lane where the vehicle should travel, which is identified based on the road image data, to instruct the vehicle to travel according to the displayed navigation guidance data.

9. An electronic device, wherein: include: Memory, processor; The memory stores executable codes, and when the processor executes the executable codes, the processor executes the navigation method for augmented reality according to any one of claims 1 to 7.

10. A non-transitory machine-readable storage medium, wherein: The non-transitory machine-readable storage medium stores executable code, and when the executable code is executed by a processor of an electronic device, the processor is caused to execute the navigation method for augmented reality according to any one of claims 1 to 7.

Images