Method and apparatus for using augmented reality in traffic

Abstract

Augmented reality can be used to assist a user in navigating to a desired location. A first location and a device orientation of a user device can be obtained. A second location can be obtained. A path from the first location to the second location can be determined. Camera feedback can be displayed on the user device. An indicator of the path can be displayed on the camera feedback based on the device orientation. In response to determining that the device orientation is aligned with the second location, a marker can be displayed on the camera feedback, and the marker can indicate the second location.

Description

[0001] Cross - Reference to Related Applications

[0002] This application claims priority to U.S. Non - Provisional Application No. 16 / 525,955, filed on July 30, 2019, with the title "Methods and Apparatuses for Using Augmented Reality in Traffic", the entire content of which is incorporated herein by reference. Technical Field

[0003] This application generally relates to providing navigation using augmented reality. Background Art

[0004] People often plan to meet in crowded places. It is difficult for both strangers and friends to find each other. When a person is in a car, it may be particularly difficult to find him. Even when close to the car, passengers using a ride - sharing platform may have difficulty determining the car's location. By providing improved navigation to help a person reach a desired location, their experience can be enhanced. Summary of the Invention

[0005] One aspect of this application relates to a system for augmented reality navigation. The system includes one or more processors and one or more non - transitory computer - readable memories. The one or more non - transitory computer - readable memories are connected to the one or more processors and store instructions executed by the one or more processors. Executing the instructions enables the system to perform operations including: obtaining a first location and a device orientation of a user device; obtaining a second location; determining a path from the first location to the second location; displaying camera feedback on the user device; displaying an indicator of the path on the camera feedback based on the device orientation; and in response to determining that the device orientation is aligned with the second location, displaying a marker on the camera feedback that indicates the second location.

[0006] Another aspect of this application relates to a method for augmented reality navigation. The method includes: obtaining a first location and a device orientation of a user device; obtaining a second location; determining a path from the first location to the second location; displaying camera feedback on the user device; displaying an indicator of the path on the camera feedback based on the device orientation; and in response to determining that the device orientation is aligned with the second location, displaying a marker on the camera feedback that indicates the second location.

[0007] Another aspect of the present application relates to a non - transitory computer - readable storage medium configured with instructions executable by one or more processors to cause the one or more processors to perform operations, the operations including: obtaining a first location and a device orientation of a user device; obtaining a second location; determining a path from the first location to the second location; displaying a camera feedback on the user device; displaying an indicator of the path on the camera feedback based on the device orientation; and in response to determining that the device orientation is aligned with the second location, displaying a marker on the camera feedback that indicates the second location.

[0008] In some embodiments, displaying an indicator of the path may include: determining a direction of the second location relative to the device orientation, wherein the path from the first location to the second location includes the direction of the second location relative to the device orientation; and displaying an indicator of the path in the direction of the second location relative to the device orientation.

[0009] In some embodiments, displaying an indicator of the path may include: determining a route from the first location to the second location, wherein the path from the first location to the second location includes the route; detecting features in the camera feedback related to the route; and displaying an indicator of the path on the features in the camera feedback.

[0010] In some embodiments, the features in the camera feedback may include a road leading to the second location.

[0011] In some embodiments, the indicator of the path may include a dynamic arrow along the path.

[0012] In some embodiments, displaying the camera feedback on the user device may include displaying the camera feedback on a first portion of the user device; displaying a map on a second portion of the user device; and displaying at least a portion of the path on the map.

[0013] In some embodiments, when the user of the user device moves closer to the second location, the size of the marker indicating the second location increases.

[0014] In some embodiments, displaying the camera feedback on the user device may include: in response to determining that the first location and the second location are within a threshold distance, displaying a button for enabling the camera of the user device; and in response to detecting a selection of the button, displaying the camera feedback on the user device.

[0015] The above features of the systems, methods, and non-transitory computer-readable media disclosed in this application, as well as the operating methods of structure-related elements, functions, combinations of components, and manufacturing economies, will become more apparent when considering the following description and the appended claims in reference to the accompanying drawings, all of which form a part of this specification, where like reference numerals represent corresponding parts in each of the drawings. However, it should be clearly understood that the drawings are for illustrative and descriptive purposes only and are not intended to limit the scope of this application. It should be understood that the above general description and the following detailed description are only exemplary and explanatory and do not limit the application as claimed. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The preferred and non-limiting embodiments of this application can be more easily understood by reference to the accompanying drawings, in which:

[0017] Figure 1A is an exemplary platform for augmented reality navigation as shown in some embodiments of this application.

[0018] Figure 1B is an exemplary computing system for augmented reality navigation as shown in some embodiments.

[0019] Figure 2 is an exemplary display for initiating augmented reality navigation as shown in some embodiments of this application.

[0020] Figure 3 is an exemplary display of augmented reality navigation including an indicator of a path as shown in some embodiments of this application.

[0021] Figure 4 is an exemplary display of augmented reality navigation including a marker indicating a second location as shown in some embodiments of this application.

[0022] Figure 5 shows a block diagram of a computer system on which any of the embodiments described herein can be implemented.

[0023] Figure 6 is a flowchart of an exemplary method for augmented reality navigation as shown in some embodiments of this application. DETAILED DESCRIPTION

[0024] Specific non - limiting embodiments of the present application will now be described with reference to the accompanying drawings. It should be understood that the specific features and aspects of any embodiment disclosed herein can be used in combination with the specific features and aspects of any other embodiment disclosed herein. It should also be understood that these embodiments are by way of example only and illustrate a small number of embodiments within the scope of the present application. Various changes and modifications that are obvious to those skilled in the art to which the present application pertains are considered to be within the spirit, scope, and contemplation of the present application as further defined in the appended claims.

[0025] The technology disclosed herein can improve the user experience by providing navigation using augmented reality. The navigation directions can be enhanced through the camera feedback on the user device. For example, arrows can be overlaid on the ground in the camera feedback to show the user the path they need to take. Markers can also be added at the exact location in the camera feedback where the user is trying to reach. This can be particularly useful when the user is a passenger using a shared - ride service and has to walk to meet the car. Augmented reality can be used to enable the user to quickly reach the desired location.

[0026] Figure 1A is an exemplary platform 100 for augmented reality (AR) navigation as shown in some embodiments. The exemplary platform 100 can include a server system 102, a computing device 104, and a computing device 106. It should be understood that although Figure 1A two computing devices are shown, the platform 100 can include any number of computing devices. The server system 102 can be implemented in one or more networks (e.g., enterprise networks), one or more endpoints, one or more servers, or one or more clouds. The server can include hardware or software that manages access to centralized resources or services in the network. The cloud can include a cluster of servers and other devices distributed across the network. The computing devices 104 and 106 can be implemented on or as various devices such as mobile phones, tablets, servers, desktop computers, laptop computers, wearable devices (e.g., smartwatches, head - mounted cameras), dashcams, vehicles (e.g., cars, trucks, boats, trains, autonomous vehicles, electric scooters, electric bicycles). The server system 102 can communicate with the computing devices 104 and 106 and other computing devices. The computing devices 104 and 106 communicate with each other through the server system 102 and can also communicate directly with each other. Communication between the devices can be carried out via the Internet, a local network (e.g., LAN), or direct communication (e.g., Bluetooth TM , radio frequency, infrared).

[0027] Figure 1B is an exemplary computing system 110 for AR navigation as shown in some embodiments. The computing system 110 can be implemented in the platform 100. Although the computing system 110 is inFigure 1B Shown as a single entity herein, but this is merely for ease of reference and does not imply a limitation. One or more components or one or more functions of the computing system 110 described herein can be implemented in a single computing device or multiple computing devices. For example, the computing system 110 can be entirely included in the server system 102 or the computing device 104 or the computing device 106. In another example, the computing system 110 can be implemented across the server system 102, the computing device 104, and the computing device 106.

[0028] In some embodiments, the computing system 110 includes a navigation component 112, a camera component 114, and an augmented reality component 116. In some embodiments, the computing system 102 can further include a startup component 118. The computing system 110 can include other components. The computing system 110 can include one or more processors (e.g., digital processors, analog processors, digital circuits designed to process information, central processing units, graphics processing units, microcontrollers or microprocessors, analog circuits designed to process information, state machines, and / or other mechanisms for electronically processing information) and memory (e.g., permanent memory, temporary memory). The processor can be configured to perform various operations by interpreting machine-readable instructions stored in the memory. The computing system 110 can include other computing resources. In some instances, the computing system 110 can include a single stand-alone hardware device that is configured to be communicatively coupled or physically connected to components of a computer system. In some instances, the computing system 110 can include an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA) that is configured to perform transaction verification operations associated with one or more distributed applications. The above-described computing system 110 can be installed with appropriate software (e.g., platform programs, etc.) and / or hardware (e.g., wired, wireless connections, etc.) to access other devices of the platform 100.

[0029] The navigation component 112 can be configured to obtain a location and a device orientation. A first location and a device orientation of a user device can be obtained. A second location can be obtained. In some embodiments, the second location can include a fixed destination. In some embodiments, the second location can include the location of a second device, and a second device orientation can be obtained. In some embodiments, the second device can include the user device. In some embodiments, the second device can include an autonomous or remote system that does not require user interaction. The ways of obtaining information can include accessing, obtaining, analyzing, determining, checking, identifying, loading, locating, opening, receiving, retrieving, reviewing, storing, or one or more of other ways of obtaining information.

[0030] In some embodiments, the first user device and the second device may include all or part of the computing system 110. In some embodiments, the first user device may include the computing device 104 and the second device may include the computing device 106. For example, the first user device may be a mobile phone of a first user, and the second device may be a mobile phone of a second user. The first user and the second user may be pedestrians attempting to locate each other, a passenger and a driver attempting to locate each other, or two drivers attempting to locate each other. In another example, the first user device may be a mobile phone of a first user, and the second device may be an autonomous vehicle. In another example, the first user device may be a wearable device.

[0031] The location may include an address, a landmark, or GPS (Global Positioning System) coordinates. In some embodiments, the location may be input by the user. For example, a driver may determine the location of a nearby landmark. In another example, a passenger may input the location of a destination. In some embodiments, the location may be determined using GPS or an access point connected to the device. In some embodiments, visual localization may be used to determine the location. Visual odometry, visual inertial odometry, or visual inertial telemetry may be used to track the location, orientation, and movement of the device. Changes in location may be detected using sensors on the device (e.g., cameras, accelerometers, proximity sensors, gyroscopes). Cameras may be used to detect features and objects. For example, visual localization may use ARKIT TM or ARCORE TM . The camera may include a camera connected to the device (e.g., a mobile device camera, a webcam), a dashcam, or a six-degree-of-freedom (6DoF) camera.

[0032] A database including topology and images may be used to identify the detected features and objects. For example, the database may include a topological map and images of a landmark. In some embodiments, the database may include images of users and vehicles. For example, the database may include an image of a driver's car that a passenger is trying to find. Images of all sides of the car may be uploaded to the database by the driver. The computing system 110 may perform all or part of the visual localization. In some embodiments, the database may be accessed by or located on one or more of the server system 102, the computing device 104, and the computing device 106. For example, the images may be captured by one or both of the computing device 104 and the computing device 106. In some embodiments, the images may be uploaded to the server system 102. The server system 102 may perform the visual localization and send the location information back to one or both of the computing device 104 and the computing device 106. In some embodiments, the visual localization may be performed locally on one or both of the computing device 104 and the computing device 106.

[0033] In some embodiments, visual positioning can be used to determine the first position and the second position. Both the first user and the second user can turn on the camera on their user devices. Visual positioning can be used to determine the position of the first user's device based on the camera feedback from the first device, and can determine the position of the second user's device based on the camera feedback from the second device.

[0034] The navigation component 112 can be further configured to determine a path from the first position to the second position. For example, the path can be from the position of the passenger to the position of the driver. In some embodiments, the path is the direction of the second position relative to the device orientation. For example, the path can be the direction in which the user of the first user device can turn to face the second position. The direction can be determined using the position and the device orientation.

[0035] In some embodiments, the path can be a route from the first position to the second position. The route can include multiple steps that the user must take to reach the second position. For example, the route can include a list of turns that the user must make, and the list of turns can include distance, direction, and street name.

[0036] The camera component 114 can be configured to display camera feedback on the user device. The camera feedback can display real-time feedback from the camera. For example, a real-time video from the camera can be displayed. The camera can include a device communicatively connected to the user device (e.g., webcam, dashcam, video recorder, handheld camera) or a component embedded in the user device (e.g., mobile device camera).

[0037] The augmented reality component 116 can be configured to display an indicator of the path and a marker indicating the second position. The indicator and the marker can be displayed on the user device. The indicator and the marker can be augmented on the camera feedback. The indicator can be displayed in response to determining that the device orientation is not aligned with the second position. For example, the indicator can be displayed when the camera of the user device is not pointed at the second position. In some embodiments, the indicator can be displayed in the direction leading to the second position. For example, the indicator can be displayed on the user device to indicate the direction in which the user must travel to reach the second position. The indicator can be displayed along the screen edge of the user device facing the second position. For example, an arrow can be displayed near the screen edge. If the user is moving towards or away from the direction of the second position, the indicator can include a different color display. As the user moves towards and away from the second position, the indicator can include dimming and brightening of the screen. For example, the screen edge closest to the second position can brighten.

[0038] In some embodiments, an indicator may be displayed on a feature in the camera feedback. The feature may be detected based on its correlation with a route from a first location to a second location. For example, a feature in the camera feedback may include a road leading to the second device location. A dynamic arrow may be displayed along the path to the second location. For example, the arrow may move towards the second location. The arrow may show the passenger the road or sidewalk they need to follow to reach their driver. In some embodiments, the indicator may be displayed in response to determining that the device orientation is aligned with the second location. For example, the indicator may continue to be displayed after the device has turned to face the second location.

[0039] In response to determining that the device orientation is aligned with the second location, a marker indicating the second location may be displayed. For example, the marker may be displayed when the user device is facing the second location. The user device may be determined to be facing the second location when the second location is within the camera feedback. The marker may be displayed in the camera feedback. For example, the marker may be an icon marking the car the passenger is trying to reach. The car may be identified using GPS or other location technologies. The marker may remain aligned with the second location as the user device moves. The size of the marker may increase as the user device moves closer to the second location. The enlarged marker may give the passenger a sense of perspective as they approach their car. The marker may be dynamic and colored. For example, an orange marker may rotate or pulsate at the second location (e.g., the car) the passenger is trying to reach.

[0040] In some embodiments, the augmented reality component 116 may be configured to display additional information to assist with navigation. The camera feedback may be displayed on a first portion of the user device, and a map may be displayed on a second portion of the user device. A portion of the path may be displayed on the map. For example, the streets included in the route to the second device location may be highlighted on the map. The second location may be determined on the map. The second portion of the user device may include a navigation disk containing the map. A compass-style navigation may be displayed in the navigation disk or on a third portion of the user device. Text navigation information may be displayed on a fourth portion of the user device. For example, distance, direction, and street names may be displayed at the top of the user device. The combination of displayed information may enable the passenger to reach their car in a timely manner.

[0041] In some embodiments, traditional communication and identification means may be displayed. For example, the driver's name, photo, and vehicle information (e.g., color, make, model, license plate) may be displayed. Buttons for communication channels may be displayed. The communication channels may include phone, text, and video chat. For example, camera feedback from another device may be displayed.

[0042] The startup component 118 can be configured to start AR navigation on a user device. Starting AR navigation can include activating a camera connected to the user device and displaying camera feedback on the user device. The camera feedback can be started based on a threshold distance. The threshold distance can include a set distance. For example, the threshold distance can be 100 meters from a second location such as the passenger's car. The threshold distance can also be set using a geofence. In some embodiments, the camera can be automatically started when the user device is within the threshold distance of the second location. In some embodiments, in response to determining that the first location and the second location are within the threshold distance, a button for enabling the camera of the user device can be displayed. The camera feedback can be started in response to detecting a selection of the button. For example, the user can press the button. The button for enabling the camera can be displayed together with other functions (such as a map and buttons for calling and sending messages to the driver). The startup component 118 can save resources of the user device. Using GPS, camera, and accelerometer may require a large amount of computation. The startup component can delay the activation of AR to limit the consumption of the battery of the user device.

[0043] In some embodiments, a request can be sent from a remote server (such as server system 102) to a second user device to start a second camera. The request can automatically start the camera of the second device or prompt the user of the second device to start the camera. For example, the prompt can include a button for enabling the camera on the driver's device. In some embodiments, when the passenger turns on their camera, the driver's camera can be automatically turned on.

[0044] Figure 2 An exemplary display 210 of a user device 200 for starting AR navigation is shown. The user device 200 can include all or part of the computing device 104, the computing device 106, or the computing system 110. The user device 200 can be used by a passenger or a driver during a ridesharing trip. The display 210 can include a button 220 for starting AR navigation. For example, the button 220 can be a button included in Figure 1B the startup component 118. A small text banner 222 can be included to explain the AR navigation feature. The text banner 222 can include language prompting the user to start AR navigation (such as "Use your camera to find your shared vehicle"). Clicking on the text banner 222 can allow the user to learn more about AR. The display 210 includes a map 230 and a marker 232 that can display the driver's location. The display 210 also includes a text notification section 240 that displays a reminder to the passenger informing the passenger that the driver has arrived. The display 210 also includes a driver information section 242 that can include the driver's name, photo, and vehicle information. The driver information section 242 can include a button 244 that allows the passenger to call and send messages to the driver.

[0045] Figure 3 FIG. 310 shows an exemplary display of a user device 200 for augmented reality navigation that displays an indicator including a path to a second location. The display 310 may include navigation information 320, camera feedback 330, a map 340, and a driver information section 342. The navigation information 320 may include a direction, a distance, and an "X" for exiting the augmented reality navigation. The camera feedback 330 may be displayed. For example, the camera feedback 330 may be displayed using Figure 1B the camera component 114. A road 332 may be detected in the camera feedback 330 as part of a path leading to the second location. An arrow 334 may be augmented along the road 332. For example, the arrow may be an indicator Figure 1B displayed by the augmented reality component 116. The map 340 may be displayed to provide further navigation to the user. Streets included in the route to the second location may be highlighted in the map. The driver information section 342 may include the driver's name, photo, and vehicle information. The driver information section 342 may include a button 344 that allows a passenger to call and send messages to the driver.

[0046] Figure 4 FIG. 410 shows an exemplary display of a user device 200 for augmented reality navigation that displays a marker indicating a second location. The display 410 may include navigation information 420, camera feedback 430, a map 440, and a driver information section 442. The navigation information 420 may include a direction, a distance, and an "X" for exiting the augmented reality navigation. In some embodiments, the augmented reality navigation may be automatically exited when the driver starts a trip. The camera feedback 430 may be displayed. For example, the camera feedback 430 may be displayed using Figure 1B the camera component 114. A car 432 may be detected in the camera feedback 430 as the second location. In response to detecting the second location (e.g., the location of the car 432) in the camera feedback 430, a marker 434 may be augmented on the camera feedback 430 to indicate the location of the car 432. For example, the marker may be a marker Figure 1B displayed by the augmented reality component 116. An arrow 436 may be displayed along the path leading to the car 432. The arrow 436 may include the arrow 334 that is continuously displayed when the device is turned towards the second location. The arrow 334 may be displayed along the road 332. For example, the arrow 334 may be an indicator Figure 1B displayed by the augmented reality component 116. The map 440 may be displayed to provide further navigation to the user. Streets included in the route to the second location may be highlighted. The driver information section 442 may include the driver's name, photo, and vehicle information. The driver information section 442 may include a button 444 that allows a passenger to call and send messages to the driver.

[0047] Figure 5 FIG. 500 shows a block diagram of a computer system 500 on which any of the embodiments described herein may be implemented. For example, the computer system 500 may be any one of the server system 102 and the computing devices 104 and 106. The computer system 500 includes a bus 502 or other communication mechanism for communication, and one or more hardware processors 504 connected to the bus 502 for processing information. As an example, the hardware processor 504 may be one or more general-purpose microprocessors.

[0048] The computer system 500 also includes a main memory 506, such as random access memory (RAM), cache, and / or other dynamic storage devices, coupled to the bus 502 for storing information and instructions executed by the processor 504. The main memory 506 may also be used to store temporary variables or other intermediate information during the execution of instructions by the processor 504. When these instructions are stored in a storage medium accessible to the processor 504, the computer system 500 presents as a special-purpose machine customized to perform the operations specified in the instructions. The main memory 506 may include non-volatile media and / or volatile media. Non-volatile media may include, for example, optical discs or magnetic disks. Volatile media may include dynamic memory. Common forms of media may include, for example, floppy disks, flexible disks, hard disks, solid state drives, magnetic tapes, or any other magnetic data storage media, compact discs read-only memory, any other optical data storage media, any physical media with a hole pattern, random access memory, dynamic random access memory, programmable read-only memory, and erasable programmable read-only memory, flash - erasable programmable read-only memory, non-volatile random access memory, any other memory chip or cartridge, and their network versions.

[0049] The computer system 500 may implement the techniques described herein using custom hardwired logic, one or more application-specific integrated circuits or gate arrays, firmware, and / or program logic, which in combination with the computer system cause the computer system 500 or, when programmed, to become a special-purpose machine. According to one embodiment, the techniques herein are performed by the computer system 500 in response to one or more sequences of one or more instructions contained in the main memory 506 executed by the processor 504. These instructions may be read from another storage medium (e.g., the storage device 508) into the main memory 506. Executing the sequence of instructions contained in the main memory 506 causes the processor 504 to perform the processing steps described herein. For example, the computing system 500 may be used to implement Figure 1A the server system 102, the computing device 104, and the computing device 106 shown. In another example, the computing system 500 may be used to implement Figure 1BThe computing system 110 or one or more components of the computing system 110 are shown. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.

[0050] Computer system 500 also includes a communication interface 510 coupled to bus 502. Communication interface 510 provides a bidirectional data communication coupling to one or more network links connected to one or more networks. As another example, communication interface 510 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN (or a WAN component that communicates with a WAN). Wireless links may also be implemented.

[0051] The performance of certain operations may be distributed among processors, not only residing in a single computer, but also deployed on multiple computers. In some example embodiments, the processor or processor-implemented engine may be located in a single geographic location (e.g., in a home environment, an office environment, or within a server farm). In other example embodiments, the processor or processor-implemented engine may be distributed across multiple geographic locations.

[0052] Figure 6 1 is a flowchart of an exemplary method 600 for augmented reality navigation according to some embodiments of the present application. The method 600 may be performed in a process including, for example, Figure 1A and Figure 1B As another example, Figure 6 The process / method shown and described in conjunction with the figure may be stored in Figure 5 When these instructions are implemented by the computer program instructions in the main memory 506 of Figure 5 When executed by the processor 504, they may perform the following operations: Figure 6 The steps shown and described above. The operations of method 600 described below are intended to be illustrative. Depending on the implementation, method 600 may include additional, fewer, or alternative steps performed in various orders or in parallel. Method 600 may be implemented in various computing systems or devices including one or more processors.

[0053] With respect to method 600, at 610, a first location and a device orientation of a user device may be obtained. At 620, a second location may be obtained. At 630, a path from the first location to the second location may be determined. At 640, a camera feedback may be displayed on the user device. At 650, an indicator of the path may be displayed on the camera feedback based on the device orientation. At 660, in response to determining that the device orientation is aligned with the second location, a marker may be displayed on the camera feedback, the marker may indicate the second location.

[0054] This document describes certain embodiments as including logic or multiple components. The components can be software components (e.g., code embodied on a machine-readable medium) or hardware components (e.g., tangible units capable of performing specific operations that can be configured or arranged in a specific physical manner). As used herein, for convenience, when the components of computing system 110 can include instructions that program or configure the computing system 110 to perform operations, these components can be described as performing or configured to perform the operations.

[0055] Although examples and features of the disclosed principles are described herein, modifications, adaptations, and other implementations are possible without departing from the spirit and scope of the disclosed embodiments. Additionally, the words "comprising," "having," "including," and "containing," and other similar forms are intended to be equivalent in meaning and are open-ended, in that the one or more items following any one of these words are not meant to be an exhaustive list of such items or meant to be limited to only the listed items. It must also be noted that, as used herein and in the appended claims, unless the context clearly dictates otherwise, the singular forms "a," "an," and "the" include plural references.

[0056] The embodiments shown herein are described in sufficient detail to enable those skilled in the art to practice the disclosed teachings. Other embodiments can be used and derived therefrom, such that structural and logical substitutions and changes can be made without departing from the scope of this application. Accordingly, the detailed description should not be construed in a limiting sense, and the scope of the various embodiments is defined only by the appended claims and the full scope of equivalents to which such claims are entitled.

Claims

1. A system for augmented reality navigation, the system comprising one or more processors and one or more non-transitory computer-readable memories, the one or more non-transitory computer-readable memories being connected to the one or more processors and storing instructions executable by the one or more processors to cause the system to perform operations, the operations including: Obtaining a first position and a device orientation of a user device; Obtaining a second position; Determining a path from the first position to the second position; Displaying camera feedback on the user device; Based on the device orientation, displaying an indicator of the path on the camera feedback; And In response to determining that the device orientation is aligned with the second position, displaying a marker on the camera feedback, the marker indicating the second position; When the user of the user device moves closer to the second position, increasing the size of the marker indicating the second position; And, in response to determining that the device orientation is not aligned with the second position, displaying the indicator in the direction leading to the second position.

2. The system according to claim 1, wherein Displaying the indicator of the path includes: Determining a direction of the second position relative to the device orientation, wherein the path from the first position to the second position includes the direction of the second position relative to the device orientation; and Displaying the indicator of the path in the direction of the second position relative to the device orientation.

3. The system according to claim 1, wherein Displaying the indicator of the path includes: Determining a route from the first position to the second position, wherein the path from the first position to the second position includes the route; Detecting features in the camera feedback related to the route; and Displaying the indicator of the path on the features in the camera feedback.

4. The system according to claim 3, characterized in that, The features in the camera feedback include a road leading to the second position.

5. The system according to claim 3, wherein The indicator of the path includes a dynamic arrow along the path.

6. The system according to claim 1, wherein Displaying the camera feedback on the user device includes displaying the camera feedback on a first portion of the user device; And The operations further include: Displaying a map on a second portion of the user device; And Displaying at least a portion of the path on the map.

7. The system according to claim 1, wherein Displaying the camera feedback on the user device includes: In response to determining that the first position and the second position are within a threshold distance, displaying a button for enabling the camera of the user device; and In response to detecting a selection of the button, displaying the camera feedback on the user device.

8. A method for augmented reality navigation, comprising: Obtaining a first position and a device orientation of a user device; Obtaining a second position; Determining a path from the first position to the second position; Displaying camera feedback on the user device; Based on the device orientation, displaying an indicator of the path on the camera feedback; And In response to determining that the device orientation is aligned with the second position, displaying a marker on the camera feedback, the marker indicating the second position; When the user of the user device moves closer to the second position, increasing the size of the marker indicating the second position; And, in response to determining that the device orientation is not aligned with the second position, the indicator is displayed in the direction leading to the second position.

9. The method according to claim 8, characterized in that The indicator that displays the path includes: Determining the direction of the second position relative to the device orientation, wherein the path from the first position to the second position includes the direction of the second position relative to the device orientation; and Displaying the indicator of the path in the direction of the second position relative to the device orientation.

10. The method according to claim 8, characterized in that, The indicator that displays the path includes: Determining the route from the first position to the second position, wherein the path from the first position to the second position includes the route; Detecting features in the camera feedback related to the route; and Displaying the indicator of the path on the features in the camera feedback.

11. The method according to claim 10, wherein The features in the camera feedback include a road leading to the second position.

12. The method according to claim 10, wherein The indicator of the path includes a dynamic arrow along the path.

13. The method according to claim 8, wherein Displaying the camera feedback on the user device includes displaying the camera feedback on a first part of the user device; And The method further includes: Displaying a map on a second part of the user device; And Displaying at least a portion of the path on the map.

14. The method according to claim 8, wherein Displaying the camera feedback on the user device includes: In response to determining that the first position and the second position are within a threshold distance, displaying a button for enabling the camera of the user device; and In response to detecting a selection of the button, displaying the camera feedback on the user device.

15. A non-transitory computer-readable storage medium storing instructions executed by one or more processors to cause the one or more processors to perform operations, the operations including: Obtaining a first position and a device orientation of a user device; Obtaining a second position; Determining a path from the first position to the second position; Displaying camera feedback on the user device; Based on the device orientation, displaying an indicator of the path on the camera feedback; And In response to determining that the device orientation is aligned with the second position, displaying a marker on the camera feedback that indicates the second position; When the user of the user device moves closer to the second position, increasing the size of the marker indicating the second position; And, in response to determining that the device orientation is not aligned with the second position, the indicator is displayed in the direction leading to the second position.

16. The non-transitory computer-readable storage medium according to claim 15, wherein The indicator that displays the path includes: Determining the route from the first position to the second position, wherein the path from the first position to the second position includes the route; Detecting features in the camera feedback related to the route; and Displaying the indicator of the path on the features in the camera feedback.

17. The non-transitory computer-readable storage medium according to claim 16, wherein The features in the camera feedback include a road leading to the second position.

18. The non-transitory computer-readable storage medium according to claim 15, wherein Displaying the camera feedback on the user device includes displaying the camera feedback on a first part of the user device; And The operations further include: Displaying a map on a second part of the user device; And Display at least a portion of the path on the map.

Images