Method, apparatus, and computer-readable storage medium for providing interactive navigation assistance using movable guide markers

Abstract

The present disclosure relates to methods, apparatuses, and computer-readable storage media for providing interactive navigation assistance using movable guide markers. Methods, apparatuses, and computer-readable storage media for displaying a first marker at a location at a first user device, wherein the location is remotely defined at a second user device; displaying a current geographic location and a current vantage point for the first user device at the second user device; displaying a second marker at the second user device; accepting input at the second user device for adjusting the second marker from the first location to a second location, wherein the second location indicates a target geographic location in a first virtual view of the current geographic location of the first user device as displayed on the second user device; and displaying the second marker at the target geographic location in a second virtual view of the current geographic location displayed at the first user device in response to the adjustment.

Description

[0001] Related Applications Citations

[0002] This application is a divisional application of the invention patent application with international application number PCT / FI2013 / 050009, international application date January 7, 2013, priority date February 2, 2012, date of entry into the Chinese national phase September 9, 2014, and Chinese national application number 201380013278.6. Technical Field

[0003] The present invention relates generally to wireless networks and, more particularly, to methods, apparatus, and computer-readable storage media for providing interactive navigation assistance using movable guide markers. Background Art

[0004] This section is intended to provide a background or context for the invention disclosed below. The descriptions herein may include concepts that may be explored but are not necessarily concepts that have been previously conceived, implemented, or described. Therefore, unless otherwise expressly stated herein, the content described in this section is not prior art prior to the description in this application and is not admitted to be prior art by reason of inclusion in this section.

[0005] It is often necessary for a first user to obtain navigation instructions from a second user when the first user and the second user are in different locations. Various technologies for navigation assistance are based on the first user making a video call from a first user device to a second user device via a wireless communication network. An image captured by a camera at the first user device is sent to the second user device. By using voice or text messaging at the second user device, the second user instructs the first user (i.e., the individual who needs navigation guidance) to point the camera to a favorable location to assist the second user in identifying the location of the first user. However, in many cases, it may be difficult for the second user to identify the location from the favorable location initially provided by the first user. Therefore, the second user may have to repeatedly tell the first user to move around and point the camera in different directions by trial and error until the second user has the hope of observing a similar image. Therefore, it is necessary to provide an improved method, device, and computer-readable storage medium for enhanced navigation assistance. Summary of the invention

[0006] According to a first aspect of the invention, a method includes: displaying a first marker at a location at a first user device, wherein the location is remotely defined at a second user device; displaying a current geographic location and a current vantage point for the first user device at the second user device; displaying a second marker at the second user device; accepting input at the second user device for adjusting the second marker from the first location to a second location, wherein the second location indicates a target geographic location in a first virtual view of the current geographic location of the first user device as displayed on the second user device; and, in response to the adjustment, displaying a second marker of the target geographic location in a second virtual view of the current geographic location at the first user device.

[0007] According to a second aspect of the present invention, a device is configured to accept input for defining a location. The device includes a second user device for use with a first user device configured to display a first marker at the current geographic location of the first user device. The second user device is configured to display the current geographic location and the current vantage point for the first user device; the second user device displays a second marker; the second user device accepts the input, and in response to the input, adjusts the second marker from the first position to the second position, wherein the second position indicates a target geographic location in a first virtual view of the current geographic location of the first user device; and in response to the adjustment, causes the first user device to display the second marker of the target geographic location in the second virtual view of the current geographic location.

[0008] Illustratively, the first and second marks can be implemented using any of the following: a persistent pointer, a non-persistent pointer, a persistent highlighting range, or a non-persistent highlighting range. For example, if both the first and second marks are implemented using a persistent pointer, the first pointer is first displayed at a certain position on the first user device, and then moved to a display position on the first user device, such as specified by a remote user who manipulates the second pointer at the second user device. Alternatively or additionally, the first and second marks can be implemented on the second user device by a non-persistent pointing or highlighting mechanism, wherein the remote user taps a finger on a selected display building or a selected portion of a display building, and for a short period of time (such as a few seconds), the highlighting area or range is displayed on both the first and second user devices at a geographical location corresponding to the finger tapping, around or next to it. In this example, a temporarily or instantaneously highlighted area is used to provide a first mark on the first user device and a second mark on the second user device. Alternatively or additionally, the first mark can be implemented using a persistent pointer, and the second mark can be implemented using a non-persistent highlighting area. Alternatively or additionally, the first mark may be implemented using a non-persistent highlighted area, and the second mark may be implemented using a persistent pointer. Alternatively or additionally, the highlighted area may remain highlighted until receiving user input (such as tapping, touching, or pressing a non-displayed area of ​​the first user device display or the second user device display). The highlighted area may include an entire building or a portion of a building or a specific floor of a building.

[0009] According to a third aspect of the present invention, a non-transitory computer-readable storage medium having an executable program stored thereon is provided. The program instructs a processing device to execute: displaying a first marker at a location at a first user device, wherein the location is remotely defined at a second user device; displaying a current geographic location and a current vantage point for the first user device at the second user device; displaying a second marker at the second user device; accepting input at the second user device for adjusting the second marker from the first location to a second location, wherein the second location indicates a target geographic location in a first virtual view of the current geographic location of the first user device as displayed on the second user device; and displaying a second marker of the target geographic location in a second virtual view of the current geographic location at the first user device in response to the adjustment. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 is a block diagram illustrating an example configuration for providing interactive navigation assistance using guide markers according to the present invention;

[0011] Figure 2A and Figure 2Btogether include a flow chart illustrating an example method for providing interactive navigation assistance using guide markers according to the present invention;

[0012] Figure 3 illustrates an example screen shot of a first graphical user interface for providing interactive navigation assistance according to the present invention;

[0013] Figure 4 An example screenshot illustrating a second graphical user interface for providing interactive navigation assistance using guide markers according to the present invention;

[0014] Figure 5 An example screenshot illustrating a third graphical user interface for providing interactive navigation assistance using guide markers according to the present invention;

[0015] Figure 6 An example screenshot illustrating a fourth graphical user interface for providing interactive navigation assistance using guide markers according to the present invention;

[0016] Figure 7 An example screenshot illustrating a fifth graphical user interface for providing interactive navigation assistance using guide markers according to the present invention;

[0017] Figure 8 An example screenshot illustrating a sixth graphical user interface for providing interactive navigation assistance using guide markers according to the present invention;

[0018] Fig. 9 An example screen shot illustrating a seventh graphical user interface for providing interactive navigation assistance using guide markers according to the present invention; and

[0019] Fig.10 Illustrate example screenshots of an eighth graphical user interface for providing interactive navigation assistance using guide markers in accordance with the present invention. DETAILED DESCRIPTION

[0020] Figure 1 1 is a hardware block diagram illustrating an example configuration for providing interactive navigation assistance using guide markers according to the present invention. The first user device 11 and the second user device 12 are both equipped to communicate via a wireless network 26. Alternatively or additionally, any one of the first user device 11 and the second user device 12 can be equipped to communicate via a wired network. Illustratively, the first user device 11 and the second user device 12 can each represent a mobile phone, a tablet or a wireless handheld device. The first user device 11 includes a processor 13 operatively coupled to a GPS receiver 15, a compass 17, a user interface 19 and a computer-readable storage medium 19.

[0021] According to one illustrative embodiment of the present invention, the second user device 12 for use by the second user may include a processor 14 operatively coupled to a GPS receiver 16, a compass 18, a user interface 20, and a computer-readable storage medium 22. However, according to other illustrative embodiments, the second user device 12 does not need to include a GPS receiver or a compass. No GPS receiver or a compass is required because the second user device 12 is configured to display a virtual view corresponding to the current location of the first user device 11. The user interface 20 is configured to change the direction of the virtual view displayed by the second user device 12 in response to receiving input from the second user. The received input illustratively includes at least one of the following: shaking, pressing, or tapping any one of the various user interface 20 elements on the display of the second user device 12. Therefore, according to these other illustrative embodiments, instead of or in addition to the previously mentioned tablet and mobile phone, the second user device 12 can also be implemented using an ordinary or stationary personal computer (PC). Yet another option is to use the compass 18 for changing the direction of the virtual view displayed on the second user device 12, but in other cases, implementations for changing the direction of the virtual view will use finger input on a touch screen or mouse input for panning.

[0022] The GPS receiver 15 is configured to obtain a set of geographic coordinates based on the current geographic location of the first user device 11. If the second user device 12 is so equipped, the GPS receiver 16 is configured to obtain a set of geographic coordinates based on the current geographic location of the second user device 12. The compass 17 is configured to determine a current position or vantage point for the first user device 11. If the second user device is so equipped, the compass 18 is configured to determine a current position or vantage point for the second user device 12. For purposes of illustration, the user interface 19 and the user interface 20 may each be implemented using a touch-sensitive display screen or, alternatively, a display screen and an associated input device such as a mouse, a pointer, a keypad, or a stylus.

[0023] The wireless network 26 is coupled to the map server 23. The map server 23 is configured to retrieve a view data set for a geographic location in response to receiving a set of geographic coordinates and a current position. The map server sends the retrieved view data set to the wireless network 26. The wireless network 26 distributes the view data set to at least one of the first user device 11 or the second user device 12. The view data is processed by the first user device 11 or the second user device 12 to display at least one of the following: a map view, an augmented reality (AR) view, a panoramic view, or a virtual view including a three-dimensional (3D) model. The 3D model may but need not include a panoramic view. Alternatively or additionally, the 3D model may utilize a 3D model of a building textured using a photograph from reality.

[0024] The panoramic view provides full 360-degree free movement for pointing in any direction or orientation regardless of the current direction or orientation in which the AR view is oriented. The map server 23 stores panoramic content data (including building three-dimensional objects) to one or more user devices (such as the first user device 11 and the second user device 12). The use of three-dimensional objects allows accurate pointing, even if a first viewpoint of a given geographic location as displayed on the first user device 11 and a second viewpoint of a given geographic location as displayed on the second user device 12 can be obtained from different vantage points.

[0025] The map server also forwards the guide pointer information from the second user device 12 to the first user device 11. Optionally, the map server 23 may store a contact list for each of the multiple users and geographic location and vantage point data repeatedly exchanged between two or more users. The map server 23 may be programmed to convert the guide pointer coordinates of the second user obtained through the panoramic view into the AR view of the first user.

[0026] The optional map view displays the current location for the first user device 11 or the second user device 12 by placing a cursor or marker on a two-dimensional street map or road map of the geographic area corresponding to the set of geographic coordinates and the current location. The AR view displays a visual image for the set of geographic coordinates and the current location in the form of a perspective view. The AR view displays the current location for the first user device 11 or the second user device 12 by superimposing a cursor or marker on the displayed perspective view. This perspective view is similar or the same as, for example, a view that would be viewed through a viewfinder of a digital camera.

[0027] A panoramic view is created from photographs of buildings and structures in a geographic area. Illustratively, a vehicle-mounted camera may be used to capture photographs, and geographic coordinate data and laser rangefinder data are collected and associated with each photograph taken. Image files for each of a plurality of photographs and laser rangefinder data and geographic coordinate data associated with each image file are stored together in a map and panoramic database 24 on a computer-readable storage medium 25 accessible to a map server 23. The image files, laser rangefinder data, and geographic coordinate data are used to generate a three-dimensional (3D) model of the geographic area. Alternatively or additionally, the 3D model may be acquired separately, and the laser rangefinder data may be used to align the 3D model with the photograph. A corresponding set of photographs, laser rangefinder data, and geographic coordinate data (which together comprise a set of panoramic data from the 3D model) is used to generate a panoramic view for a corresponding geographic location and orientation.

[0028] Figure 2A and Figure 2BThe present invention also includes a flowchart illustrating an exemplary method for providing interactive navigation assistance using guide markers according to the present invention. It is often necessary to Figure 1 ) obtains navigation instructions from a second user at a second user device 12 when the first user and the second user are at different locations. In summary, the operation sequence of FIG. 2 provides a technical solution, wherein the first user device 11 ( Figure 1 ) displays an augmented reality (AR) view corresponding to the current geographic location and current vantage point of the first user device. The second user device 12 displays a panoramic view corresponding to the current geographic location and current vantage point of the first user device. The second user device 12 accepts a first input for changing the vantage point of the panoramic view displayed on the second user device 12. The second user device 12 accepts a second input for adjusting the position of a first visual guide pointer of the panoramic view displayed on the second user device 12. The first visual guide pointer is a mark that illustratively includes any of the following: a persistent pointer, a non-persistent pointer, a persistent highlighted area or range, or a non-persistent highlighted area or range. Alternatively or additionally, the highlighted area may remain highlighted until receiving user input (such as tapping, touching, or pressing a non-prominent display area of ​​the display of the first user device 11 or the second user device 12). The AR view displayed by the first user device 11 includes a second visual guide pointer that moves in response to adjusting the position of the first visual guide pointer on the panoramic view of the first user device 11. The second visual guidance pointer is a marker illustratively including any of the following: a persistent pointer, a non-persistent pointer, a persistent highlighted area or area, or a non-persistent highlighted area or area. The voice or text communication channel may be Figure 2A and Figure 2B During all or part of the sequence of operations shown in , the first user device 11 and the second user device 12 are active via the wireless network 26. Any of the first visual guidance pointer or the second visual guidance pointer can illustratively include a highlighted area that includes the entire building or a portion of a building or a specific floor of a building. Therefore, identifying the current geographic location can include not only identifying the latitude and longitude or similar coordinates, but also identifying a parameter indicating the height above the ground.

[0029] Figure 2A and Figure 2B The sequence of operations in Figure 2A The block 201 starts, wherein the first user equipment 11 ( Figure 1 ) collects geographic location and orientation information for the first user. The first user device 11 displays an augmented reality (AR) view corresponding to the collected geographic location and displays a vantage point ( Figure 2A, block 203). Then, the first user equipment 11 ( Figure 1 ) establishes communication with the second user device 12 via the wireless network 26 to request navigation guidance ( Figure 2A , block 205).

[0030] At block 207, the first user device 11 ( Figure 1 ) sends the geographic location and orientation information to the map server 23 via the wireless network 26. The orientation information may but need not include AR view vantage point information. The map server 23 uses the geographic location and orientation information to retrieve a panoramic data set ( Figure 2A , block 209). Then, in block 211, the map server 23 ( Figure 1 ) sends the panoramic data set to the second user device 12. The second user device 12 receives the panoramic data from the map server 23 via the wireless network 26 and displays a panoramic view that closely corresponds to the geographic location and has a panoramic view vantage point ( Figure 2A , block 213). In practice, the panoramic views correspond as closely as possible to the geographic locations, but in some cases the closest available panoramic data may be somewhat out of range for certain geographic locations.

[0031] Optionally, the first user equipment 11 and the second user equipment 12 ( Figure 1 ) or both of them respectively display a map view vantage point for the first user in a mini-map displayed simultaneously with the AR view or the panoramic view ( Figure 2A , block 215), wherein the map view vantage point is obtained from the position information previously collected in block 201. For the second user device 12 ( Figure 1 ), noting that this position information may not be obtained with reference to the physical or geographic location of the second user device 12, but instead the position information may be related to a virtual viewpoint of the geographic location where the first user device 11 is located and for which the second user device 12 is displaying a virtual view. For example, the position information of the second user device 12 may be determined with reference to a position on a panoramic view displayed on a screen of the second user device 12.

[0032] In block 217 ( Figure 2A ), the second user equipment 12 ( Figure 1 ) accepts a first input for changing the panoramic view vantage point of the panoramic view to a new panoramic view vantage point. In effect, this enables the second user to view the panoramic view of the same geographic location from multiple different perspectives. At block 219 ( Figure 2A ), the second user equipment 12 ( Figure 1) sends a request for new panoramic view data corresponding to the new panoramic view vantage point to the map server 23. The second user device 12 receives the new panoramic view data corresponding to the new panoramic view vantage point from the map server and displays the new panoramic view data corresponding to the new panoramic view vantage point ( Figure 2A , block 221). The second user equipment 12 ( Figure 1 ) accepts a second input requesting a movable visual guidance pointer function, and in response to the second input, displays a first visual guidance pointer on a panoramic view currently being displayed on a second user device ( Figure 2A , block 223).

[0033] Figure 2A and Figure 2B The sequence of operations advances to Figure 2B Block 225, wherein the second user device 12 ( Figure 1 ) determines a set of geographic coordinates corresponding to the current position of the first visual guide pointer by using a three-dimensional (3D) model of the displayed panoramic view. The 3D model may be obtained from the map server 23 via the wireless network 26, or the 3D model may be stored in the second user device 12, or both. The second user device 12 then sends the set of geographic coordinates to the first user device 11 via the wireless network 26. The second user device 12 receives a third input ( Figure 2B , block 227). The program then loops back to block 225 ( Figure 2B ), wherein the second user equipment 12 ( Figure 1 ) determines a new set of geographic coordinates corresponding to the new position of the first visual guide pointer. The second user device 12 determines a new set of geographic coordinates corresponding to the new position of the first visual guide pointer by using the 3D model of the displayed panoramic view. The second user device 12 then sends the new set of geographic coordinates to the first user device 11 via the wireless network 26.

[0034] Program control from block 225 ( Figure 2B ) proceeds to block 229, wherein the first user device 11 ( Figure 1 ) receives a set of geographic coordinates from the second user device 12 via the wireless network 26. Next, at block 233 ( Figure 2B ), first user equipment 11( Figure 1 ) in block 229 ( Figure 2B ) displays a second visual guide pointer on the AR view at a location corresponding to the geographic coordinates received from the second user device. The second visual guide pointer may be implemented in the form of a cursor or a mark. Optionally, the first user device 11 ( Figure 1 ) and the AR view simultaneously display the geographic location and vantage point for the second user device 12 or the virtual viewpoint for the second user device 12 ( Figure 2B, block 235). Optionally, the first user equipment 11 and the second user equipment 12 ( Figure 1 ) may exchange (or pre-store) additional descriptions of buildings to ensure that the first user device 11 is on the correct building and even places a second visual guidance pointer on the AR view at the correct floor of the building. If the vantage point of the first user device 11 is different from the virtual viewpoint of the second user device 12, so that the camera of the first user device 11 is aimed along an orientation different from the orientation of the virtual viewpoint or viewing direction currently being displayed by the second user device, the map server 23 or the first user device 11 may be programmed to provide visual cues for orienting the first user device to the new or different vantage point.

[0035] As an alternative or in addition to blocks 225 and 229, the second user equipment 12 ( Figure 1 ) can determine a panoramic view coordinate set corresponding to the current position of the movable visual guidance pointer. The second user device 12 then sends the panoramic view coordinate set to the map server 23. The map server 23 converts the panoramic view coordinate set into an AR view coordinate set for the fixed visual guidance pointer to be displayed by the first user device 11. The map server 23 then sends the AR view coordinate set ( Figure 2B , block 231). The first user equipment 11 ( Figure 1 ) receives the AR view coordinate set and displays a fixed marker or cursor on the AR view at a position corresponding to the current position of the movable visual guide pointer on the panoramic view displayed by the second user device 12.

[0036] According to Figure 2A and Figure 2B In the process described in the second user equipment 12 ( Figure 1 ) can be considered a "remote guidance provider". This user is free to choose his / her vantage point with reference to the panoramic view. This user can point to the building from a vantage point different from the vantage point of the first user device 11, for example.

[0037] Figure 3 FIG. 1 shows a method for performing a first operation on a first user device 11 ( Figure 1 ) is an example screen shot of a graphical user interface 300 for receiving interactive navigation assistance. A small map 301 ( Figure 3 ) displays the user device 11 ( Figure 1 ) and the shadow wedge 303 ( Figure 3 ) is displayed for user device 11 ( Figure 1 )'s current position or vantage point. Big compass 304 ( Figure 3 ) also displays the current position or vantage point at the bottom of the interface 300. User device ( Figure 1 )11Augmented reality (AR) view 302 showing the current location ( Figure 3 In this example, a user named Lisa is using user device 11 ( Figure 1 ). Lisa reaches her approximate destination, which is Café Honolulu, but she is unsure of the exact location of the café. Map Server 23 ( Figure 1 ) Place a point of interest icon 312 on the AR view 302 ( Figure 3 ) is inaccurate. In addition, in the AR view 302 ( Figure 3 ) has many different entrances. To cause further uncertainty for Lisa, the point of interest icon 312 is in English, but the actual cafe has a foreign language sign that Lisa does not understand.

[0038] Figure 4 FIG. 1 shows a method for performing a first operation on a first user device 11 ( Figure 1 ) receives an example screenshot of a graphical user interface for interactive navigation assistance. Figure 4 The graphical user interface is shown in landscape mode Figure 3 The landscape mode can provide an AR view 302 from the first user device 11 ( Figure 1 )'s current location.

[0039] Figure 5 FIG. 1 shows a method for transmitting data from a second user device 12 ( Figure 1 ) is an example screenshot of a graphical user interface 500 for providing interactive navigation assistance to a first user device 11. Lisa is confused about the exact location of the cafe, so she calls her friend Mark for some navigation guidance. Mark is on a second user device 12 ( Figure 1 Once Mark answers Lisa's call at the second user device 12, the second user device is configured to display a panoramic view 502 ( Figure 5 ). The graphical user interface 500 also includes a display of the first user device 11 ( Figure 1 )'s current location in a small map 501( Figure 5 ) and display for the first user device 11 ( Figure 1 )'s current position or vantage point shadow wedge 503 ( Figure 5 ). Big Compass 504 ( Figure 5 ) also displays the current position or vantage point of the first user device 11 at the bottom of the live video view 500.

[0040] Figure 6FIG. 1 shows a method for performing a first operation on a first user device 11 ( Figure 1 ) receives an example screenshot of a graphical user interface for interactive navigation assistance. In this example, the visual guide pointer 610 ( Figure 6 )exist Figure 4 The visual guide pointer 610 ( Figure 6 ) indicates the second user equipment 12 ( Figure 1 ) has received a panoramic view of the location of the first user device 11. The second user device 12 is now ready to accept input from Mark for providing navigation guidance to the first user device.

[0041] Figure 7 and Figure 8 The movable visual guide pointer 710 ( Figure 7 ) This form of marking is on the second user device 12 ( Figure 1 ) provides an example screenshot 700 and screenshot 800 of a graphical user interface for interactive navigation assistance. As before, the second user device is configured to display the first user device 11 ( Figure 1 )'s panoramic view 502 ( Figure 5 , Figure 7 and Figure 8 ). Mark moves the movable vision guide pointer 710 from Figure 7 The initial position shown in the figure is moved to Figure 8 In this example, Mark knows where the cafe that Lisa is looking for is located. Therefore, Mark has moved the movable visual guide pointer 710 ( Figure 7 and Figure 8 ) moves from the second floor of the building in the center of screenshots 700 and 800 to the top floor of the building on the right hand side of the screenshots. Figure 8 The screenshot 800 also illustrates the second user device 12 ( Figure 1 ) may optionally have the ability to zoom in on a desired location within the panoramic view 502.

[0042] Fig. 9 FIG. 6 shows a method of using a visual guidance pointer 610 ( Fig. 9 ) This form of marking is in the first user device 11 ( Figure 1 ) receives an example screen shot of a graphical user interface 900 for interactive navigation assistance. With the movable visual guide pointer 710 ( Figure 7 and Figure 8 ) on the second user device 12 ( Figure 1 ) is moved, the visual guide pointer 610 ( Fig. 9 ) on the first user device 11( Figure 1 ) Figure 6 The first position shown in FIG. 1 is correspondingly moved to FIG. Fig. 9 In addition to the dotted guide pointer 610 and the guide pointer 710 ( Figure 6-Figure 9 ), many other kinds of visual indications may be used in addition to or in place of them, including causing the pointed building to glow with a different color, shade, brightness, or intensity relative to the surrounding buildings. The guide pointer 610 and the guide pointer 710 may be implemented using any method for prominently displaying a portion of a building in the AR view. Optionally, the second user device 12 may be configured to accept multi-touch or hover sensing input for defining multiple points for the guide pointer 610, 710. For example, the movable visual guide pointer 710 ( Figure 7 ), so as to highlight the entire floor of the building. Alternatively or additionally, the highlighted area may remain highlighted until receiving user input (such as tapping, touching or pressing the first user device 11 or the second user device 12 ( Figure 1 ) non-visible display area of ​​the display).

[0043] Fig.10 The diagram is used for the second user device 12 ( Figure 1 ) provides an example screenshot of a graphical user interface 1000 for interactive navigation assistance. In this example, a second user at a second user device 12 may change his or her vantage point (i.e., position) to a vantage point different from that provided by the first user device 11. For example, the second user may wish to glimpse around the location of the first user device 11 without instructing the first user at the first user device 11 to shake their camera around. Graphical user interface 1000( Fig.10 ) indicates the first wedge 1001 and the second wedge 1003 on the mini-map ( Fig.10 ), the first wedge diagram is used for the first user device 11 ( Figure 1 ) of the location or advantageous point, and the second wedge diagram is used for the second user device 12 ( Figure 1 )’s direction or advantageous location.

[0044] Embodiments of the present invention may be implemented in software (executed by one or more processors), hardware (e.g., application specific integrated circuits), or a combination of software and hardware. In an exemplary embodiment, the software (e.g., application logic, instruction set) is maintained on any of a variety of conventional computer-readable media. In the context of this document, "computer-readable media" can be any medium or component that can contain, store, communicate, propagate, or transport instructions for use by or in conjunction with an instruction execution system, apparatus, or device (such as a computer), and for example, in Figure 1 An example of a computer is described and depicted in . The computer-readable medium may include computer-readable storage medium 21 or computer-readable storage medium 22 or other devices, which may be any medium or component that can contain or store instructions for use by or in conjunction with an instruction execution system, apparatus or device (such as a computer).

[0045] If desired, the different functions discussed herein may be performed in different orders and / or in parallel with each other. In addition, if desired, one or more of the functions described above may be optional or may be combined. Although various aspects of the present invention are described above, other aspects of the present invention include other combinations of features from the described embodiments and not only include the combination explicitly described above.

[0046] It is also noted here that although the above describes example embodiments of the present invention, these descriptions should not be viewed in a limiting sense. On the contrary, there are several changes and modifications that can be made without departing from the scope of the present invention.

Claims

1. A method for providing guidance, comprising: displaying a first virtual view at a first user device and displaying a marker at a first location in the first virtual view, wherein the first virtual view is an augmented reality view or a panoramic view at a current geographic location of the first user device, wherein the augmented reality is captured using a camera in the first user device; receiving, at the first user device, from a second user device, an adjustment for adjusting the marker from the first position to a second position, wherein the second position indicates a target geographic location in the first virtual view of the current geographic location of the first user device displayed in a second virtual view at the second user device; as well as In response to receiving the adjustment, the marker is displayed in the first virtual view at the first user device at the second position instead of the first position, wherein the marker displayed in the first virtual view at the second position instead of the first position provides the first user with the guidance to the second position based on the adjustment made to the marker from the first position to the second position. 2 . The method of claim 1 , wherein the marking comprises at least one of: a persistent pointer, a non-persistent pointer, a persistent highlighting area, or a non-persistent highlighting area.

3. The method according to claim 1 or 2, wherein displaying the first virtual view comprises: An augmented reality view corresponding to the current geographic location and current vantage point of the first user device is displayed at the first user device. 4 . The method of claim 3 , wherein the displayed augmented reality view of the first user device includes the marker, and the marker moves in response to the adjustment.

5. The method according to claim 1 or 2, wherein a voice or text communication channel between the first user equipment and the second user equipment is provided through a wireless communication network.

6. A method according to claim 1 or 2, wherein the marking is implemented using a persistent pointer, which is first displayed at any location on the first user device and then moved to a display location on the first user device specified by a remote user operating another marker at the second user device.

7. An apparatus for providing guidance, the apparatus being a first user device and comprising: A processing device configured to: displaying a first virtual view and displaying a marker at a first location in the first virtual view, wherein the first virtual view is an augmented reality view or a panoramic view at a current geographic location of the first user device, wherein the augmented reality is captured using a camera in the first user device; receiving, from a second user device, an adjustment for adjusting the marker from the first position to a second position, wherein the second position indicates a target geographic location in the first virtual view of the current geographic location of the first user device displayed in a second virtual view at the second user device; as well as In response to receiving the adjustment, the marker is displayed in the first virtual view at the second position instead of the first position, wherein the marker displayed in the first virtual view at the second position instead of the first position provides the first user with the guidance to the second position based on the adjustment made to the marker from the first position to the second position.

8. The apparatus of claim 7, wherein the indicia comprises at least one of: a persistent pointer, a non-persistent pointer, a persistent highlighting area, or a non-persistent highlighting area.

9. The apparatus according to claim 7 or 8, wherein displaying the first virtual view comprises: An augmented reality view corresponding to the current geographic location and current vantage point of the first user device is displayed. 10 . The apparatus of claim 9 , wherein the displayed augmented reality view of the first user device includes the marker, and the marker moves in response to the adjustment.

11. The apparatus according to claim 7 or 8, wherein a voice or text communication channel between the first user equipment and the second user equipment is provided through a wireless communication network.

12. An apparatus according to claim 7 or 8, wherein the marking is implemented using a persistent pointer, which is first displayed at any location on the first user device and then moved to a display location on the first user device specified by a remote user operating another marker at the second user device.

13. A non-transitory computer-readable storage medium having an executable program stored thereon, wherein the program instructs a processing device to perform the method according to any one of claims 1-6.

14. A method for providing guidance, comprising: displaying, at a second user device, a second virtual view generated based on a current geographic location and a current vantage point for the first user device, wherein the second virtual view is a camera view received from the first user device; displaying a marker at the second user device; receiving, at the second user device, an input for adjusting the marker from a first position to a second position, wherein the second position indicates a target geographic location of the current geographic location of the first user device in the second virtual view; as well as The second position is sent to the first user device at the second user device, wherein the second position indicates an adjustment of another marker in the first virtual view at the first user device from the first position to the second position, and the other marker indicates guiding the first user to the second position in the first virtual view at the first user device based on the adjustment made to the other marker from the first position to the second position.

15. The method of claim 14, wherein the indicia comprises at least one of: a persistent pointer, a non-persistent pointer, a persistent highlighting area, or a non-persistent highlighting area.

16. The method according to claim 14 or 15, wherein displaying the second virtual view comprises: A panoramic view corresponding to the current geographic location and the current vantage point of the first user device is displayed at the second user device. 17 . The method of claim 16 , further comprising receiving, at the second user device, a first input for changing the current vantage point of the panoramic view displayed on the second user device. 18 . The method of claim 17 , further comprising receiving, at the second user device, a second input for adjusting a position of the marker on the panoramic view displayed on the second user device.

19. The method according to claim 14 or 15, further comprising providing a voice or text communication channel between the first user equipment and the second user equipment through a wireless communication network.

20. A method according to claim 14 or 15, wherein the mark is implemented by a non-continuous pointing mechanism, so that the second user device is configured to receive a finger tapping input on a selected displayed building or a selected part of the displayed building, and a geographical location corresponding to the finger tapping input on the second user device is prominently displayed on both the first user device and the second user device instantaneously or temporarily; wherein the temporarily or instantaneously prominently displayed area is used to provide the mark on the second user device and another mark on the first user device, or the prominently displayed area remains prominently displayed until a user input comprising at least one of the following is received: tapping, touching or pressing a non-prominently displayed area on the first user device or the second user device.

21. An apparatus for providing guidance, the apparatus being a second user device and comprising: A processing device configured to: displaying a second virtual view generated based on a current geographic location and a current vantage point for a first user device, wherein the second virtual view is a camera view received from the first user device; Display markup; receiving an input for adjusting the marker from a first position to a second position, wherein the second position indicates a target geographic location of the current geographic location of the first user device in the second virtual view; as well as The second position is sent to the first user device, wherein the second position indicates an adjustment of another marker in the first virtual view at the first user device from the first position to the second position, and the other marker indicates guiding the first user to the second position in the first virtual view at the first user device based on the adjustment made to the other marker from the first position to the second position.

22. The apparatus of claim 21, wherein the indicia comprises at least one of: a persistent pointer, a non-persistent pointer, a persistent highlighting area, or a non-persistent highlighting area.

23. The apparatus of claim 21 or 22, wherein displaying the second virtual view comprises: A panoramic view corresponding to the current geographic location and the current vantage point of the first user device is displayed.

24. The apparatus of claim 23, the processing device further configured to receive a first input for changing the current vantage point of the panoramic view displayed on the second user device.

25. The apparatus of claim 24, the processing device further configured to receive a second input for adjusting a position of the marker on the panoramic view displayed on the second user device.

26. The apparatus according to claim 21 or 22, further comprising a voice or text communication channel between the first user equipment and the second user equipment being provided through a wireless communication network.

27. An apparatus according to claim 21 or 22, wherein the mark is implemented by a non-continuous pointing mechanism, so that the second user device is configured to receive a finger tapping input on a selected displayed building or a selected part of the displayed building, and a geographical location corresponding to the finger tapping input on the second user device is prominently displayed on both the first user device and the second user device instantaneously or temporarily; wherein the temporarily or instantaneously prominently displayed area is used to provide the mark on the second user device and another mark on the first user device, or the prominently displayed area remains prominently displayed until a user input comprising at least one of the following is received: tapping, touching or pressing a non-prominently displayed area on the first user device or the second user device.

28. A non-transitory computer-readable storage medium having an executable program stored thereon, wherein the program instructs a processing device to perform the method according to any one of claims 14-20.

Images