Route guidance system, route guidance device, route guidance method, and route guidance program

Abstract

This invention provides a route guidance system, a route guidance method, and a route guidance program that enable easy understanding of the direction of guidance by reliably displaying guidance objects such as avatars within the imaging range of a mobile device. [Solution] In the route guidance system 100, the guidance direction determination unit 211 determines the guidance direction from the user's current location based on the guidance route, the object position setting unit 212 sets a display position for displaying the guidance object, such as an avatar, on the image captured by the camera 24 based on the guidance direction and the imaging range of the camera 24, and the route guidance processing unit 213 causes the guidance object displayed at the set display position to guide the user according to the guidance route. Furthermore, if the guidance direction is outside the imaging range, the object position setting unit 212 sets the display position of the guidance object within the imaging range.

Description

Technical Field

[0004] , , , , , , , , , , , , ,

[0005] ,

[0003]

[0001] The present invention relates to a route guidance system, a route guidance device, a route guidance method, and a route guidance program for guiding a user along a route to a set destination.

Background Art

[0002] Conventionally, a navigation device (see, for example, Patent Document 1) that displays a route to a set destination on a map and guides a user to the destination along the route is known.

[0003] In recent years, AR (augmented reality) navigation that utilizes AR has been put into practical use (see Non-Patent Document References). This AR navigation is a system that overlays digital information on a real image projected by a camera of a mobile terminal such as a smartphone used by a user to provide navigation to the user. Even in a narrow area where it is difficult to grasp the position with GPS or in a facility such as a subway where GPS radio waves do not reach easily, it is possible to determine the exact position and direction and guide the route to the destination. The AR navigation realizes accurate navigation when moving in a shopping mall, a hospital, an airport, or a station building.

[0004] For example, the navigation in Non-Patent Document 1 indicates the direction from the current location of the user to the destination with a guiding arrow, and the user can reach the destination by moving in the direction indicated by the guiding arrow. Also, the navigation in Non-Patent Document 2 arranges a virtual guide called an avatar at a position in front on the route from the current location of the user, and the user can move to the destination while being guided by the avatar.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Non-Patent Document 1

[0006] However, with conventional AR navigation, if the user is guided in the opposite direction to the camera's imaging direction, the guidance direction will be towards the user's back. In this case, for example, a guidance arrow may be pointed towards the user, or the avatar may be placed on a path outside the camera's imaging range. Therefore, the user cannot easily determine which direction to move from their current location. Also, because the direction of travel from the current location is unclear, there is a risk of the user bumping into people or objects around them if they turn left and right or suddenly turn around while looking at the display screen of their mobile device in order to find a guidance object.

[0007] The object of the present invention is to provide a route guidance system, route guidance device, route guidance method, and route guidance program that enable easy understanding of the direction of guidance by reliably displaying guidance objects such as avatars within the imaging range of a mobile terminal. [Means for solving the problem]

[0008] A route guidance system according to one aspect of the present invention is a route guidance system that guides a user to a predetermined destination by displaying a guidance route to the destination on an image captured by the imaging unit of a mobile terminal used by the user. The route guidance system comprises: a guidance direction determination unit that determines the direction of guidance from the user's current location based on the destination and the user's current location; an object position setting unit that sets a position for displaying a guidance object on the image captured by the imaging unit based on the guidance direction determined by the guidance direction determination unit and the imaging range captured by the imaging unit; and a route guidance processing unit that displays the guidance object at the position set by the object position setting unit and guides the user along the guidance route to the guidance object. The object position setting unit sets the display position of the guidance object within the imaging range when the guidance direction is outside the imaging range.

[0009] Another aspect of the present invention is a route guidance device that guides a user to a predetermined destination by displaying a guidance route to the destination on an image captured by an imaging unit. The route guidance device includes: a guidance direction determination unit that determines the direction of guidance from the user's current location based on the destination and the user's current location; an object position setting unit that sets a position for displaying a guidance object on the image captured by the imaging unit based on the guidance direction determined by the guidance direction determination unit and the imaging range captured by the imaging unit; and a route guidance processing unit that displays the guidance object at the position set by the object position setting unit and guides the user along the guidance route to the guidance object. The object position setting unit sets the display position of the guidance object within the imaging range when the guidance direction is outside the imaging range.

[0010] Another aspect of the present invention relates to a route guidance method that guides a user to a predetermined destination by displaying a guidance route to the destination on an image captured by the imaging unit of a mobile terminal used by the user. The route guidance method is a method in which one or more processors perform the following steps: a guidance direction determination step in which one or more processors determine the direction of guidance from the user's current location based on the destination and the user's current location; an object position setting step in which one of the processors sets a position for displaying a guidance object on the image captured by the imaging unit based on the guidance direction determined by the guidance direction determination step and the imaging range captured by the imaging unit; and a route guidance step in which one of the processors displays the guidance object at the position set by the object position setting step and guides the user along the guidance route to the guidance object. The object position setting step sets the display position of the guidance object within the imaging range if the guidance direction is outside the imaging range.

[0011] Another aspect of the present invention is a route guidance program that guides a user to a predetermined destination by displaying a guidance route to the destination on an image captured by the imaging unit of a mobile terminal used by the user. The route guidance program is a program that causes one or more processors to execute: a guidance direction determination step that determines the direction of guidance from the user's current location based on the destination and the user's current location; an object position setting step that sets a position for displaying a guidance object on the image captured by the imaging unit based on the guidance direction determined by the guidance direction determination step and the imaging range captured by the imaging unit; and a route guidance step that displays the guidance object at the position set by the object position setting step and guides the user along the guidance route to the guidance object. The object position setting step sets the display position of the guidance object within the imaging range if the guidance direction is outside the imaging range.

[0012] Furthermore, the present invention can also be considered as a computer-readable recording medium that non-temporarily stores the aforementioned route guidance program. [Effects of the Invention]

[0013] According to the present invention, by reliably displaying a guidance object such as an avatar within the imaging range of a mobile device, it is possible to easily grasp the direction of guidance. [Brief explanation of the drawing]

[0014] [Figure 1] Figure 1 is a block diagram showing the configuration of a user terminal that implements a route guidance system according to an embodiment of the present invention. [Figure 2] Figure 2 is a flowchart showing an example of the procedure for route guidance processing performed by a route guidance system according to an embodiment of the present invention. [Figure 3] Figure 3 is a flowchart showing an example of the procedure for route guidance processing performed by a route guidance system according to an embodiment of the present invention. [Figure 4] Figure 4 is a schematic diagram showing how a user is guided by a route guidance system according to an embodiment of the present invention. [Figure 5] Figure 5 is a network diagram showing the configuration of a route guidance system according to another embodiment of the present invention. [Modes for carrying out the invention]

[0015] The embodiments of the present invention will be described below with reference to the attached drawings. Note that the following embodiments are merely examples of the present invention and do not limit the technical scope of the present invention.

[0016] Figure 1 is a block diagram showing the configuration of a user terminal 20 for realizing a route guidance system 100 according to an embodiment of the present invention. The route guidance system 100 is an example of the route guidance system of the present invention. The user terminal 20 is an example of a mobile terminal or route guidance device of the present invention.

[0017] Unlike a conventional navigation system that uses a road map to guide a route along a road to a destination, the route guidance system 100 accurately navigates a user to a destination set on the floor of a facility when the user moves within facilities such as a shopping mall, a hospital, an airport, or a station. Specifically, the route guidance system 100 is an AR navigation system realized by combining predetermined digital information with an actual video (moving image) projected onto the display unit 22A by the camera 24 of the user terminal 20.

[0018] As shown in FIG. 1, the route guidance system 100 includes a user terminal 20. The navigation service by the route guidance system 100 is realized by the user terminal 20.

[0019] The user terminal 20 is a terminal device owned by a user who receives the navigation service of the route guidance system 100. The user receives the navigation service while starting the camera 24 with the user terminal 20 and capturing a peripheral video in the direction in which the user is about to proceed. The user terminal 20 is, for example, an information processing device, and specifically, a portable terminal such as a smartphone or a tablet terminal that a user can carry around, a notebook or desktop personal computer, or the like. Also, the user terminal 20 may be a wearable terminal such as a smartwatch on which a navigation screen can be displayed. An application (software) for executing the route guidance process described later is installed in the user terminal 20.

[0020] As shown in FIG. 1, the user terminal 20 includes a control unit 21, an operation display unit 22, a storage unit 23, a camera 24 (an example of the imaging unit of the present invention), a position information receiving unit 25, a communication unit 28, and the like. The user terminal 20 is a terminal device used by a user who moves to a facility that receives the navigation service, and is an information processing device such as a smartphone, a mobile phone, or a tablet terminal. In the present embodiment, a smartphone is exemplified as an example of the user terminal 20.

[0021] The camera 24 is a digital camera that outputs the captured video as digital data. The user captures the surroundings within the facility that receives the navigation service using the camera 24. By superimposing digital information on the captured real video, AR navigation is realized.

[0022] The communication unit 28 is a communication interface for connecting the user terminal 20 to a network such as the Internet by wire or wirelessly and performing data communication according to a predetermined communication protocol via the network.

[0023] The operation display unit 22 is a user interface including a display unit 22A such as a liquid crystal display or an organic EL display for displaying various information, and an operation unit 22B such as a mouse, keyboard, numeric keypad, or touch panel for receiving the user's operations. The user can start an application for receiving the navigation service by the route guidance system 100 or set a destination that the user himself / herself wants to go through the application via the operation unit 22B. Also, information used for the navigation service provided to the user in the route guidance system 100 is displayed on the display unit 22A.

[0024] The storage unit 23 is a non-volatile storage device for storing various information, for example, a semiconductor memory such as a flash memory. The storage unit 23 stores a control program for causing the control unit 21 to execute various processes, a control program necessary for executing various processes required for the navigation service provided by the route guidance system 100, and the like.

[0025] Furthermore, the memory unit 23 stores mapping data used for the navigation service provided by the route guidance system 100. The mapping data is 3D map data that includes images and location information of floors and corridors within the facility to which the navigation service is applied, as well as images and location information of the surrounding structures. The 3D map data also includes, for example, location information of structures, the number of floors on which they are installed, information indicating the function of the structure itself, identification information such as names that can identify the structures, and characteristic landmark information included within the facility. The 3D map data may also be stored in a storage device connected to the user terminal 20 via a network.

[0026] The location information receiving unit 25 is a receiving device capable of receiving location information indicating the user's location within the facility (the location of the user terminal 20). Since the user moves around the facility with the user terminal 20, the location of the user terminal 20 is considered to be the user's location. For example, the location information receiving unit 25 could be a GPS receiving device capable of receiving positioning signals transmitted from GPS satellites, or a receiving device capable of receiving signals transmitted from a beacon transmitter compliant with Bluetooth beacon standards.

[0027] The control unit 21 controls the operation of each part of the user terminal 20. The control unit 21 has control devices such as a CPU, ROM, and RAM. The CPU is a processor that performs various arithmetic operations. The ROM is a non-volatile memory unit in which control programs for causing the CPU to perform various operations are pre-stored. The RAM is a volatile or non-volatile memory unit that stores various information and is used as a temporary memory (work area) for the various operations performed by the CPU. The control unit 21 controls the user terminal 20 by executing various control programs pre-stored in the ROM or memory unit 23 using the CPU.

[0028] Specifically, as shown in Figure 1, the control unit 21 includes various processing units such as a route search unit 210, a guidance direction determination unit 211 (an example of the guidance direction determination unit of the present invention), an object position setting unit 212 (an example of the object position setting unit of the present invention), a route guidance processing unit 213 (an example of the route guidance processing unit of the present invention), and a data acquisition unit 214. The control unit 21 functions as the various processing units by executing various processes according to the control program using the CPU. Some or all of the processing units included in the control unit 21 may be composed of electronic circuits. The control program may be a program that causes multiple processors to function as the various processing units.

[0029] When a user operates the user terminal 20 and a route search request is input, including the user's current location information and destination information indicating a predetermined destination, the route search unit 210 performs a process to search for a guided route within the facility from the user's current location to the destination. Here, the user's current location matches the current location of the user terminal 20. The route search unit 210 searches for a route (guide route) connecting the current location and the destination by referring to the 3D map data of the facility stored in the storage unit 23. The guided route search process by the route search unit 210 is a conventionally known search processing technique, and a detailed explanation is omitted here. Once a guided route is found, the route information is stored in the storage unit 23.

[0030] The guidance direction determination unit 211 performs a process to determine the guidance direction from the user's current location based on the user's destination and the user's current location. Specifically, when the guidance direction determination unit 211 finds a guidance route by the route search unit 210 in response to the route search request, it determines the direction from the user's current location toward that guidance route as the guidance direction.

[0031] The object position setting unit 212 performs a process to set a position (object position) for displaying a predetermined guidance object based on the guidance direction determined by the guidance direction determination unit 211 and the imaging range captured by the camera 24. Here, the guidance object is digital information that is superimposed and displayed on the image captured by the camera 24 in order to guide the user using the navigation service. In this embodiment, a human-shaped avatar is used as the guidance object. In other words, the object position setting unit 212 sets a position for placing the guidance object on the image captured by the camera 24. Note that the guidance object is not limited to a human shape, but may be an animal type, a virtual creature type, an anime character or so-called local character, or even a simple figure or three-dimensional object, as long as it walks or moves ahead of the user to guide them along the way.

[0032] In this embodiment, the object position setting unit 212 sets the display position of the guide object within the imaging range of the camera 24 if the guide direction determined by the guide direction determination unit 211 is outside the imaging range of the camera 24.

[0033] The route guidance processing unit 213 displays the guidance object at the position set by the object position setting unit 212 and performs processing to guide the user along the guidance route to the guidance object.

[0034] By the way, in conventional AR navigation, if the guidance direction is not within the imaging range of the camera 24 of the user terminal 20 used by the user, that is, if the guidance direction is behind the user, the guidance arrow will be pointed towards the user, or the guidance object will be placed on a path outside the camera's imaging range. As a result, the user may not be able to easily determine which direction to proceed from their current location because the direction of the guidance arrow is unclear and the guidance object that is supposed to guide them does not appear. Also, because it is difficult to determine the direction of travel from the current location, if the user turns left and right or suddenly turns around while looking at the display screen of the user terminal 20 in order to look for the guidance object, there is a risk of bumping into people or objects around them.

[0035] In contrast, in this embodiment, as described above, when the guidance direction is outside the imaging range of the camera 24, the display position of the guidance object is set within the imaging range. The guidance object is then displayed at the set position. This makes it possible to reliably display guidance objects such as avatars within the imaging range of the user terminal 20, and as a result, the user can easily grasp the guidance direction.

[0036] The route guidance processing unit 213 generates an auxiliary route from the display position set by the object position setting unit 212 to the guide route when the guidance direction is outside the imaging range of the camera 24, and guides the user along the auxiliary route and the guide route using the guide object. Here, it is preferable that the auxiliary route is a route connecting the display position to the nearest position (connection point) on the guide route. This auxiliary route corresponds to the left-turn route and the right-turn route described later.

[0037] The object position setting unit 212 preferably sets the display position of the guide object to a position closer to the guide direction, with reference to the imaging direction of the camera 24, within the imaging range of the camera 24.

[0038] Furthermore, the object position setting unit 212 may determine whether there are obstacles on the left and right sides of the imaging range based on the image captured by the camera 24, and if it determines that there are obstacles on either the left or right side, it may set the display position of the guide object to the other side within the imaging range.

[0039] The data acquisition unit 214 acquires various types of information as needed. The data acquisition unit 214 acquires location information to identify the location of the user terminal 20. As described above, the location information includes location information based on GPS signals, the identification number or location information of the wireless LAN access point to which the user terminal 20 is connected, and the identification number or location information of the Bluetooth beacon to which the user terminal 20 is connected. Furthermore, when determining the location of the user terminal 20 within a facility by utilizing features such as structures within the facility, the location information is the current surrounding image captured by the camera 24 of the user terminal 20. In addition, if the user terminal 20 is equipped with an acceleration sensor, gyro sensor, geomagnetic sensor (electronic compass), etc., the data acquisition unit 214 acquires the detection signals of each of these sensors as location information. The acquired location information is used in the route search processing by the route search unit 210.

[0040] [Route guidance processing] The following describes an example of the procedure for route guidance processing performed by the control unit 21 in the route guidance system 100 (i.e., the user terminal 20) using the flowcharts in Figures 2 and 3, and also describes the route guidance method of the present invention.

[0041] Furthermore, the present invention can be understood as an invention of a route guidance method that performs one or more steps included in the route guidance process. Also, the one or more steps included in the route guidance process described herein may be omitted as appropriate. Furthermore, the execution order of each step in the route guidance process may differ to the extent that similar effects are produced. In addition, although the case in which each step in the route guidance process is executed by the control unit 21 of the user terminal 20 is given as an example, a route guidance process in which each step in the route guidance process is executed in a distributed manner by multiple processors can also be considered as another embodiment.

[0042] <Step S11> When an application for receiving navigation services from the route guidance system 100 is launched on the user terminal 20, first, in step S11, the control unit 21 determines whether the user has set a destination they wish to go to through the application. If the destination has been set, the control unit 21 forwards the route search request, which includes destination information indicating the destination and current location information indicating the current location of the user terminal 20, to the route search unit 210.

[0043] <Step S12> In the next step S12, the route search unit 210 of the control unit 21 searches for a guided route within the facility from the current location to the destination based on the route search request. Once a guided route is found, information indicating the guided route from the current location to the destination is stored in the storage unit 23.

[0044] <Step S13> In the next step S13, the control unit 21 determines whether the guide direction is outside or within the imaging range of the camera 24. This determination is performed by the guide direction determination unit 211. Step S13 is an example of the guide direction determination step of the present invention.

[0045] If it is determined in step S13 that the guide direction is outside the imaging range of the camera 24, the process proceeds to step S15. On the other hand, if it is determined that the guide direction is within the imaging range of the camera 24, the process proceeds to step S14.

[0046] <Step S14> When it is determined that the guidance direction is within the imaging range of the camera 24, the control unit 21 sets a display position in the next step S14 that is within the imaging range of the camera 24 and on the guidance route for displaying the guidance object. This process is performed by the object position setting unit 212. The process then proceeds to step S22 (see Figure 3).

[0047] <Step S15> If the control unit 21 determines that the guide direction is outside the imaging range of the camera 24, in the next step S15, it determines whether the guide direction is to the left, right, or center within the imaging range of the camera 24, with reference to the imaging direction of the camera 24. For example, the control unit 21 makes a determination with reference to a vertical plane including the imaging direction towards which the camera 24 is pointed, and if the guide direction is to the left of the vertical plane, it determines that "the guide direction is to the left." Also, if the guide direction is to the right or center of the vertical plane, it determines that "the guide direction is to the right or center."

[0048] Furthermore, if the guide direction exactly coincides with the vertical plane in a plan view, it is determined that "the guide direction is centered."

[0049] <Step S16> If the guidance direction is determined to be to the left in step S15, the control unit 21 determines whether there is an obstacle to the left of the user based on the 3D map data and the current location information. If it is determined that there is an obstacle to the left of the captured image that prevents the user from passing, the process proceeds to step S20. On the other hand, if it is determined that there is no obstacle to the left of the captured image that prevents the user from passing, the process proceeds to step S17. The obstacles include, for example, structures such as walls and pillars, shelves and storage sheds, etc.

[0050] <Step S17> If it is determined that there are no obstacles to the left of the captured image that would prevent a user from passing, the control unit 21 sets the display position of the guide object to a position to the left of the center of the imaging range in step S17. This process is performed by the object position setting unit 212. Step S17 is an example of the object position setting step of the present invention.

[0051] <Step S18> Subsequently, in step S18, the control unit 21 generates a counterclockwise route (an example of an auxiliary route in the present invention) from the set display position to the guide route, and proceeds to the next step S22 (see Figure 3).

[0052] <Step S19> If the guidance direction is determined to be to the right or center in step S15, the control unit 21 determines in step S19 whether there is an obstacle to the user's right based on the 3D map data and the current location information. If it is determined that there is an obstacle to the user's right side of the captured image that prevents the user from passing, the process proceeds to step S17, where the display position of the guidance object is set to the opposite left side.

[0053] <Step S20> If it is determined that there are no obstacles preventing the user from passing to the right of the captured image, the control unit 21 sets the display position of the guide object to a position to the right of the center of the imaging range in step S20. This process is performed by the object position setting unit 212. Also, if it is determined in step S16 that there are obstacles to the right of the captured image, the control unit 21 sets the display position of the guide object to a position to the right of the center of the imaging range. Step S20 is an example of the object position setting step of the present invention.

[0054] <Step S21> Subsequently, in step S21, the control unit 21 generates a clockwise route (an example of an auxiliary route in the present invention) from the set display position to the guide route, and proceeds to the next step S22 (see Figure 3).

[0055] <Step S22> As shown in Figure 3, in step S22, the control unit 21 displays the guide object at the display position set in steps S14, S17, and S21. The displayed guide object is, for example, a humanoid avatar (the object indicated by reference numeral A1 in Figure 4), and this avatar performs actions according to a pre-registered program using well-known animation processing.

[0056] <Steps S23, S24> Specifically, when it is determined that the user is moving towards the avatar (Yes in S23), the control unit 21 moves the avatar in the direction of guidance along the auxiliary path and the guidance route (S24). Steps S23 and S24 are performed by the route guidance processing unit 213. Note that steps S23 and S24 are examples of route guidance steps of the present invention.

[0057] <Step S25> Subsequently, in step S25, the control unit 21 determines whether or not the user terminal 20 has arrived at its destination based on its location information. If it determines that the user has arrived at its destination, the series of processes ends.

[0058] <Step S26> In step S23, if the user remains stationary without moving towards the avatar, or moves in a different direction, in the next step S26, the control unit 21 determines whether the avatar has moved relative to the imaging range of the camera 24. In other words, the control unit 21 determines whether the avatar has moved out of frame from the imaging range of the camera 24. If it is determined in step S26 that the avatar has moved outside the imaging range, the process proceeds to step S28. On the other hand, if it is determined that the avatar remains within the imaging range, the process proceeds to step S27.

[0059] <Step S27> In step S27, the control unit 21 temporarily puts the avatar into a waiting state, waiting for the user to start walking. At this time, the control unit 21 makes the avatar act as if it is calling out to the user. After that, the process from step S23 onwards is repeated.

[0060] <Step S28> On the other hand, if the avatar moves relatively outside the imaging range of the camera 24, in step S28, the control unit 21 performs a process to change the display position of the guide object back into the imaging range of the camera 24 and reset it.

[0061] <Step S29> In the next step S29, the control unit 21 generates a looping route again, either a counter-clockwise route or a clockwise route. After that, the processing from step S22 onwards is repeated. Note that in step S29, a looping route on the same side as the previously generated route may be generated, or a looping route, either a counter-clockwise route or a clockwise route, may be generated again by the execution of the processing in steps S15 to S21.

[0062] As described above, the route guidance system 100 according to this embodiment determines the direction of guidance from the user's current location based on the guidance route, sets a display position for displaying the guidance object, such as an avatar, on the image captured by the camera 24 based on the guidance direction and the imaging range of the camera 24, and guides the user according to the guidance route by the guidance object displayed at the set display position. Furthermore, if the guidance direction is outside the imaging range, the display position of the guidance object is set within the imaging range. As a result, even if the guidance direction is outside the imaging range of the camera 24, the display position of the guidance object is set within the imaging range, so the guidance object is reliably displayed at the set position. Therefore, it is possible to reliably display the guidance object, such as an avatar, within the imaging range of the user terminal 20, and as a result, the user can always grasp the direction of guidance without losing sight of the guidance object.

[0063] Furthermore, if the display position of the guidance object is set within the imaging range, there is a risk that the guidance object may deviate from the guidance route. However, in this embodiment, a looping route (a left-hand route or a right-hand route) is generated from the set display position to the guidance route. Therefore, the avatar can be smoothly moved from the display position to the guidance route via the auxiliary path.

[0064] Furthermore, as shown in Figure 4, by having avatar A1 move along a winding route, users can reach their destination simply by intuitively following behind avatar A1 without having to know the location of the destination. Moreover, since users do not need to swing their terminal 20 from side to side or turn around, the risk of bumping the terminal 20 into people or objects around them, or the user bumping into people or objects around them, is reduced, thereby improving the safety of both the user and those around them.

[0065] In the embodiments described above, the user terminal 20 is exemplified as having a route search unit 210, a guidance direction determination unit 211, an object position setting unit 212, and a route guidance processing unit 213. However, the present invention is not limited to such a configuration.

[0066] For example, as shown in Figure 5, if the route guidance system 100 includes a management server 10 and a user terminal 20, the management server 10 may be equipped with a route search unit 210, and the user terminal 20 may be equipped with a guidance direction determination unit 211, an object position setting unit 212, and a route guidance processing unit 213. Alternatively, all or part of the guidance direction determination unit 211, the object position setting unit 212, and the route guidance processing unit 213 may be provided in the management server 10. In this case, the route search unit 210 is implemented by the control unit of the management server 10. Furthermore, various information acquired by the data acquisition unit 214 of the user terminal 20 is transmitted from the user terminal 20 to the management server 10 for route guidance search.

[0067] Here, the management server 10 is an information processing device that is connected to the user terminal 20, which is provided with navigation services by the route guidance system 100, via a network so that they can communicate with each other. The management server 10 can be, for example, a server computer, a server device such as a cloud server, or a personal computer. Note that the management server 10 is not limited to a single computer, but may be a computer system in which multiple computers work together, or a cloud computing system. Also, the various processes performed on the management server 10 may be distributed and executed by one or more processors. Computer software for operating the route guidance system 100 is installed on the management server 10.

[0068] The 3D map data may be stored in the memory unit of the management server 10, or it may be stored in a network storage device such as a database connected to the management server 10 or the user terminal 20 via a network.

[0069] [Notes on the invention] The following is an overview of the invention extracted from the above-described embodiments. Note that each configuration and processing function described below can be selected and combined as desired.

[0070] <Note 1> A route guidance system that displays a pre-set route to a destination on video footage captured by the imaging unit of a mobile terminal used by the user, and guides the user to the destination, A guidance direction determination unit determines the direction of guidance from the user's current location based on the destination and the user's current location. An object position setting unit sets a position for displaying a guide object on the image captured by the image capture unit, based on the guide direction determined by the guide direction determination unit and the imaging range captured by the imaging unit. A route guidance processing unit that displays the guide object at the position set by the object position setting unit and guides the user along the guide route to the guide object, Equipped with, The object position setting unit sets the display position of the guide object within the imaging range when the guide direction is outside the imaging range, in a route guidance system.

[0071] <Note 2> The route guidance system according to Appendix 1, wherein the route guidance processing unit generates an auxiliary route from the display position set by the object position setting unit to the guidance route when the guidance direction is outside the imaging range, and causes the guidance object to guide the user along the auxiliary route and the guidance route.

[0072] <Note 3> The route guidance system according to Appendix 1 or 2, wherein the object position setting unit sets the display position of the guide object in the imaging range at a position closer to the guide direction with reference to the imaging direction by the imaging unit.

[0073] <Note 4> The route guidance system according to any one of the appendices 1 to 3, wherein the object position setting unit determines whether there are obstacles on the left and right sides of the imaging range based on the image captured by the imaging unit, and if it determines that there are obstacles on either the left or right side, sets the display position of the guidance object to the other side within the imaging range. [Explanation of Symbols]

[0074] 20: User terminal 21: Control Unit 22: Operation display section 22A: Display section 22B: Operation section 23: Storage section 24: Camera 25: Location information receiving unit 28: Communications Department 100: Route guidance system 211: Route search section 211: Guidance direction determination unit 212: Object position setting section 213: Route guidance processing unit 214: Data Acquisition Unit

Claims

1. A route guidance system that displays a pre-set route to a destination on video footage captured by the imaging unit of a mobile terminal used by the user, and guides the user to the destination, A guidance direction determination unit determines the direction of guidance from the user's current location based on the destination and the user's current location. An object position setting unit sets a position for displaying a guide object on the image captured by the imaging unit, based on the guide direction determined by the guide direction determination unit and the imaging range captured by the imaging unit. A route guidance processing unit that displays the guide object at the position set by the object position setting unit and guides the user along the guide route to the guide object, Equipped with, The object position setting unit sets the display position of the guide object within the imaging range when the guide direction is outside the imaging range, in a route guidance system.

2. The route guidance system according to claim 1, wherein the route guidance processing unit generates an auxiliary route from the display position set by the object position setting unit to the guidance route when the guidance direction is outside the imaging range, and causes the guidance object to guide the user along the auxiliary route and the guidance route.

3. The route guidance system according to claim 1, wherein the object position setting unit sets the display position of the guide object in the imaging range at a position closer to the guide direction with reference to the imaging direction by the imaging unit.

4. The route guidance system according to claim 1, wherein the object position setting unit determines whether there are obstacles on the left and right sides of the imaging range based on the image captured by the imaging unit, and if it determines that there are obstacles on either the left or right side, it sets the display position of the guidance object to the other side within the imaging range.

5. A route guidance device that displays a pre-set route to a destination on an image captured by an imaging unit, and guides the user to the destination, A guidance direction determination unit determines the direction of guidance from the user's current location based on the destination and the user's current location. An object position setting unit sets a position for displaying a guide object on the image captured by the imaging unit, based on the guide direction determined by the guide direction determination unit and the imaging range captured by the imaging unit. A route guidance processing unit that displays the guide object at the position set by the object position setting unit and guides the user along the guide route to the guide object, Equipped with, The object position setting unit is a route guidance device that sets the display position of the guidance object within the imaging range when the guidance direction is outside the imaging range.

6. A route guidance method that guides a user to a predetermined destination by displaying a pre-set route to that destination on an image captured by the imaging unit of a mobile terminal used by the user, One or more processors A guidance direction determination step that determines the direction of guidance from the user's current location based on the destination and the user's current location, An object position setting step, which sets a position for displaying the guide object on the image captured by the imaging unit, based on the guide direction determined by the guide direction determination step and the imaging range captured by the imaging unit, The process involves performing a route guidance step which involves displaying the guide object at the position set by the object position setting step and causing the guide object to guide the user along the guide route, The object position setting step is a route guidance method in which, when the guidance direction is outside the imaging range, the display position of the guidance object is set within the imaging range.

7. A route guidance program that displays a pre-set route to a destination on video footage captured by the imaging unit of a mobile terminal used by the user, and guides the user to the destination, One or more processors, A guidance direction determination step that determines the direction of guidance from the user's current location based on the destination and the user's current location, An object position setting step, which sets a position for displaying the guide object on the image captured by the imaging unit, based on the guide direction determined by the guide direction determination step and the imaging range captured by the imaging unit, A route guidance step is performed in which the guide object is displayed at the position set by the object position setting step and the guide object is used to guide the user along the guide route. The object position setting step is a route guidance program that sets the display position of the guidance object within the imaging range when the guidance direction is outside the imaging range.

Images