Route guidance program by characters using artificial intelligence

Abstract

To provide a mobile information device that enables easier, more enjoyable, and more efficient arrival at a destination. 【Solution means】It includes an artificial intelligence that recognizes a subject from an image taken by a user and generates a character on a map, and uses the artificial intelligence to generate a character and a route guidance method based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. It includes a function that can calculate the optimal route from the current location to the target destination using the map function and display the target destination and the route on the map at the location of the destination, and a function that reflects the selection of the route guidance method and the change of the display content in consideration of the weather and time.

Description

Technical Field

[0001] The present invention relates to a route guidance program by a character using artificial intelligence.

Background Art

[0002] With the spread of mobile terminals such as smartphones, navigation services for pedestrians have come to be used. However, since pedestrians have a high degree of freedom in the direction of travel, it may take time to match the map displayed on the screen with reality. Therefore, instead of displaying a map, it has been considered to perform navigation by augmented reality (AR). For example, Patent Document 1 discloses a method of superimposing and displaying a character moving toward a destination on an image of the real world by using a head-mounted display (HMD). Further, Patent Document 2 describes a portable navigation device, which includes a display unit for displaying an image, a route information acquisition unit for acquiring route information indicating a route to a destination, an image acquisition unit for acquiring an image of the real world, an augmented reality image generation unit for generating an augmented reality image in which an image of a character moving along the route is superimposed on the image of the real world based on the route information, a map image generation unit for generating a map image showing the route on a map based on the route information, an angle detection unit for detecting an inclination angle of the display unit from the horizontal direction, and a display control unit for outputting the augmented reality image to the display unit when the angle is equal to or greater than a predetermined threshold value and outputting the map image to the display unit when the angle is less than the predetermined threshold value.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] When the user is heading towards the destination, the present invention enables the user to select, through artificial intelligence, a method for displaying a character for route guidance, so that the user can reach the destination more clearly, enjoyably, and efficiently.

[0005] The present invention relates to a route guidance program using artificial intelligence installed on a mobile terminal. It includes artificial intelligence that recognizes a subject from an image captured by the user and generates a character on a map, and can generate a character and a route guidance method using artificial intelligence based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. Also, for privacy protection, measures such as data anonymization, deletion, and obtaining user consent can be taken. The present invention is expected to be used in tourist attractions, commercial facilities, public transportation, etc., and can realize more user-friendly and personalized route guidance.

Means for Solving the Problems

[0006] The present invention relates to a route guidance program using artificial intelligence installed on a mobile terminal. It includes artificial intelligence that recognizes a subject from an image captured by the user and generates a character on a map, and can generate a character and a route guidance method using artificial intelligence based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. Also, for privacy protection, measures such as data anonymization, deletion, and obtaining user consent can be taken. Furthermore, it is expected to be used in tourist attractions, commercial facilities, public transportation, etc., and can realize more user-friendly and personalized route guidance.

[0007] The present invention also enables better service provision for facility providers such as tourist attractions, commercial facilities, and public transportation. The present invention is significantly different from the prior art in that it can realize more user-friendly and personalized route guidance by using more advanced technologies.

Effects of the Invention

[0008] The present invention is a route guidance program using artificial intelligence mounted on a mobile terminal, which includes artificial intelligence that recognizes a subject from an image captured by a user and generates a character on a map, and can generate a character and a route guidance method using artificial intelligence based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. Also, for privacy protection, measures such as data anonymization, deletion, and obtaining user consent can be taken. It is assumed to be used at tourist spots, commercial facilities, public transportation, etc., and can be made easier to use and realize personalized route guidance.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0010] The definitions of the keywords in the claims are as follows.

[0011] Route guidance program using artificial intelligence installed on a mobile device: A route guidance program that includes artificial intelligence that recognizes a subject from a photographed image and generates a character on a map. The program anonymizes data so that individuals cannot be identified when collecting images or usage history taken by the user, and appropriately protects the data. A route guidance program using artificial intelligence installed on a mobile device, including artificial intelligence that recognizes a subject from an image taken by the user and generates a character on a map, and using artificial intelligence to generate characters and route guidance methods based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. A route guidance program using artificial intelligence, including a function that can calculate the optimal route from the current location to the destination using a map function and display the destination and the route on the map, and a function that reflects the selection of the route guidance method and the change of the display content in consideration of weather and time.

[0012] The keyword in the claims, "route guidance program using artificial intelligence," refers to a program that utilizes artificial intelligence installed on a mobile device to provide route guidance when the user is heading to a destination.

[0013] For example, the following usage examples in the claims can be considered.

[0014] In the claims of "route guidance program using artificial intelligence," a program including the following functions: · A function that uses a camera installed on a mobile device to recognize subjects passed by when the user is heading to a destination · A function that uses artificial intelligence to propose an optimal route based on information such as past usage history, characteristics of the map area, weather, and time · A function that displays cute characters on route guidance using a character generation function A program with the above functions is expected to be used in tourist attractions, commercial facilities, public transportation, etc., and is easier to use and can realize personalized route guidance.

[0015] In addition, in order to implement the above program, it is necessary to equip the mobile terminal with a camera, a map, artificial intelligence, and a character generation function, and develop a program by integrating these functions. Specifically, it is necessary to recognize the subject with the camera, set the destination on the map, calculate the optimal route using artificial intelligence, and display a character on the route guidance using the character generation function.

[0016] Artificial intelligence: Technology that gives a computer intelligent processing, judgment, and learning capabilities.

[0017] Shooting function: A function that uses the camera installed on the mobile terminal to shoot the surrounding scenery or subject.

[0018] Image recognition function: A function that recognizes the subject, the direction the camera is facing, the weather at the time of shooting, etc. from the captured image by artificial intelligence.

[0019] Display function: A function that clearly displays the information of the recognized subject and destination to the user.

[0020] Map function: A function that is used when the user sets a destination, calculates the optimal route from the current location to the destination, and can display the destination and the route on the map at the location of the destination.

[0021] Character generation function: A function that can generate a character based on the user's location and provide route guidance.

[0022] Usage history: A function in which the route guidance information used by the user on the mobile terminal in the past is recorded, the user's preferences and behavior tendencies are analyzed by artificial intelligence, and can be utilized for future route guidance.

[0023] Type of destination: Depending on the purpose of the user's movement, it is set by the address, facility name, etc., and the purpose of the user's movement can be inferred from the content using artificial intelligence.

[0024] Features of the map area: including the types and details of information displayed on the map, the scale of the map, etc., and it is possible to grasp whether it is a densely populated area, a tourist area, or has altitude differences using artificial intelligence.

[0025] Weather and time: Considered in the selection of the route guidance method and the change of display content in view of the accuracy and safety of route guidance.

[0026] <Usage example of the claims> A route guidance program using artificial intelligence installed on a mobile terminal, which recognizes a subject using a shooting function, sets a destination using a map function, recognizes the weather and time using an image recognition function, displays a character on the route guidance using a character generation function, and can generate an optimal route guidance method using artificial intelligence based on information such as usage history, type of destination, features of the map area, weather and time. Also, for privacy protection, measures such as data anonymization, deletion, and obtaining user consent can be taken. As a result, it is assumed to be used in tourist areas, commercial facilities, public transportation, etc., and can be made more user-friendly and realize personalized route guidance.

[0027] This embodiment relates to a route guidance program that utilizes landmark information. The landmark information, in combination with spatial information, can provide more accurate and user-friendly route guidance. In this embodiment, by using the processing related to the physical identification and utilization of landmarks, context can be added to the route guidance and landmarks related to the knowledge possessed by the user can be integrated. Also, it is possible to integrate the integrated landmarks with advertisements. Thereby, landmark-based route guidance can be provided, and the possibility of the user following the route guidance can be increased. This embodiment can provide a useful route guidance program for the user.

[0028] Example: In a smartphone application, when the user is guided to a destination, an animated character is displayed on the screen. According to the distance between the user's current position and the destination, the character points in the direction of the real world and at the same time displays the distance. This animated character functions as a friendly guide for the user.

[0029] Hereinafter, a route guidance program by the mobile terminal according to the present embodiment will be described.

[0030] The present invention is a route guidance program for causing a mobile terminal to execute, in the mobile terminal, a photographing function for controlling the mobile terminal to photograph a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting a destination where the user holding the mobile terminal moves on a map, a character generation function for generating a character for the display function based on the position of the user in the display function, and the character generation function performs matching between the difference information between the distance the user has moved and the destination and the recognized subject and the subject on the map, and generates an image of the character based on the direction information to be headed to the destination.

[0031] In an embodiment of the present invention, when a user is heading towards a destination, a mobile terminal can provide route guidance. The mobile terminal includes a photographing function for photographing a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting a destination where the user holding the mobile terminal is moving on a map, and a character generation function for generating a character for the display function based on the position of the user. The character generation function can generate an image of a character based on the difference information between the distance the user has moved and the destination, and the matching of the recognized subject with the subject on the map, and the direction information towards the destination. Also, in the present invention, an image display program executed by a terminal device is provided. This program includes a determination means for determining which of a live guidance image and a map guidance image is to be preferentially displayed based on the relationship between the photographing direction and the traveling direction of the photographing means, and a display control means based on the determination result.

[0032] A route guidance program characterized by including, in a computer, a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a position information extraction and storage function for extracting and storing position information from the photographed subject, a route information acquisition and storage function for acquiring and storing route information from the position information obtained by the position information extraction and storage function to a destination, a direction display function for calculating and displaying direction information from the current position to the next destination from the route information obtained by the route information acquisition and storage function, and a guidance means selection and switching means for guiding the user by guidance means such as voice guidance or vibration guidance based on the direction information calculated by the direction display function. Examples of computer-readable recording media include magnetic media such as hard disks, floppy (registered trademark) disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions such as ROMs, RAMs, and flash memories.

[0033] The computer controls its own operation according to the read program, thereby realizing a surrounding map display processing unit and a landmark map display processing unit on the computer. The surrounding map display processing unit searches for a route from the user's current position to the destination and acquires landmark information on that route. The landmark map display processing unit displays the landmarks passed by the user on the route from the current position to the destination based on the acquired landmark information. As a result, the user can more intuitively grasp the route to the destination. The voice recognition device includes a voice recognition function that analyzes the input voice data and outputs a voice recognition result based on the analysis result, and an operation function that determines the content of the input voice data based on the voice recognition result and performs an operation according to the content of the input voice data based on the determination result. The present invention relates to an operation function provided in a voice recognition device. Specifically, according to the content of the voice data received by the voice recognition device, a specific application can be launched or a specific operation can be executed. For example, when voice data such as "Tell me the phone number" is input, the phone book application is launched, and when voice data such as "Next" is input, the next image is displayed in an application such as a slide show.

[0034] In the present embodiment, the position of the subject is specified by subject recording processing for performing the first shooting on the subject at the shooting location, subject guiding processing for guiding the approximate position of the subject to the operator who has moved from the shooting location to the shooting location for the second shooting, and subject measurement processing for measuring the position of the subject by performing the second shooting on the subject at the shooting location. Further, in the present embodiment, the route guidance program has a character generation function for generating a character image based on the difference information between the distance traveled by the operator and the target location and the direction information to be headed for the target location by matching the recognized subject with the subject on the map.

[0035] In the subject guidance process, when it is determined from the GPS signal obtained from the GPS unit that the operator is close to the subject within a distance less than a predetermined distance from the subject, the digital camera vibrates, sounds an alarm, or displays a message to notify the operator. This makes it easier to find the subject and take a picture. In addition, since the present invention can display the route to the destination by the route guidance program, even a person who does not know the route to the destination can easily reach the destination. Furthermore, the present invention can generate an image of a character by the character generation function. Further, when an operation member such as a "shooting" button is pressed, it may be determined that the operation member has been pressed from the signal transmitted from the "shooting" button or the like. In the present invention, when an operation member such as a "shooting" button is pressed, it is determined that the operation member has been pressed from the signal transmitted from the "shooting" button or the like. As a result, since it is determined that the operation member has been pressed from the signal transmitted from the "shooting" button or the like, accurate information processing is performed even when the operation member is not pressed from the signal transmitted from the "shooting" button or the like. Also, if it is determined that the operation member has been pressed from the signal transmitted from the "shooting" button or the like, necessary processes such as "shooting" processing and "saving" processing are automatically performed.

[0036] When the subject recording process is performed multiple times for the same subject, the previously acquired shooting data may be updated with the more recent data or the shooting data taken at a position where it is easier to specify the position of the subject.

[0037] 1. Shoot the subject using the shooting function. 2. Recognize the subject using the image recognition function. 3. Display the shot subject using the display function. 4. Set the target location where the user is moving on the map using the map function. 5. Generate a character based on the user's position using the character generation function. 6. Using the route guidance program, an image of the character is generated based on the direction information to the destination by matching the difference information between the distance the user has traveled and the destination and the recognized subject with the subject on the map.

[0038] Also, the computer acquires subject position information from the image obtained in the first shooting in the subject measurement process, calculates information such as the distance and direction from this information to the shooting point, and reflects it in the difference information used in the route guidance program. The computer includes a shooting function for controlling a mobile terminal that shoots a subject, an image recognition function for recognizing the subject, a position information acquisition processing unit that acquires position information when the photographed subject is matched with the subject on the map, and a route guidance processing unit that performs route guidance to the destination based on the position information acquired from the position information acquisition processing unit. The computer can perform route guidance to the operator by voice guidance, screen display, etc. based on the route guidance information calculated by the route guidance processing unit. A route guidance program.

[0039] The present invention is a "route guidance program". This program is executed on a "computer". This program can provide "route guidance" (such as turn right, etc.) from an "image" (such as a video taken with a camera) in which a "subject" (such as a building or a signboard, etc.) is reflected to a "destination" (such as a building or a signboard, etc.) and allow for "enjoyable movement" (such as moving enjoyably in a game-like feeling). Since this program is executed on a "computer", it can also be used on a "smartphone" or a "tablet terminal", etc.

[0040] In a computer, a photographing control unit, an image recognition unit, a position information acquisition unit, a route guidance program execution unit, a display unit, and an audio output unit for controlling a mobile terminal that photographs a subject are provided. The position information acquisition unit acquires current position information from the subject photographed by the mobile terminal. Then, the route guidance program execution unit calculates route information from the current position information to the destination. And the audio output unit provides voice guidance on the direction and distance to proceed next based on the calculated route information. And the display unit provides guidance on the direction and distance to proceed next on the screen based on the calculated route information. The computer device acquires current position information from the subject photographed by the mobile terminal by the position information acquisition unit. Then, the route guidance program execution unit calculates route information from the current position information to the destination. And the audio output unit provides voice guidance on the direction and distance to proceed next based on the calculated route information.

[0041] An object of the present invention is to provide a route guidance program for performing route guidance when a user heads for a destination in a mobile terminal. The route guidance program of the present invention includes a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting a destination where the user holding the mobile terminal moves on a map, and a character generation function for generating a character for the display function based on the position of the user in the display function. Further, when the second type of surrounding map information is sent from the map information server, the surrounding map display processing unit can display a surrounding map in which the landmark direction and the destination direction are superimposed on the display unit.

[0042] When the central processing unit of a mobile terminal executes a predetermined program stored in a memory or an external storage device, etc., when it receives information input from a user, it transmits a map display request or the like based on the received information to a map image processing device. Next, when it receives map data or the like from the map image processing device, a function of displaying a map image on a display is realized based on this. Also, a mobile terminal equipped with a photographing function and an image recognition function can perform character generation based on the recognition result of a subject and the position information of the user, and can provide route guidance to a destination.

[0043] The present invention relates to a route guidance program using a mobile terminal. According to the present invention, a user can set a target destination on a map and perform route guidance to reach that target destination. Also, by performing matching between the difference information between the distance the user has moved and the target destination, and the recognized subject and the subject on the map, an image of a character can be generated based on the direction information to head towards the target destination. Further, when the user displays the mobile terminal at a location other than the search route, by erasing the search route information from the screen according to its posture and displaying an arrow (not shown) indicating the search route direction, it is possible to guide the user to the destination by turning the mobile terminal in the search route direction.

[0044] A pedestrian may directly input an address or the like indicating the departure place and the destination, or may select the departure place and the destination from a map application.

[0045] The present invention relates to a route guidance system using a mobile terminal. The mobile terminal is equipped with a photographing function, an image recognition function, a display function, a map function, and a character generation function. The user sets a destination on the map and photographs a subject with the photographing function. The image recognition function recognizes the subject and obtains the direction information to head towards the destination by matching it with the subject on the map. The character generation function generates an image of a character based on the position information of the user and the direction information to head towards the destination. Also, the system control unit places a landmark and switches the currently displayed image when an image switching button is pressed. The computer is provided with a photographing function for controlling a portable terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting, on a map, a destination to which a user holding the portable terminal moves, a character generation function for generating a character for the display function based on the position of the user, and the character generation function executes generation of a character image based on direction information for heading to the destination by performing matching between difference information between the distance the user has moved and the destination and matching between the recognized subject and a subject on the map. This is a route guidance program for causing the above to be executed.

[0046] The present invention is a route guidance program used in a device such as a smartphone. In the present invention, a subject is recognized from a photographed image, and necessary information such as direction information and distance information from the current position to the destination is calculated from the position information and used in the route guidance program. In addition, direction instructions, distance instructions, etc. required when proceeding from the current position to the destination are clearly displayed by an animated character. As a result, route guidance that was difficult to understand in the prior art becomes easy to understand. A route guidance program for a device such as a portable terminal, characterized in that the computer includes a photographing function for controlling a device such as a portable terminal that photographs a subject, an image recognition function for recognizing the subject, a route guidance program including a calculation processing unit for calculating necessary information (such as direction information) from the photographed subject, the current position, the destination position, etc., an animation processing unit, etc., and communication means between these processing units.

[0047] In this embodiment, when the user is heading towards the destination, the route guidance program generates an image of a character based on the difference information between the distance the user has traveled and the destination, and the matching of the recognized subject with the subject on the map, as well as the direction information for heading towards the destination. The image of the character generated in this way is displayed by the display function. Also, in this embodiment, the route guidance program also has a map function for setting the destination where the user is moving on the map. Furthermore, in this embodiment, the character generation function also has a character display function for displaying the image of the character generated by the route guidance program.

[0048] The map information providing system of the present invention includes a terminal sales company that manufactures and sells car navigation terminals, a map data sales company that manages this system and generates and sells map data (map information), a communication line company that provides the generated map data to users via a communication line, and a plurality of users who receive the map data and pay a consideration therefor (here, a financial institution that classifies and pays the consideration paid by the users to the map data sales company and the communication line company), and the terminal sales company, the map data sales company, the communication line company, and the financial institution are connected by a network such as the Internet. Also, this system is used from the application software installed in the car navigation terminal manufactured by the terminal sales company. This application software displays the map information provided by the map data sales company based on the position information received by the car navigation terminal from GPS satellites. Also, this application software acquires payment information from the financial institution via the communication line and restricts the range of map information available to the user based on that information.

[0049] The present invention is a route guidance program that combines subject recognition technology and character generation technology. This program calculates direction information to a destination through matching processing between a photographed subject and a subject on a map, and generates a character image based on the direction information. By displaying this character image on a display device, the user can be guided on the route to the destination. Also, since the photographed subject in the present invention is used for calculating direction information to the destination, it is possible to provide route guidance even in places such as inside buildings and mountainous areas where it was impossible with conventional technologies.

[0050] An object of the present invention is to provide a route guidance program for performing route guidance when a user heads towards a destination on a mobile terminal. The route guidance program of the present invention includes a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map a destination towards which the user holding the mobile terminal moves, a character generation function for generating a character for the display function based on the position of the user for the display function, and the character generation function generates an image of a character based on direction information to be headed towards the destination by performing matching between difference information between the distance the user has moved and the destination and the recognized subject and a subject on the map.

[0051] The route guidance system according to the present invention is a system for setting a destination towards which a user moves and performing route guidance to the destination. This system includes a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map a destination towards which the user holding the mobile terminal moves, and a character generation function for generating a character for the display function based on the position of the user for the display function. Also, when this system receives an instruction indicating that the user has reached a point farther from the destination, it can also display an imaging image corresponding to the next destination that the user should target.

[0052] When the user sets a destination, the route guidance program calculates the distance from the user's current location to the destination. Also, every time the user moves, the program recalculates the distance between the current location and the destination and generates an image of a character. The image of the character changes according to the direction in which the user should head towards the destination. For example, when the user approaches the destination, the character will happily dance. On the other hand, when the user moves away from the destination, the character will look worried. Also, when the recognized subject matches the subject on the map, the character will display an animation related to that subject.

[0053] In addition, this route guidance program may end when the user reaches the destination, or may execute the route guidance program again if the user does not reach the destination.

[0054] The present invention provides a route guidance program and its method that enable the user to intuitively understand the direction to move and the distance to the destination. Specifically, a route guidance program and its method consisting of various processing parts such as photographing, recognition, display, map, and character generation are provided for a computer. These processing parts are related to each other. For example, a character image is generated by calculating the direction and distance from the photographed subject to the destination. The route guidance program and its method consisting of these processing parts can be used on a variety of devices such as smartphones and car navigators, and are widely applicable beyond specific uses.

[0055] This embodiment aims to enable a user to display a landmark map grouped into a plurality of groups according to a predetermined rule. For this purpose, in this embodiment, before transmitting a request for a surrounding map, if a group of landmarks that the user wants to display on the landmark map has been specified by the user, a landmark map including the landmarks belonging to the group specified by the user and the current position of the user can be displayed. Thereby, the user can display only the landmarks that the user is interested in and can efficiently and quickly obtain the necessary information.

[0056] This embodiment aims to provide a character generation method and a route guidance method that do not deviate from the route guidance program even when the user is moving. For this reason, in this embodiment, at the time of character generation, how far the user has advanced in a straight line from the current position to the destination (hereinafter referred to as "progress degree") and how far the user has deviated from the straight line from the current position to the destination (hereinafter referred to as "deviation degree") are calculated, and the character image, voice guidance content, etc. are determined from these values. Also, in this embodiment, the character image, voice guidance content, etc. are also changed according to the case where the "progress degree" and the "deviation degree" increase or decrease by a certain amount or more. By these contrivances, the user can move efficiently and quickly without deviating from the route guidance program.

[0057] The present invention has a function of determining whether there are landmarks on the surrounding map when the user heads towards a destination, transmitting the surrounding map to the mobile terminal if there are, and if not, selecting a landmark to be a direction display target from among the landmarks whose location information is registered in the landmark location information storage unit, and transmitting the landmark location information of this selected landmark and the surrounding map to the mobile terminal. Thereby, the user can more accurately grasp the route to the destination. Also, since the present invention enables the user to more accurately grasp the route to the destination, it also leads to stress reduction for the user.

[0058] The surrounding map request processing unit is a route guidance program that notifies the mobile terminal of the position of a landmark on the surrounding map even when the position is not notified to the mobile terminal, if there is a landmark on the surrounding map whose angle with respect to the orientation of the mobile terminal is less than 90 degrees.

[0059] When information is provided by multiple companies, icon images can be obtained from each piece of information and integrated for display.

[0060] The present invention relates to a route guidance program for a mobile terminal. According to the present invention, a user can set a destination on a map and receive route guidance to reach that destination. Specifically, by using a mobile terminal equipped with an image recognition function for recognizing a subject, a user can set a destination on a map and receive route guidance to reach that destination. Further, by performing matching between the distance the user has traveled and the difference information with the destination, and the recognized subject and the subject on the map, an image of a character can be generated based on the direction information to the destination by the character generation function.

[0061] The route guidance system according to the present invention is a system that sets a destination for a user to move to and provides route guidance to reach that destination. This system is realized by a mobile terminal held by the user. This mobile terminal is provided with a photographing function for photographing a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting a destination for the user to move to on a map, and a character generation function for generating a character for the display function based on the position of the user. Further, the route guidance system according to the present invention also includes reception means for receiving a user's instruction, and the target image display control means can also sequentially switch and display a plurality of captured images stored in the image storage means based on the user's instruction. The computer comprises a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, position information extraction and storage means for extracting and storing position information from the photographed subject, and display means for acquiring and displaying position information data from the position information extraction and storage means. The computer is a display control program for guiding information such as the direction and distance the user should travel, and characters, etc. according to the direction and distance to travel, etc., from the position information data, including the moving distance and direction information from the previous photographing time to the present, the current position information, and the distance and direction information to the destination. The above road guidance system facilitates the provision of guidance information such as the direction and distance the user should travel, and a display control program for characters, etc. Further, in the present invention, more accurate guidance is possible by acquiring and displaying position information data from the position information extraction and storage means.

[0062] The road guidance program according to the present invention comprises the above-described technical features, and since subject recognition technology and position information acquisition technology, etc. are combined, it has higher convenience than conventional navigation systems. Furthermore, the road guidance program according to the present invention has higher convenience than conventional navigation systems because subject recognition technology and position information acquisition technology, etc. are combined. And the road guidance program according to the present invention has higher convenience than conventional navigation systems because subject recognition technology and position information acquisition technology, etc. are combined.

[0063] In one embodiment of the present invention, the terminal device includes a photographing means, a determination means for determining which of a live guidance image using a photographed image captured by the photographing means and a map guidance image using map information is to be preferentially displayed based on the relationship between the photographing direction of the photographing means and the traveling direction of the terminal device, and a display control means for performing control to display one of the live guidance image and the map guidance image based on the determination by the determination means. Further, in one embodiment of the present invention, the determination means extracts feature amounts of buildings and the like on the road on which the terminal device travels, and selects one of the live guidance image and the map guidance image by collating the feature amounts with the map information. A mobile support system characterized by comprising a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a route display function for acquiring and displaying route information to a destination set by a user, an arrival prediction function for acquiring and displaying information such as the time and distance required to reach a destination set by the user, a step count calculation function for calculating and displaying the number of steps required for the user to reach the destination from information such as the time and distance required to reach the destination set by the user, a calorie consumption calculation function for calculating and displaying the calorie consumption required for the user to reach the destination from the number of steps required for the user to reach the destination set by the user, and a water replenishment amount calculation function for calculating and displaying the water replenishment amount required for the user to reach the destination from the calorie consumption required for the user to reach the destination set by the user. The present invention relates to a mobile support system which provides information, advice, etc. necessary when heading to a specific location, enabling a user to move comfortably and efficiently. The present invention is a system which also calculates and provides the number of steps, calorie consumption, etc. from the time, distance, etc. required when the user reaches a set destination, enabling the user to move efficiently in terms of health.

[0064] In addition, this route guidance program may end when the user reaches the destination, or may execute the route guidance program again if the user does not reach the destination.

[0065] The present invention relates to a route guidance program by a portable information terminal. The route guidance program of the present invention causes the portable information terminal to determine whether it has passed through a point before a turning point for each positioning. When the portable information terminal determines that it has passed through a point before a turning point, the portable information terminal is made to access a map / photo information providing server to download an image of a photo of the moving direction at a point one ahead of the point before the turning point, and the image of the photo of the moving direction at a point one ahead of the point before the turning point can be displayed on the image display surface. Further, the present invention includes a photographing function for controlling a portable terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting a destination to which the user holding the portable terminal moves on a map, and a character generation function for generating a character for display on the display function based on the position of the user.

[0066] In this embodiment, when the user heads for the destination, the route guidance program executes generating an image of a character based on the difference information between the distance the user has moved and the destination, and by matching the recognized subject with the subject on the map, and based on the direction information for heading to the destination. The image of the character generated in this way is displayed by the display function. Also, in this embodiment, the route guidance program also has a map function for setting the destination to which the user moves on the map. Further, in this embodiment, the character generation function also has a character display function for displaying the image of the character generated by the route guidance program.

[0067] The present invention relates to a route guidance program for a portable information terminal. The portable information terminal is provided with a function of photographing a subject, an image recognition function, a display function, a map function, and a character generation function. The character generation function sets a destination to which the user moves on a map and generates a character based on the user's position. The character generation function generates an image of a character based on the difference information between the distance the user has moved and the destination, and the matching between the recognized subject and the subject on the map, and based on the direction information to be headed to the destination. The route guidance program can also measure the current position at predetermined intervals, download and display an image of a photograph in the moving direction at a point near the current position.

[0068] In one embodiment of the present invention, the user heads to a destination with a portable terminal. The portable terminal has a photographing function of photographing a subject, an image recognition function of recognizing the subject, a display function of displaying the photographed subject, a map function of setting a destination to which the user holding the portable terminal moves on a map, a character generation function of generating a character for the display function based on the user's position, and the character generation function can generate an image of a character based on the difference information between the distance the user has moved and the destination, and the matching between the recognized subject and the subject on the map, and based on the direction information to be headed to the destination. Such a route guidance program displays a character indicating the traveling direction when the user proceeds to the destination, so that the user can move more smoothly.

[0069] When it is determined that the character is located in a first distance area, which is the distance area where the character has arrived at the destination and is the closest distance from the user, the character control unit may determine that the user has arrived at the destination.

[0070] The route guidance program according to the present invention provides intuitive route guidance to the user by displaying a character when the user heads towards the destination. The size of this character can be changed according to the scale of the destination image, the distance from the shooting location of the destination image to the parking location, etc., so that it corresponds to the actual size of the vehicle within the destination image. Thereby, the user can receive more accurate route guidance. Further, since the present invention has an image recognition function for recognizing a subject, when the user confirms the route to the destination, the user can refer to surrounding buildings, signboards, etc.

[0071] The present invention relates to a route guidance program by a mobile terminal. According to the present invention, when the user heads towards the target destination, by displaying a character, the user's interest can be attracted. Also, by controlling the movement of the character, the direction in which the user heads towards the target destination can be indicated. Furthermore, by controlling the position of the character, the direction in which the user heads towards the target destination can be indicated. With the present invention, the user can enjoy the route guidance to the target destination.

[0072] When it is determined that the character is located in the distance area in the route guidance program according to the present invention, the character control unit performs control to move the character towards the destination at a speed faster than in the case of the distance area.

[0073] The present invention can provide route guidance when the user heads towards the destination by using a mobile phone terminal as a navigation device. Specifically, the mobile phone terminal is provided with a shooting function for shooting a subject, an image recognition function for recognizing the subject, a display function for displaying the shot subject, a map function for setting the target destination where the user holding the mobile terminal moves on the map, and a character generation function for generating a character for the display function based on the position of the user. With such a route guidance program, the user can reach the destination smoothly without getting lost.

[0074] The present invention is a system that can guide a user to a destination by selecting a character the user likes from a plurality of characters. The user travels towards the destination with a mobile terminal, and based on the photos taken on the way, the character guides the way to the destination. Also, as the user moves, new characters can be acquired. This system is enjoyable for the user to use, and by guiding the way to the destination, the user can reach the destination without getting lost.

[0075] The present invention is a system that can guide a user to a destination by selecting a character the user likes from a plurality of characters. The user travels towards the destination with a mobile terminal, and based on the photos taken on the way, the character guides the way to the destination. Also, as the user moves, new characters can be acquired. This system is enjoyable for the user to use, and by guiding the way to the destination, the user can reach the destination without getting lost.

[0076] The present invention is such that a user can select and display a character the user likes from a plurality of characters. Also, when the user moves a certain distance, new characters can be added. As a result, the user can collect characters according to their preference. Furthermore, the present invention can set a destination for the user to move to and guide the way to that destination. At this time, the wayfinding is realized by matching the recognized subject with the subject on the map and generating direction information to head towards the destination.

[0077] The present invention relates to a device for providing route guidance when a user is heading towards a destination. This device has a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map the destination towards which the user holding the mobile terminal is moving, and a character generation function for generating a character for the display function based on the position of the user. Also, this device has display mode selection means for selecting a display mode or a non-display mode based on a user operation, and the control means can display the image of the character when the display mode is selected and make the image of the character non-displayed when the non-display mode is selected.

[0078] The present invention is configured such that when the photographed subject does not match the subject on the map, a map guidance image can be preferentially displayed instead of an actual scene guidance image.

[0079] The present invention relates to a route guidance program for a mobile information terminal. The mobile information terminal is provided with a function for photographing a subject, an image recognition function, a display function, a map function, and a character generation function. The character generation function sets on a map the destination towards which the user is moving and generates a character based on the position of the user. The character generation function generates an image of the character based on the difference information between the distance the user has moved and the destination and the matching of the recognized subject with the subject on the map, based on the direction information towards the destination. The route guidance program can also measure the current position at predetermined intervals, download an image of a photograph of the moving direction at a point near the current position, and display the photograph of the moving direction on the image display surface.

[0080] The route guidance system according to the present invention can recognize a photographed subject while moving along a route set on a map by a user to the destination, and display a character indicating the direction to the destination. At this time, the route to the destination includes a plurality of partial routes, and it is possible to display the partial route connecting the point where the currently displayed captured image was taken and the immediately preceding point in an emphasized manner. Thereby, the user can more easily grasp the route to the destination.

[0081] The present invention relates to a route guidance system that makes it easier for a user to grasp the route to a destination. This system acquires direction information from a subject photographed while the user sets and moves along a route to the destination, generates a character image, and displays it. Also, it is possible to display the most recent partial route from the current position among a plurality of partial routes in an emphasized manner. Thereby, the user can more easily and clearly grasp the route.

[0082] The present invention relates to a route guidance program using a mobile terminal. According to the present invention, when a user sets a destination to move to, route guidance to that destination can be provided. Also, when the user is moving, by recognizing surrounding subjects and performing matching between those subjects and subjects on the map, direction information indicating the direction to the destination can be generated. Furthermore, a character generating function can generate and display a character for heading to the destination. In this way, the user can head to the destination while having fun.

[0083] The route guidance program according to the present invention includes an image recognition function for recognizing a subject, a map function for setting a destination where the user moves on a map, a character generation function for generating a character for display based on the user's position, and the character generation function is made to execute generating a character image based on difference information between the distance the user has moved and the destination, and direction information indicating the direction to the destination by performing matching between the recognized subject and the subject on the map. Also, the route guidance program according to the present invention is a program implemented on a computer.

[0084] When it is determined that the character does not exist within a predetermined determination range, the image generation unit may generate a navigation screen on which the existence direction information is displayed.

[0085] The present invention relates to a route guidance program using a mobile terminal. According to the present invention, a user can set a destination to move to and perform route guidance to the destination. Specifically, when the user moves, the position information of the user is acquired, and a character is generated based on the position information. Also, when the user moves toward the destination, the direction information of the user is acquired, and a character is generated based on the direction information. Further, when the user moves, the surrounding subjects are recognized, and by performing matching between the subjects and the subjects on the map, the direction information to be headed toward the destination can be acquired, and a character can be generated based on the direction information.

[0086] When it is set to "not preferentially display" and is in a state where the character image is to be displayed, if a touch on the character image is detected, instead of the character image, an auxiliary illustration such as an enlarged view by the navigation function can be displayed.

[0087] The present invention is also applicable to mobile terminals such as smartphones and tablet terminals. The computer is provided with a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a position information extraction and storage function for extracting and storing position information from the photographed subject, a history data creation and display function for creating and displaying history data of places visited by the user from the position information stored by the position information extraction and storage function, an interesting place extraction and display function for extracting and displaying information on places and stores that the user himself / herself is interested in from the history data created by the history data creation and display function, and a new visit place extraction and display function for extracting and displaying information on places and stores that the user has not visited from the information on the interesting places and stores extracted by the interesting place extraction and display function. The present invention relates to the technical field of "location services" including "location information", "history data", "places of interest", "new visited places", etc., and aims to provide solutions to the technical problems of "creating history data", "extracting places of interest", and "extracting new visited places" in the technical field of "location services".

[0088] The present invention is a route guidance program used in devices such as smartphones. In the present invention, a subject is recognized from a captured image, and route and direction information from the current location to the destination are calculated and displayed based on the location information. Also, when moving from the current location to the destination, an avatar or the like is used as a guide. Thus, visual route guidance, which was impossible with the prior art, is possible and highly convenient.

[0089] When there is an instruction that the user has reached a point farther from the destination, the system can also display a captured image corresponding to the point closer to the destination, which the user should target next.

[0090] When the user sets a route to the destination on the map, the route guidance system according to the present invention can recognize the captured subject while moving along the route and display a character indicating the direction to the destination. At this time, the route to the destination includes a plurality of sub-routes, and the sub-route connecting the point where the currently displayed captured image was taken and the immediately previous point can be highlighted and displayed. By doing so, the user can more easily understand the route to the destination.

[0091] The present invention relates to a route guidance system that makes it easier for a user to understand the route to a destination. After the user sets a route to the destination, this system acquires direction information from a subject photographed while moving, generates a character image from this information, and displays it. Also, the route to the destination includes a plurality of partial routes, and it is also possible to emphasize and display the partial route connecting the point where the currently displayed captured image was taken and the previous point. With these mechanisms, the user can more easily understand the route to the destination and the direction of travel.

[0092] The present invention is a system for providing route guidance when a user heads towards a destination. This system has the user carry a mobile terminal, and the mobile terminal can photograph a subject. This system recognizes the photographed subject and identifies the position of the subject on a map. Also, the user sets a target destination to move to, and provides route guidance to that target destination. At this time, a character is generated based on the user's position information, and the character indicates the direction in which it should head towards the destination. In this way, the user can receive route guidance to the destination.

[0093] A pedestrian may directly input an address or the like indicating the departure place and the destination, or may select the departure place and the destination from a map application.

[0094] When it is determined that the character is located in a first distance area, which is the distance area where the character has arrived at the destination and is closest to the user, the character control unit may determine that the user has arrived at the destination. The present invention can assist the user to move smoothly to the destination without getting lost by providing a route guidance program.

[0095] When the user arrives at the destination, it is determined whether the arrived destination is the final destination. If not, that is, if the arrived destination is an intermediate destination, the process continues towards the next destination.

[0096] The location information providing system according to the present invention includes a location information providing device for providing location information, a location information receiving device for receiving location information, and a location information using device for using location information. The location information providing device acquires information on a plurality of stores from a database including information on the stores in ascending order of proximity to the current location based on the current location received from the location information receiving device, and transmits the information on the stores to the location information receiving device. The location information receiving device receives the information on the stores and displays the information on the stores. Further, the location information using device can perform processes such as product purchase and reservation using the information on the stores.

[0097] A route guidance program having a subject recognition function, a map function, and a character generation function, which, when executed by a computer, sets a destination to which a user moves on a map, and determines the direction to head towards the destination by matching a subject photographed when the user moves with a subject on the map, and a character image is generated and displayed from the difference between the distance the user has moved and the distance to the destination. It is a route guidance program characterized by this.

[0098] The present invention relates to a route guidance program for a portable information terminal. According to the present invention, a destination to which a user holding a portable information terminal moves is set on a map, and by performing matching between the difference information between the distance the user has moved and the destination and the recognized subject and a subject on the map, a character image is generated based on the direction information to head towards the destination, thereby providing a route guidance program. Further, by a route guidance server control program, a guide route, which is the route from the departure position to the target position, is searched, and map / photo specific information for specifying map / photo information corresponding to the scenery visible in the moving direction along the guide route is created, and the route guidance can be displayed on the image display surface of the portable information terminal.

[0099] The present invention relates to a route guidance program composed of a number of elements such as shooting, recognition, display, map, and character generation controlled by a computer, and its control method, etc., and provides technical means and its realization method, etc. capable of natural route guidance under specific conditions. For example, instead of an instruction like "Go to there and turn right", an instruction like "Go to the building over there" is possible, and "the building over there" is automatically recognized from the building image captured by a camera. Also, on the way to "the building over there", an instruction like "Go to there and turn right" is also possible, and "to there" is automatically calculated from the position information obtained from GPS, etc.

[0100] The route guidance system according to the present invention includes an image storage means for storing a plurality of captured images that capture the respective scenes of a plurality of points existing on the route to the destination, a map storage means for storing a map including the destination, a target image display control means for sequentially switching and displaying the plurality of captured images stored in the image storage means in the order on the route to the destination, and a map display control means for reflecting the route connecting each of the plurality of points on the map stored in the map storage means and displaying it in association with the plurality of captured images. Further, when the plurality of points existing on the route to the destination are vending machines installed at regular intervals, the route guidance system according to the present invention can include a product information display control means for displaying product information that can be purchased from the vending machines.

[0101] The route guidance system according to the present invention includes an image storage means for storing a plurality of captured images that capture the respective scenes of a plurality of points existing on the route to the destination, a map storage means for storing a map including the destination, a target image display control means for sequentially switching and displaying the plurality of captured images stored in the image storage means in the order on the route to the destination, and a map display control means for reflecting the route connecting each of the plurality of points on the map stored in the map storage means, and is the route guidance system as described above.

[0102] The present invention can acquire position information indicating the current position of the user side measured by a GPS device via a communication network 2 by starting an application program that is owned by the user side, which is a person being guided, and is set according to a required operation, and can be connected to a guidance operator side facility via the communication network to inquire about a destination using message data including voice for the operator and image data such as GPS (photo) indicating the position information. It comprises a wireless mobile phone, and a police box server computer installed in the guidance operator side facility and having a function of being operated by the operator to search for a route including a destination selected and registered in advance by a knowledgeable person familiar with the destination information from map information including specific information about the destination and other incidental information for providing information in response to an inquiry about the destination from the user side and downloading it to the user side via the communication network 2. And the present invention provides a route guidance system and a method thereof capable of extracting facility information such as stores existing on the route to the destination queried from the user side and other incidental information from the map information downloaded by the police box server computer and providing them to the user side using these facility information and incidental information.

[0103] A program for a computer, which has a photographing function for controlling a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a route guidance function for displaying route guidance information such as the distance and direction to a target point where the user holding the mobile terminal moves, a character generation function for displaying a character image or animation generated from the position and movement direction of the user on the display function, and the character generation function can generate and display a character image or animation from the distance and direction the user has moved.

[0104] The present invention relates to a route guidance program for a mobile information terminal. The route guidance program of the present invention causes the mobile information terminal to determine whether it has passed a point before a turning point for each positioning. When the mobile information terminal determines that it has passed a point before a turning point, the mobile information terminal is made to access a map / photo information providing server to download an image of a photo of the moving direction at a point one ahead of the point before the turning point, and the image of the photo of the moving direction at a point one ahead of the point before the turning point can be displayed on the image display surface.

[0105] In an embodiment of the present invention, when a user holding a mobile terminal sets a destination, route guidance for heading to the destination can be performed. At this time, a subject is photographed by a photographing function, and the subject is recognized by an image recognition function. Then, matching is performed between the destination set on the map and the subject, and direction information for heading to the destination is acquired. Based on this direction information, a character image is generated by a character generation function and displayed to perform route guidance. Also, a character image is generated from difference information between the distance the user has moved and the destination and displayed to perform route guidance. Furthermore, it is possible to acquire and present map information including a route to the destination from the position information of the current position acquired from a GPS device or from the nearest house number, building, etc. notified by an operator.

[0106] The present invention utilizes the latest technologies such as subject recognition technology and GPS technology, and can provide a more accurate route guidance service than before. Also, the present invention can be realized by a Java (registered trademark) application program or the like and can be used by many users.

[0107] The route guidance method according to the present invention includes a route guidance device, a user terminal, and a database server. The route guidance device includes a position information acquisition unit, an image capturing unit, an image analysis unit, and a route guidance information generation unit. The user terminal includes a display unit. The database server includes a database. The position information acquisition unit acquires the latitude and longitude of the current position of the route guidance device. The image capturing unit captures the scenery at the position based on the latitude and longitude acquired from the position information acquisition unit. The image analysis unit extracts a landmark point from the captured image. The route guidance information generation unit generates a route to the destination.

[0108] In the present invention, by having the "character" move based on information such as "direction to the destination" and "distance", the "direction to the destination" and "distance" are clearly expressed. Also, by having the "character" move in matching with the "recognized subject", it becomes easy to show how to proceed "from the location where the recognized subject is" to "the destination".

[0109] The present invention relates to a system for providing route guidance when a user is heading towards a destination. This system is controlled by a mobile terminal held by the user. This system has a function of photographing a subject, an image recognition function, a display function, a map function, and a character generation function. The character generation function can generate an image of a character based on the difference information between the distance the user has moved and the target location, and by matching the recognized subject with the subject on the map, based on the direction information towards the target location. The relative azimuth angles of each candidate evacuation location are displayed on the screen.

[0110] They are listed in order from the one with the shortest straight-line distance from the current position to the candidate evacuation location, and are displayed in the form of "straight-line distance from the current position to the candidate evacuation location", "straight-line distance from the current position to the candidate evacuation location", "straight-line distance from the current position to the candidate evacuation location".

[0111] The present invention relates to a system for providing route guidance when a user travels towards a destination. This system operates under computer control, acquiring and processing a number of parameters such as the current position and direction of travel from information obtained from a number of sensors such as a camera for photographing subjects and a camera for image recognition, as well as GPS information.

[0112] The present invention relates to a route guidance program for a portable information terminal. The route guidance program of the present invention causes the portable information terminal to determine whether it has passed a point in front of a turning point for each positioning. When the portable information terminal determines that it has passed a point in front of a turning point, the portable information terminal is made to access a map and photo information providing server to download an image of a photo of the moving direction at a point one ahead of the point in front of the turning point, and the image of the photo of the moving direction at a point one ahead of the point in front of the turning point can be displayed on the image display surface.

[0113] The route guidance program according to the present invention is provided as an application installed in a portable terminal. The user starts the route guidance program by possessing the portable terminal and setting a destination. The route guidance program uses the camera of the portable terminal to photograph the surrounding scenery and recognizes the subject by image recognition technology. Matching is performed between the recognized subject and landmarks on the map to determine the landmark for direction display. An image of a character is generated based on the landmark for direction display to indicate the direction in which the user should travel towards the destination. Also, the remaining distance is calculated and displayed from the distance the user has traveled and the distance to the destination.

[0114] A route guidance program for causing a computer to realize a photographing function for controlling a portable terminal that photographs a subject, an image recognition function for recognizing the subject, an information acquisition function for acquiring information related to the photographed subject, a display function for displaying information related to the subject based on the information acquired by the information acquisition function, a group information display function for determining a group to which the subject belongs from the information acquired by the information acquisition function and displaying information related to the group, and the group information display function is characterized in that it is displayed in different colors, shapes, etc. for each category to which the group belongs. In the present invention, the "subject" includes not only artificial objects such as buildings and signboards but also natural objects. The route guidance program according to the present invention operates on a portable terminal such as a smartphone and provides route guidance to a destination and surrounding information to the user. The user photographs the surrounding scenery, buildings, etc. (hereinafter referred to as "subjects") with the camera of a smartphone or the like, and this program automatically acquires and displays information related to the subjects (for example, store names, business hours, etc.) and groups (for example, restaurant groups, etc.). Also, by being displayed in different colors, shapes, etc. for each "group", the visual effect is enhanced.

[0115] The present invention provides a route guidance program that enables a user to reach a destination without getting lost by causing a portable information terminal to measure the current position of the portable information terminal at predetermined time intervals, causing the portable information terminal to access a map and photo information providing server to download an image of a photograph in the moving direction at a point near the current position, and displaying the photograph in the moving direction on the image display surface of the portable information terminal.

[0116] A route confirmation button is displayed on the image display surface of the mobile information terminal. When the user of the mobile information terminal clicks the route confirmation button, the mobile information terminal is made to access a map / photo information providing server to sequentially download photos at each point in the traveling direction and display them on the image display surface of the mobile information terminal. Also, the route guidance program acquires the position information of the mobile information terminal and calculates the distance between the current location and the destination. Then, when the distance to the destination becomes a certain value or less, a destination arrival message is displayed. Further, when the distance to the destination is a certain value or more, a character corresponding to the traveling direction is displayed by the route guidance program.

[0117] The route guidance program may also adopt a method of guiding to a place where public transportation means such as the nearest station or bus stop where public transportation means are available on the route from the current location to the destination, and then guiding to the destination by public transportation means from there. Also, the route guidance program may adopt a method of guiding in multiple patterns such as the shortest route or the optimal route from the current location to the destination so that there are options.

[0118] The central processing unit determines to preferentially display the actual scene guidance image when the inclination of the shooting direction of the camera is within a predetermined range with respect to the horizontal plane, and determines to preferentially display the map guidance image when the inclination of the shooting direction of the camera is outside the predetermined range with respect to the horizontal plane.

[0119] The route guidance program according to the present invention includes a map function for setting a destination to which a user moves, an image recognition function for recognizing a subject, a display function for displaying the photographed subject, a character generation function for generating a character, and an image generation unit for generating an image of the character. The character generation function generates an image of the character based on the direction information to be headed for the destination by performing matching between the difference information between the distance the user has moved and the destination and the recognized subject and the subject on the map. Further, when it is determined that the character is located within a predetermined determination range provided based on the user's visual field range on the map and the character is located in the right side area of the head direction or the line-of-sight direction, the image generation unit may generate a navigation image displaying the character at the image position on the right side image area.

[0120] The route guidance program according to the present invention is executed in the following procedure. That is, the photographing function photographs the subject, the image recognition function recognizes the subject, the display function displays the subject, the map function sets the destination of the user, the character generation function generates a character image from the position information of the user, calculates the direction information from the difference information, changes the character image from the direction information and displays it on the display screen, and when the user moves, recalculates the direction information from the difference information, changes the character image, and displays it on the display screen. The list numbers correspond to the "Examples" in the "Detailed Description of the Invention".

[0121] The mobile information terminal according to the present invention has the following functions. That is, an artificial intelligence function, a position information detection function, a direction detection function, a photographing function, an image recognition function, a map information recording function, a destination setting function, a route calculation function, a display function for displaying images, recognizes the image taken by the photographing function with the image recognition function, inputs information regarding the recognized image, the photographing direction of the photographing function detected by the direction detection function, the map recorded in the map information recording function, the set destination, and the calculated route into the artificial intelligence function, the artificial intelligence function calculates the direction to the destination, and a destination direction display function for displaying the direction on the image being photographed or on the map displayed by the display function; a character generation display function for generating and displaying a character using the artificial intelligence function; a route guidance display function for simultaneously displaying the photographed image or map, the destination, the route, and the generated character on the display function; and a display selection function for the artificial intelligence function to select whether to display based on the image being photographed or based on the map according to the photographed image, the past usage history of the user, the type of destination, and the characteristics of the destination area.

[0122] The character generation display function can generate a completely new character based on information such as the photographed image, the past usage history of the user, the type of destination, and the characteristics of the destination area. Also, the character generation display function can change the character display generated according to the situation. For example, functions including changing based on the distance to the destination, the subject recognized in the image being photographed, the relative number of steps to the destination, calorie consumption, or water replenishment amount, the position of the turning angle on the route, the advertisement publication information on the route, the weather and time situation information during route guidance, the direction information detected by the direction detection function, the tourism information related to the points on the route, the voice received from the user, etc. are included.

[0123] By changing the character display according to the distance to the destination, the user can be made aware that they are approaching the destination, and the tension can be increased. By changing the character display according to the subject recognized in the image during shooting, the user can be made aware of the existence of landmarks or interesting shops, making the route guidance enjoyable. By changing the character display according to the relative number of steps, calorie consumption, or water replenishment amount to the destination, the user can be guided along the route in a game-like manner. By changing the character display according to the position of the turning point on the route, the user can be strongly aware of the existence of the turning point. By changing the character display according to the advertisement publication information on the route, the user can be made aware of the existence of the advertisement. By changing the character display according to the weather or time situation information during route guidance, the user can be given the freedom to choose actions that speed up or slow down the travel time to the destination. By changing the character display according to the direction information detected by the direction detection function, it is possible to convey to the user whether they are heading in the correct direction. By changing the character display according to the tourism information related to the points on the route, the tourism information can be efficiently conveyed to the user. Finally, by changing based on the voice or the like received from the user, the user's intention can be reflected in the route guidance.

[0124] Figure 1 is a schematic diagram showing a function in which a character (cat) according to the present invention is superimposed on an image being photographed by a portable information terminal to provide route guidance.

[0125] Figure 2 is a drawing showing each function and component included in the portable information terminal 1 according to the present invention. That is, the CPU 2 includes an artificial intelligence function, an image recognition function, a destination setting function, a route calculation function, a destination direction display function, a character generation display function, a route guidance display function, and a display selection function. The GPS module 2 includes a position information detection function, the azimuth sensor 3 includes a direction detection function, the camera 4 includes a photographing function, the memory 5 includes a map information recording function and other recording functions, and the display 6 includes a display function.

[0126] Figure 3 is a drawing showing a method of identifying the current location and the direction the shooting function is facing by matching the information on the convenience store signboard where the shooting direction during the shooting function is recognized through image recognition with the positional relationship of the convenience store on the map using the artificial intelligence function.

[0127] Figure 4 is a drawing illustrating how the artificial intelligence function generates a character using artificial intelligence.

[0128] Figure 5 is a drawing illustrating how the artificial intelligence function uses a display selection function to select whether to display based on the image during shooting or based on the map.

Claims

【Claim 1】 A computer is caused to have a photographing function for photographing a mobile terminal, a display function for displaying an image obtained by the photographing, a function for positioning the current position of the mobile terminal by GPS, a map function for setting, on a map, a destination to which a user holding the mobile terminal moves, a direction display function for calculating and displaying direction information from the current position to the destination and a character generation function for generating by superimposing a character for route guidance on the image, changing the character display according to the distance to the destination, changing it based on the direction information, and generating the character to dance cheerfully as it approaches the destination. A route guidance program for realizing the above is provided.

Images