Information processing system, information processing method, and program

Abstract

In a CPU 11 of a management server 1, an information management unit 31 manages movement assistance information, which is output toward a first user moving in a prescribed region and is for assisting the movement of the first user, in a manner such that the movement assistance information is associated with a prescribed site in the prescribed region. When the first user approaches the prescribed site, a transmission control unit 36 performs control for transmitting control information for outputting the movement assistance information, which has been associated with the prescribed site, toward the first user. The movement assistance information is generated on the basis of the natural voice of a second user having a prescribed relationship with the first user and / or the prescribed region.

Description

Information processing system, information processing method, and program

[0001] The present invention relates to an information processing system, an information processing method, and a program.

[0002] 2. Description of the Related Art There is known a technique for outputting voice information for route guidance from a mobile terminal carried by a moving user (see, for example, Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2015-034777

[0004] Such technology, which relies on map display, can be very difficult to use for people with spatial cognitive impairment or those who have difficulty reading maps. Therefore, solutions for people with spatial cognitive impairment will be very easy to use for the general public. Furthermore, for people with spatial cognitive impairment, "independence" is an important element, and to achieve independence, they must be able to reach their destination on their own. In this case, the following four issues must be resolved.

[0005] The first issue is safety. Because working memory is primarily affected, hyperconcentration and simultaneous tasks present challenges. Hyperconcentration also makes it difficult to consider those around you. Those who struggle with simultaneous tasks also face challenges, such as difficulty managing multiple visual fields and tasks. Spatial awareness is also a challenge, exacerbating the danger posed by difficulty grasping three-dimensional distances, such as differences between left and right and front and back. As a result, issues arise with people, cars, and road shapes. This is due to the visual challenges of simultaneously handling simultaneous tasks, as well as the difficulty of processing simultaneous tasks through touch and hearing. Therefore, information must be provided in a way that takes into account the user's safety concerns. Once a destination is set, users are preoccupied with arriving at their destination, making it difficult to consider those around them. Visual displays, in particular, not only lack visual space, but also make it difficult to balance their thoughts with the information around them. While touch and hearing are available for presentations when the user's field of vision is focused on the scenery, even touch can provide excessive support. For example, if you receive an instruction to turn right and try to move in that direction, but your working memory is unable to handle both tasks simultaneously, you will simply move your body in the direction presented by the tactile stimulus without considering your surroundings.On the other hand, if the information you receive through your ears is just a fixed, impersonal guide to the left and right, you will only listen to the voice and focus your attention solely on turning left or right, which will also cause excessive concentration of your working memory, and there remains a problem that must be solved even when it comes to information received through your ears.

[0006] The second challenge is reaching one's destination. Disabilities such as topographical disorientation can make it difficult for individuals to remember and forget scenery. Furthermore, visual field deviations and a narrower field of view can also affect the visual field. Therefore, actions such as looking at a display can limit the visual field's focus on the scenery, further hindering memorization. To help individuals memorize scenery, ensure safety, and provide a sense of security, approaches that utilize various sensory information, such as visual and auditory information, as well as smell and touch, can help prevent overfocus while moving. When viewing electronic information on a screen, such as a map or display, individuals struggle to convert from two-dimensional to three-dimensional, and they also struggle with their physical sense of direction, making it difficult to arrive at their destination. However, whether AR glasses can solve this problem poses challenges, such as overfocus and the technical difficulty of correcting the field of view. Furthermore, overly detailed guidance that accurately controls one's position and stays in the right place can give too much of the answer and lead to excessive reliance on it. In particular, for those who are facing the challenge of independence, this can result in impeding independence, as they are required to make decisions and remember things as much as possible on their own. To solve this, support is needed to help them naturally move towards independence so that they can make their own decisions.

[0007] The third issue is security. People tend to become anxious when they are alone, so it is necessary to solve the problem of this tendency to become anxious when someone they can trust is not always nearby. Even if people are able to go out alone, there are currently methods for constantly transforming someone into another entity, such as physical robots, virtual robots using video technology, or autonomously controlled systems using AI that present virtual information through auditory and other means. Even if an accurate presence is presented, the person concerned will have a problem determining whether they can safely entrust themselves to that entity. In particular, with regard to AI, the issue of impersonation remains a challenge, and it is already beyond the realm of what humans can decide on their own.

[0008] The fourth issue is desire. Going out requires motivation, and the content that stimulates that motivation needs both temporary and long-term content. Having this will change your psychology, making you want to go out, walk, or go out alone.

[0009] The present invention was made in light of this situation, and aims to enable users moving around a specific area to feel as if they are being guided by someone who understands them or the place they are in, and to provide support from both guide helpers and tour guides in the form of an unmanned navigation system to resolve the shortage of human resources and to continuously preserve and utilize local memory information, using digital technology in the form of a "navigation guide" (a term coined by the present invention combining navigation and guide) so that the provider can clearly understand it.

[0010] In order to achieve the above-mentioned object, one aspect of the present invention is an information processing system comprising: a management means for managing travel assistance information to assist the travel of a first user moving within a specified area, the travel assistance information being output to the first user in association with a specified point in the specified area; and an audio output means for outputting the travel assistance information associated with the specified point to the first user when the first user approaches the specified point, wherein the travel assistance information provides guidance by providing information on scenery visible at the first user's destination, the information being generated based on the voice of a second user who has a specified relationship with at least one of the first user and the specified area.

[0011] An information processing device, an information processing method, and a program corresponding to the information processing system according to one aspect of the present invention are also provided as an information processing device, an information processing method, and a program corresponding to the information processing system according to one aspect of the present invention.

[0012] According to the present invention, a user moving through a predetermined area can have the feeling that someone who understands him or her or the place where he or she is is guiding him or her there.

[0013] 1 is a diagram illustrating an example of the overall configuration of an information processing system. FIG. 2 is a block diagram illustrating an example of the hardware configuration of a management server. FIG. 3 is a functional block diagram of a management server and a user terminal. FIG. 4 is a flowchart illustrating an example of generation and extraction of travel assistance information. FIG. 5 is a flowchart illustrating an example of processing of a user terminal. FIG. 6 is a diagram illustrating an overview of a service to which the information processing system is applied. FIG. 7 is a diagram illustrating an overview of a service to which the information processing system is applied. FIG. 8 is a diagram illustrating an example of a user interface. FIG. 9 is a diagram illustrating an example of a user interface. FIG. 10 is a diagram illustrating an example of a user interface. FIG. 11 is a diagram illustrating an example of a user interface. FIG. 12 is a diagram illustrating an example of priority control. FIG. 13 is a diagram illustrating an example of priority control.

[0014] The present embodiment will be described below with reference to the drawings. <Information Processing System> Fig. 1 is a diagram showing an example of the overall configuration of an information processing system S according to the present embodiment. The information processing system S manages travel assistance information (e.g., audio information) for supporting the travel of a first user (a person receiving travel assistance) who is traveling within a predetermined area and is output to the first user among users using the information processing system S, in association with a predetermined point in the predetermined area. When the first user approaches the predetermined point, the information processing system S outputs to the first user travel assistance information that is easily visible in a panoramic view of the destination that the first user tends to be interested in and that is managed in association with the predetermined point.

[0015] The predetermined area is an area in which the first user can travel by foot or by various means of transportation. For example, the first user's residential area, a destination the first user will visit for the first time, or a destination the first user has visited but has not yet fully solidified in their memory are all examples of a "predetermined area." Any point within the predetermined area can be considered a "predetermined point." For example, if the "predetermined area" is the first user's residential area, intersections frequently used by the first user in daily life and schools the first user attends are both examples of "predetermined points." Furthermore, if the "predetermined area" is a destination the first user will visit, building information such as hotels, restaurants, shrines, and temples that can be seen at the first user's destination, road features, road surfaces, and signs are all examples of "predetermined points" that are easily visible in the scenery.

[0016] The travel assistance information is information generated based on the actual voice of a second user who has a predetermined relationship with at least one of the first user and the predetermined area, or learning information analyzed and generated by AI based on the actual voice information. In this embodiment, an example will be described in which the travel assistance information output is voice information. The predetermined relationship is a relationship between the first user and at least one of the predetermined area, such as a family relationship (between users), a kinship relationship, assistance or support, or a relationship in which the parties know each other, such as friends and acquaintances. The predetermined relationship also includes a relationship between a person who becomes acquainted at a destination and someone who can navigate and guide the destination, as well as a relationship in which the parties have common or similar hobbies, generations, ideas, social status, etc.

[0017] The information processing system S is configured by connecting a management server 1 and user terminals 2-1 to 2-n (n is an integer equal to or greater than 1) via a network N. The network N is, for example, the Internet, a LAN (Local Area Network), or a VPN (Virtual Private Network). Hereinafter, when there is no need to explain each of the user terminals 2-1 to 2-n individually, they may be collectively referred to as the "user terminal 2."

[0018] (Management Server 1) The management server 1 is an information processing device that manages the entire information processing system S. The management server 1 acquires various types of information transmitted from the user terminal 2 and from the outside, and is capable of performing various processes. The management server 1 is also capable of transmitting various types of information to the user terminal 2 and the outside.

[0019] For example, the management server 1 stores and manages in a database questions for generating travel assistance information, which questions relate to at least one of a first user and a predetermined location. For example, the management server 1 manages, as questions about the first user, questions relating to at least one of information indicating the attributes of the first user and information indicating the relationship between the first user and a user who created the travel assistance information (hereinafter referred to as a "third user").

[0020] A "third user" is treated as a "second user" if it has a predetermined relationship with the predetermined area or the first user. That is, the users (third users) who have created travel assistance information include users (second users) who have a predetermined relationship with the predetermined area or the first user, and users who do not have a predetermined relationship.

[0021] The information indicating the attributes of the first user is information about the first user (hereinafter referred to as "first user information"), such as objective information about the first user, such as the age, gender, and social status of the first user, and subjective information about the first user, such as the hobbies, thoughts, and personality of the first user. Furthermore, the "information indicating the relationship between the first user and the third user" is, for example, objective information about the relationship between the first user and the third user, and subjective information about the impression of the first user from the third user.

[0022] Furthermore, for example, the management server 1 manages questions regarding information indicating attributes of a predetermined location as questions regarding the predetermined location. Information indicating attributes of a predetermined location includes, for example, the country or region, climate, season, date and time, scenery, and characteristics of surrounding structures. Note that the data format of the questions managed by the management server 1 is not particularly limited. For example, the questions may be in the form of audio information or text information.

[0023] The management server 1 transmits predetermined control information to the user terminal 2 of the third user. Specifically, for example, if the data format of the question is audio information, the management server 1 transmits control information for outputting the question from a speaker, earphones, or the like of the user terminal 2 of the third user. Furthermore, for example, if the data format of the question is text information, the management server 1 transmits control information for displaying the question on a display, or the like, of the user terminal 2 of the third user.

[0024] The control information is information for causing the user terminal 2 of the third user to output a question stored and managed in a database at a predetermined timing, and this control information may include information regarding the timing of outputting the question. Examples of such control information include control information for causing the third user to output a question when the third user approaches a predetermined point, control information for causing the third user to output a question when the third user has moved a predetermined distance, and control information for causing the third user to output a question when a predetermined time has elapsed. Whether the third user has approached the predetermined point is determined, for example, from the location information of the predetermined point and information indicating the third user's current location.

[0025] The management server 1 also generates travel assistance information. Specifically, when audio information recording the third user's actual voice response to a question is transmitted from the third user's user terminal 2, the management server 1 generates travel assistance information based on the audio information. After generating the travel assistance information, the management server 1 associates the travel assistance information with a predetermined point in a predetermined area, stores the information in a database, and manages it.

[0026] Furthermore, the management server 1 manages the travel assistance information in association with information about the third user who created the travel assistance information (hereinafter referred to as "third user information"). The third user information includes, for example, identification information (e.g., a user ID) that can uniquely identify the third user, and information indicating the attributes of the third user. The information indicating the attributes of the third user includes, for example, the third user's name, captured image, address, age, gender, educational background, occupation, hobbies, thoughts, social status, etc.

[0027] When the user terminal 2 of the moving first user approaches a predetermined point, the management server 1 causes the first user's user terminal 2 to output travel assistance information that is managed in association with the predetermined point. Specifically, the management server 1 transmits control information for outputting the travel assistance information to the user terminal 2 of the first user.

[0028] When input information for outputting second user information is transmitted from the user terminal 2 of the first user, the management server 1 extracts a user corresponding to the second user from among the third users and outputs the extracted information to the user terminal 2 of the first user. Whether or not a user corresponds to the second user is determined based on the information related to the predetermined area and the commonalities and similarities between the first user information and the third user information.

[0029] For example, suppose the first user is an elementary school student or an elderly person, and the third users include the first user's family members (e.g., mother, father, children, grandchildren, etc.) and friends, or other related parties who are familiar with the first user. In this case, the management server 1 extracts the third users, including the first user's family members (e.g., mother, father, children, grandchildren, etc.), who are familiar with the first user, as second users, and outputs their recorded voices as second user information to the first user's user terminal 2. Furthermore, suppose the first user is a visitor to a predetermined area, and the third users include three users (e.g., people familiar with the area) who created mobility assistance information related to the predetermined area. In this case, the management server 1 extracts the three third users as second users and outputs them as second user information to the first user's user terminal 2.

[0030] When information indicating a second user designated by a first user (hereinafter referred to as "designation information") is transmitted from the user terminal 2, the management server 1 extracts travel assistance information created by the second user identified by the designation information. Then, when the user terminal 2 of the first user approaches a predetermined point in a predetermined area, the management server 1 transmits control information for causing the user terminal 2 to output the extracted travel assistance information to the first user. The transmitted travel assistance information is linked to the predetermined point from a speaker, earphone, or the like of the user terminal 2 of the first user, and audio information from the recorded voice is output. The specific configuration and processing of the management server 1 will be described in detail below.

[0031] (User Terminal 2) The user terminal 2 is an information processing device operated by a user who uses the information processing system S, and is configured, for example, as a smartphone, a tablet terminal, etc. Dedicated application software that enables use of the information processing system S is installed on the user terminal 2.

[0032] Based on user operation, the user terminal 2 activates dedicated application software that enables use of the information processing system S, enabling it to acquire various types of information transmitted from the management server 1 and from the outside. The user terminal 2 also performs various processes based on the acquired information and information input by user operation. The user terminal 2 also transmits various types of information to the management server 1 and to the outside.

[0033] For example, the user terminal 2 of the first user accepts an input operation for displaying second user information or an input operation for specifying the second user, and transmits the input information to the management server 1. The user terminal 2 of the first user also acquires travel assistance information generated by the management server 1, stores it in a database, and manages it. Then, when the user terminal 2 approaches a predetermined point, it outputs the travel assistance information to the first user.

[0034] Furthermore, the user terminal 2 of the first user outputs audio information (hereinafter referred to as "judgment support information") to support the first user in determining the orientation. For example, the user terminal 2 of the first user may output, as the judgment support information, audio messages recorded from sound effects and human voices, or voice synthesis technology as the main components, as well as information that can be used to judge support as tactile sensations that allow intuitive recognition of movement judgments or other bodily sensations.

[0035] Furthermore, for example, the user terminal 2 of the third user acquires a question generated by the management server 1 regarding at least one of information about the scenery that is estimated to be visible from the first user and a predetermined location, and outputs the question to the third user. The user terminal 2 of the third user also records the third user's real voice response to the question, and transmits the voice information to the management server 1. The specific configuration and processing details of the user terminal 2 will be described later.

[0036] The above-described processing by each of the management server 1 and the user terminal 2 that constitute the information processing system S is an example, and it is sufficient if the information processing system S as a whole has the function of realizing the above-described processing. Therefore, some or all of the functions that realize the above-described processing may be shared or cooperated within the information processing system S.

[0037] For example, some or all of the functions of the management server 1 may be functions of another information processing device (e.g., the user terminal 2) in the information processing system S, or some or all of the functions of another information processing device in the information processing system S may be functions of the management server 1. Furthermore, some or all of the functions of the management server 1 may be transferred to another server (not shown). This promotes processing in the information processing system S as a whole and also enables processes to complement each other.

[0038] 2 is a block diagram showing an example of the hardware configuration of the management server 1 according to this embodiment. The management server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20.

[0039] The CPU 11 executes various processes in accordance with programs recorded in the ROM 12 or programs loaded from the storage unit 18 into the RAM 13. The RAM 13 also stores data and the like required for the CPU 11 to execute various processes. The CPU 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output interface 15 is also connected to this bus 14.

[0040] The input / output interface 15 is connected to an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20. The output unit 16 is composed of a display, a speaker, etc., and outputs various types of information as images and sounds. The input unit 17 is composed of a keyboard, a mouse, a touch panel, etc., and accepts input of various types of information. The storage unit 18 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various types of data. The communication unit 19 communicates with other devices via a network N including the Internet.

[0041] Removable media 21, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, is appropriately attached to the drive 20. Programs read from the removable media 21 by the drive 20 are installed in the storage unit 18 as needed. The removable media 21 can also store various data stored in the storage unit 18 in the same way as the storage unit 18. Although not shown, it is assumed that the user terminal 2 has the hardware configuration shown in FIG. 2.

[0042] <Functional Configuration> Figure 3 is a functional block diagram showing an example of the functional configuration of the management server 1 and the user terminal 2. Details of each functional block will be described below. (Functional Configuration of Management Server 1) When the CPU 11 of the management server 1 operates, an information management unit 31, a location identification unit 32, an acquisition unit 33, an extraction unit 34, a generation unit 35, and a transmission control unit 36 ​​function. In addition, the storage unit 18 of the management server 1 is provided with a user DB 41 in which user information is stored, a question DB 42 in which questions to be output to third users are stored, and a support information DB 43 in which travel support information is stored.

[0043] The information management unit 31 stores and manages various types of information in a database. For example, the information management unit 31 stores and manages user information in a user DB 41 of the storage unit 18. The information management unit 31 also stores and manages questions output to a third user in a question DB 42 of the storage unit 18. Specifically, the information management unit 31 manages, as questions about the first user among questions output to a third user, questions related to at least one of information indicating the attributes of the first user and information indicating the relationship between the first user and the third user. The information management unit 31 also manages, as questions about a predetermined location among questions output to a third user, questions related to information indicating the attributes of the predetermined location. The information management unit 31 also associates travel assistance information with predetermined locations in a predetermined area, and stores and manages the information in the assistance information DB 43 of the storage unit 18.

[0044] The location identification unit 32 identifies the current location of the user. For example, the location identification unit 32 identifies the current location of the user based on the user's GPS (Global Positioning System) or GNSS (Global Navigation Satellite System) information.

[0045] The acquisition unit 33 acquires various types of information. For example, the acquisition unit 33 acquires various types of information transmitted from the user terminal 2. Examples of the information transmitted from the user terminal 2 include audio information recorded as an answer to a question transmitted from the user terminal 2 of the third user, and input information transmitted from the user terminal 2 of the first user for displaying second user information on the user terminal 2 of the first user.

[0046] The extraction unit 34 extracts a user corresponding to the second user from among the third users. Specifically, the extraction unit 34 extracts a user corresponding to the second user from among the third users based on the commonality or similarity between the information related to the predetermined area and the first user information and the third user information.

[0047] The generation unit 35 generates the travel assistance information. Specifically, the generation unit 35 generates the travel assistance information based on audio recording information that records the answers of the third user's voice to questions regarding at least one of the first user and the predetermined location.

[0048] The transmission control unit 36 ​​controls the transmission of various types of information. Specifically, the transmission control unit 36 ​​controls the transmission of various types of information via the communication unit 19 to the user terminal 2 and to the outside. For example, the transmission control unit 36 ​​controls the transmission of control information for causing the user terminal 2 of the third user to output a question for generating travel assistance information. The transmission control unit 36 ​​also controls the transmission of control information for causing the user terminal 2 of the first user to output the generated travel assistance information. Note that the transmission control unit 36 ​​may transmit control information that vibrates the user terminal 2 before outputting the travel assistance information. This serves as a signal to the first user that travel assistance information is about to be output, and also has the effect of making the travel assistance information easier to understand.

[0049] (Functional Configuration of User Terminal 2) When the CPU of the user terminal 2 is operating, an acquisition unit 51, an information management unit 52, an audio output control unit 53, a display control unit 54, a recording control unit 55, and a transmission control unit 56 function. In addition, the storage unit of the user terminal 2 is provided with an assistance information DB 61 in which travel assistance information is stored. Note that it is not necessary for all of the functional units in the user terminal 2 to be provided in the same terminal; for example, only some of the above-mentioned functional units may be provided in the user terminal 2-1.

[0050] The acquisition unit 51 acquires various types of information. For example, the acquisition unit 51 acquires input information accepted by the input unit. Examples of the input information accepted by the input unit include information input to display second user information and information input to specify the second user. The acquisition unit 51 also acquires audio information of the third user's actual voice, recorded under the control of the recording control unit 55 (described later). The acquisition unit 51 also acquires various types of information transmitted from the management server 1 and from the outside. For example, the acquisition unit 51 acquires control information transmitted from the management server 1 for outputting various types of information from various output devices, such as speakers, earphones, and displays, of the output unit. Among these, examples of information output from audio output devices, such as speakers and earphones, include audio information of questions regarding at least one of the first user and a specified location, travel assistance information, and decision assistance information. Examples of information displayed on an image output device, such as a display, and information output as audio information, such as voice synthesis, include, for example, a user interface, text or audio information of questions related to information visible in a specified area, regarding at least one of the first user and a specified location, and the like.

[0051] The information management unit 52 stores and manages various types of information in a database. For example, the information management unit 52 associates travel assistance information with predetermined points in a predetermined area, and stores and manages the information in an assistance information DB 61 of the storage unit.

[0052] The audio output control unit 53 controls the output of various types of audio information from the output unit. For example, the audio output control unit 53 controls the output of audio information of a question regarding at least one of the first user and a predetermined location from a speaker or earphone of the output unit to a third user. The audio output control unit 53 also controls the output of travel support information and judgment support information from the speaker or earphone of the output unit to the first user.

[0053] The display control unit 54 controls the display of various types of information on the display of the output unit, etc. For example, the display control unit 54 controls the display of a user interface of dedicated application software that enables use of the information processing system S. The display control unit 54 also controls the display of audio information of a question regarding at least one of the first user and a predetermined location on the display of the output unit, etc.

[0054] The recording control unit 55 controls the recording of the third user's voice response to a question regarding at least one of the first user and the predetermined location. Specifically, the recording control unit 55 controls the storage of audio information, which is the third user's voice response to the question, in the storage unit.

[0055] The transmission control unit 56 controls the transmission of various types of information to the management server 1 and to the outside via the communication unit. For example, the transmission control unit 56 controls the transmission of various types of input information to the management server 1. Examples of the input information transmitted to the management server 1 include information input to display second user information and information input to specify the second user. The transmission control unit 56 also controls the transmission of recorded voice information to the management server 1. Examples of the voice information transmitted to the management server 1 include voice information that is a response in the voice of the third user to a question regarding at least one of the first user and a predetermined location.

[0056] <Processing Flow> (Travel Support Information Generation Process (Management Server 1)) Fig. 4(A) is a flowchart showing an example of the flow of the processing of the management server 1 up to the generation of travel support information. The management server 1 stores and manages a question to be output to the third user in a database (Step S1). At a predetermined timing (YES in Step S2), the management server 1 causes the user terminal 2 of the third user to output a question to the third user (Step S3). On the other hand, if it is not the predetermined timing (NO in Step S2), the determination process of Step S2 is repeated until the predetermined timing.

[0057] When the voice information of the third user's answer to the question output in step S3 is transmitted (YES in step S4), the management server 1 acquires the voice information (step S5). On the other hand, when the voice information of the third user's answer to the question output in step S3 is not transmitted (NO in step S4), the management server 1 repeats the determination process of step S4 until the voice information of the third user's answer to the question is transmitted.

[0058] The management server 1 then generates travel assistance information based on the acquired voice information (step S6), associates the travel assistance information with a predetermined point in the predetermined area, and stores and manages the information in a database (step S7).The management server 1 also associates the travel assistance information generated in step S6 with third user information of the third user who created the travel assistance information and manages the information (step S8).

[0059] (Travel Support Information Extraction Process (Management Server 1)) Fig. 4(B) is a flowchart showing an example of the flow of the process of the management server 1 up to the extraction of travel support information. When input information for displaying second user information is transmitted from the user terminal 2 of the first user (YES in step S11), the management server 1 extracts a user corresponding to the second user from among the third users (step S12) and displays information about that user as second user information on the user terminal 2 of the first user (step S13). On the other hand, if input information for displaying second user information has not been transmitted (NO in step S11), the management server 1 repeats the determination process of step S11 until input information for displaying second user information is transmitted.

[0060] When designation information indicating the second user designated by the first user is transmitted from the user terminal 2 (YES in step S14), the management server 1 acquires the designation information (step S15) and extracts travel support information based on the voice of the designated second user (step S16). On the other hand, if designation information has not been transmitted from the user terminal 2 (NO in step S14), the management server 1 repeats the determination process of step S14 until designation information is transmitted from the user terminal 2.

[0061] When the user terminal 2 of the moving first user approaches a predetermined point (YES in step S17), the management server 1 causes the user terminal 2 to output the travel support information managed in association with the predetermined point to the first user (step S18). On the other hand, when the user terminal 2 of the first user is not approaching the predetermined point (NO in step S17), the management server 1 repeats the determination process of step S17 until the user terminal 2 of the first user approaches the predetermined point.

[0062] 5A is a flowchart showing an example of the processing flow of the user terminal 2 of the first user. When an input operation for displaying the second user information is performed (YES in step S21), the user terminal 2 of the first user accepts the input operation (step S22) and transmits the input information to the management server 1 (step S23). On the other hand, if an input operation for displaying the second user information is not performed (NO in step S21), the user terminal 2 of the first user repeats the determination processing of step S21 until an input operation for displaying the second user information is performed.

[0063] When an input operation to designate a second user is performed (YES in step S24), the user terminal 2 of the first user accepts the input operation (step S25) and transmits the input information to the management server 1 (step S26). On the other hand, if an input operation to designate a second user is not performed (NO in step S24), the user terminal 2 of the first user repeats the determination process of step S24 until an input operation to designate a second user is performed.

[0064] When the travel assistance information is transmitted from the management server 1 (YES in step S27), the user terminal 2 of the first user acquires the travel assistance information (step S28) and stores and manages it in a database (step S29). Specifically, the user terminal 2 of the first user stores and manages the acquired travel assistance information in the assistance information DB 61 of the storage unit. On the other hand, if the travel assistance information has not been transmitted (NO in step S27), the user terminal 2 of the first user repeats the determination process of step S27 until the travel assistance information is transmitted.

[0065] When the user terminal 2 of the first user approaches the predetermined point (YES in step S30), the user terminal 2 outputs travel support information to the first user (step S31). On the other hand, when the user terminal 2 of the first user is not approaching the predetermined point (NO in step S30), the user terminal 2 of the first user repeats the determination process of step S30 until the user terminal 2 approaches the predetermined point.

[0066] (Travel Support Information Generation Process (User Terminal 2)) Fig. 5(B) is a flowchart showing an example of the processing flow of the user terminal 2 of the third user. When the user terminal 2 of the third user receives a question generated by the management server 1 and directed to the third user (YES in step S41), the user terminal 2 of the third user acquires the question (step S42) and outputs it to the third user (step S43). On the other hand, if the question has not been received (NO in step S41), the user terminal 2 of the third user repeats the determination process of step S41 until the question is received.

[0067] When the third user's voice response to the question is input (YES in step S44), the user terminal 2 of the third user records the response (step S45) and transmits audio information of the response to the management server 1 (step S46). On the other hand, if the third user's voice response to the question is not input (NO in step S44), the user terminal 2 of the third user repeats the determination process of step S44 until the third user's voice response to the question is input.

[0068] <Specific Example> (Example of application to family, friends, and acquaintances who are knowledgeable about user 1) Fig. 6 is a diagram showing an overview of an original navigation service to which the information processing system S is applied. The original navigation service shown in Fig. 6 is a service that links predetermined points in a predetermined area with travel assistance information, which is audio information. With the original navigation service, a user who creates travel assistance information can independently create travel assistance information that is visually recognizable and easy to remember for the user, while imagining the user who will use the travel assistance information.

[0069] 6 shows a user U1 as a first user moving through a residential area A1, which is a predetermined area, a user U2 as a third user who creates mobility support information corresponding to the residential area A1, and a predetermined point in the residential area A1, XX 1-chome intersection P1. In the example of FIG. 6, user U1 is an elderly woman, and user U2 is a family member, friend, or acquaintance (in the example of the photo, a grandchild) who is familiar with user U1.

[0070] User U2 operates user terminal 2-2 to create travel assistance information to assist his grandmother, user U1, in traveling in the direction of residential area A1. Specifically, user U2 records his own voice on user terminal 2-2 to create travel assistance information to be output from user terminal 2-1 to user U1 when user U1 heads toward a predetermined point in residential area A1.

[0071] When user U2 creates mobility assistance information, a question is output from user terminal 2-2 of user U2 to user U2. In the example of FIG. 6, the question is output as synthesized speech and text information. In this case, a question such as "Who would you like to tell?" is output from user terminal 2-2. If user U2 responds to this question with "Grandma," user U2 can imagine the state in which grandma is standing at P1 like U1, and can record audio information corresponding to the location of P1 where grandma is standing, along with location information (GPS) and body orientation (geomagnetic field).

[0072] When user U2 utters, based on the information visible in the scenery from where U1 is standing, "Grandma, if you go in the direction of the big tree standing near the XX 1-chome intersection, you can get home," the user's voice is recorded and associated with the XX 1-chome intersection P1 as mobility assistance information. Note that such an exchange may be carried out by user U2 on-site at the XX 1-chome intersection P1 while viewing the actual scenery, or may be carried out at another remote location (for example, at home).

[0073] In this way, the original navigation service not only allows travel assistance information to be associated with a specific location in a specific area, but also allows for the association to take into account the orientation at the specific location. Hereinafter, this function will be referred to as the "panning function." With the panning function, information for controlling the left and right output balance (hereinafter referred to as "panning information") is recorded when recording audio information, thereby achieving a more realistic stereo audio output when outputting travel assistance information.

[0074] The panning information is generated and recorded based on the content of the operation to specify a direction during recording, the recognition results of the recorded audio information, etc. When the panning information is generated based on the content of the operation to specify a direction during recording, for example, the panning information is generated based on information recorded while a third user performs an operation indicating "left" or "right" with a joystick or the like. When the panning information is generated based on the recognition results of the recorded audio information, for example, the panning information is generated based on words indicating a direction (e.g., "left side" or "right side") detected from the audio information.

[0075] User U1 (or user U2 assisting user U1) operates user terminal 2-1 to display second user information. Although not shown, in the example of FIG. 6, it is assumed that information indicating user U2, who has been extracted from the third users as the user corresponding to the second user, is displayed as the second user information. Here, when user U1 (or user U2 assisting user U1) performs an operation to designate user U2, the setting of the travel assistance information to be output from user terminal 2-1 is completed.

[0076] Subsequently, as user U1, traveling through residential area A1, approaches XX 1-chome intersection P1, mobility assistance information is output from user terminal 2-1 in the voice of user U2, user U1's grandchild, saying, "Grandma, if you head in the direction of the big tree standing near the XX 1-chome intersection, you'll get home." This mobility assistance information is uniquely created in advance for user U2, user U1's grandchild, to help his grandmother U1 find her way home without getting lost. U2, who knows U1's daily behavior, imagines that U1 can visually confirm the information and assist her in making decisions. Therefore, it differs from conventional, one-size-fits-all navigation information. As a result, user U1 feels as if his grandchild is guiding him on the spot, and he feels reassured by hearing the familiar voice of his grandchild.

[0077] (Example of application as an unmanned navigation guide in a place visited by a user for the first time) Figure 7 is a diagram showing an overview of a tour service to which the information processing system S is applied. The tour service is an unmanned navigation guide service derived from the original navigation service of Figure 6, and is a service that enables a first user to use travel assistance information created by a third user at a destination to which the first user is traveling for the first time. In a tour provided by the navigation guide service, a tour course consisting of a combination of multiple predetermined locations to which travel assistance information is associated is provided to the first user. The configuration of the tour course is determined by the third user. Therefore, unlike the uniform tour courses provided by conventional tour services, a unique tour course that reflects the individual characteristics of the third user is provided.

[0078] 7 shows user U11 as a first user traveling through tour A2, a predetermined area, for the first time, users U12 to U14 as third users, and XX Shrine P2, a predetermined location on tour A2. In the example of FIG. 7, user U11 is a woman in her twenties visiting the predetermined area A2 for the first time, while users U12 to U14 are familiar with the predetermined area A2 but are unacquainted with user U11. Furthermore, user U12 is a woman in her twenties, user U13 is a man in his sixties, and user U14 is a woman in her sixties.

[0079] Each of users U12 to U14 operates user terminals 2-12 to 14, respectively, to create a tour course consisting of a combination of multiple pieces of travel assistance information that support the travel of first-time visitors in the predetermined area A2. Specifically, each of users U12 to U14 records their own voice on user terminals 2-12 to 14, respectively, to create travel assistance information that is output when a first-time visitor as a first user approaches each of multiple predetermined points in the predetermined area A2.

[0080] For example, when user U12 creates travel assistance information, a question is output from user U12's user terminal 2-12. Although not shown, in the example of FIG. 7, a question is output via chat. In this case, a question such as "Who would you like to tell?" is displayed as text information on the chat screen of user terminal 2-12. If user U12 responds to this question by inputting a response such as "A person walking around the city visiting this place for the first time," a further question is displayed, such as "What landmark on the scenery should that person use to move to the next point?". If user U12 responds to this question by voice and text, such as "To get to the shrine, you should climb the stairs you see in front of you," user terminal 2-12 receives the voice information of U12 and other sensory-based information, which U12 previously provided to U11 at the predetermined base where U11 is walking. Next, U12 is prompted with a message such as, "Please speak what you would like to tell U11 at X-X Shrine." Following this message, user U12 speaks, "The coffee shop called X-X near the entrance to X-X Shrine is recommended for young women traveling alone," and the user's voice is recorded and associated with X-X Shrine P2 as travel assistance information.

[0081] The user U12 creates a tour course by performing the above-described exchange for each of a plurality of predetermined locations. Note that the user U12 may perform such exchange and record his / her voice at the site (X Shrine P2) while viewing the surrounding scenery, or may perform such exchange and recording at a different location (e.g., at home) other than the site. Note that the location of the first piece of travel assistance information generated among the plurality of pieces of travel assistance information may be set as the start point of the corresponding tour course, and the location of the last piece of travel assistance information generated may be set as the end point.

[0082] User U11 operates the user terminal 2-11 to display second user information. In the example of Figure 7, the second user information is displayed as information indicating users U12 to U14 extracted from the third users as users corresponding to the second user, and further, user U12, who is close in age to the user U11, is recommended as a recommended second user. Here, when user U11 performs an operation to specify the recommended user U12, for example, the travel support information output from the user terminal 2-11 is set to that created by user U12.

[0083] Later, when user U11 approaches X-shrine P2, a location he has never visited before, in the form of a new location, user U12 outputs travel assistance information from user terminal 2-11, saying, "The coffee shop called X-shrine near the entrance is recommended for young women traveling alone." This travel assistance information was created by user U12, who is familiar with the specific area A2 visited by user U11, as a guide to enhance the travel experience of user U11, a first-time visitor, and differs from conventional, one-size-fits-all travel guides. This allows user U11 to feel as if a woman of similar age is guiding her on the spot, and, despite traveling alone, gives her the reassuring feeling of traveling with a female friend who is familiar with the area.

[0084] Tour courses are displayed on a designated tour list screen and can be deleted by a user operation on that screen (for example, by pressing the delete button). In this case, the deleted tour is stored in a designated archive folder. Each tour can also be uploaded to the cloud by a user operation (for example, by pressing the share button). Tour information uploaded to the cloud can be set to a status such as "private," "limited access (for example, for one person only, multiple people)," or "public."

[0085] (Specific example of user interface) Figs. 8(A) to 12(B) are diagrams showing a specific example of a user interface displayed on the user terminal 2. Figs. 8(A) to 8(C) are diagrams showing a specific example of a user interface displayed on the user terminal 2 when a third user creates travel assistance information. Fig. 8(A) shows a specific example of a screen displayed when an operation to start creating travel assistance information is performed. Fig. 8(B) shows a specific example of a screen displayed when an operation to specify a point to associate with travel assistance information is performed. Fig. 8(C) shows a specific example of a screen displayed when an operation to record a human voice to create travel assistance information is performed.

[0086] The third user first presses a button B1 labeled "Create New" that is displayed on the screen shown in FIG. 8(A). Next, the third user performs an operation to specify a point to which travel assistance information is to be associated from a map M displayed on the screen shown in FIG. 8(B). For example, the third user slides at the point to which travel assistance information is to be associated and performs an operation to record. Then, an icon P indicating the specified point is displayed. The third user checks the point of the displayed icon P and presses a button B2 labeled "Set up a voice." This specifies the point to which travel assistance information is to be associated.

[0087] Next, the third user presses the slide button B3 labeled "Put a voice" displayed on the screen shown in Fig. 8 (C). This allows the recording of the actual voice of the third user. Although not shown, when a button for completing the recording is pressed, travel assistance information based on the actual voice of the third user is generated, and the travel assistance information is associated with the location indicated by the icon P.

[0088] 9 and 10 are diagrams showing specific examples of user interfaces displayed on the user terminal 2 when checking travel assistance information created by a third user. Fig. 9(A) shows a specific example of a map M displayed on the user terminal 2. Icons P11 to P15 indicating points with which travel assistance information is associated are displayed on the map M. The points indicated by the icons P11 to P15 are all points specified by the third user, and are each associated with travel assistance information based on the third user's voice.

[0089] Furthermore, the outer edges of the icons P11 and P15 indicate the boundaries between the areas where the respective travel assistance information is output (inner areas of the icons) and the areas where the travel assistance information is not output (outer areas of the icons). Therefore, for example, when the first user enters the area indicated by the icon P11, the travel assistance information is output from the user terminal 2 of the first user.

[0090] Furthermore, before the travel assistance information is output, a sound effect or a voice message may be output to notify the first user that the first user has entered the area. Furthermore, the content of the sound effect or voice message may differ depending on the attribute of the area.

[0091] For example, suppose a third user sequentially records audio information while specifying the locations indicated by icons P11 to P15 in that order. A course is then generated based on the order in which the third user recorded the audio information. Specifically, a course is generated that starts at the location indicated by icon P11 and finishes at the location indicated by icon P15. The generated course is used, for example, as a tour course provided by the third user in the tour service shown in FIG. 7 described above.

[0092] FIG. 9(B) shows a specific example of travel assistance information displayed as text information. The third user can output the associated travel assistance information in the form of audio information or text information by performing an operation (e.g., a tapping operation) to designate each of the icons P11 to P15 indicating the location to which the created travel assistance information is associated. This allows the third user to easily check the content of the travel assistance information. For example, when the third user performs an operation to designate the icon P11 indicating the location set as the starting point among the icons P11 to P15 displayed on the map M, the travel assistance information associated with the icon P11 is output in the form of audio information or text information. Note that FIG. 9(B) shows an example in which the travel assistance information T associated with the icon P11 is output in the form of text information.

[0093] 10(A) shows a specific example of icons indicating the area where travel assistance information is to be output. The third user can specify the area where the associated travel assistance information is to be output by performing an operation to change the size of each of the icons P11 to P15 indicating the location to which the created travel assistance information is associated (for example, an operation to pinch in or out). This allows the third user to freely change the range of the specific area to which the travel assistance information is to be output.

[0094] For example, when the third user pinches out on each of the icons P11 and P14 among the icons P11 to P15 displayed on the map M in FIG. 9A described above, the sizes of the icons P11 and P14 increase, as shown in FIG. 10A. That is, the area in which travel assistance information is output becomes larger. Also, when the third user pinches in on each of the icons P11 and P14 displayed on the map M in FIG. 10A described above, the sizes of the icons P11 and P14 decrease, as shown in FIG. 9A. That is, the area in which travel assistance information is output becomes smaller.

[0095] FIG. 10(B) shows a specific example of an operation for moving the area in which travel assistance information is output. The third user can move the area in which the associated travel assistance information is output by performing an operation (e.g., a dragging operation) to change the location of each of icons P11 to P15, which indicate the location to which the created travel assistance information is associated. This allows the third user to freely change the specific location in the area in which travel assistance information is output. For example, when the third user performs an operation to drag icon P15 to the right, among icons P11 to P15 displayed on the map M in FIG. 10(A) described above, the location of icon P15 moves as shown in FIG. 10(B).

[0096] 11(A) to 11(D) are diagrams illustrating specific examples of user interfaces displayed on the user terminal 2 when the first user uses the tour service. FIG. 11(A) illustrates a specific example of a screen displayed when the first user performs an operation to start using the tour service. The first user first inputs a place name, address, structure name, etc. into an input field R1 for specifying the starting point of the tour course and an input field R2 for specifying the end point of the tour course, both of which are displayed on the screen illustrated in FIG. 11(A). In the example illustrated in FIG. 11(A), "Sakuragicho" is input into input field R1, and "Motomachi-Chinatown" is input into input field R2. That is, the first user wishes to receive a tour course starting from the area around Sakuragicho Station in Yokohama City, Kanagawa Prefecture, and ending from the area around Motomachi-Chinatown Station in the same city. After completing the input into input fields R1 and R2, the screen illustrated in FIG. 11(B) is displayed.

[0097] FIG. 11(B) shows a specific example of a screen displaying third user information. The screen shown in FIG. 11(B) displays the notation "Sakuragicho - Motomachi / Chinatown Recommended Navigation Guided Tour" and the notation "Please select someone you are interested in," along with captured images showing users U21 to U29 extracted from the third users who have a high degree of match in terms of information such as attributes as the third user, hobbies, characteristics, and the degree of complementarity of the course. The first user performs an operation (e.g., a tap operation) to designate a user of interest from among users U21 to U29. The screen shown in FIG. 11(C) is then displayed. If the first user wishes to change the tour course provided, they can return to the screen of FIG. 11(A) by pressing button B4 labeled "Back."

[0098] 11(C) shows a specific example of third user information of a second user designated by a first user. Note that the third user information shown in FIG. 11(C) is assumed to be the third user information of user U23 designated by the first user among users U21 to U29, which are third users shown in FIG. 11(B) described above.

[0099] The third user information shown in FIG. 11(C) displays the "profile" of user U23, including hobbies, characteristics, and an overview of the tour courses offered. If the first user references the information in the "profile" of user U23 and considers that the user is suitable as a guide for their tour, they press button B5 labeled "Select this person." This displays the screen shown in FIG. 11(D). If the user wishes to change the designation of the second user, they can return to the screen of FIG. 11(B) by pressing button B6 labeled "Back."

[0100] In this way, the first user can freely select and use a tour course offered by a user who matches his or her hobbies and preferences from among the users extracted as the third users. This type of service is not limited to the use cases of traditional travel tours, which have a limited range of tour guides and tour courses to choose from, but can also be used to create tours that can be left in the local area as walking tour courses that anyone can create, mainly in areas that have not previously been treated as tourist destinations.

[0101] 11(D) shows a specific example of a screen that is displayed when the first user performs an operation to start moving along the tour course. The screen shown in FIG. 11(D) displays buttons B7 to B9 along with a message saying "The navigation tour will start. Do you want to close the screen?"

[0102] To start moving along the tour course, the first user presses the button B7 labeled "Start Tour." To confirm the contents of the tour course, the first user presses the button B8 labeled "Confirm Route." To reconfirm the second user information of the specified second user, the first user presses the button B9 labeled "Back."

[0103] 12(A) and 12(B) are diagrams showing specific examples of user interfaces displayed on the user terminal 2-2 of the second user and the user terminal 2-1 of the first user when the second user uses the monitoring mode. A second user who creates travel assistance information using the original navigation service can use the "monitoring mode," a function provided in the user terminal 2. The "monitoring mode" is a function that enables the two users who created the travel assistance information to remotely support the travel of the first user, who is the output destination of the travel assistance information. As shown in FIG. 12(A), the screen displayed on the user terminal 2-1 of the first user is shared and displayed on the screen of the user terminal 2-2 of the second user who uses the "monitoring mode."

[0104] As shown in FIG. 12(B), the user terminal 2-1 of the first user displays a map M including icons P21 to P25 indicating locations associated with travel assistance information created by the second user. Of the icons P21 to P25, icon P21 is displayed in a color different from the other icons P22 to P25. This indicates that the location indicated by icon P21 is the first user's current location. The screen displayed on the user terminal 2-1 of the first user is shared and displayed on the user terminal 2-2 of the second user using the "monitoring mode," so the second user can grasp the first user's current location at a glance.

[0105] A second user using the "monitoring mode" can add and create travel assistance information in the above manner even while the first user is traveling. For example, suppose the first user travels to the points indicated by icons P21 to P25 in that order, and the first user's current location is the point indicated by icon P21. In this case, the second user can add a point to which travel assistance information is to be associated in the area between the point indicated by icon P21 and the point indicated by icon P25.

[0106] For example, suppose that the location to which the second user wishes to associate additional travel assistance information is between the location indicated by icon P24 and the location indicated by icon P25. In this case, the second user performs an operation (e.g., a long press) to designate the location to which the second user wishes to associate travel assistance information, and records a voice recording that will serve as the travel assistance information. Then, as shown by the dashed line in FIG. 12(B), an icon P26 indicating the additionally designated location is displayed on the map M. As a result, when the first user enters the area indicated by icon P26, the travel assistance information associated with icon P26 is output.

[0107] Here, for example, suppose that the first user starts using a tour course that moves through the points indicated by each of the icons P21 to P25 shown in FIG. 12(B) in that order, and the first user's current location is the point indicated by icon P21. In this case, by moving through the order of the tour course, the first user can enjoy the tour while listening to the travel assistance information associated with each of the points indicated by each of the icons P21 to P25 in order. However, the first user may be a person who needs to be monitored, such as an elderly person or an elementary school student, or may be visiting a place for the first time, and may make a mistake in judgment while traveling and get lost.

[0108] In response to this, the user terminal 2 of the first user outputs judgment support information that supports the first user in determining the direction of the first user moving within a predetermined area, thereby reducing the risk that the first user will make a judgment error and get lost. Unlike the movement support information, the judgment support information in this embodiment is output as pre-created, versatile sound effects or voice messages rather than audio information in the third user's voice. Hereinafter, the function of the user terminal 2 to output judgment support information to the first user will be referred to as a "calibration function."

[0109] For example, if the first user's current location deviates from the original course, the calibration function outputs a sound effect or a voice message indicating that the first user has deviated from the original course as the judgment support information. Specifically, a unique beep indicating that the first user has deviated from the original course or a voice message such as "You may have deviated from the original course" may be output as the judgment support information. In addition, a vibration function may be linked to the sound effect or voice message.

[0110] In addition to a sound effect or a voice message indicating that the first user has deviated from the course, a voice message may be output as the judgment support information to provide guidance to the point indicated by each of the icons P21 to P25 that is closest to the first user's current location. However, there may be cases where the point indicated by each of the icons P21 to P25 that is closest to the first user's current location has already been visited (deleted). In such cases, the user terminal 2 may output, as the judgment support information, a voice message to provide guidance to the point not visited by the first user that is closest to the first user's current location.

[0111] Here, examples of the "voice message for providing route guidance from the first user's current location to the nearest point" output from the user terminal 2 as judgment support information include a message that refers to a direction, such as "Go east about XX meters," or a message that refers to a landscape, such as "Go in the direction where you can see the ocean about XX meters." However, depending on the ability of the first user or the environment in which the first user is located, it may be difficult for the first user to navigate according to a voice message that refers to a direction or a landscape. In such cases, for example, the first user's current body orientation may be estimated, and a voice message regarding detailed physical movements, such as "Turn right," "Turn left," or "Look back," may be output as judgment support information. Furthermore, a mechanism is provided in which, when the first user is facing the correct direction, a sound or vibration is changed, thereby providing a mechanism for notifying the first user of the correct walking direction at regular intervals without the user having to visually check the information on a visual device.

[0112] The method for estimating the current body orientation of the first user is not particularly limited. For example, the current body orientation of the first user may be estimated based on various information, such as the orientation of the user terminal 2 identified from the acceleration and geomagnetic values ​​detected by the user terminal 2, three-dimensional information about the first user's body, and how the first user is holding the user terminal 2. The first user may hold the user terminal 2 by, for example, inserting it into a breast pocket, hanging it around the neck with a strap, holding it in the hand, or putting it in a bag or other carry-on luggage. By performing estimation taking these into consideration, a mechanism is provided that can correctly link the geomagnetic field that can be used by functions within the user terminal.

[0113] Furthermore, for example, if the first user has not deviated from the original course, the fact that the user has not deviated from the original course may be implicitly indicated by not outputting the judgment support information. Alternatively, the fact that the user has not deviated from the original course may be actively indicated by outputting a voice message such as "You are proceeding as per the original course" or "If you can see XX to the right, you are not deviating from the original course." These output modes may be set by the first user in advance.

[0114] 13A to 14F are diagrams illustrating priority control according to this embodiment. As described above, in a tour course where users move in order, when multiple installed locations are close to each other, the travel support information to be output is controlled according to the location of the first user U.

[0115] 13(A) and 13(B) are diagrams showing an icon U representing a first user, icons P1 and P2 indicating the range in which predetermined travel support information is to be output, and areas E1 and E2 corresponding to the icons P1 and P2, respectively. Note that the travel support information corresponding to icons P1 and P2 is assumed to be adjacent travel support information on a tour course in which the users move in sequence. Areas E1 and E2 are areas indicating boundaries for determining whether travel support information corresponding to icons P1 and P2 is to be output consecutively. For example, when the first user is located at icon U in FIG. 13(A), the user terminal 2 outputs travel support information corresponding to icon P1. However, when the first user moves to the position indicated by icon U in FIG. 13(B) (outside area E1), a message such as "Out of range" is output. Furthermore, when the first user is located at icon U in FIG. 13(A) and continues straight into the range indicated by icon P2, the user terminal 2 moves outside area E1, but does not output a message such as "Out of range." This is because the first user entered area E2 before leaving area E1, and as described above, when the first user enters area E2 before leaving area E1, travel assistance information is continuously output. Note that the diagonal lines within icon P1 in the figure indicate that the output of travel assistance information has resulted in erasure (setting the audio to a state where it has already been output).

[0116] As shown in Figures 13(C) and 13(D), the user terminal 2 continuously outputs travel support information in the same manner as described above, even when an icon P2 corresponding to one piece of travel support information (the range in which the other piece of travel support information is output) is included within an area E1 corresponding to the other piece of travel support information.

[0117] 13(E) and 13(F) are diagrams showing an example in which a "start audio" (corresponding to icon P1 in FIGS. 13(E) and 13(F)) is set to be output first on a tour course that moves in order. When the first user moves from the position indicated by icon U in FIG. 13(E) to the range indicated by icon P2 without passing through the range indicated by icon P1, the user terminal 2 does not output travel assistance information corresponding to icon P2. This makes it possible to avoid outputting audio in the middle (audio corresponding to icon P2) first when it is desired to output travel assistance information continuously.

[0118] 14(B)。 Note that when the first user moves from the position shown by icon U in Fig. 14(A) to the position shown by icon U in Fig. 14(B), the user terminal 2 may output the travel assistance information corresponding to icon P4 without performing the above-described control. This is because the travel assistance information corresponding to icon P3 is not a start sound, and in this case, the travel assistance information before (past) icon P4 (travel assistance information corresponding to icons P1 to P3) may be erased.

[0119] Furthermore, when the first user moves from the position indicated by icon U in FIG. 13(E) into a range outside the area E1 corresponding to the start sound and within which subsequent travel assistance information is to be output, the user terminal 2 may output the subsequent travel assistance information without performing the above-described control. In this case, travel assistance information that precedes (is past) the above-described subsequent travel assistance information may be erased in the tour course in which the user moves in sequence. Note that once erased, the erasure of travel assistance information may be reset if the user moves out of the areas corresponding to all travel assistance information in the tour course in which the user moves in sequence.

[0120] Furthermore, in controlling the start sound, the user terminal 2 may not output travel assistance information corresponding to icon P3 when the first user moves straight from the position indicated by icon U in FIG. 14(C) to the position indicated by icon U in FIG. 14(D). This allows travel assistance information corresponding to icons P1 to P3 to be output consecutively (in order) even when they are close to each other on a tour course where the users move in a sequential order. Note that when icon P3 is located outside (not close to) area E1, the user terminal 2 may output travel assistance information corresponding to icon P3 without performing the above-described control. In this case, travel assistance information before (past) icon P3 (travel assistance information corresponding to icons P1 to P2) may be erased.

[0121] In addition, even if the first user moves straight from the position shown in icon U in Figure 14 (C) to the position shown in icon U in Figure 14 (D), if the travel assistance information corresponding to icon P1 is not a start audio, the user terminal 2 should output travel assistance information corresponding to icon P3.

[0122] Furthermore, when the first user moves straight from the range of icon P1 through the range of icon P2 to the position shown by icon U in FIG. 14(E), the user terminal 2 may output travel assistance information corresponding to icons P1, P2, and P4 in that order. This is because the range of icon P3 is located outside the area E2 corresponding to icon P2, and therefore the travel assistance information corresponding to icon P3 is ignored. Note that, as shown in FIG. 14(F), when the range of icon P3 (including a portion thereof) is located within the area E2 corresponding to icon P2, the user terminal 2 may not output travel assistance information corresponding to icon P4 even when the first user moves straight from the range of icon P1 through the range of icon P2 to the position shown by icon U in FIG. 14(E).

[0123] 14(E), if the first user moves through the areas indicated by icons P1 to P4 in order, the erasure is not reset. This is because, although the area of ​​icon P3 does not overlap with area E2, areas E2 and E3 overlap (are continuous).

[0124] As mentioned above, when the pieces of travel support information are close to each other and the first user moves into the range corresponding to the second piece of travel support information before finishing listening to the first piece of travel support information, the user terminal 2 may output the second piece of travel support information after finishing outputting the first piece of travel support information.

[0125] <Advantageous Effects of the Present Embodiment> According to the above-described embodiment, for example, travel assistance information can be created for the person with whom the grandmother has the closest relationship and who gives her peace of mind. Specifically, as in the above example, family members or grandchildren who know the elderly grandmother well can record their own voices to create travel assistance information for the grandmother to use. In this case, original travel assistance information can be created that takes into account the routes the grandmother frequently travels and the locations of the stores she frequents. However, as the grandmother who uses the travel assistance information, she may occasionally forget the way due to her advanced age. While she can ask someone for directions, she may not be able to ask anyone due to shame or fear. In such situations, if the grandmother can hear travel assistance information based on the voices of family members or friends who know her well, she can travel safely without having to ask someone for directions, while receiving the support of a trusted voice from the back of her memory. The reverse is also true. For children, notifications of dangerous locations and the history of those locations may be more familiar to the elderly. Communicating these information in their own words not only helps to ensure the safety of their children but also motivates the elderly to use the information.

[0126] Furthermore, travel assistance information created for one person can be provided to multiple people. The aforementioned tour service is a specific example of a method for providing travel assistance information to multiple people. According to the tour service, multiple people can use one tour course. Furthermore, when there are multiple tour courses available for multiple people, a single tour course can be created by linking the multiple tour courses. In this case, the linking process may be performed by AI (artificial intelligence), so that the multiple tour courses are automatically linked. This allows, for example, the automatic creation of a single tour course connecting a home and a destination door-to-door. Furthermore, tour course matching using AI (artificial intelligence) is also possible, so that, for example, a tour course created and provided by a sake lover (e.g., a tour around sake breweries) can be matched to a tour course suitable for sake lovers.

[0127] In addition to providing simple directions to a store, the travel assistance information described above can also be used to introduce a place to a friend or warn of dangers to a family member. For example, when a friend expresses interest in a place, such as "I went there, and that route was fun!", the user may actually want the friend to take them there. However, since the friend has already been there once, the friend may not be particularly interested in accompanying the friend. Therefore, the travel assistance information can be applied to situations where a friend might imagine and tell the friend about places they should be careful of. This can be applied not only to one-to-one navigation-guided tours between users, but also to one-to-many (multiple) and many-to-many (multiple) relationships. Furthermore, in an interaction between a grandfather and his grandson, the grandson can imagine his grandfather and warn of dangers, or act as if he is walking with his grandfather. In this embodiment, the guidance is based on the visible scenery, which is often overlooked as a social issue, and serendipity is expected to occur by seeing the scenery. This will have the benefit of creating a society where people can understand and move around the area without skipping over important information about the city, for example.

[0128] <Other Embodiments> Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope of achieving the object of the present invention are included in the present invention.

[0129] For example, in the above-described embodiment, an example is described in which one user (third user) creates travel assistance information, and one or more users (first users) other than the first user use the travel assistance information. However, this is not limiting. For example, the user who created the travel assistance information can also use the travel assistance information himself. Furthermore, the created travel assistance information can be used by one or more users separately or simultaneously. Furthermore, the travel assistance information may be subject to buying and selling, so that the person who created the travel assistance information (third user) can receive a predetermined incentive.

[0130] Furthermore, in the above-described embodiment, a user corresponding to the second user is extracted from among the third users who have created the travel support information, and the extracted user information is displayed in a selectable manner on the user terminal 2 of the first user. However, this is not limited to this. The step of extracting a user corresponding to the second user from among the third users may be omitted, and the second user may be designated in advance from the user terminal 2 of the first user. Specifically, for example, in the example of FIG. 6 described above, the second user, user U2, may be designated in advance by operating the user terminal 2-1 of user U1, the first user.

[0131] 10(A) , the size of the area where travel support information is to be output can be understood from the size of each of the icons P11 to P15, but this is not limiting. For example, the color or design of each of the icons P11 to P15 may be used to represent the difference in the size of the area where travel support information is to be output.

[0132] Furthermore, with regard to the size (detection range) of each of the icons P11 to P15 in FIG. 10A described above, if the size is made small, they will not be detected on wide roads, and if the size is made large (for example, 10 m), adjacent pieces of mobility assistance information will interfere with each other. To address this issue, it is advisable to use the position information of the center point of each piece of mobility assistance information. For example, the mobility assistance information (for example, voice) whose center point is closest to the user's position is output. This allows the correct mobility assistance information to be provided to the user even in the case of interference as described above.

[0133] Furthermore, with regard to the method shown in FIG. 8C above, for example, recording may be performed by pressing the record button or by sliding a predetermined slide bar displayed on the screen. Recording may then be terminated when the user releases their hand from the slide bar. The slide bar may be of a horizontal or vertical sliding type. Specifically, recording may begin when the vertical slide bar is slid downward. The vertical sliding type has the advantage of being easier to slide than horizontally, for example, when holding a smartphone in one hand. When a voice is generated using the vertical bar, deleting the generated voice may be achieved by sliding the generated voice upward.

[0134] To avoid having to press the record button each time, a new item (L-shaped hook) can be placed near (for example, below) the slide bar, and by tapping the item, continuous recording can be performed, for example, every 15 seconds. Note that the continuous recording mode can be cancelled by sliding the item upwards.

[0135] Furthermore, if you want to input a longer voice than the 15-second voice mentioned above, you can turn on a setting such as "embed voice as voice" in advance, which allows you to place the voice from the time the user speaks until they press the button in the desired location.

[0136] The type of travel assistance information may also be determined based on the recording time. For example, if the recording time is less than a predetermined time (e.g., 10 seconds or 15 seconds), the travel assistance information may be classified as a "navigation voice" that provides directions. For example, if the recording time is equal to or longer than a predetermined time, the travel assistance information may be classified as a "guide voice" that explains facilities, etc. The user may be able to distinguish between the above-described "navigation voice" and the "guide voice." For example, the "navigation voice" that is listened to while walking may start with a "beep" sound, while the guide voice may start with a "beep beep." Furthermore, if the user reaches a location corresponding to the "navigation voice" while the "guide voice" is being played, the "navigation voice" may be given priority and output as audio. After listening to the "guide voice" for a long time (e.g., 10 minutes), the user may become unsure of which direction to go next. In this case, for example, the following trigger may be used to output a "navigation voice" for the next destination. - End playback of the guide voice - Leave the area within the detection range of the mobility support information (for example, a diameter of 20 m) - Make a 360-degree turn on the spot Note that if part of the area corresponding to the "guide voice" overlaps with part of the area corresponding to the "navigation voice," it is preferable that the "navigation voice" be output by the above-mentioned trigger.

[0137] The distance between the above-mentioned "navigation voices" (from their center points) should be a predetermined distance (e.g., 30 m from the center point). Furthermore, while the above-mentioned "navigation voice" is generally recorded and added, adding a voice to every "predetermined point" can be very tedious, and the listening user may prefer not to hear the voice if they are on the correct route. Therefore, a different sound (e.g., a beep) may be output instead of the voice when the user is walking on the correct route. In addition to the above-mentioned voice-enabled and voiceless "voice" types, voice-required "voices" may also be provided. For example, when using voice-required "voices," voices may be required on roads with curves of a predetermined angle or more (e.g., approximately 15 or 30 degrees) or roads with branching roads. On the other hand, voiceless "navigation voices" may be provided on roads with fewer curves. Furthermore, since there are many complex navigation routes, the route order of the "navigation voices" may be preset in the system. This allows the user to be guided to the correct route regardless of the distance between the "navigation voices." Furthermore, even if the areas of the "navigation voice" (travel assistance information) overlap, the user may be guided to a predetermined navigation route as described above. However, if the user's location cannot be moved according to the predetermined order and is more than a predetermined distance (e.g., 30 m) away from the center point of the next travel assistance information, semi-calibration may be activated, and the nearest travel assistance information may be pointed to. Note that, since travel assistance information on a route that has already been passed is erased, the travel assistance information that has not been erased may be pointed to. Note that even in this case, if the user is more than a predetermined distance (e.g., 30 m) away from the center point of the current travel assistance information, semi-calibration may be activated, and the user may be guided to the nearest travel assistance information. In this case, the erasure process may be reset even if the route has already been passed. Note that, in the above-mentioned cases where a voice is required (such as in the case of a curve at a predetermined angle), a sound (e.g., a chir-a-lan) different from a normal sound (e.g., a "whoosh") may be used.

[0138] In the above-described embodiment, when the "navigation voice" and the "calibration voice" overlap, it is preferable to prioritize the "navigation voice." For example, when the "calibration voice" comes close to the "navigation voice," it is preferable to generate the "calibration voice" after the "navigation voice" ends. Also, if the "calibration voice" is being output and the vehicle approaches an area corresponding to the "navigation voice," it is preferable to cancel the "calibration voice" midway. Note that once the "calibration voice" is activated, the calibration voice will continue to be generated in response to the rotation navigation gesture. Therefore, when the vehicle reaches an area corresponding to any of the travel assistance information, it is preferable to switch to the normal semi-calibration mode for subsequent generation.

[0139] The above-described navigation route may be automatically assigned. For example, it is assumed that the route is assigned at a predetermined interval (e.g., 30-meter intervals) from the user's current location or a preset location. It is also assumed that the route is assigned at a predetermined interval (e.g., 30-meter intervals) from the goal and intermediate points to the start point. Furthermore, it is preferable that a route including a curve of a predetermined angle (e.g., 15 degrees or more) be automatically assigned. If the information capacity of the tour information exceeds a predetermined value, it is preferable to divide the tour information. For example, assuming a 1.5-hour tour, it would normally be possible to travel from the start to the goal without dividing the tour. However, due to file capacity issues, it is preferable to divide the tour into 30-minute intervals and divide the service into 30-minute intervals as well. For example, the first 30 minutes may be audio-enabled, and the following hour may be audio-disabled.

[0140] 11(B) , only the captured images of the user selected as the second user from among the third users are displayed as the second user information, but the second user information is not limited to this. For example, the number of tour courses offered by the second user, the content of evaluations from the first user (e.g., the number of so-called "likes" or comments), part of the profile (e.g., hobbies), etc. may be displayed.

[0141] Furthermore, in the above-described embodiment, the judgment support information output to the first user is different from the travel support information in that it is not audio information of the third user's actual voice, but is a pre-created, versatile sound effect or audio message. However, the present invention is not limited to this, and the audio message output as the judgment support information may be based on the actual voice.

[0142] In the above-described embodiment, the decision support information is output to the first user who is traveling along the tour course, but this is not limiting. The decision support information may also be output to a third user who is creating a tour course.

[0143] Furthermore, in the above-described embodiment, the second user using the "monitoring mode" can additionally create travel assistance information, but this is not limited to this. For example, audio recording may be enabled to interrupt the travel assistance information being output. For example, if the created travel assistance information is 10 minutes of audio information, one or more audio recordings may be enabled to interrupt the 10 minutes of travel assistance information being output. In this case, the output of the travel assistance information may be paused during the interrupt recording, and the output of the paused travel assistance information may be resumed when the interrupt recording is completed.

[0144] Furthermore, in the above-described embodiment, the recording may be initiated by the user uttering a trigger word. For example, if a trigger word "grandma" is pre-set in the system based on voice recognition, when the user speaks "grandma," the word triggers the start of recording mode, and a 15-second recording countdown begins. When recording ends (15 seconds have elapsed), the system enters standby mode. If the trigger word is spoken again during standby mode, recording will begin again. An important element of the navigation guide is who the message is intended for. By setting a trigger word, the user can explicitly specify the intended recipient of the message, which helps the user to understand the feelings of the person and convey the message with the desired message, raising awareness within themselves.

[0145] In the above-described embodiment, the supporter (the party creating the navigation guide) speaks into the smartphone microphone. The speech is recognized and the point is registered as a POI (point of interest: a point that can be represented on a map). The POI is registered as a name of the POI as text information recognized as speech, and the supporter's live voice (actual voice) is recorded as an audio media file, and a geofence (an area set as location information surrounded by a virtual boundary) retains the function of playing the media file. The user, as a navigation guide, can use the function without being aware of the POI or geofence because a media file of the supporter's pre-recorded voice is played back with each change in latitude and longitude during travel, as if a person were nearby. This allows the user to use the function without being aware of the POI or geofence. This voice is reproduced with each change in latitude and longitude, as if it were actually present on the ground, allowing the supporter to expand their functions as a virtual being, establishing a mobile augmented reality technology that uses only hearing and no visual information such as a display.

[0146] The following scenarios are possible examples of scenarios in which the mobility assistance information described above can be used. In the first scenario (1-to-N), a user has a set destination (destination) and then searches for a route using a navigation system. In this case, the application displays many people who are the most knowledgeable about the destination. Then, among these people, the user is automatically matched with someone who shares similar hobbies and preferences. After checking the profiles of the matched people, the user receives navigation based on the mobility assistance information of people who the user thinks "could be friends with" or "would like to walk with." This allows the user to enjoy the scenery without worrying about the electronic device at hand, and by walking while looking at the scenery, the user can experience arriving at the destination before they know it.

[0147] In the second scenario (one-to-one), imagine that when you are waiting to meet a friend, your friend sends you a link for mobility assistance information. When you select the link, a navigation route to your destination is completed. This allows you to walk without looking at the screen of your device, and you are taught about the fun of the city. You will realize, "What a fun city!" You will also have the experience of arriving at your destination before you know it. Your friend can also provide you with information about the city that only locals know, or information about your favorite towns.

[0148] The third scenario (one-to-one) is to imagine a target person and generate travel assistance information for that person to visit the town and check it out beforehand. For example, if the target person likes cute shops and sets destinations such as a cake shop, a flower shop, or an art museum, spots where voice input is automatically output at regular intervals, and the target person can add interesting shops by dragging them. This completes an original tour of the town. The completed travel assistance information (link) is then sent to the target person.

[0149] In a fourth scenario (one-to-many), it is assumed that information such as "Climbing this mountain has caused many accidents, making it a serious problem," "This place is dangerous, this place has a spectacular view, watch your step, you need to arrive here at xx o'clock to reach the lodge by evening," etc., is left as travel assistance information. This allows the user to access the travel assistance information without, for example, removing gloves or operating an electronic device. It also provides a sense of security that someone is nearby, reducing feelings of loneliness. It also prevents the user from concentrating excessively on the electronic device at hand, allowing the user to quickly notice animals such as bears.

[0150] In the fifth scenario (evaluation scenario), users are expected to make evaluations such as, "The designated tour was fun," "They showed me places only locals know. They're amazing professionals!", "I want to say thank you," "I want to use it every day," and "I got my own walking points."

[0151] In the sixth scenario (market scenario), it is assumed that users will use tours (travel assistance information) when the next day is a holiday. It is also assumed that users will use tours that are less crowded and allow them to discover something new, rather than the roads they usually walk. It is also assumed that users will use tours that visit less popular tourist spots.

[0152] Furthermore, the above-described series of processes can be executed by hardware or software. In other words, the above-described functional configuration is merely an example and is not particularly limited. In other words, it is sufficient for the information processing system to be provided with a function that can execute the above-described series of processes as a whole, and the type of functional block used to realize this function is not particularly limited to the above-described example.

[0153] The location of the functional blocks is not particularly limited and may be arbitrary. For example, the functional blocks of the management server 1 may be transferred to another device, or the functional blocks of another device may be transferred to a server. Furthermore, one functional block may be configured as a single piece of hardware, a single piece of software, or a combination of both.

[0154] When a series of processes is executed by software, the programs constituting the software are installed onto a computer or the like from a network or a recording medium. The computer may be a computer incorporated into dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

[0155] The recording medium containing such a program may be configured as a removable medium (not shown) that is distributed separately from the device main body in order to provide the program to users, etc., or may be configured as a recording medium that is pre-installed in the device main body and provided to users, etc. Since the program can be distributed via a network, the recording medium may be installed in or accessible from a computer that is connected or connectable to the network.

[0156] In this specification, the steps describing the program recorded on the recording medium include not only processes that are performed in chronological order, but also processes that are not necessarily performed in chronological order but are performed in parallel or individually. Also, in this specification, the term "system" means an overall device composed of multiple devices or multiple means, etc.

[0157] In other words, the information processing system to which the present invention is applied can take various forms having the following configurations. (1) That is, an information processing system to which the present invention is applied (e.g., the information processing system S in FIG. 1) has a management means (e.g., the "information management unit 31" in FIG. 3) that manages travel assistance information (e.g., voice information) for assisting the travel of a first user (e.g., "user U1" in FIG. 6) moving in a predetermined area (e.g., "residential area A1" in FIG. 6) by associating the travel assistance information with a predetermined point in the predetermined area (e.g., "XXXX 1st Street intersection P1" in FIG. 6), and a voice output means (e.g., the "transmission control unit 36" in FIG. 3, the "voice output control unit 53" in FIG. 4) that outputs the travel assistance information associated with the predetermined point to the first user when the first user approaches the predetermined point, and the travel assistance information is information generated based on the voice of a second user (e.g., "user U2" in FIG. 6) who has a predetermined relationship (e.g., a parent-child relationship, a relationship of close age, a relationship of common hobbies and tastes, etc.) with at least one of the first user and the predetermined area. As a result, travel assistance information generated based on the voices of the first user or second and third users who have a predetermined relationship with the predetermined area is associated with and managed as a predetermined point in the predetermined area, and when the first user moving through the predetermined area approaches the predetermined point, the travel assistance information associated with the predetermined point is output to the first user. As a result, the first user can feel as if the second and third users are guiding them on the spot. When the third user changes, the content information guided to them will be different even for the same tour course, eliciting new motivation for traveling.

[0158] (2) The system may further include a second user extraction unit (e.g., the "extraction unit 34" in FIG. 3) that extracts a user corresponding to the second user from among the third users who created the travel assistance information (e.g., "user U2" in FIG. 6). This allows the user corresponding to the second user to be extracted from among the third users who created the travel assistance information. As a result, the first user can feel as if the extracted second user is guiding them on the spot.

[0159] (3) Furthermore, the second user extraction means can extract a user corresponding to the second user from among the third users based on information about the predetermined area, information about the first user, and information about the third user. This allows a user corresponding to the second user to be extracted from among the third users based on information about the predetermined area, information about the first user, and information about the third user. As a result, the first user can feel as if the extracted second user is guiding him or her around the location.

[0160] (4) The information processing device may further include a second user information notification means (e.g., the “extraction unit 34” and “transmission control unit 36” in FIG. 3 ) that notifies the first user of information about the second user (e.g., the above-mentioned “second user information”), and a designated information acquisition means (e.g., the “acquisition unit 33” in FIG. 3 ) that acquires designated information indicating the second user designated by the first user. The audio output means may output the travel assistance information generated (e.g., generated by the “generation unit 35” in FIG. 3 ) based on the actual voice of the second user designated by the first user to the one user. As a result, information about the second user is notified to the first user, and the travel assistance information generated based on the actual voice of the second user designated by the first user is output to the one user. As a result, the first user may feel as if the second user designated by the first user is guiding them on the spot.

[0161] (5) The information management device may further include a question management unit (e.g., the “information management unit 31” in FIG. 3 ) that manages questions for generating the travel assistance information, the questions being related to at least one of the first user and the predetermined location, a question implementation unit (e.g., the transmission control unit 36 ​​in FIG. 3 , the acquisition unit 51 in FIG. 4 , and the audio output control unit 53) that notifies the third user of the questions at a predetermined timing, and a response recording unit (e.g., the audio recording control unit 55 in FIG. 4 ) that records a voice response from the third user to the questions. In this way, a question related to at least one of the first user and the predetermined location is notified to the third user at a predetermined timing, and a voice response from the third user to the questions is recorded, thereby making it possible to generate travel assistance information.

[0162] (6) Furthermore, the question management means can manage, as questions about the first user, questions about at least one of information indicating the attributes of the first user (e.g., age, gender, hobbies, thoughts, personality, etc.) and information indicating the relationship between the first user and the third user (e.g., the relationship between the first user and the third user, the impression of the first user from the third user, etc.). As a result, questions about the first user about at least one of information indicating the attributes of the first user and information indicating the relationship between the first user and the third user are managed, and the questions are notified to the third user at a predetermined timing. Then, a voice response from the third user to the questions is recorded, making it possible to generate mobility assistance information.

[0163] (7) Furthermore, the question management means can manage, as questions about the predetermined location, questions about information indicating attributes of the predetermined location (for example, location, climate, season, date and time, scenery, history, etc.). Thus, questions about information indicating attributes of the predetermined location are managed as questions about the predetermined location, and the questions are notified to the third user at a predetermined timing. Furthermore, a voice response from the third user to the question is recorded, making it possible to generate travel assistance information.

[0164] (8) Furthermore, the question implementation unit can output the question to the third user at a timing when the third user approaches the predetermined point, which is identified based on information indicating the third user's current location (for example, the third user's current location identified by the location identification unit 32 in FIG. 3 ). This allows the question to be output at a timing when the third user approaches the predetermined point based on the information indicating the third user's current location, making it possible to generate travel assistance information for each predetermined point.

[0165] (9) The question implementation unit may output the question to the third user when the third user has traveled a predetermined distance or when a predetermined time has elapsed. This allows the question to be output when the third user has traveled a predetermined distance or when a predetermined time has elapsed, making it possible to generate travel assistance information according to the travel distance or travel time of the third user.

[0166] (10) The audio output means may further output, to the first user, decision support information, which is audio information (e.g., voice, sound effects, etc.) for supporting the first user in determining a direction. Since the decision support information is output to the first user, the first user can make a decision based on the decision support information. As a result, the first user can arrive at the destination efficiently without making a mistake in the direction of travel.

[0167] Furthermore, an information processing device to which the present invention is applied (for example, the management server 1 in Figure 1) has a management means for managing travel assistance information to assist the movement of a first user moving through a specified area, which is output to the first user, by associating it with a specified point in the specified area, and an audio output means for outputting the travel assistance information associated with the specified point to the first user when the first user approaches the specified point, wherein the travel assistance information is information generated based on the actual voice of a second user who has a specified relationship with at least one of the first user and the specified area.

[0168] 1: Management server, 2: User terminal, 11: CPU, 16: Output unit, 17: Input unit, 18: Storage unit, 19: Communication unit, 31: Information management unit, 32: Location identification unit, 33: Acquisition unit, 34: Extraction unit, 35: Generation unit, 36: Transmission control unit, 51: Acquisition unit, 52: Information management unit, 53: Audio output control unit, 54: Display control unit, 55: Recording control unit, 56: Transmission control unit, S: Information processing system, N: Network

Claims

1. An information processing system comprising: a management means for managing travel assistance information for assisting the movement of a first user moving within a specified area, the travel assistance information being output to the first user moving within the specified area, and a voice output means for outputting the travel assistance information associated with the specified point to the first user when the first user approaches the specified point, wherein the travel assistance information is information generated based on the actual voice of a second user having a specified relationship with at least one of the first user and the specified area.

2. The information processing system according to claim 1, further comprising a second user extraction means for extracting a user corresponding to the second user from among third users who have created the travel support information.

3. The information processing system of claim 2, wherein the second user extraction means extracts a user corresponding to the second user from among the third users based on information relating to the specified area, information relating to the first user, and information relating to the third user.

4. An information processing system as described in claim 1, further comprising: a second user information notification means for notifying the first user of information regarding the second user; and a designated information acquisition means for acquiring designated information indicating the second user designated by the first user, wherein the voice output means outputs the travel support information generated based on the actual voice of the second user designated by the first user to the first user.

5. The information processing system of claim 2, further comprising: a question management means for managing questions for generating the travel support information, the questions being related to at least one of the first user and the specified location; a question implementation means for notifying the third user of the questions at a specified timing; and a response recording means for recording a voice response from the third user to the questions.

6. The information processing system of claim 5, wherein the question management means manages questions regarding the first user that are related to at least one of information indicating attributes of the first user and information indicating a relationship between the first user and the third user.

7. The information processing system according to claim 5, wherein said question management means manages questions about information indicating attributes of said specific location as questions about said specific location.

8. The information processing system of claim 5, wherein the question implementation means outputs the question to the third user at a time when the third user approaches the specified point, which is identified based on information indicating the current location of the third user.

9. The information processing system according to claim 5, wherein the question implementation means outputs the question to the third user when the third user has moved a predetermined distance or when a predetermined time has elapsed.

10. The information processing system according to claim 1, wherein the audio output means further outputs, to the first user, judgment support information for supporting the first user in judging a direction.

11. An information processing method comprising the steps of: managing travel assistance information for assisting the movement of a first user moving within a specified area, the travel assistance information being output to the first user moving within the specified area, in association with a specified point in the specified area; and outputting the travel assistance information associated with the specified point to the first user when the first user approaches the specified point, wherein the travel assistance information is information generated based on the actual voice of a second user having a specified relationship with at least one of the first user and the specified area.

12. A program that causes a computer to execute a process including the steps of: managing travel assistance information for assisting the movement of a first user moving within a specified area, the travel assistance information being output to the first user moving within the specified area, in association with a specified point in the specified area; and outputting the travel assistance information associated with the specified point to the first user when the first user approaches the specified point, wherein the travel assistance information is information generated based on the actual voice of a second user that has a specified relationship with at least one of the first user and the specified area.

Images