Information processing system, information processing method, and program

Abstract

To enable a user to acquire a feeling of being guided on the spot by a person who understands the user himself / herself or a person who understands a place at which the user is.SOLUTION: In a CPU 11 of a management server 1, an information management part 31 manages movement support information outputted toward a first user moving in a prescribed area to support the movement of the first user in association with a prescribed point in the prescribed area. Then, when the first user approaches the prescribed point, a transmission control part 36 performs control for transmitting control information to output the movement support information associated with the prescribed point toward the first user. Here, the movement support information is information generated based on voice of a second user having a prescribed relation to at least either the first user or the prescribed area.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] There is known a technique for outputting voice information for route guidance from a mobile terminal carried by a moving user (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-034777 A Summary of the Invention [Problem to be solved by the invention]

[0004] Such technology, which is premised on displaying maps, can be very difficult to use for people with spatial cognitive impairments or who have difficulty with maps. Therefore, solutions for people with spatial cognitive impairments will be very easy to use for the general public. Also, for people with spatial cognitive impairments, "independence" is an important element, and to achieve independence, they must be able to reach their destination on their own. In that case, the following four issues must be resolved.

[0005] The first is the issue of safety. Since working memory is mainly affected, there are issues with hyperconcentration and simultaneous tasks. In addition, hyperconcentration can make it difficult to be considerate of others, and if you are not good at simultaneous tasks, it can be difficult to keep multiple fields of vision and complete multiple tasks. They also have difficulty with spatial recognition tasks, and have difficulty grasping three-dimensional distances, such as left-right and front-to-back differences, which makes things even more dangerous. As a result, they have problems with people, cars, and road shapes. This requires a method of communication that takes into account the safety of the user, since there is a problem with receiving simultaneous tasks visually, and it is difficult to process simultaneous tasks through touch and hearing. When a destination is set, the user only thinks about arriving at the destination, making it difficult to consider the surroundings. In such a situation, especially with visual displays, not only does the visual field lack, but it also becomes difficult to balance the thoughts with the information around. If the visual field is directed toward the scenery, the presentation can be tactile or auditory, but even tactile support can be excessive. For example, if the user is instructed to turn right and tries to move to the right, but the working memory is in a state where simultaneous tasks are difficult, the user will move in the direction presented by the tactile stimulus without considering the surroundings. On the other hand, if the information received through the ears is merely impersonal left and right guidance, the driver will only listen to the voice and focus their attention only on turning left and right, which also causes the working memory to become over-focused, and so there remains a problem that must be solved even when it comes to information received through the ears.

[0006] The second challenge is reaching the destination. If you have a disability such as topographical disorientation, which is a mobility issue, you will have difficulty remembering and forgetting scenery. Furthermore, you may also be affected by a shift in your visual field and a narrower range of visual angles, so when you look at a display, you will concentrate on the information presented, which will limit the area in which your visual field can be directed toward the scenery, making it even more difficult to remember the scenery. In addition, in order to provide a sense of security while ensuring safety and allowing the user to remember the scenery, one approach would be to move around while preventing hyperconcentration by using various sensory information, such as information received through the eyes, ears, smell, and touch. When electronic information such as maps and displays are displayed on a screen, the person with disabilities not only has difficulty converting from 2D to 3D, but also has difficulty with their sense of direction, making it difficult for them to arrive at their destination. However, if something like AR glasses can solve this problem, there are issues such as hyperconcentration and the high technical difficulty of correcting the field of view. Furthermore, overly polite guidance that correctly controls the position and is too correct in the right place will give too much of the answer, and the person will end up relying on it too much. In particular, people with disabilities who are facing the challenge of independence are required to make their own decisions and remember as much as possible, which could result in them being hindered from becoming independent. To solve this problem, support is needed to naturally move towards independence so that they can make their own decisions.

[0007] The third issue is safety. People tend to feel anxious when they are alone, so it is necessary to solve the problem of the tendency to feel anxious if there is no one they can trust nearby. Even if people are able to go out alone, there are currently methods to turn someone into another being, such as physical robots, virtual robots using video technology, or autonomously controlled systems using AI to present virtual information through auditory information, and even if an accurate presence is presented, it is still a challenge for the person involved to decide whether they can safely entrust themselves to that object. In particular, with AI, there is still the issue of solving the problem of impersonation, which is already beyond the realm of what we can judge on our own.

[0008] The fourth is the desire task. Going out requires motivation, and the content that brings that motivation needs to be both temporary and long-term. Having that makes people want to go out, walk, or go out alone.

[0009] The present invention has been made in light of these circumstances, and aims to provide a "navigation guide" (a term coined by the present invention combining navigation and guide) that allows users moving around a given area to feel as if they are being guided by someone who understands them or the place they are in, and that provides support as both a guide helper and a tour guide, resolving the shortage of human resources, and providing digital technology in the form of an unmanned navigation system to continuously preserve and utilize local memory information in a way that is clearly understood by the provider. [Means for solving the problem]

[0010] In order to achieve the above object, one aspect of the present invention is a management means for managing travel support information, which is output to a first user moving within a predetermined area and is for supporting the movement of the first user, in association with a predetermined point within the predetermined area; a voice output means for outputting the travel support information associated with the predetermined point to the first user when the first user approaches the predetermined point; having The travel assistance information is provided by providing information on scenery visible at a destination of the first user, the information being generated based on a real voice of a second user having a predetermined relationship with at least one of the first user and the predetermined area. It is an information processing system.

[0011] An information processing device, an information processing method, and a program corresponding to the information processing system according to one aspect of the present invention are also provided as an information processing device, an information processing method, and a program corresponding to the information processing system according to one aspect of the present invention. Effect of the Invention

[0012] According to the present invention, a user moving through a specified area can have the sensation of being guided by someone who understands him or her or the place where he or she is located. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 illustrates an example of an overall configuration of an information processing system. [Diagram 2] 2 is a block diagram showing an example of a hardware configuration of a management server; [Diagram 3] FIG. 2 is a functional block diagram of a management server and a user terminal. [Figure 4] 13 is a flowchart showing an example of generation and extraction of travel support information. [Diagram 5] 13 is a flowchart illustrating an example of processing of a user terminal. [Figure 6] FIG. 1 is a diagram illustrating an overview of a service to which an information processing system is applied. [Figure 7] FIG. 1 is a diagram illustrating an overview of a service to which an information processing system is applied. [Figure 8] FIG. 4 illustrates an example of a user interface. [Figure 9] FIG. 4 illustrates an example of a user interface. [Figure 10] FIG. 4 illustrates an example of a user interface. [Figure 11] FIG. 4 illustrates an example of a user interface. [Figure 12] FIG. 4 illustrates an example of a user interface. [Figure 13] FIG. 13 illustrates an example of priority control. [Figure 14] FIG. 13 illustrates an example of priority control. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, this embodiment will be described with reference to the drawings. <Information processing system> FIG. 1 is a diagram showing an example of the overall configuration of an information processing system S according to this embodiment. The information processing system S manages, in association with a predetermined point in the predetermined area, travel assistance information (e.g., audio information) for supporting the movement of a first user (a person receiving travel assistance) who is moving in a predetermined area among users using the information processing system S. When the first user approaches the predetermined point, the information processing system S outputs, to the first user, travel assistance information that is easily visible in a panoramic view that tends to interest the first user at the destination that is managed in association with the predetermined point.

[0015] The predetermined area is an area where the first user can move on foot or by various means of transportation. For example, the first user's residential area, a first destination where the first user will go out, or a destination that the first user has been to but has not yet been memorized are all examples of the "predetermined area." Any point within a predetermined area can be considered as a "predetermined point." For example, if the "predetermined area" is the residential area of ​​the first user, an intersection that the first user frequently uses in daily life and a school that the first user commutes to are both examples of a "predetermined point." Also, for example, if the "predetermined area" is a destination where the first user goes out, building information such as hotels, restaurants, shrines and temples that can be seen at the destination of the first user, road characteristics, road surfaces, signs, etc. are all examples of "predetermined points" that are easily visible in the scenery.

[0016] The travel support information is information generated based on the real voice of a second user who has a specified relationship with at least one of the first user and the specified area, or learning information analyzed and generated by AI based on the real voice information.In this embodiment, an example of the travel support information to be output is described, which is voice information. The predetermined relationship is a relationship between at least one of the first user and the predetermined area, and examples of such relationships include family relationships (between users), kinship relationships, assistance and support, or relationships in which the parties can know each other, such as friends and acquaintances. In addition, relationships between people who are acquainted at a destination and those who can navigate and guide the destination, and relationships in which hobbies, generations, ideas, social status, etc. are common or similar are also included in the predetermined relationship.

[0017] The information processing system S is configured by connecting a management server 1 and user terminals 2-1 to 2-n (n is an integer equal to or greater than 1) via a network N. The network N is, for example, the Internet, a LAN (Local Area Network), a VPN (Virtual Private Network), etc. Hereinafter, when there is no need to explain each of the user terminals 2-1 to 2-n individually, they may be collectively referred to as the "user terminal 2."

[0018] (Management Server 1) The management server 1 is an information processing device that manages the entire information processing system S. The management server 1 is capable of acquiring various types of information transmitted from the user terminal 2 and the outside and performing various types of processing. The management server 1 is also capable of transmitting various types of information to the user terminal 2 and the outside.

[0019] For example, the management server 1 stores and manages in a database questions for generating travel support information, which questions are related to at least one of a first user and a predetermined location. For example, the management server 1 manages, as questions related to the first user, questions related to at least one of information indicating attributes of the first user and information indicating a relationship between the first user and a user (hereinafter referred to as a "third user") who created the travel support information.

[0020] A "third user" is treated as a "second user" if it has a predetermined relationship with a predetermined area or a first user. In other words, the users (third users) who have created the travel support information include users (second users) who have a predetermined relationship with a predetermined area or a first user, and users who do not have a predetermined relationship.

[0021] The information indicating the attributes of the first user is information about the first user (hereinafter referred to as "first user information"), and includes objective information such as the first user's age, sex, and social status, and subjective information such as the first user's hobbies, thoughts, and personality. Also, "information indicating the relationship between the first user and the third user" is, for example, objective information such as the relationship between the first user and the third user, and subjective information such as the third user's impression of the first user.

[0022] Furthermore, for example, the management server 1 manages, as a question regarding a specific location, a question regarding information indicating attributes of the specific location. The information indicating the attributes of a specific location is, for example, a country or region, a climate, a season, a date and time, a scenery, characteristics of surrounding structures, etc. The data format of the questions managed by the management server 1 is not particularly limited. For example, the questions may be voice information or text information.

[0023] The management server 1 transmits predetermined control information to the user terminal 2 of the third user. Specifically, for example, if the data format of the question is voice information, the management server 1 transmits control information for outputting the question from a speaker, earphones, or the like of the user terminal 2 of the third user. Also, for example, if the data format of the question is text information, the management server 1 transmits control information for displaying the question on a display, or the like, of the user terminal 2 of the third user.

[0024] The control information is information for causing the user terminal 2 of the third user to output a question stored and managed in a database at a predetermined timing, and this control information may include information regarding the timing of outputting the question. Examples of such control information include control information for outputting a question when the third user approaches a predetermined point, control information for outputting a question when the third user moves a predetermined distance, and control information for outputting a question when a predetermined time has elapsed. Whether the third user has approached a predetermined point is identified, for example, from location information of the predetermined point and information indicating the current location of the third user.

[0025] The management server 1 also generates travel support information. Specifically, when voice information of a recorded answer to a question from the third user's user terminal 2 is transmitted from the third user's user terminal 2, the management server 1 generates travel support information based on the voice information. After generating the travel support information, the management server 1 associates the travel support information with a predetermined point in a predetermined area, stores it in a database, and manages it.

[0026] Furthermore, the management server 1 manages the travel support information in association with information on the third user who created the travel support information (hereinafter referred to as "third user information"). The third user information includes, for example, identification information (for example, a user ID) that can uniquely identify the third user, information indicating the attributes of the third user, etc. The information indicating the attributes of the third user includes, for example, the name, captured image, address, age, sex, educational background, occupation, hobbies, thoughts, social status, etc. of the third user.

[0027] When the moving user terminal 2 of the first user approaches a predetermined point, the management server 1 causes the first user's user terminal 2 to output travel support information managed in association with the predetermined point. Specifically, the management server 1 transmits control information for outputting the travel support information to the first user's user terminal 2.

[0028] When input information for outputting the second user information is transmitted from the user terminal 2 of the first user, the management server 1 extracts a user corresponding to the second user from among the third users and outputs the extracted information to the user terminal 2 of the first user. Whether or not the user corresponds to the second user is determined based on the information on the predetermined area and the commonalities and similarities between the first user information and the third user information.

[0029] For example, suppose that the first user is an elementary school student or an elderly person, and the third users include related parties who are familiar with the first user, such as the first user's family members (e.g., mother, father, children, grandchildren, etc.) and friends. In this case, the management server 1 extracts related parties who are familiar with the first user, such as the first user's family members and friends, from among the third users as users corresponding to the second user, and outputs the recorded voice to the user terminal 2 of the first user as the second user information. Also, for example, suppose that the first user is a visitor who visits a specific area, and three users (e.g., people familiar with the area) who created travel support information for the specific area are included in the third users. In this case, the management server 1 can extract the three users from the third users as users corresponding to the second user, and output them to the user terminal 2 of the first user as second user information.

[0030] When information indicating a second user designated by a first user (hereinafter referred to as "designation information") is transmitted from the user terminal 2, the management server 1 extracts travel support information created by the second user identified by the designation information. Then, when the user terminal 2 of the first user approaches a predetermined point in a predetermined area, the management server 1 transmits control information for outputting the extracted travel support information from the user terminal 2 to the first user. The transmitted travel support information is linked to the predetermined point from a speaker, earphone, or the like of the user terminal 2 of the first user, and audio information from the recorded human voice is output. The specific configuration and processing details of the management server 1 will be described later.

[0031] (User terminal 2) The user terminal 2 is an information processing device operated by a user who uses the information processing system S, and is configured, for example, as a smartphone, a tablet terminal, etc. It is assumed that dedicated application software that enables the information processing system S to be used is installed in the user terminal 2.

[0032] The user terminal 2 activates dedicated application software that enables the use of the information processing system S based on user operation, making it possible to acquire various types of information transmitted from the management server 1 and from the outside. The user terminal 2 also makes it possible to perform various types of processing based on the acquired various types of information and various types of information input by user operation. The user terminal 2 also makes it possible to transmit various types of information to the management server 1 and to the outside.

[0033] For example, the user terminal 2 of the first user accepts an input operation for displaying second user information and an input operation for designating the second user, and transmits the input information to the management server 1. The user terminal 2 of the first user also acquires travel support information generated by the management server 1, stores it in a database, and manages it. Then, when the user terminal 2 approaches a predetermined point, it outputs the travel support information to the first user.

[0034] In addition, the user terminal 2 of the first user outputs voice information (hereinafter referred to as "judgment support information") for supporting the first user in determining the direction. For example, the user terminal 2 of the first user can output, as the judgment support information, a voice message recorded from a sound effect or a real voice, or a voice synthesis technology as the main source, as well as information that can judge the support as a tactile sense that can intuitively recognize a movement judgment or other sensations that can be judged by the body.

[0035] Also, for example, the user terminal 2 of the third user acquires a question about at least one of the information about the scenery presumably visible from the first user and a predetermined point, generated by the management server 1, and outputs the question to the third user. Also, the user terminal 2 of the third user records the third user's real voice response to the question as real voice, and transmits the voice information to the management server 1. The specific configuration and processing details of the user terminal 2 will be described later.

[0036] The above-mentioned processes by the management server 1 and the user terminal 2 constituting the information processing system S are just examples, and it is sufficient that the information processing system S as a whole has the function of realizing the above-mentioned processes. Therefore, some or all of the functions of realizing the above-mentioned processes may be shared or cooperated within the information processing system S.

[0037] For example, some or all of the functions of the management server 1 may be functions of other information processing devices (e.g., the user terminal 2) in the information processing system S, and some or all of the functions of other information processing devices in the information processing system S may be functions of the management server 1. Furthermore, some or all of the functions of the management server 1 may be transferred to other servers (not shown). This promotes processing in the information processing system S as a whole and also enables the processes to be complemented.

[0038] <Hardware configuration> (Hardware configuration of Management Server 1) FIG. 2 is a block diagram showing an example of a hardware configuration of the management server 1 according to this embodiment. The management server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a memory unit 18, a communication unit 19, and a drive 20.

[0039] The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 18 to the RAM 13. The RAM 13 also stores data and the like required for the CPU 11 to execute various processes. The CPU 11, the ROM 12, and the RAM 13 are interconnected via a bus 14. An input / output interface 15 is also connected to this bus 14.

[0040] The input / output interface 15 is connected to an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20. The output unit 16 is composed of a display, a speaker, etc., and outputs various information as images and sounds. The input unit 17 is composed of a keyboard, a mouse, a touch panel, etc., and accepts input of various information. The storage unit 18 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various data. The communication unit 19 communicates with other devices via a network N including the Internet.

[0041] Removable media 21, which may be a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is appropriately attached to the drive 20. Programs read from the removable media 21 by the drive 20 are installed in the storage unit 18 as necessary. The removable media 21 can also store various data stored in the storage unit 18 in the same manner as the storage unit 18. Although not shown, each of the user terminals 2 has the hardware configuration shown in FIG.

[0042] <Functional configuration> 3 is a functional block diagram showing an example of the functional configuration of the management server 1 and the user terminal 2. Each functional block will be described in detail below. (Management Server 1 Functional Configuration) In the CPU 11 of the management server 1, an information management unit 31, a location identification unit 32, an acquisition unit 33, an extraction unit 34, a generation unit 35, and a transmission control unit 36 ​​function during operation. In addition, the storage unit 18 of the management server 1 is provided with a user DB 41 in which user information is stored, a question DB 42 in which questions to be outputted to third users are stored, a support information DB 43 in which travel support information is stored, and the like.

[0043] The information management unit 31 stores and manages various types of information in a database. For example, the information management unit 31 stores and manages user information in a user DB 41 of the storage unit 18. In addition, the information management unit 31 stores and manages questions outputted to third users in a question DB 42 of the storage unit 18. Specifically, the information management unit 31 manages, among the questions output to the third user, questions regarding the first user, which questions are related to at least one of information indicating the attributes of the first user and information indicating the relationship between the first user and the third user. Furthermore, the information management unit 31 manages questions related to information indicating attributes of the predetermined location as questions related to the predetermined location among questions output to the third user. Furthermore, the information management unit 31 associates travel support information with the predetermined location in the predetermined area, and stores and manages the information in the support information DB 43 of the storage unit 18.

[0044] The location identification unit 32 identifies the current location of the user. For example, the location identification unit 32 identifies the current location of the user based on the user's Global Positioning System (GPS) or Global Navigation Satellite System (GNSS) information.

[0045] The acquisition unit 33 acquires various information. For example, the acquisition unit 33 acquires various information transmitted from the user terminal 2. Examples of the information transmitted from the user terminal 2 include audio information recorded as an answer to a question transmitted from the user terminal 2 of the third user, and input information transmitted from the user terminal 2 of the first user for displaying second user information on the user terminal 2 of the first user.

[0046] The extraction unit 34 extracts a user corresponding to the second user from among the third users. Specifically, the extraction unit 34 extracts a user corresponding to the second user from among the third users based on the information on the predetermined area and the commonality or similarity between the first user information and the third user information.

[0047] The generation unit 35 generates the travel support information. Specifically, the generation unit 35 generates the travel support information based on voice recording information that records a response in the actual voice of a third user to a question regarding at least one of the first user and the predetermined location.

[0048] The transmission control unit 36 ​​controls the transmission of various information. Specifically, the transmission control unit 36 ​​controls the transmission of various information to each of the user terminal 2 and the outside via the communication unit 19. For example, the transmission control unit 36 ​​controls the transmission of control information for causing the user terminal 2 of the third user to output a question for generating travel support information. In addition, the transmission control unit 36 ​​controls the transmission of control information for causing the user terminal 2 of the first user to output the generated travel support information. Note that, before outputting the travel support information, the transmission control unit 36 ​​may transmit control information to vibrate the user terminal 2. This serves as a cue to the first user that travel support information is about to be output, and also has the effect of making the travel support information easier to understand.

[0049] (Functional configuration of user terminal 2) In the CPU of the user terminal 2, an acquisition unit 51, an information management unit 52, an audio output control unit 53, a display control unit 54, a recording control unit 55, and a transmission control unit 56 function during operation. In addition, the storage unit of the user terminal 2 is provided with an assistance information DB 61 in which travel assistance information is stored. Note that it is not necessary for all of the functional units in the user terminal 2 to be provided in the same terminal; for example, the user terminal 2-1 may be provided with only some of the above-mentioned functional units.

[0050] The acquisition unit 51 acquires various information. For example, the acquisition unit 51 acquires input information accepted by the input unit. Examples of the input information accepted by the input unit include information input to display second user information, information input to specify the second user, and the like. In addition, the acquisition unit 51 acquires audio information of the actual voice of the third user recorded under the control of the recording control unit 55 described later. The acquisition unit 51 also acquires various pieces of information transmitted from the management server 1 and from the outside. For example, the acquisition unit 51 acquires control information transmitted from the management server 1 for outputting various pieces of information from various output devices such as speakers, earphones, and displays of the output unit. Among these, information output from audio output devices such as speakers and earphones includes, for example, audio information of questions regarding at least one of the first user and a specified location, travel support information, and judgment support information. Furthermore, information displayed on an image output device such as a display and information output as audio information such as voice synthesis include, for example, a user interface, text of questions related to information visible in a specified area regarding at least one of the first user and a specified location, and audio information.

[0051] The information management unit 52 stores and manages various types of information in a database. For example, the information management unit 52 associates travel assistance information with a predetermined point in a predetermined area, and stores and manages the information in an assistance information DB 61 in the storage unit.

[0052] The audio output control unit 53 controls the output of various types of audio information from the output unit. For example, the audio output control unit 53 controls the output of audio information of a question regarding at least one of the first user and a specific location from a speaker or earphone of the output unit to a third user. The audio output control unit 53 also controls the output of travel support information and decision support information from a speaker or earphone of the output unit to the first user.

[0053] The display control unit 54 controls the display of various information on the display of the output unit, etc. For example, the display control unit 54 controls the display of a user interface of dedicated application software that enables the use of the information processing system S. The display control unit 54 also controls the display of audio information of a question regarding at least one of the first user and a predetermined location on the display of the output unit, etc.

[0054] The recording control unit 55 controls the recording of the answer in the third user's voice to the question about at least one of the first user and the predetermined location. Specifically, the recording control unit 55 controls the storage unit to store the voice information, which is the answer in the third user's voice to the question, in the storage unit.

[0055] The transmission control unit 56 controls the transmission of various information to the management server 1 and the outside via the communication unit. For example, the transmission control unit 56 controls the transmission of various input information to the management server 1. Examples of the input information transmitted to the management server 1 include information input to display second user information and information input to specify the second user. The transmission control unit 56 also controls the transmission of recorded voice information to the management server 1. Examples of the voice information transmitted to the management server 1 include voice information that is a response in the actual voice of the third user to a question regarding at least one of the first user and the specified location.

[0056] <Processing flow> (Travel support information generation process (management server 1)) FIG. 4(A) is a flow chart showing an example of the flow of the processing of the management server 1 up to the generation of travel support information. The management server 1 stores and manages in a database a question to be output to the third user (step S1). At a predetermined timing (YES in step S2), the management server 1 causes the user terminal 2 of the third user to output a question to the third user (step S3). On the other hand, if it is not the predetermined timing (NO in step S2), the determination process of step S2 is repeated until the predetermined timing.

[0057] When the management server 1 receives the voice information of the third user's answer to the question output in step S3 (YES in step S4), it acquires the voice information (step S5). On the other hand, when the voice information of the third user's answer has not been received (NO in step S4), the management server 1 repeats the determination process in step S4 until the voice information of the third user's answer is received.

[0058] Then, the management server 1 generates travel support information based on the acquired voice information (step S6), associates the travel support information with a predetermined point in a predetermined area, and stores and manages the information in a database (step S7).The management server 1 also associates the travel support information generated in step S6 with third user information of the third user who created the travel support information, and manages the information (step S8).

[0059] (Travel support information extraction process (management server 1)) FIG. 4B is a flow chart showing an example of the flow of the processing of the management server 1 up to the extraction of travel support information. When input information for displaying the second user information is transmitted from the user terminal 2 of the first user (YES in step S11), the management server 1 extracts a user corresponding to the second user from among the third users (step S12) and displays information about the user as the second user information on the user terminal 2 of the first user (step S13). On the other hand, if input information for displaying the second user information is not transmitted (NO in step S11), the management server 1 repeats the determination process of step S11 until input information for displaying the second user information is transmitted.

[0060] When the management server 1 receives from the user terminal 2 designation information indicating the second user designated by the first user (YES in step S14), the management server 1 acquires the designation information (step S15) and extracts travel support information based on the voice of the designated second user (step S16). On the other hand, when the designation information is not received from the user terminal 2 (NO in step S14), the management server 1 repeats the determination process in step S14 until the designation information is received from the user terminal 2.

[0061] When the moving user terminal 2 of the first user approaches a predetermined point (YES in step S17), the management server 1 causes the user terminal 2 to output travel support information managed in association with the predetermined point to the first user (step S18). On the other hand, when the user terminal 2 of the first user is not approaching the predetermined point (NO in step S17), the management server 1 repeats the determination process of step S17 until the user terminal 2 of the first user approaches the predetermined point.

[0062] (User information display process (user terminal 2)) FIG. 5(A) is a flowchart showing an example of the flow of processing in the user terminal 2 of the first user. When an input operation for displaying the second user information is performed (YES in step S21), the user terminal 2 of the first user accepts the input operation (step S22) and transmits the input information to the management server 1 (step S23). On the other hand, when an input operation for displaying the second user information is not performed (NO in step S21), the user terminal 2 of the first user repeats the determination process of step S21 until an input operation for displaying the second user information is performed.

[0063] When an input operation to designate a second user is performed (YES in step S24), the user terminal 2 of the first user accepts the input operation (step S25) and transmits the input information to the management server 1 (step S26). On the other hand, when an input operation to designate a second user is not performed (NO in step S24), the user terminal 2 of the first user repeats the determination process of step S24 until an input operation to designate a second user is performed.

[0064] When the travel support information is transmitted from the management server 1 (YES in step S27), the user terminal 2 of the first user acquires the travel support information (step S28), and stores and manages it in a database (step S29). Specifically, the user terminal 2 of the first user stores and manages the acquired travel support information in the support information DB 61 in the storage unit. On the other hand, if the travel support information has not been transmitted (NO in step S27), the user terminal 2 of the first user repeats the determination process of step S27 until the travel support information is transmitted.

[0065] When the user terminal 2 of the first user approaches the predetermined point (YES in step S30), it outputs travel support information to the first user (step S31). On the other hand, when the user terminal 2 of the first user does not approach the predetermined point (NO in step S30), the user terminal 2 of the first user repeats the determination process of step S30 until the user terminal 2 approaches the predetermined point.

[0066] (Mobility support information generation process (user terminal 2)) FIG. 5(B) is a flowchart showing an example of the flow of processing in the user terminal 2 of the third user. When the user terminal 2 of the third user receives a question generated by the management server 1 and to be output to the third user (YES in step S41), the user terminal 2 acquires the question (step S42) and outputs it to the third user (step S43). On the other hand, if the question has not been transmitted (NO in step S41), the user terminal 2 of the third user repeats the determination process of step S41 until the question is transmitted.

[0067] When the third user's voice answer to the question is input (YES in step S44), the user terminal 2 of the third user records the answer (step S45) and transmits audio information of the answer to the management server 1 (step S46). On the other hand, if the third user's voice answer to the question is not input (NO in step S44), the user terminal 2 of the third user repeats the determination process of step S44 until the third user's voice answer to the question is input.

[0068] <Example> (Example of application to family, friends and acquaintances who are knowledgeable about User 1) FIG. 6 is a diagram showing an outline of an original navigation service to which the information processing system S is applied. The original navigation service shown in Fig. 6 is a service that links a specific point in a specific area with travel assistance information, which is audio information. With the original navigation service, a user who creates travel assistance information can create unique travel assistance information that is visually recognizable and easy to remember for the user who will use the travel assistance information.

[0069] 6 shows a user U1 as a first user moving in a residential area A1, which is a predetermined area, a user U2 as a third user who creates mobility support information corresponding to the residential area A1, and a predetermined point in the residential area A1, XX 1-chome intersection P1. In the example of FIG. 6, the user U1 is an elderly woman, and the user U2 is a family member, friend, or acquaintance (in the example of the photo, a grandchild) who is familiar with the user U1.

[0070] User U2 operates user terminal 2-2 to create travel support information for supporting the travel of user U1, who is his / her grandmother, in the direction of residential area A1. Specifically, user U2 records his / her own voice on user terminal 2-2 to create travel support information to be output from user terminal 2-1 to user U1 when user U1 heads toward a specific point in residential area A1.

[0071] When user U2 creates mobility support information, a question is output from user terminal 2-2 of user U2 to user U2. In the example of FIG. 6, the question is output as voice synthesis and text information. In this case, a question such as "Who would you like to tell?" is output from user terminal 2-2. If user U2 responds to this question with "Grandma," user U2 can imagine a state in which grandma is standing at P1 like U1, and can record voice information according to the location of P1 where grandma is standing, along with location information (GPS) and body orientation (geomagnetic field).

[0072] When user U2 says, "Grandma, if you go in the direction of the big tree standing near the XX 1-chome intersection, you can get home," based on the information visible in the scenery from where U1 is standing, the actual voice is recorded and associated with the XX 1-chome intersection P1 as travel assistance information. Note that such an exchange may be performed by user U2 at the actual scene at the XX 1-chome intersection P1, or may be performed at another remote location (e.g., at home).

[0073] In this way, the original navigation service allows travel assistance information to be associated with a specific point in a specific area, and further allows for association that takes into account the orientation at the specific point. Hereinafter, this type of function is referred to as the "panning function." With the panning function, information for controlling the left and right output balance is recorded when recording audio information (hereinafter, referred to as "panning information"), thereby realizing a more realistic stereo audio output when outputting travel assistance information.

[0074] The panning information is generated and recorded based on the contents of the operation to specify the direction during recording, the recognition result of the recorded voice information, etc. Among these, when the panning information is generated based on the contents of the operation to specify the direction during recording, for example, the panning information is generated based on information recorded while the third user performs an operation indicating "left" or "right" with a joystick or the like. Also, when the panning information is generated based on the recognition result of the recorded voice information, for example, the panning information is generated based on words indicating the direction (for example, "left side" or "right side") detected from the voice information.

[0075] User U1 (or user U2 assisting user U1) operates user terminal 2-1 to display the second user information. Although not shown, in the example of FIG. 6, it is assumed that information indicating user U2, who has been extracted from the third users as a user corresponding to the second user, is displayed as the second user information. Here, when user U1 (or user U2 assisting user U1) performs an operation to designate user U2, the setting of the travel support information to be output from user terminal 2-1 is completed.

[0076] After that, when user U1, who is moving in residential area A1, approaches XX 1-chome intersection P1, travel support information is output from user terminal 2-1 in the voice of user U2, who is user U1's grandchild, saying, "Grandma, if you go in the direction of the big tree standing near XX 1-chome intersection, you can get home." This travel support information is different from conventional uniform navigation information because it was created in advance by user U2, who is user U1's grandchild, as a guide to help user U1, who is a grandmother, get home without getting lost, imagining that U2, who knows U1's usual behavior, can visually confirm it and assist U1 in making decisions. Therefore, user U1 can get the feeling that his grandchild is guiding him on the spot, and can feel reassured by hearing the familiar voice of his grandchild.

[0077] (Example of application as an unmanned navigation guide in a place where the user is visiting for the first time) FIG. 7 is a diagram showing an overview of a tour service to which the information processing system S is applied. The tour service is an unmanned navigation guide service derived from the original navigation service in FIG. 6, and is a service that enables the first user to use travel assistance information created by a third user at a destination where the first user is traveling for the first time. In the tour of the navigation guide service, a tour course consisting of a combination of multiple predetermined points to which travel assistance information is associated is provided to the first user. The configuration of the tour course is decided by the third user. Therefore, unlike the uniform tour courses provided by conventional tour services, etc., a unique tour course that reflects the individual characteristics of the third user is provided.

[0078] 7 shows a user U11 as a first user who uses a tour A2, which is a predetermined area, for the first time, users U12 to U14 as third users, and a shrine P2, which is a predetermined point in the tour A2. In the example of FIG. 7, the user U11 is a woman in her 20s who is visiting the predetermined area A2 for the first time, and the users U12 to U14 are familiar with the predetermined area A2 but are not acquainted with the user U11. Furthermore, the user U12 is a woman in her 20s, the user U13 is a man in his 60s, and the user U14 is a woman in her 60s.

[0079] Each of the users U12 to U14 operates the user terminals 2-12 to 14 to create a tour course consisting of a combination of multiple pieces of travel support information that support the travel of a person visiting for the first time in the predetermined area A2. Specifically, each of the users U12 to U14 records his or her own voice on the user terminals 2-12 to 14 to create travel support information to be output when a first-time user as a first user approaches each of multiple predetermined points in the predetermined area A2.

[0080] For example, when the user U12 creates travel support information, a question is output from the user terminal 2-12 of the user U12. Although not illustrated, in the example of FIG. 7, a question is output by chat. In this case, a question such as "Who would you like to tell?" is displayed as text information on the chat screen of the user terminal 2-12. When the user U12 responds to this question by inputting an answer such as "A person walking around the town who is visiting this place for the first time," a further question is displayed such as "What landmark on the scenery should that person use to move to the next point?" When the user U12 responds to this question by voice and text at the place where U11 is walking, the user terminal 2-12 provides the user with voice information of U12 and other information based on other senses that U12 previously answered to U11 at the predetermined base where U11 is walking. Next, U12 is shown a message such as, "Please speak what you would like to tell U11 at X-jinja Shrine." Following this message, user U12 speaks, "The coffee shop called X-jinja near the entrance to X-jinja Shrine is recommended for young women traveling alone." The user's voice is then recorded and associated with X-jinja Shrine P2 as travel support information.

[0081] The user U12 creates a tour course by carrying out the above-mentioned exchanges at each of the multiple predetermined locations. Note that the user U12 may carry out such exchanges and record his / her voice while looking at the surrounding scenery at the actual location (XX Shrine P2) or may carry out such exchanges at a different location (e.g., at home) other than the actual location. It is advisable to set the position of the first generated travel support information among the multiple travel support information as the start point of the corresponding tour course, and the position of the last generated travel support information as the end point.

[0082] The user U11 operates the user terminal 2-11 to display the second user information. In the example of FIG. 7, information indicating the users U12 to U14 extracted as the second user from among the third users is displayed as the second user information, and further, the user U12 who is close in age is recommended as the recommended second user. Here, when the user U11 performs an operation to specify the recommended user U12, for example, the travel support information output from the user terminal 2-11 is set to the information created by the user U12.

[0083] After that, when the user U11, who has visited the place A2 for the first time, approaches the XX shrine P2, the user U12 outputs travel support information from the user terminal 2-11 saying, "The XX coffee shop near the entrance of the XX shrine is recommended for young women traveling alone." This travel support information is uniquely created by the user U12, who is familiar with the specific area A2 visited by the user U11, as a guide to enrich the travel of the user U11, who is visiting for the first time, and is different from conventional uniform travel guides. Therefore, the user U11 can get the feeling that a woman close to his age is guiding him on the spot, and can get the reassuring feeling that he is traveling with a female friend who is familiar with the area, even though he is traveling alone.

[0084] The tour course is displayed on a predetermined tour list screen, and can be deleted by a user operation on the screen (for example, pressing a delete button). In this case, the deleted tour is stored in a predetermined archive folder. In addition, each tour can be uploaded to the cloud by user operation (e.g., pressing a share button). The status of tour information uploaded to the cloud can be set to "private", "limited public (e.g., only one person, multiple people)", "public", etc.

[0085] (Example of user interface) 8(A) to 12(B) are diagrams showing specific examples of user interfaces displayed on the user terminal 2. FIG. 8(A) to 8(C) are diagrams showing specific examples of user interfaces displayed on the user terminal 2 when the third user creates travel support information. FIG. 8(A) shows a specific example of a screen that is displayed when an operation to start creating travel support information is performed. FIG. 8(B) shows a specific example of a screen that is displayed when performing an operation to specify a location to which travel support information is to be associated. FIG. 8(C) shows a specific example of a screen that is displayed when performing an operation to record a real voice for creating travel support information.

[0086] The third user first presses a button B1 labeled "Create New" displayed on the screen shown in FIG. 8(A). Next, the third user performs an operation to specify a point to which the travel support information is to be associated from a map M displayed on the screen shown in FIG. 8(B). For example, the third user slides at the point to which the travel support information is to be associated and performs an operation to record. Then, an icon P indicating the specified point is displayed. The third user checks the point of the displayed icon P and presses a button B2 labeled "Set up a voice". This specifies the point to which the travel support information is to be associated.

[0087] Next, the third user presses the slide button B3 labeled "Put a voice" displayed on the screen shown in Fig. 8(C). This enables recording of the actual voice of the third user. Although not shown, when a button for completing the recording is pressed, travel support information based on the actual voice of the third user is generated, and the travel support information is associated with the location indicated by the icon P.

[0088] 9 and 10 are diagrams showing specific examples of user interfaces displayed on the user terminal 2 when the third user checks travel support information created by the third user. 9(A) shows a specific example of a map M displayed on the user terminal 2. Icons P11 to P15 indicating points associated with travel support information are displayed on the map M. The points indicated by the icons P11 to P15 are all points designated by a third user, and are each associated with travel support information based on the third user's voice.

[0089] Furthermore, the outer edge of each of the icons P11 and P15 indicates the boundary between the area where the travel support information is output (the inner area of ​​the icon) and the area where the travel support information is not output (the outer area of ​​the icon). Therefore, for example, when the first user enters the inside of the area indicated by the icon P11, the travel support information is output from the user terminal 2 of the first user.

[0090] Also, before the travel support information is output, a sound effect or a voice message may be output to notify the first user that the first user has entered the area. Furthermore, the content of the sound effect or voice message may be different for each attribute of the area.

[0091] Here, for example, it is assumed that the third user sequentially records audio information while specifying the points indicated by the icons P11 to P15 in that order. Then, a course is generated in the order in which the third user recorded the audio information. Specifically, a course is generated with the point indicated by the icon P11 as the start point and the point indicated by the icon P15 as the finish point. The generated course is used, for example, as a tour course provided by the third user in the tour service shown in FIG. 7 described above.

[0092] FIG. 9(B) shows a specific example of travel support information displayed as text information. The third user can output the associated travel support information in the form of voice information or text information by performing an operation (for example, a tapping operation) to designate each of the icons P11 to P15 indicating the point to which the created travel support information is associated. This allows the third user to easily check the content of the travel support information. For example, when the third user performs an operation to designate the icon P11 indicating the point set as the starting point among the icons P11 to P15 displayed on the map M, the travel support information associated with the icon P11 is output in the form of voice information or text information. Note that FIG. 9(B) shows an example in which the travel support information T associated with the icon P11 is output in the form of text information.

[0093] 10(A) shows a specific example of an icon indicating an area where travel support information is to be output. The third user can specify an area where the associated travel support information is to be output by performing an operation to change the size of each of the icons P11 to P15 indicating the point to which the created travel support information is associated (for example, an operation to pinch in or pinch out). This allows the third user to freely change the range of the specific area where the travel support information is to be output.

[0094] For example, when the third user pinches out on each of the icons P11 and P14 among the icons P11 to P15 displayed on the map M in FIG. 9(A) above, the size of the icons P11 and P14 increases as shown in FIG. 10(A). That is, the area in which the travel support information is output becomes wider. Also, for example, when the third user pinches in on each of the icons P11 and P14 displayed on the map M in FIG. 10(A) above, the size of the icons P11 and P14 decreases as shown in FIG. 9(A). That is, the area in which the travel support information is output becomes narrower.

[0095] FIG. 10(B) shows a specific example of an operation for moving the area where the travel support information is output. The third user can move the area where the travel support information is output by performing an operation for changing the points where the icons P11 to P15 indicating the points to which the created travel support information is associated (for example, a dragging operation) are arranged. This allows the third user to freely change the specific point of the area where the travel support information is output. For example, when the third user performs an operation for dragging the icon P15 to the right among the icons P11 to P15 displayed on the map M in FIG. 10(A) described above, the point of the icon P15 moves as shown in FIG. 10(B).

[0096] 11(A) to 11(D) are diagrams showing specific examples of user interfaces displayed on the user terminal 2 when the first user uses the tour service. FIG. 11(A) shows a specific example of a screen displayed when the first user performs an operation to start using the tour service. The first user first inputs a place name, an address, a name of a structure, etc., into an input field R1 for specifying a starting point of the tour course and an input field R2 for specifying a finishing point of the tour course, both displayed on the screen shown in FIG. 11(A). In the example of FIG. 11(A), "Sakuragicho" is input into the input field R1, and "Motomachi-Chinatown" is input into the input field R2. That is, the first user wants to be offered a tour course starting from the area around Sakuragicho Station in Yokohama City, Kanagawa Prefecture, and finishing from the area around Motomachi-Chinatown Station in the same city. When input into the input fields R1 and R2 is completed, the screen shown in FIG. 11(B) is displayed.

[0097] FIG. 11(B) shows a specific example of a screen on which third user information is displayed. The screen shown in FIG. 11(B) displays a notation "Sakuragicho-Motomachi-Chinatown Recommended Navigation Guide Tour" and a notation "Please select the person you are interested in", as well as a captured image showing extracted users U21 to U29 who have high matching degrees in terms of information such as attributes as the third user, hobbies, characteristics, and complementary degrees of the course, among the third users. The first user performs an operation (for example, a tap operation) to specify a user of interest among the users U21 to U29. Then, the screen shown in FIG. 11(C) is displayed. In addition, when changing the tour course to be provided, the user can return to the screen of FIG. 11(A) by pressing the button B4 marked "Back".

[0098] Fig. 11(C) shows a specific example of the third user information of the second user designated by the first user. Note that the third user information shown in Fig. 11(C) is the third user information of the user U23 designated by the first user among the users U21 to U29, which are the third users shown in Fig. 11(B) described above.

[0099] The third user information shown in FIG. 11(C) displays the "profile" of user U23, including hobbies, characteristics, and an overview of the tour courses offered. If the first user refers to the information in the "profile" of user U23 and thinks that the user is suitable as a guide for his / her tour, he / she presses button B5 marked "Select this person." This displays the screen shown in FIG. 11(D). If the user wishes to change the designation of the second user, he / she can return to the screen of FIG. 11(B) by pressing button B6 marked "Back."

[0100] In this way, the first user can freely select and use tour courses provided by users who match his / her hobbies and preferences from among the users extracted as the third user. This type of service is not limited to the use cases of traditional travel tours, which have a limited range of tour guides and tour courses to choose from, but can also be used to create tours that can be left in the area as city walking courses that anyone can create, mainly in areas that have not been treated as tourist destinations until now.

[0101] Fig. 11(D) shows a specific example of a screen that is displayed when the first user performs an operation to start moving along the tour course. The screen shown in Fig. 11(D) displays buttons B7 to B9 along with a message saying "Starting the navigation tour. Do you want to close the screen?"

[0102] When the first user wants to start moving along the tour course, he / she presses the button B7 labeled "Start Tour." When the first user wants to check the contents of the tour course, he / she presses the button B8 labeled "Check Route." When the first user wants to check the second user information of the specified second user again, he / she presses the button B9 labeled "Back."

[0103] 12(A) and 12(B) are diagrams showing specific examples of user interfaces displayed on the user terminal 2-2 of the second user and the user terminal 2-1 of the first user when the second user utilizes the monitoring mode. The second user who created the travel support information using the original navigation service can use the "monitoring mode" function of the user terminal 2. The "monitoring mode" is a function that enables the second user who created the travel support information to remotely support the travel of the first user who is the output destination of the travel support information. As shown in FIG. 12(A), the screen displayed on the user terminal 2-1 of the first user is shared and displayed on the screen of the user terminal 2-2 of the second user who uses the "monitoring mode".

[0104] As shown in FIG. 12(B), the user terminal 2-1 of the first user displays a map M including icons P21 to P25 indicating locations to which the travel support information created by the second user is associated. Among the icons P21 to P25, the icon P21 is displayed in a color different from the other icons P22 to P25. This indicates that the location indicated by the icon P21 is the current location of the first user. The screen displayed on the user terminal 2-1 of the first user is shared and displayed on the user terminal 2-2 of the second user using the "monitoring mode," so that the second user can grasp the current location of the first user at a glance.

[0105] The second user using the "monitoring mode" can add and create travel support information in the above manner even while the first user is moving. For example, assume that the first user moves through the points indicated by the icons P21 to P25 in that order, and the first user's current location is the point indicated by the icon P21. In this case, the second user can add a point to which the travel support information is to be associated in the area between the point indicated by the icon P21 and the point indicated by the icon P25.

[0106] For example, suppose that the location to which the second user wishes to additionally associate travel support information is between the location indicated by icon P24 and the location indicated by icon P25. In this case, the second user performs an operation to specify the location to which the second user wishes to associate travel support information (for example, a long press operation) and records a voice to be used as the travel support information. Then, as shown by the dashed line in FIG. 12(B), an icon P26 indicating the additionally specified location is displayed on the map M. As a result, when the first user enters inside the area indicated by icon P26, the travel support information associated with icon P26 is output.

[0107] Here, for example, assume that the first user starts using a tour course that moves through the points indicated by the icons P21 to P25 shown in FIG. 12B in that order, and the first user's current location is the point indicated by the icon P21. In this case, the first user can enjoy the tour while listening to the travel support information associated with each of the points indicated by the icons P21 to P25 in order by moving through the tour course in the order shown. However, the first user may be a person who needs to be watched over, such as an elderly person or an elementary school student, or may be a person who is visiting a place for the first time, and may make a mistake in judgment when moving and get lost.

[0108] In response to this, the user terminal 2 of the first user outputs judgment support information that supports the judgment of the direction of the first user moving in a specified area, thereby reducing the risk that the first user will make a mistake in judgment and get lost. Unlike the movement support information, the judgment support information in this embodiment is output as pre-created versatile sound effects or voice messages, rather than as audio information of the third user's actual voice. Hereinafter, the function of the user terminal 2 to output judgment support information to the first user will be referred to as a "calibration function."

[0109] For example, if the first user's current location deviates from the original course, the calibration function outputs a sound effect or a voice message indicating that the first user has deviated from the original course as the judgment support information. Specifically, a unique beep sound indicating that the first user has deviated from the original course or a voice message such as "You may have deviated from the course" is output as the judgment support information. In addition, a vibration function may be linked to the sound effect or voice message.

[0110] In addition to a sound effect or a voice message indicating that the course has been deviated from, a voice message for providing route guidance from the first user's current location to the closest point among the points indicated by each of the icons P21 to P25 may be output as the decision support information. However, there may be cases where the closest point from the first user's current location among the points indicated by each of the icons P21 to P25 is a point that has already been visited (erased). In such a case, the user terminal 2 may output, as the decision support information, a voice message for providing route guidance from the first user's current location to the closest point among the points not visited by the first user.

[0111] Here, the "voice message for providing route guidance from the first user's current location to the closest location" output from the user terminal 2 as the judgment support information may refer to a direction such as "go east about XX meters" or a scenery such as "go XX meters in the direction where the sea is visible". However, depending on the ability of the first user and the environment in which the first user is placed, it may be difficult for the first user to move according to the voice message that refers to the direction or scenery. In such a case, for example, the current body direction of the first user may be estimated, and a voice message regarding a small physical movement such as "turn right", "turn left", or "look back" may be output as the judgment support information. In addition, a mechanism is formed in which the sound or vibration is changed when the user faces the correct direction, and the correctness of the walking direction can be notified at regular intervals without visually checking the information on the visual device.

[0112] The method of estimating the current body orientation of the first user is not particularly limited. For example, the current body orientation of the first user may be estimated based on various information such as the orientation of the user terminal 2 specified from the acceleration and geomagnetic values ​​detected by the user terminal 2, three-dimensional information of the first user's body, and how the first user holds the user terminal 2. The first user may hold the user terminal 2 by inserting it into a breast pocket, hanging it around the neck with a strap, holding it in the hand, or putting it in baggage such as a bag. Since estimation is performed taking these into consideration, a mechanism is provided for correctly linking the geomagnetic field that can be used by functions in the user terminal.

[0113] Also, for example, if the first user has not deviated from the original course, the fact that the user has not deviated from the course may be implicitly indicated by not outputting the judgment support information. Also, the fact that the user has not deviated from the course may be actively indicated by outputting a voice message such as "You are proceeding as per the course" or "If you can see XX to the right, you are not deviating from the course." These output modes may be set in advance by the first user.

[0114] <Priority Control> 13(A) to 14(F) are diagrams for explaining priority control according to this embodiment. As described above, in a tour course where people move in order, when multiple people are placed close to each other, the travel support information to be output is controlled according to the position of the first user U.

[0115] Figures 13(A) and 13(B) are diagrams showing an icon U indicating a first user, icons P1 and P2 indicating the range in which specified travel support information is to be output, and areas E1 and E2 corresponding to icons P1 and P2, respectively. It should be noted that the travel support information corresponding to the icon P1 and the icon P2 are adjacent travel support information on a tour course along which travel is performed in order. Moreover, the areas E1 and E2 are areas indicating boundaries for determining whether or not to continuously output travel support information corresponding to the icons P1 and P2. For example, when the first user is at icon U in Figure 13 (A), the user terminal 2 outputs travel support information corresponding to icon P1, but when the first user moves to the position indicated by icon U in Figure 13 (B) (outside area E1), a message such as "out of range" is output. 13(A) and the first user continues to move straight into the range indicated by the icon P2, the user terminal 2 moves outside the area E1, but does not output a message such as "Out of range" as described above. This is because the first user enters the range of area E2 before moving outside the area E1, and as described above, when the first user enters the area E2 before moving outside one area E1, the travel support information is continuously output. The diagonal lines in the icon P1 in the drawing indicate that erasure (putting the audio in a state where it has already been output) has been performed as a result of outputting travel assistance information.

[0116] As shown in Figures 13(C) and 13(D), the user terminal 2 continuously outputs travel support information in the same manner as described above, even when an icon P2 corresponding to one piece of travel support information (the range in which the other piece of travel support information is output) is included within an area E1 corresponding to the other piece of travel support information.

[0117] Figures 13(E) and 13(F) are diagrams showing an example in which there is a "start sound" (corresponding to icon P1 in Figures 13(E) and 13(F)) that is set to be output first on a tour course that moves in a sequence. 13(E) from the position indicated by icon U to the range indicated by icon P2 without passing through the range indicated by icon P1, the user terminal 2 does not output travel support information corresponding to icon P2. This makes it possible to avoid outputting audio in the middle (audio corresponding to icon P2) when travel support information is to be output continuously.

[0118] When the first user moves from the position indicated by icon U in Fig. 14(A) to the position indicated by icon U in Fig. 14(B), the user terminal 2 may output the travel support information corresponding to icon P4 without performing the above-mentioned control. This is because the travel support information corresponding to icon P3 is not a start sound, and in this case, the travel support information before (past) icon P4 (travel support information corresponding to icons P1 to P3) may be erased.

[0119] Furthermore, when the first user moves from the position shown in icon U in FIG. 13(E) into a range outside the area E1 corresponding to the start sound and within which subsequent travel support information is to be output, the user terminal 2 may output the subsequent travel support information without performing the above-mentioned control. In this case, travel support information prior to (past) the above-mentioned subsequent travel support information may be erased in the tour course in which the user moves in sequence. Note that once erased travel support information, the erasure may be reset if the user moves out of the area corresponding to all travel support information in the tour course in which the user moves in sequence.

[0120] Furthermore, in controlling the start sound, the user terminal 2 may not output travel support information corresponding to icon P3 when the first user moves straight from the position indicated by icon U in Fig. 14(C) to the position indicated by icon U in Fig. 14(D). This allows travel support information corresponding to icons P1 to P3 to be output continuously (in order) even if they are close to each other in a tour course in which the users move in order. When the icon P3 is located outside the area E1 (when it is not close), the user terminal 2 may output the travel support information corresponding to the icon P3 without performing the above-mentioned control. In this case, the travel support information before (past) the icon P3 (travel support information corresponding to the icons P1 to P2) may be erased.

[0121] In addition, even if the first user moves straight from the position shown in icon U in Figure 14 (C) to the position shown in icon U in Figure 14 (D), if the movement support information corresponding to icon P1 is not a start audio, the user terminal 2 should output the movement support information corresponding to icon P3.

[0122] Furthermore, when the first user moves straight from the range of icon P1 through the range of icon P2 to the position shown by icon U in Fig. 14(E), the user terminal 2 may output travel support information corresponding to icons P1, P2, and P4 in that order. This is because the range of icon P3 is located outside the area E2 corresponding to icon P2, and therefore the travel support information corresponding to icon P3 is ignored. In addition, as shown in Figure 14 (F), when the range of icon P3 (including a part of it) is located within area E2 corresponding to icon P2, even if the user moves straight from the range of icon P1 through the range of icon P2 to the position shown by icon U in Figure 14 (E), the user terminal 2 does not output travel support information corresponding to icon P4.

[0123] 14(E), if the first user moves through the areas indicated by icons P1 to P4 in order, the erasure is not reset. This is because, although the area of ​​icon P3 does not overlap area E2, area E2 and area E3 overlap (are continuous).

[0124] As described above, when the pieces of mobility support information are close to each other and the first user moves into the range corresponding to the second mobility support information before finishing listening to the first piece of mobility support information, the user terminal 2 may output the second mobility support information after finishing outputting the first piece of mobility support information.

[0125] <Advantageous Effects of the Present Embodiment> According to the above-mentioned embodiment, for example, it is possible to create travel support information for a person who has the closest relationship with the elderly grandmother and who gives the elderly grandmother peace of mind. Specifically, as in the above-mentioned example, family members, grandchildren, etc. who know the elderly grandmother well can record their own voices to create travel support information to be used by the grandmother. In this case, original travel support information can be created taking into consideration the roads that the grandmother usually travels and the locations of the stores that the grandmother frequents. On the other hand, the grandmother, who uses the travel support information, sometimes forgets the way due to old age. She can ask someone for directions, but she may not be able to ask anyone for directions due to shame or fear. In such a situation, if the grandmother can hear travel support information based on the voices of family members and friends who know her well, she can move around with confidence without asking anyone for directions while receiving the support of her memory as a reliable voice from a corner of her memory. The opposite is also true. Elderly people may know more about dangerous places for children and their history, so by conveying this information in their own words, it will not only help to ensure the safety of their children, but also motivate the elderly people to use the service.

[0126] In addition, travel support information created for one person can be provided to multiple people. The above-mentioned tour service is a specific example of a method for providing travel support information to multiple people. According to the tour service, multiple people can use one tour course. In addition, when there are multiple tour courses that can be used by multiple people, one tour course can be created by linking the multiple tour courses. In this case, the multiple tour courses may be automatically linked by having AI (artificial intelligence) perform the linking work. This makes it possible to automatically create, for example, one tour course that connects a home and a destination door-to-door. In addition, since it is also possible to match tour courses by AI (artificial intelligence), for example, a tour course created and provided by a sake lover (for example, a tour around a sake brewery) can be matched to a tour course suitable for a sake lover.

[0127] In addition, the above-mentioned mobility assistance information is not only used as a simple guide to get to a store, but is also expected to be used for purposes such as introducing a place to a friend, or informing a family member of danger. For example, when a friend says, "I went here, and this route was fun!", the user actually wants the friend to take them there, but the friend who is showing them around may not be particularly keen to go with them because they have been there once before. This can be applied to situations where the friend can imagine and tell them things they should be careful of. This can be applied not only to one-to-one navigation guided tour relationships between users, but also to one-to-N (multiple) and N (multiple) to N (multiple) relationships. In addition, in the case of an interaction between a grandfather and grandchild, the grandchild can imagine his grandfather and communicate when he senses danger, or act as if he is walking with his grandfather. In this embodiment, since the guidance is based on the visible scenery, it is expected that serendipity will occur by seeing the scenery, which is often overlooked as a social issue. This has the advantage of creating a society where people can understand and move around the area without skipping important information about the city, for example.

[0128] <Other embodiments> Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present invention are included in the present invention.

[0129] For example, in the above embodiment, an example is described in which one user (third user) creates travel support information, and one or more users (first users) other than the user use the travel support information, but the present invention is not limited to this. For example, the user who created the travel support information can also use the travel support information himself. In addition, the created travel support information can be used by one or more users separately or simultaneously. Furthermore, the travel support information may be subject to buying and selling, so that the person who created the travel support information (third user) can receive a predetermined incentive.

[0130] In the above embodiment, a user corresponding to the second user is extracted from the third users who created the travel support information, and is displayed as second user information in a selectable manner on the user terminal 2 of the first user, but this is not limited to the above. The step of extracting a user corresponding to the second user from the third users may be omitted, and the second user may be designated in advance from the user terminal 2 of the first user. Specifically, for example, in the example of FIG. 6 described above, the second user, user U2, may be designated in advance by operating the user terminal 2-1 of user U1, the first user.

[0131] 10(A) above, the size of the area in which travel support information is output can be understood from the size of each of the icons P11 to P15, but this is not limiting. For example, the color or design of each of the icons P11 to P15 may represent the difference in the size of the area in which travel support information is output.

[0132] In addition, regarding the size (detection range) of each of the icons P11 to P15 in Figure 10 (A) described above, if the size is made small, it will not be possible to detect it on wide roads, and if the size is made large (for example, 10 m), there is a problem that adjacent pieces of travel support information will interfere with each other. For this purpose, it is advisable to use the position information of the center point of each piece of travel support information. For example, travel support information (e.g., voice) having a center point closest to the user's position is output. This makes it possible to provide the user with correct travel support information even in the case of interference as described above.

[0133] In addition, in the method shown in Fig. 8(C) above, recording may be performed, for example, when a predetermined slide bar displayed on the screen is slid in addition to pressing the record button. When the user releases the slide bar, recording may be stopped. The slide bar may be a type that slides horizontally or vertically. Specifically, it is preferable to start recording when the vertical slide bar is slid downward. The vertical sliding type has the advantage that it is easier to slide than horizontally, for example, when holding the smartphone in one hand. When a voice is generated using the vertical bar, it is preferable to be able to delete the generated voice by sliding it upward.

[0134] Also, to save the trouble of pressing the record button each time, a new item (L-shaped hook) can be provided around (for example, below) the slide bar, and by tapping the item, continuous recording can be performed, for example, every 15 seconds. Note that the continuous recording mode can be cancelled by sliding the item upwards.

[0135] In addition, if you want to input a longer audio signal other than the 15-second sound mentioned above, you can turn on a setting such as "embed audio as sound" in advance, which allows you to place the audio from when the user speaks until when they press the button in the desired location.

[0136] The type of travel assistance information may also be determined according to the recording time. For example, if the recording time is less than a predetermined time (e.g., 10 seconds or 15 seconds), the travel assistance information may be determined as "navigation voice" to inform the driver of the route. For example, if the recording time is equal to or longer than a predetermined time, the travel assistance information may be determined as "guidance voice" to explain facilities, etc. In addition, the user may be able to distinguish between the above-mentioned "navigation voice" and "guide voice." For example, the beginning sound of the "navigation voice" that the user listens to while walking may be "pon" and the beginning sound of the guide voice may be "ponpon." In addition, if the user reaches a location corresponding to the "navigation voice" while the "guide voice" is being played, the "navigation voice" may be given priority and output as voice. In addition, after listening to the "Guide Voice" for a long time (e.g., 10 minutes), the user may become confused as to which direction to go next. In this case, for example, it is recommended to output the "Navigation Voice" for the next destination by using the following trigger. End the guide audio playback -Leaving the area where the movement support information is detected (for example, a diameter of 20 m) - Rotate 360 ​​degrees on the spot In addition, when a part of the area corresponding to the "guide voice" overlaps with a part of the area corresponding to the "navigation voice", the "navigation voice" may be output in response to the above-mentioned trigger.

[0137] The distance (between the center points) between the above-mentioned "navigation voices" may be set to a predetermined distance (for example, about 30 m from the center point). In addition, the above-mentioned "navigation voice" is, in principle, a recorded voice, but it would be very tedious to record the voice at all "predetermined points", and the user may not want to hear the voice if they are on the right path. Therefore, if the user is on the right path, a different sound (such as a beep) may be output instead of the voice. In addition, the types of "audio" may include "audio" that requires voice in addition to the above-mentioned ones with voice and those without voice. For example, when using a "voice" that requires voice, it may be necessary to use voice on roads with curves of a certain angle or more (for example, about 15 degrees or 30 degrees) or roads with branching roads. On the other hand, on roads with few curves, a "navigation voice" without voice can be installed. In addition, since there are many complicated navigation routes, the route order between the "navigation voices" may be preset in the system. This allows the user to be guided to the correct route regardless of the distance between the "navigation voices." Furthermore, even if the areas of the "navigation voice" (travel support information) overlap, the user should be guided to a preset navigation route as described above. However, if the user's own location cannot be moved according to the preset order and is a predetermined distance (e.g., 30 m) or more away from the center point of the next travel support information, semi-calibration should be triggered and the travel support information of the nearest location should be indicated. In addition, since travel assistance information on a route that has been passed through is deleted, the travel assistance information that has not been deleted is pointed to. Even in this case, if the vehicle is a certain distance (e.g., 30 m) or more away from the center point of the current travel support information, semi-calibration is triggered and the vehicle is guided to head to the nearest travel support information. In this case, the clearing process may be reset even if the vehicle has already passed the center point. In addition, when a voice is required as described above (such as in the case of a curve at a predetermined angle), it is advisable to use a sound (such as cha-raan) different from the normal sound (such as poon).

[0138] In the above-described embodiment, when the "navigation voice" and the "calibration voice" overlap, the "navigation voice" should be given priority. For example, when the "calibration voice" comes close to the "navigation voice", the "calibration voice" should be generated after the "navigation voice" ends. Also, when the vehicle approaches an area corresponding to the "navigation voice" while the "calibration voice" is being output, the "calibration voice" should be canceled midway. Once activated, calibration sounds will be generated whenever a rotational navigation gesture is received, so when you reach an area corresponding to any of the mobility support information, it is recommended that you switch to the normal semi-calibration mode for subsequent generation.

[0139] The above-mentioned navigation route may be automatically assigned. For example, it is assumed that allocation will be performed at a predetermined interval (for example, 30 m interval) from the user's current location and the set location. Also, for example, it is assumed that calculations are made from the goal and intermediate points and allocation is made at predetermined intervals (for example, 30 m intervals) to the start point. Furthermore, for example, a route including a curve of a predetermined angle (for example, 15 degrees or more) may be automatically assigned as a navigation route. If the information capacity of the tour information is larger than a predetermined value, it is advisable to divide the tour information. For example, assuming a tour of 1 hour and 30 minutes, it would be possible to go from the start to the goal without dividing the tour, but due to issues with file capacity, it is advisable to divide the tour into 30-minute intervals and divide the service into 30-minute intervals as well. For example, the first 30 minutes may have voice, and the following hour may have no voice.

[0140] In the example of Fig. 11(B) described above, only the captured images of the user extracted as the second user from among the third users are displayed as the second user information, but the second user information is not limited to this. For example, the number of tour courses provided by the second user, the contents of the evaluation from the first user (for example, the number of so-called "likes" or comments), a part of the profile (for example, hobbies), etc. may be displayed.

[0141] In the above-described embodiment, the decision support information output to the first user is different from the travel support information in that it is not audio information of the third user's real voice, but is a versatile sound effect or audio message created in advance. However, it is not limited to this, and the audio message output as the decision support information may be based on the real voice.

[0142] In the above embodiment, the decision support information is output to the first user who is moving along the tour course, but is not limited to this. The decision support information may be output to a third user who is creating a tour course.

[0143] In the above embodiment, the second user using the "watching mode" can additionally create travel support information, but this is not limited thereto. For example, audio may be recorded so as to interrupt the travel support information being output. For example, if the created travel support information is 10 minutes of audio information, one or more audio may be recorded so as to interrupt the travel support information being output for 10 minutes. In this case, the output of the travel support information may be stopped midway during the interrupt recording, and when the interrupt recording ends, the output of the stopped travel support information may be resumed.

[0144] In the above-described embodiment, the user may also initiate the above-described recording by uttering a trigger word. For example, if the trigger word "Grandma" is set in advance based on voice recognition in the system, when the user speaks "Grandma," the word triggers the recording mode to start and a 15-second recording countdown begins. When recording ends (15 seconds have passed), the system goes into standby mode. If the trigger word is spoken again during standby mode, recording will start again. An important element of a navigation guide is who you are delivering it to. By setting a trigger word, you can explicitly state who you are delivering the words to, and it will help you to become aware of that person's feelings and be able to deliver the words you want to convey.

[0145] In the above embodiment, the supporter (the person creating the navigation guide) speaks into the smartphone microphone. The points where the words are recognized as voice are registered as POIs (points of interest: points that can be represented on a map). The POI is set as the name of the POI as text information recognized as voice, and the voice of the supporter (live voice) remains as voice recording information as an audio media file, and a geofence (an area set as location information surrounded by a virtual boundary) remains as a function to play the media file. The user can use the function without being aware of POIs or geofences, as the voice of the supporter, pre-recorded as a media file, acts as a navigation guide with each change in latitude and longitude as if a person is nearby, and the supporter becomes a presence that accompanies and accompanies the user on their journey. This voice is played with each change in latitude and longitude as if the supporter is actually present on the ground, and the function of the supporter can be expanded as a virtual presence, establishing augmented reality technology for mobility using only hearing, without the use of visual information such as a display.

[0146] In addition, as a scenario in which the above-mentioned travel support information is used, for example, the following scenario is assumed. In the first scenario (1:N), when the destination is decided, the user is expected to search for a route using navigation. In this case, many people who are the most knowledgeable about the destination will appear on the application. Among these people, the user will be automatically matched with people who share the same hobbies and tastes as the user. After checking the profiles of the matched people, the user will receive navigation based on the mobility support information of people who the user thinks "could be friends with" or "want to walk with." This allows the user to enjoy the scenery without worrying about the electronic device at hand, and by walking while looking at the scenery, the user will be able to experience arriving at the goal before they know it.

[0147] In the second scenario (one-to-one), when you are meeting up with a friend, your friend will send you a link for mobility support information. When you select the link, a navigation route to your destination will be completed. This allows you to walk without looking at the screen of your device, and you will be told about the fun things about the town. You will then realize, "What a fun town!" You will also have the experience of arriving at your destination before you know it. Your friend can also provide you with information about the town that only locals know, or information about towns that you like.

[0148] The third scenario (one-to-one) is to imagine a target person and generate travel support information for that person to do a preliminary check before coming to the town. For example, if the target person likes cute shops and sets destinations such as cake shops, flower shops, art museums, etc., spots where the person can enter their voice are automatically output at equal intervals, and the person can add interesting shops by dragging. This completes an original tour of the town. The completed travel support information (link) is sent to the target person.

[0149] As a fourth scenario (1:N), for example, it is assumed that information such as "Many people get lost when climbing this mountain, it's a big problem," "This place is dangerous, this place has a spectacular view, watch your step, you need to arrive here at xx o'clock to reach the lodge by evening" is left as travel support information. This allows the user to use the travel support information without, for example, removing gloves and operating electronic devices. It also gives the user a sense of security that someone is nearby, reducing feelings of loneliness. It also prevents the user from concentrating too much on the electronic device at hand, so that the user can quickly notice animals such as bears, for example.

[0150] In the fifth scenario (evaluation scenario), users are expected to make evaluations such as "The specified tour was fun," "They showed me places only locals know. They are amazing professionals in this field!", "I want to say thank you," "I want to use it every day," and "I was able to earn my walking points."

[0151] The sixth scenario (market scenario) is that users will use tours (travel support information) when the next day is a holiday. It is also assumed that users will use tours that are less crowded and allow them to discover something, rather than the roads they usually walk on. It is also assumed that users will use tours to lesser known tourist spots.

[0152] In addition, the above-mentioned series of processes can be executed by hardware or software. In other words, the above-mentioned functional configuration is merely an example and is not particularly limited. In other words, it is sufficient that the information processing system is provided with a function capable of executing the above-mentioned series of processes as a whole, and the type of functional block used to realize this function is not particularly limited to the above-mentioned example.

[0153] In addition, the location of the functional block is not particularly limited and may be arbitrary. For example, the functional block of the management server 1 may be transferred to another device, or the functional block of another device may be transferred to a server. In addition, one functional block may be configured as a single piece of hardware, a single piece of software, or a combination of both.

[0154] When a series of processes is executed by software, a program constituting the software is installed in a computer or the like from a network or a recording medium. The computer may be a computer built into dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

[0155] The recording medium containing such a program may be configured not only as a removable medium (not shown) distributed separately from the device main body in order to provide the program to the user, etc., but also as a recording medium etc. provided to the user in a state in which the medium is pre-installed in the device main body. Since the program can be distributed via a network, the recording medium may be mounted on or accessible to a computer connected or connectable to the network.

[0156] In this specification, the steps describing the program recorded on the recording medium include not only processes performed in chronological order, but also processes that are not necessarily performed in chronological order but are performed in parallel or individually. In addition, in this specification, the term "system" refers to an overall device composed of multiple devices, multiple means, etc.

[0157] In other words, the information processing system to which the present invention is applied can take various forms having the following configurations. (1) That is, an information processing system to which the present invention is applied (e.g., information processing system S in FIG. 1) has a management means (e.g., "information management unit 31" in FIG. 3) that manages travel support information (e.g., voice information) for supporting the travel of a first user (e.g., "user U1" in FIG. 6) moving in a predetermined area (e.g., "residential area A1" in FIG. 6) by associating the information with a predetermined point (e.g., "XXXX 1st intersection P1" in FIG. 6) in the predetermined area, and a voice output means (e.g., "transmission control unit 36" in FIG. 3, "voice output control unit 53" in FIG. 4) that outputs the travel support information associated with the predetermined point to the first user when the first user approaches the predetermined point, and the travel support information is information generated based on the actual voice of a second user (e.g., "user U2" in FIG. 6) who has a predetermined relationship (e.g., parent-child relationship, relationship of close age, relationship of having common hobbies and tastes, etc.) with at least one of the first user and the predetermined area. As a result, the travel support information generated based on the voices of the first user or the second and third users having a predetermined relationship with the predetermined area is associated with a predetermined point in the predetermined area and managed, and when the first user moving through the predetermined area approaches the predetermined point, the travel support information associated with the predetermined point is output to the first user. As a result, the first user can get the feeling that the second and third users are guiding him / her there and then. When the third user changes, the content information guided to him / her is different even for the same tour course, which brings out new motivation to move.

[0158] (2) The system may further include a second user extraction means (e.g., “extraction unit 34” in FIG. 3) that extracts a user corresponding to the second user from among third users (e.g., “user U2” in FIG. 6) who created the mobility support information. In this way, a user who corresponds to the second user is extracted from among the third users who created the travel support information. As a result, the first user can feel as if the extracted second user is guiding him or her on the spot.

[0159] (3) In addition, the second user extraction means can extract a user corresponding to the second user from among the third users based on information regarding the specified area, information regarding the first user, and information regarding the third user. In this way, a user corresponding to the second user is extracted from among the third users based on the information on the predetermined area, the information on the first user, and the information on the third user. As a result, the first user can feel as if the extracted second user is guiding him or her around the area.

[0160] (4) The mobile device further includes a second user information notification means (e.g., the “extraction unit 34” and the “transmission control unit 36” in FIG. 3 ) for notifying the first user of information regarding the second user (e.g., the above-mentioned “second user information”), and a designated information acquisition means (e.g., the “acquisition unit 33” in FIG. 3 ) for acquiring designated information indicating the second user designated by the first user, and the voice output means can output the mobility support information generated (e.g., generated by the “generation unit 35” in FIG. 3 ) based on the actual voice of the second user designated by the first user to the one user. This allows the first user to be notified of information about the second user, and the travel support information generated based on the actual voice of the second user designated by the first user is output to the first user. As a result, the first user can feel as if the second user designated by the first user is guiding him or her on the spot.

[0161] (5) The system may further include a question management means (e.g., the “information management unit 31” in FIG. 3) for managing questions for generating the travel support information, the questions being related to at least one of the first user and the specified location, a question implementation means (e.g., the transmission control unit 36 ​​in FIG. 3, the acquisition unit 51 in FIG. 4, and the audio output control unit 53) for notifying the third user of the questions at a specified timing, and a response recording means (e.g., the recording control unit 55 in FIG. 4) for recording a voice response from the third user to the questions. As a result, a question regarding at least one of the first user and the specified location is notified to the third user at a specified timing, and a voice response to the question from the third user is recorded, making it possible to generate travel support information.

[0162] (6) Furthermore, the question management means can manage, as questions about the first user, questions regarding at least one of information indicating the attributes of the first user (e.g., age, gender, hobbies, thoughts, personality, etc.) and information indicating the relationship between the first user and the third user (e.g., the relationship between the first user and the third user, the impression of the first user from the third user, etc.). In this way, questions about at least one of information indicating the attributes of the first user and information indicating the relationship between the first user and the third user are managed as questions about the first user, and the questions are notified to the third user at a predetermined timing. Then, a voice response from the third user to the questions is recorded, making it possible to generate travel support information.

[0163] (7) The question management means can manage questions about information indicating attributes of the specific location (for example, location, climate, season, date and time, scenery, history, etc.) as questions about the specific location. In this way, questions about information indicating attributes of the specific location are managed as questions about the specific location, and the questions are notified to the third user at a specific timing. Then, a voice response from the third user to the questions is recorded, so that travel support information can be generated.

[0164] (8) In addition, the question implementation means can output the question to the third user at a timing when the third user approaches the specified location, which is identified based on information indicating the third user's current location (for example, the third user's current location identified by the location identification unit 32 in Figure 3). As a result, the question is output at a timing when the third user approaches a predetermined point based on the information indicating the third user's current location, so that travel support information can be generated for each predetermined point.

[0165] (9) Furthermore, the question execution means can output the question to the third user when the third user moves a predetermined distance or when a predetermined time has elapsed. As a result, the question is output when the third user has traveled a predetermined distance or when a predetermined time has elapsed, making it possible to generate travel support information according to the travel distance and travel time of the third user.

[0166] (10) The audio output means can further output, to the first user, judgment support information which is audio information (e.g., voice, sound effects, etc.) for supporting the first user in judging a direction. In this way, the decision support information is output to the first user, and the first user is able to make a decision based on the decision support information. As a result, the first user can arrive at the destination efficiently without making a mistake in the direction of travel.

[0167] In addition, an information processing device to which the present invention is applied (for example, the management server 1 in FIG. 1) The system includes a management means for managing travel support information for supporting the movement of a first user moving within a specified area, the travel support information being output to the first user moving within the specified area and associated with a specified point in the specified area, and an audio output means for outputting the travel support information associated with the specified point to the first user when the first user approaches the specified point, wherein the travel support information is information generated based on the actual voice of a second user having a specified relationship with at least one of the first user and the specified area. [Explanation of symbols]

[0168] 1: Management server, 2: User terminal, 11: CPU, 16: Output unit, 17: Input unit, 18: Storage unit, 19: Communication unit, 31: Information management unit, 32: Location identification unit, 33: Acquisition unit, 34: Extraction unit, 35: Generation unit, 36: Transmission control unit, 51: Acquisition unit, 52: Information management unit, 53: Audio output control unit, 54: Display control unit, 55: Recording control unit, 56: Transmission control unit, S: Information processing system, N: Network

Claims

[Claim 1] a management means for managing travel assistance information for supporting the travel of a first user, the travel assistance information being output to a first user traveling within a predetermined area, in association with a predetermined point within the predetermined area; a voice output means for outputting the travel support information associated with the predetermined point to the first user when the first user approaches the predetermined point; having The travel support information is information generated based on a real voice of a second user having a predetermined relationship with at least one of the first user and the predetermined area. Information processing system.

Images