Travel support terminal, device, system, method, and program

Abstract

To enrich travel of a second user by using a travel history obtained from an actual trip of a first user.SOLUTION: A travel support terminal comprises: acquisition means that acquires information regarding a recommended location determined on the basis of tour record information which is generated on the basis of a photographing order including multiple images captured by a first user at respective locations and in which the photographing locations of the images are associated with respective locations in a three-dimensional virtual space, and position information of a second user; and display means that causes a screen displayed from the viewpoint of the second user to display a recommendation to move to the recommended location.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a travel assistance terminal, a device, a system, a method, and a program. [Background technology]

[0002] Patent Document 1 discloses a technology related to an information processing device that renders a virtual space image based on a two-dimensional image. The information processing device according to Patent Document 1 creates data of a three-dimensional virtual space including an imaged object or a landscape based on two-dimensional image data capturing the imaged object or a landscape, and renders a virtual space image viewed from a virtual camera based on the three-dimensional virtual space data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-008779 Summary of the Invention [Problem to be solved by the invention]

[0004] Therefore, there is a need for prospective travelers to utilize the travel histories of other travelers' actual experiences when planning a trip.

[0005] In view of the above-mentioned problems, the purpose of the present disclosure is to provide a travel support terminal, device, system, method, and program for assisting a second user in enhancing the trip of the first user by using the travel history of the first user's actual travels. [Means for solving the problem]

[0006] The travel support terminal according to the present disclosure includes: an acquisition means for acquiring information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of taking the images, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; a display means for displaying a recommendation to travel to the recommended location on a screen displayed from the viewpoint of the second user; Equipped with.

[0007] A travel assistance device according to the present disclosure includes: a generating means for generating tour record information based on the order of taking images including a plurality of images taken at each location by the first user; a registration means for registering the tour record information so that the second user can use the tour record information by associating the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space; Equipped with.

[0008] The travel support terminal according to the present disclosure includes: an acquisition means for acquiring a plurality of images taken at various locations by a first user; a registration means for registering the tour record information generated based on the photographing order including the plurality of images, by associating the photographing location of each image with each location in the three-dimensional virtual space, so that the tour record information can be used by a second user; Equipped with.

[0009] The travel support system according to the present disclosure comprises: a first travel assistance terminal; a second travel assistance terminal; a travel assistance device; the first travel support terminal transmits a plurality of images taken by the first user at each location to the travel support device; The travel assistance device generating tour record information based on the order of photographing including the plurality of images received from the first travel support terminal; The photographing locations of each image included in the tour record information are associated with each location in the three-dimensional virtual space, and the tour record information is registered so that it can be used by a second user via the second travel support terminal.

[0010] The travel support method according to the present disclosure comprises: The computer Acquire information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of taking the images, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; A screen displayed from the viewpoint of the second user is displayed so as to recommend travel to the recommended location.

[0011] The travel support method according to the present disclosure comprises: The computer generating tour record information based on the order of taking the images including the plurality of images taken at each location by the first user; The photographing locations of the images included in the tour record information are associated with the respective locations in the three-dimensional virtual space, and the tour record information is registered so that it can be used by a second user.

[0012] The travel support method according to the present disclosure comprises: The computer acquiring a plurality of images taken at various locations by a first user; Tour record information generated based on the shooting order including the plurality of images is registered so that it can be used by a second user, by associating the shooting location of each image with each location in the three-dimensional virtual space.

[0013] The travel support program disclosed herein is an acquisition process for acquiring information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of shooting, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; a recommendation display process for displaying a recommendation to travel to the recommended location on a screen displayed from the viewpoint of the second user; to be executed by the computer.

[0014] The travel support program disclosed herein is a generation process for generating tour record information based on the order of taking the images including the images taken at each location by the first user; a registration process of registering the tour record information so that the second user can use the tour record information by associating the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space; to be executed by the computer.

[0015] The travel support program disclosed herein is an acquisition process for acquiring a plurality of images taken at each location by a first user; a registration process for registering the tour record information generated based on the shooting order including the plurality of images, by associating the shooting locations of each image with each location in the three-dimensional virtual space, so that the tour record information can be used by a second user; to be executed by the computer. [Effects of the Invention]

[0016] The present disclosure can help a second user to enhance their trip by using the travel history of the first user's actual trips. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 2 is a block diagram showing the configuration of a travel support terminal according to the present disclosure. [Figure 2]1 is a flowchart showing the flow of a travel support method according to the present disclosure. [Figure 3] 1 is a block diagram illustrating a configuration of a travel assistance device according to the present disclosure. [Figure 4] 1 is a flowchart showing the flow of a travel support method according to the present disclosure. [Figure 5] FIG. 2 is a block diagram showing the configuration of a travel support terminal according to the present disclosure. [Figure 6] 1 is a flowchart showing the flow of a travel support method according to the present disclosure. [Figure 7] 1 is a block diagram showing the overall configuration of a travel support system according to the present disclosure. [Figure 8] FIG. 1 is a block diagram illustrating a configuration of an information terminal according to the present disclosure. [Figure 9] FIG. 1 is a block diagram showing a hardware configuration of an information terminal according to the present disclosure. [Figure 10] FIG. 2 is a block diagram showing the configuration of a travel assistance server according to the present disclosure. [Figure 11] FIG. 2 is a block diagram showing the hardware configuration of a travel assistance server according to the present disclosure. [Figure 12] 10 is a sequence chart showing the flow of travel support processing at the time of registration according to the present disclosure. [Figure 13] 10 is a sequence chart showing the flow of travel support processing during use according to the present disclosure. [Figure 14] 10A and 10B are diagrams illustrating display examples of recommendation display information according to the present disclosure. [Figure 15] 10A and 10B are diagrams illustrating display examples of recommendation display information according to the present disclosure. [Figure 16] FIG. 1 is a block diagram illustrating a configuration of an information terminal according to the present disclosure. [Figure 17] 10 is a sequence chart showing the flow of travel support processing at the time of registration according to the present disclosure. [Figure 18] 10 is a sequence chart showing the flow of travel support processing during use according to the present disclosure. [Figure 19] 10 is a sequence chart showing the flow of travel support processing during use according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0018] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0019] <Embodiment 1> FIG. 1 is a block diagram showing the configuration of a travel support terminal 1. The travel support terminal 1 is an information processing device operated by a first user and equipped with a camera. However, the travel support terminal 1 may not be equipped with a camera and may be connected to an external camera. The first user moves between multiple locations in sequence, taking photos at each location with the camera. The travel support terminal 1 includes an acquisition unit 11 and a registration unit 12.

[0020] The acquisition unit 11 acquires multiple images taken at various locations by the first user. The registration unit 12 registers the tour record information by associating the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space. Here, the "tour record information" is information generated based on the shooting order, including multiple images taken at various locations by the first user. Therefore, the tour record information can also be considered a travel history, including the images taken at various locations and the shooting order when the first user toured (traveled around) multiple locations. Furthermore, each image included in the tour record information is associated with the shooting location where the image was taken. In other words, the registration unit 12 registers the tour record information by associating it with multiple locations in the three-dimensional virtual space. Then, the registration unit 12 registers the tour record information so that it can be used by the second user. Here, the "three-dimensional virtual space" refers to electronic information of a virtual environment in which real space is configured using three-dimensional data. The three-dimensional virtual space can be considered a fully immersive space that includes a virtual environment in which people are represented by avatars (characters that represent the user). The three-dimensional virtual space may also be called a metaverse. In the present disclosure, it is assumed that the three-dimensional virtual space has predefined locations that uniquely correspond to locations visited by the first user in the real world.

[0021] The second user is a user different from the first user. For example, if the first user is a traveler, the second user is a person who plans to travel. The registration unit 12 may also register the tour record information in an external database connected to the travel support terminal 1 via a communication network. In other words, the registration unit 12 registers the tour record information so that the second user can access (reference) it using a specified information processing device. This allows the second user to access and use the tour record information of the first user via the communication network using the specified information processing device.

[0022] 2 is a flowchart showing the flow of the travel support method. First, the acquisition unit 11 acquires a plurality of images taken at various locations by a first user (S11). Next, the registration unit 12 registers tour record information generated based on the order in which the images were taken, including the plurality of images, by associating the shooting locations of each image with various locations in the three-dimensional virtual space, so that the tour record information can be used by a second user (S12).

[0023] In this way, the tour record information of the present disclosure can be said to be information that defines the order of multiple images taken by a first user when he or she actually visited each location in real space, by regarding the order in which the images were taken, derived from differences in the shooting times, etc., as the order in which the first user visited each location. Therefore, the tour record information can also be said to be travel record information of the first user. The tour record information registers the shooting locations of each image in association with each location in the three-dimensional virtual space. Therefore, when a second user moves through the three-dimensional virtual space using a predetermined information processing device, the second user can display images taken by the first user at locations associated with the tour record information of the first user. Therefore, the second user can simulate the first user's trip through the three-dimensional virtual space. Therefore, the second user can plan his or her own trip by referring to the tour record information of the first user before or during the trip. In other words, the second user who is planning to travel can utilize the travel history actually experienced by other travelers (first users) when planning their trip. Therefore, the travel support terminal according to the present disclosure can support the second user in enhancing the trip by using the travel history of the first user's actual travels. Furthermore, the second user can also use a predetermined information processing device to refer to the tour record information and to refer to images, etc. included in the tour record information corresponding to the location in the real space, even at a predetermined location in the real space.

[0024] The travel support terminal 1 includes a processor, memory, and storage device (not shown). The storage device stores a computer program that implements the process of the travel support method shown in Fig. 2, for example. The processor then loads the computer program from the storage device into the memory and executes the computer program. The processor thereby realizes the functions of the acquisition unit 11 and registration unit 12.

[0025] Alternatively, each component of the travel assistance terminal 1 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, processors that can be used include CPUs (Central Processing Units), GPUs (Graphics Processing Units), FPGAs (Field-Programmable Gate Arrays), quantum processors (quantum computer control chips), etc.

[0026] Furthermore, when some or all of the components of the travel support terminal 1 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., in which each device is connected via a communication network. Furthermore, the functions of the travel support terminal 1 may be provided in a SaaS (Software as a Service) format.

[0027] <Embodiment 2> 3 is a block diagram showing the configuration of the travel support device 2. The travel support device 2 is an information processing device for sharing information about the travel history of a first user's actual travels with a second user. The travel support device 2 includes a generation unit 21 and a registration unit 22.

[0028] The generation unit 21 generates tour record information based on the order in which images were taken at each location by the first user. The registration unit 22 associates the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space, and registers the tour record information so that it can be used by the second user. The tour record information, three-dimensional virtual space, first user, and second user are the same as those in the first embodiment.

[0029] 4 is a flowchart showing the flow of the travel support method. First, the generation unit 21 generates tour record information based on the order in which images were taken, including a plurality of images taken at each location by the first user (S21). Next, the registration unit 22 associates the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space, and registers the tour record information so that it can be used by the second user (S22).

[0030] In this way, the second embodiment can achieve the same effects as the first embodiment described above.

[0031] The travel support device 2 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the process of the travel support method shown in FIG. 4, for example. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to implement the functions of the generation unit 21 and the registration unit 22.

[0032] Alternatively, each component of the travel assistance device 2 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc., may be used as the processor.

[0033] Furthermore, when some or all of the components of the travel support device 2 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, each connected via a communication network. Furthermore, the functions of the travel support device 2 may be provided in a SaaS (Software as a Service) format.

[0034] <Embodiment 3> FIG. 5 is a block diagram showing the configuration of travel support terminal 1a. Travel support terminal 1a is an information processing device operated by a second user and has a screen displayed from the second user's point of view. However, travel support terminal 1a may not have a screen and may be connected to an external screen. Travel support terminal 1a includes an acquisition unit 13 and a display unit 14.

[0035] The acquisition unit 13 acquires information about recommended points. Here, the "recommended point" is determined based on the tour record information and the location information of the second user and is a point to which the second user is recommended to travel. The "information about the recommended point" may be information itself indicating the recommended point, display information recommending travel to the recommended point, or text information explaining the recommended point. The "tour record information" is tour record information generated based on the order in which multiple images are taken by the first user at each point. The tour record information is information in which the shooting location of each image is associated with each point in the three-dimensional virtual space. For example, the acquisition unit 13 may acquire the tour record information of the first user from an external database via a communication network, as described in the first embodiment. The tour record information, the three-dimensional virtual space, the first user, and the second user are the same as those in the first embodiment. The "location information of the second user" is information indicating the location where the second user is currently staying, i.e., information indicating the second user's current location. Here, the "second user's location information" may be either the second user's current location in the three-dimensional virtual space or the second user's current location in real space (for example, location information of the travel support terminal 1a). The recommended location is a location to which the second user is recommended to travel from their current location. When the second user is using a three-dimensional virtual space, the second user's current location and the recommended location may be locations in the three-dimensional virtual space. Alternatively, when the second user is using an augmented reality (AR) space in real space using the travel support terminal 1a, the second user's current location and the recommended location may be locations in real space.

[0036] The display unit 14 displays, on the screen displayed from the viewpoint of the second user, a recommendation to travel to the recommended location.

[0037] 6 is a flowchart showing the flow of the travel support method. First, the acquisition unit 13 acquires information about recommended locations determined based on the tour record information and the location information of the second user (S13). The tour record information is information generated based on the order of capture, including multiple images captured by the first user at each location. The tour record information also associates the capture location of each image with each location in the three-dimensional virtual space. Next, the display unit 14 displays a recommendation to travel to the recommended location on a screen displayed from the second user's viewpoint (S14).

[0038] For example, when the second user visits a location included in the tour record information in either the three-dimensional virtual space or the real space, the second user is recommended a next destination based on the corresponding location in the tour record information. Specifically, the second user moves through the three-dimensional virtual space using the travel support terminal 1a before (or during) the trip. At this time, the travel support terminal 1a acquires information about the recommended destination determined (for example, by the travel support device 2 of the second embodiment) based on the tour record information of the first user and the current location information of the second user in the three-dimensional virtual space. Then, the travel support terminal 1a displays the second user on a screen displaying the three-dimensional virtual space from the second user's viewpoint, recommending that the second user move from their current location in the three-dimensional virtual space to the recommended destination. Alternatively, the second user may use the augmented reality space function using the travel support terminal 1a during the trip. In this case, the travel support terminal 1a acquires information about the recommended location determined based on the first user's tour record information and the second user's current location information in real space. Then, the travel support terminal 1a displays the captured image recommending the second user to move from their current location in real space to the recommended location. In addition, the third embodiment can achieve the same effects as the first or second embodiment described above.

[0039] The travel support terminal 1a includes a processor, memory, and storage device (not shown). The storage device stores a computer program that implements the process of the travel support method shown in FIG. 6. The processor then loads the computer program from the storage device into the memory and executes the computer program. The processor thereby realizes the functions of the acquisition unit 13 and the display unit 14.

[0040] Alternatively, each component of the travel assistance terminal 1a may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, processors that can be used include CPUs (Central Processing Units), GPUs (Graphics Processing Units), FPGAs (Field-Programmable Gate Arrays), quantum processors (quantum computer control chips), etc.

[0041] Furthermore, when some or all of the components of travel support terminal 1a are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., connected via a communication network. Furthermore, the functions of travel support terminal 1a may be provided in a SaaS (Software as a Service) format.

[0042] <Embodiment 4> FIG. 7 is a block diagram showing the overall configuration of a travel support system 1000. The travel support system 1000 is an information system that generates and registers a travel history (tour record information) of points SP1 to SPn (n is a natural number equal to or greater than 2) that a first user U1 has actually traveled to, and shares the travel history with a second user U2. The travel support system 1000 includes a plurality of information terminals 100 and a travel support server 200. The plurality of information terminals 100 and the travel support server 200 are communicably connected to each other via a network N. Here, the network N is a wired and wireless communication network. The plurality of information terminals 100 include, for example, an information terminal 100-1 operated by a user U11, an information terminal 100-2 operated by a user U12, an information terminal 100-n operated by a user U1n, and an information terminal 100-0 operated by a user U2. In the following description, information terminals 100-1 to 100-n and 100-0 may be simply referred to as "information terminal 100."

[0043] The points SP1 to SPn are included in the points in real space that the travel support system 1000 targets at least in the three-dimensional virtual space. The points SP1 to SPn are, for example, tourist spots. Note that each of the users U11, U12, ... U1n refers to the user U1 staying at the points SP1, SP2, ... SPn, respectively. Therefore, in the following description, the users U11, U12, ... U1n may be simply referred to as "user U1." In other words, the information terminal 100-1 is a terminal operated by the user U11 staying at the point SP1. The information terminal 100-2 is a terminal operated by the user U12 staying at the point SP2. Similarly, hereinafter, the information terminal 100-n is a terminal operated by the user U1n staying at the point SPn.

[0044] The information terminal 100-0 is a terminal operated by a user U2 who is staying at a location other than the points SP1 to SPn. In the example of Fig. 7, the user U1 is a traveler, and the user U2 is a person who plans to travel.

[0045] FIG. 8 is a block diagram showing the configuration of the information terminal 100. The information terminal 100 is a portable information processing device that has a camera function and is capable of wireless communication. The information terminal 100 may be, for example, a smartphone or a tablet terminal. The information terminal 100 is an example of the travel support terminals 1 and 1a described above. The information terminal 100 includes a memory unit 110, a photographing unit 121, a location information acquisition unit 122, a screen 123, an acquisition unit 131, a registration unit 132, and a display unit 133.

[0046] The storage unit 110 includes, for example, a nonvolatile storage device such as a flash memory and a memory such as a RAM (Random Access Memory), that is, a volatile storage device. The storage unit 110 stores at least user information 111. The user information 111 is information about a user who has been registered in advance as an owner (main operator). The user information 111 includes at least attribute information 1111. The attribute information 1111 includes personal information such as the user's age and gender, interest information such as hobbies and tastes, family structure, etc. The family structure includes the relationship between the user and family members (such as relationship), attribute information of each family member, the number of family members, etc. Note that the attribute information 1111 is not limited to these.

[0047] The photographing unit 121 is a camera that takes photographs in response to user operations, or a circuit or software that controls the camera.

[0048] The location information acquisition unit 122 acquires current location information of the information terminal 100 using a wireless communication function, and records the acquired location information in the storage unit 110 in association with the time of acquisition. The location information acquisition unit 122 is a device that acquires the current location information of the information terminal 100, and a circuit or software that controls the device. The location information acquisition unit 122 acquires location information periodically or upon a predetermined trigger. Examples of location information include, but are not limited to, GPS (Global Positioning System) information.

[0049] The screen 123 is a display device that displays various display information and images captured by the image capturing unit 121. The screen 123 is an example of a screen displayed from the user's viewpoint.

[0050] The acquisition unit 131 is an example of the acquisition unit 11 and acquisition unit 13 described above. The acquisition unit 131 acquires a plurality of images taken at each location by the photographing unit 121 in response to a user's operation. The acquisition unit 131 also acquires travel record information (tour record information) from the travel support server 200. The acquisition unit 131 also acquires information about recommended locations determined based on the travel record information and the user's location information. For example, the acquisition unit 131 acquires recommendation display information as information about recommended locations. The recommendation display information is display information for recommending travel to the recommended location. The recommendation display information is, for example, an arrow pointing from the current location of an avatar corresponding to the user to the recommended location, text information explaining the recommended location, or the like. However, the recommendation display information is not limited to these.

[0051] The registration unit 132 is an example of the registration unit 12 described above. The registration unit 132 transmits images taken at each location, the time of shooting, location information, etc. to the travel support server 200 in order to generate and register travel record information. The registration unit 132 may transmit a registration request for the travel record information to the travel support server 200. In this case, the registration request for the travel record information may include images taken at each location by the photographing unit 121, the time of shooting, location information, etc. The registration unit 132 may also transmit an additional registration request to the travel support server 200 in order to register a sharing user in the travel record information.

[0052] The display unit 133 is an example of the display unit 14 described above. The display unit 133 displays on the screen 123 a recommendation to travel to a recommended location. The display unit 133 may display information about the recommended location on the screen 123. The display unit 133 also displays recommendation display information on the screen 123. For example, when the information terminal 100 uses a three-dimensional virtual space, the display unit 133 displays on the screen 123 a field of view from the user's viewpoint in the three-dimensional virtual space. The display unit 133 also displays on the screen 123 display information including an avatar corresponding to the user in the three-dimensional virtual space. The display unit 133 may also display on the screen 123 the recommendation display information together with the avatar in the field of view from the user's viewpoint in the three-dimensional virtual space.

[0053] Furthermore, when user U2 visits a first location included in user U1's travel record information, the display unit 133 may display recommendation display information for a second location that user U1 visited after the first location as a recommended location based on the photographing order in the travel record information. This allows user U2 to recognize the order of the locations that user U1 actually visited. Furthermore, user U2 can simulate the experience of the route of the locations that user U1 actually visited in the three-dimensional virtual space.

[0054] Alternatively, the display unit 133 may display the recommendation display information by setting a location determined from the travel record information as a recommended location based on the time information (set time) when user U2 visited a first location included in the travel record information and the time when user U1 took a photo at the first location. This allows user U2 to set a time to visit a certain location in the three-dimensional virtual space while planning a trip, and thereby know the location that user U1 visited at a time close to the set time. This allows user U2 to realistically experience the local situation in the three-dimensional virtual space.

[0055] The display unit 133 may also display the recommendation display information based on the similarity between the attribute information of user U1 and the attribute information of user U2, and the travel record information of user U1. This allows user U2 to receive recommendations of recommended locations in a way that suits his or her needs. Furthermore, the display unit 133 may display the recommendation display information for multiple recommended locations in different display formats depending on the similarity between each attribute information included in the travel record information of multiple users U1 and the attribute information of user U2. This makes it easier for user U2 to understand the difference in the degree of recommendation for multiple recommended locations depending on the attribute similarity with each of multiple experienced travelers.

[0056] Furthermore, the display unit 133 may display recommendation display information for multiple recommended locations on the screen 123 based on the travel record information of multiple users U1. This makes it easier for user U2 to understand the locations and travel routes visited by multiple experienced travelers. This helps user U2 to create an original travel plan.

[0057] The display unit 133 may display the recommendation display information for each of the multiple recommended locations in a different display format depending on the rating by the user U1 who visited each of the multiple recommended locations. The display format of the recommendation display information may be expressed, for example, by the color or size of an arrow or a displayed character string, or by the degree of blinking or dimming. For example, the display unit 133 may display the recommendation display information in a size that increases with a higher rating and decreases with a lower rating. Alternatively, the display unit 133 may display the recommendation display information in a color that increases with a higher rating and decreases with a lower rating. Alternatively, the display unit 133 may display the recommendation display information in a color that increases with a higher rating and decreases with a lower rating. Alternatively, the display unit 133 may display the recommendation display information in a flashing manner for higher ratings and dimming manner for lower ratings. The display unit 133 may display the recommendation display information for each recommended location in a different display format depending on the number of users who actually visited and rated each recommended location. For example, the display unit 133 may display the recommendation display information (e.g., an arrow) in a display format such that the size of the recommendation display information (e.g., an arrow) increases as the number of users who have rated increases and decreases as the number of users who have rated decreases. Alternatively, the display unit 133 may display the recommendation display information (e.g., an arrow) in a display format such that the more users who have rated the recommendation information, the more noticeable the color, and the less noticeable the color, the fewer users who have rated the recommendation information. Alternatively, the display unit 133 may display the recommendation display information (e.g., an arrow) in a display format such that the more users who have rated the recommendation information, the more blinking the arrow, and the fewer users who have rated the recommendation information, the more dim the arrow. This makes it easier for user U2 to understand the differences in the ratings of actual visitors (user U1) for each recommended location. This can be used as a reference when user U2 makes a travel plan.

[0058] The display unit 133 may also display the recommendation display information for each recommended location in a different display format depending on the cost associated with each recommended location. For example, the display unit 133 may display the recommendation display information in a size that increases as the cost increases and decreases as the cost decreases. Alternatively, the display unit 133 may display the recommendation display information in a more noticeable color as the cost increases and in a less noticeable color as the cost decreases. Alternatively, the display unit 133 may display the recommendation display information in a flashing color as the cost increases and in a dim color as the cost decreases. This makes it easier for user U2 to visually grasp the cost required for each recommended location. This can be used as a reference when user U2 makes travel plans.

[0059] The display unit 133 may also display a recommendation to move to the recommended location on the screen 123 that displays the three-dimensional virtual space. The three-dimensional virtual space can be used by the user U2 via the information terminal 100.

[0060] The information terminal 100 may acquire images taken by the user U2 at various locations during the trip and generate travel record information for the travel assistance server 200. In this case, the information terminal 100 may register the travel record information of the user U2 in the travel assistance server 200 so that it can be used by the user U1 and a third user.

[0061] 9 is a block diagram showing the hardware configuration of the information terminal 100. The information terminal 100 includes a memory 101, a processor 102, a network interface 103, a display 104, and a camera 105.

[0062] The memory 101 is configured by a combination of volatile memory and non-volatile memory. The volatile memory is, for example, a volatile storage device such as RAM, and is a storage area for temporarily holding information when the processor 102 is operating. The non-volatile memory is, for example, a non-volatile storage device such as a hard disk or flash memory. The memory 101 stores at least a computer program that implements the processing of the travel support method for the information terminal 100 according to the present disclosure. Note that the memory 101 may include storage located away from the processor 102. In this case, the processor 102 may access the memory 101 via an I / O (Input / Output) interface, not shown.

[0063] The processor 102 is a control device that controls each component of the information terminal 100. The processor 102 reads and executes software (computer programs) from the memory 101. In this way, the processor 102 realizes the functions of the acquisition unit 131, the registration unit 132, and the display unit 133. In other words, the processor 102 performs processing of the travel support method for the information terminal 100 according to the present disclosure. The processor 102 may be, for example, a microprocessor, an MPU (Multi Processing Unit), or a CPU (Central Processing Unit). The processor 102 may also include multiple processors.

[0064] The network interface 103 may be used to communicate with a network node. The network interface 103 may include, for example, a network interface card (NIC) conforming to the IEEE 802.3 series. IEEE stands for Institute of Electrical and Electronics Engineers. The network interface 103 may also include a wireless local area network (LAN), a wired LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. Furthermore, the network interface 103 may include a function for acquiring location information. The network interface 103 may acquire, for example, GPS (Global Positioning System) information as the current location information of the information terminal 100.

[0065] The display 104 is a display device that displays information instructed by the processor 102. The display 104 is, for example, a screen such as a liquid crystal display or an organic electroluminescence (EL) display. The display 104 may include a touch panel. In other words, the display 104 is preferably an input / output device for the user.

[0066] Camera 105 takes a photograph in response to an instruction from processor 102 and outputs the photographed image to processor 102. Camera 105 is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. Camera 105 is one or more photographing devices.

[0067] FIG. 10 is a block diagram showing the configuration of the travel support server 200. The travel support server 200 is an example of the travel support device 2 described above. For example, the travel support server 200 receives images captured at various locations from the information terminal 100 of user U1 and generates travel record information for user U1 based on the order in which the images were captured, including the received images. The travel support server 200 then associates the capture locations of each image included in the travel record information with various locations in the three-dimensional virtual space and registers the travel record information so that user U2 can use it through the information terminal 100-0. When user U2's information terminal 100-0 uses the three-dimensional virtual space, the travel support server 200 determines recommended locations based on user U1's travel record information and user U2's location information, and transmits information about the recommended locations to the information terminal 100-0 to display it on the screen. The travel assistance server 200 includes a storage unit 210 , an acquisition unit 221 , a generation unit 222 , a registration unit 223 , a determination unit 224 , and a display unit 225 .

[0068] The storage unit 210 includes, for example, a non-volatile storage device such as a hard disk or flash memory, and a memory such as RAM (Random Access Memory), i.e., a volatile storage device. The storage unit 210 stores at least three-dimensional virtual space information 211. The three-dimensional virtual space information 211 stores user information 231, location information 241 to 24n, and one or more pieces of travel record information 251. The user information 231 is information about a user registered to use the three-dimensional virtual space configured in the three-dimensional virtual space information 211. The user information 231 includes at least attribute information 2311. Note that the user information 231 and the attribute information 2311 are equivalent to the user information 111 and the attribute information 1111 described above. The user information 231 also indicates user information about multiple people, including users U1 and U2.

[0069] The point information 241 to 24n is information that defines points and includes the position information of points SP1 to SPn in Fig. 7. The point information 241, etc. also includes position information in a three-dimensional virtual space. In other words, the point information 241, etc. is information that associates position information in real space with position information in a three-dimensional virtual space. Furthermore, the point information 241, etc. may also include information about stores within the points and related information about tourist spots. The store information may include the name, genre, business hours, capacity, price range, etc. of the store.

[0070] The travel record information 251 is an example of the tour record information described above. The travel record information 251 is electronic data of a travel record when a user travels around multiple locations. The travel record information 251 is information in which an image 2511, 3D data 2512, a photographing location 2513, a photographing date and time 2514, a photographing sequence 2515, related information 2516, a means of transportation 2517, attribute information 2518, and a sharing destination 2519 are associated with each other. However, the information included in the travel record information 251 is merely an example. Note that the travel record information 251 includes information in which two or more images 2511, (the 3D data 2512,) a photographing location 2513, a photographing date and time 2514, and related information 2516 are associated with each other per record (one user's travel record). Furthermore, two or more images 2511 may be associated with one photographing location 2513.

[0071] The image 2511 is image data directly captured by a user who is a traveler at a predetermined location. The 3D data 2512 is data obtained by 3D scanning the image 2511. The shooting location 2513 is any one of the location information 241 to 24n including the location information of the location where the image 2511 was captured. The shooting date and time 2514 is information about the time when the image 2511 was captured. The shooting order 2515 is the shooting order of the multiple images 2511 in one record of the travel record information 251. Therefore, the shooting order 2515 may be derived from the order of the multiple shooting dates and times 2514 in one record. Furthermore, if the shooting order 2515 is dynamically derived from the order of the multiple shooting dates and times 2514, it does not need to be stored in the storage unit 210. The related information 2516 is information related to the corresponding shooting location 2513. For example, the related information 2516 may include location information 241 (objective information) corresponding to the shooting location 2513, and comments by the user who took the photo at the shooting location 2513 (impressions, congestion, subjective information). The transportation method 2517 is the means used by the user to travel between shooting locations. Therefore, the transportation method 2517 may include different transportation methods between multiple locations. The transportation method 2517 is, for example, walking, taxi, or public transportation. The attribute information 2518 is attribute information of a user corresponding to one record of the travel record information 251. The share destination 2519 is user information (e.g., user ID, etc.) shared with one record of the travel record information 251. Users set as the share destination 2519 can use (access) the travel record information 251. Alternatively, the share destination 2519 may be all registered users of the three-dimensional virtual space. In this case, the travel record information 251 of a certain user is made public.

[0072] The acquisition unit 221 acquires images, etc. by receiving images, etc. taken at various locations from the information terminal 100 of user U1. The acquisition unit 221 also acquires images, etc. by receiving information on users with whom travel record information is shared from the information terminal 100 of user U1. The acquisition unit 221 also acquires user information and location information of user U2 by receiving it from the information terminal 100-0 when user U2 uses the three-dimensional virtual space.

[0073] The generation unit 222 is an example of the generation unit 21 described above. The generation unit 222 generates travel record information for the user U1 based on the shooting order including the received multiple images, etc. The generation unit 222 may generate the travel record information including the shooting time of each of the multiple images. The generation unit 222 may generate the travel record information including attribute information of the user U1. The generation unit 222 may generate the travel record information including the means of transportation between the shooting locations estimated based on the distance between the shooting locations in each image and the difference in the shooting dates and times of the images. Therefore, the generation unit 222 may estimate the means of transportation between the shooting locations based on the distance between the shooting locations in each image and the difference in the shooting dates and times of the images.

[0074] The registration unit 223 is an example of the registration unit 22 described above. The registration unit 223 associates the shooting locations of each image included in the travel record information with each location in the three-dimensional virtual space, and registers the travel record information so that it can be used by the second user. Specifically, the registration unit 223 identifies, from the location information 241 to 24n, location information including the shooting location acquired together with the image from the information terminal 100. Then, the registration unit 223 includes the identified location information in the travel record information 251 as the shooting location 2513. These processes can be said to be "the registration unit 223 associates the shooting locations of each image included in the travel record information with each location in the three-dimensional virtual space...and registers the travel record information." Furthermore, the registration unit 223 registers the travel record information so that it can be used by the user U2 in the three-dimensional virtual space by setting the information of the user U2 designated by the user U1 in the sharing destination 2519.

[0075] The determination unit 224 may determine a recommended location for user U2 based on the travel record information of user U1 and the location information of user U2. Specifically, the determination unit 224 identifies a shooting location (first location) in the travel record information of user U1 that includes the location information of user U2, and determines, as the recommended location, a shooting location (second location) that user U1 visited next after the first location in the travel record information of user U1.

[0076] Alternatively, the determination unit 224 determines a recommended location from the travel record information based on the time information when user U2 visited a first location included in the travel record information and the shooting time when user U1 took an image at the first location. For example, assume that user U2 sets a time to visit a certain location in the three-dimensional virtual space while planning a trip. Then, if the location visited by user U2 in the three-dimensional virtual space is the first location, the determination unit 224 may determine as the recommended location the location where user U1 took an image at or shortly after the set time.

[0077] The determination unit 224 may also determine recommended locations based on the similarity between the attribute information of user U1 and the attribute information of user U2 and the travel record information of user U1. The determination unit 224 may also determine multiple recommended locations based on the similarity between each piece of attribute information included in the travel record information of multiple users U1 and the attribute information of user U2.

[0078] The determination unit 224 may also determine recommended points based on ratings from users who have visited each of the points SP1 to SPn, or based on costs associated with each of the points SP1 to SPn.

[0079] The determination unit 224 may also determine recommendation display information for recommending travel to a recommended location based on the travel record information. Specifically, the determination unit 224 may determine the recommendation display information based on related information about the recommended location, attribute information about users U1 and U2, a set time, etc. The determination unit 224 may also determine recommendation display information to be displayed in different display forms based on related information about the recommended location, attribute information about users U1 and U2, a set time, etc. The display form may be visual information such as color, size, decoration, etc. In particular, the determination unit 224 may determine different display forms for the recommendation display information for multiple recommended locations based on the similarity between each piece of attribute information included in the travel record information for multiple users U1 and the attribute information for user U2. The determination unit 224 may also determine different display forms for the recommendation display information for each recommended location based on an evaluation by user U1 who visited each of the multiple recommended locations. The determination unit 224 may also determine a different display format for the recommendation display information at each recommendation point depending on the cost associated with each recommendation point.

[0080] The display unit 225 displays recommendation display information for recommending travel to a recommended location based on the travel record information on a screen displayed from the viewpoint of the user U2. Specifically, the display unit 225 transmits the recommendation display information determined by the determination unit 224 to the information terminal 100-0 of the user U2, thereby displaying the recommendation display information on the screen of the information terminal 100-0. In particular, the display unit 225 may display the recommendation display information for the recommended location on a screen displaying the three-dimensional virtual space used by the user U2. The display unit 225 displays the recommendation display information for the recommended location determined by the determination unit 224.

[0081] The display unit 225 may also display the recommendation display information for the multiple recommended locations in different display formats depending on the similarity between each piece of attribute information included in the travel record information of the multiple users U1 and the attribute information of the user U2.

[0082] Furthermore, the display unit 225 may display recommendation display information for a plurality of recommended locations on the screen of the information terminal 100-0 of the user U2 based on the travel record information of the plurality of users U1.

[0083] The display unit 225 may display the recommendation display information for each recommended point in a different display format depending on the evaluation by the user who visited each of the points SP1 to SPn. The display unit 225 may display the recommendation display information for each recommended point in a different display format depending on the cost associated with each of the points SP1 to SPn.

[0084] The determination unit 224 also determines recommendation display information for recommending travel to the recommended location based on the travel record information. Specifically, the determination unit 224 may determine the recommendation display information based on related information of the recommended location, attribute information of users U1 and U2, a set time, etc. In particular, the determination unit 224 may determine different display forms for the recommendation display information for the multiple recommended locations depending on the similarity between each attribute information included in the travel record information of the multiple users U1 and the attribute information of user U2. The determination unit 224 may also determine different display forms for the recommendation display information for each recommended location depending on an evaluation by user U1 who visited each of the multiple recommended locations. The determination unit 224 may also determine different display forms for the recommendation display information for each recommended location depending on the cost associated with each recommended location.

[0085] 11 is a block diagram showing the hardware configuration of the travel assistance server 200. The travel assistance server 200 includes a memory 201, a processor 202, and a network interface 203.

[0086] The memory 201 stores at least a computer program that implements the processing of the travel support method in the travel support server 200 according to the present disclosure. Other configurations of the memory 201 are the same as those of the memory 101 described above. The processor 202 is a control device that controls each component of the travel support server 200. The processor 202 reads and executes software (computer program) from the memory 201. As a result, the processor 202 realizes the functions of an acquisition unit 221, a generation unit 222, a registration unit 223, a determination unit 224, and a display unit 225. In other words, the processor 202 performs processing of the travel support method in the travel support server 200 according to the present disclosure. Other configurations of the processor 202 are the same as those of the processor 102 described above. The network interface 203 has the same configuration as that of the network interface 103 described above.

[0087] FIG. 12 is a sequence chart showing the flow of travel support processing at the time of registration. Here, it is assumed that user U1 carries information terminal 100 and travels around (visits) points SP1 to SPn. First, information terminal 100 takes a commemorative photo at point SP1 in response to an operation by user U1 (S111). Then, information terminal 100 transmits the captured image, the time of capture, and location information to travel support server 200 via network N (S112). At this time, information terminal 100 may perform a 3D scan on the captured image to generate 3D data, and transmit this data together with the image, etc. to travel support server 200. Furthermore, information terminal 100 may transmit comment information about point SP1 input by user U1 to travel support server 200 together with the image, etc.

[0088] At this time, the information terminal 100 may also transmit a request to register travel record information to the travel assistance server 200. The request to register travel record information includes the user information of the user U1 or the terminal information of the information terminal 100, in addition to the image, the shooting time, and the location information. The terminal information is configured to be able to identify the user information. Furthermore, the request to register travel record information may also include the above-mentioned 3D data, comment information, etc. In response to this, the travel assistance server 200 associates the image, the shooting time, the location information, etc. included in the received registration request with the user information and temporarily stores it in the storage unit 210. Additionally, the travel assistance server 200 may perform a 3D scan on the received image to generate 3D data, and temporarily store it together with the image, etc.

[0089] Next, the information terminal 100 takes a commemorative photo at point SP2 in response to an operation by the user U1 (S121). Then, the information terminal 100 transmits the captured image, the capture time, and location information to the travel assistance server 200 via the network N (S122). In response, the travel assistance server 200 associates the image, the capture time, and the location information included in the received registration request with the user information and temporarily stores them in the storage unit 210.

[0090] Thereafter, in the same manner, user U1 moves from one location to another and takes pictures using the information terminal 100. Then, the information terminal 100 takes a commemorative photo at a location SPn in response to an operation by user U1 (S1n1). Then, the information terminal 100 transmits the captured image, the capture time, and location information to the travel assistance server 200 via the network N (S1n2). In response, the travel assistance server 200 associates the image, the capture time, and location information included in the received registration request with the user information and temporarily stores them in the storage unit 210.

[0091] At this time, the information terminal 100 may also transmit a request to start generating travel record information to the travel assistance server 200. The travel assistance server 200 then references the multiple sets of images, their shooting times, and location information temporarily stored in the storage unit 210. The travel assistance server 200 then estimates the mode of transportation based on the distance between locations and the required time (S201). The travel assistance server 200 then generates the travel record information as described above (S202). For example, as described above, the travel assistance server 200 may identify the order in which each image was taken based on the shooting dates and times of the multiple images, and generate the travel record information including the shooting order. The travel assistance server 200 may also identify location information including the received location information, and generate the travel record information including related information in the location information. The travel assistance server 200 may also identify attribute information 2311 of user U1 from the received user information, and generate the travel record information 251 by including the identified attribute information 2311 as attribute information 2518.

[0092] Thereafter, the travel support server 200 registers the travel record information by associating each point in the three-dimensional virtual space with each shooting location (S203). For example, the travel support server 200 identifies location information including the received position information, and generates the travel record information by including the identified location information in the shooting location 2513. Thereafter, the travel support server 200 transmits the registered travel record information to the information terminal 100 via the network N (S204).

[0093] In response, the information terminal 100 plays the travel record information received from the travel assistance server 200 on the screen displaying the three-dimensional virtual space (S205). In response, the user U1 may decide which users will be the sharing destinations of the travel record information. The information terminal 100 then transmits information about the users designated by the user U1 to the travel assistance server 200 via the network N (S206). In response, the travel assistance server 200 adds and registers the received users as sharing destinations to the travel record information generated in step S202 (S207). Note that instead of additionally registering the sharing destinations, the information terminal 100 may include the designation of the users as sharing destinations in steps S112, S122, ... S1n2 or in the request to start generating the travel record information.

[0094] FIG. 13 is a sequence chart showing the flow of travel support processing during use. Here, it is assumed that user U2 uses the information terminal 100-0 to use the three-dimensional virtual space. First, the information terminal 100-0 accepts an operation by user U2 to start using the three-dimensional virtual space (S301). In response, the information terminal 100-0 transmits a request to start using the three-dimensional virtual space to the travel support server 200 via the network N. At this time, the request to start using the three-dimensional virtual space includes user information of user U2. Note that the request to start using the three-dimensional virtual space may also include location information of a starting point desired by user U2.

[0095] Then, the information terminal 100-0 receives the content of the three-dimensional virtual space from the travel assistance server 200 (S303). The content includes 3D data of the three-dimensional virtual space at the specified location and avatar information of the user U2. Then, the information terminal 100-0 displays the content (3D data and avatar) of the three-dimensional virtual space at the specified starting location on the screen 123 from the viewpoint of the user U2 (S304).

[0096] Next, the information terminal 100-0 moves the avatar from the starting point to a predetermined point in the three-dimensional virtual space in response to the operation of the user U2 (S305).Then, the information terminal 100-0 transmits the user information of the user U2 and the location information of the predetermined point to the travel assistance server 200 via the network N (S306).

[0097] In response, the travel support server 200 receives user information (attribute information) of user U2 and location information of a predetermined location from the information terminal 100-0. The travel support server 200 then identifies a first location corresponding to the received location information from the travel record information of user U1, with which the received user information is shared (S307). The travel support server 200 then determines a second location visited next to the first location from the travel record information as a recommended location (S308). The travel support server 200 then determines a display format based on the similarity of the attribute information of users U1 and U2 (S309). The travel support server 200 then generates recommendation display information for the recommended location based on the determined display format (S310). The travel support server 200 then transmits the recommendation display information to the information terminal 100-0 via the network N (S311). In response, the information terminal 100-0 displays the received recommendation display information in the three-dimensional virtual space on the screen 123 (S312). Then, steps S305 to S312 are repeated.

[0098] FIG. 14 is a diagram showing a display example of recommendation display information. The three-dimensional virtual space screen 31 is an example displayed on the screen 123 of the information terminal 100-0. It is assumed that user U2 has set "8:00" as the expected time on the three-dimensional virtual space screen 31. An avatar U2a and recommendation display information d1 are displayed on the three-dimensional virtual space screen 31. The avatar U2a is the avatar of user U2. It is assumed that the avatar U2a is moving down a street in a city as a predetermined point (first point) in the three-dimensional virtual space. The recommendation display information d1 includes an arrow pointing to a building in the upper left direction from the position of avatar U2a in the three-dimensional virtual space screen 31 and the notation "Cafe 7:00 - 21:00." Here, the recommended point "cafe" indicated by the recommendation display information d1 can be recommended for the following reasons. For example, this may be the case when the similarity between the preferences (attribute information) of users U1 and U2 is above a threshold and user U1 has visited the "cafe" in the past. Furthermore, this may be the case when user U1 rates the "cafe" higher than a threshold value. Alternatively, this may be the case when the "cafe"'s business hours include 8:00, which is user U2's expected time. Alternatively, this may be the case when the price range (cost) of the "cafe" is within user U2's set budget. From these, user U2 can recognize that the cafe is located in the direction of the arrow from his / her current location (first point) in the three-dimensional virtual space, and that the cafe (second point) will be open at the expected time of 8:00. User U2 can then recognize that the recommendation display information d1 recommends that he / she move to the cafe. This makes it easier for user U2 to move avatar U2a from his / her current location to the cafe in the three-dimensional virtual space, allowing him / her to have a simulated experience inside the cafe.

[0099] FIG. 15 is a diagram showing a display example of recommendation display information. The three-dimensional virtual space screen 32 is an example displayed on the screen 123 of the information terminal 100-0. It is assumed that the user U2 has set "12:00" as the expected time on the three-dimensional virtual space screen 32. The three-dimensional virtual space screen 32 displays an avatar U2a, recommendation display information d1, and recommendation display information d2. The recommendation display information d2 includes an arrow pointing from the position of the avatar U2a in the three-dimensional virtual space screen 32 to a building in the upper right direction, and the notation "Restaurant 11:00-14:00, 17:00-22:00." Here, the recommended location "Restaurant" indicated by the recommendation display information d2 may be recommended for the following reasons. For example, the "Restaurant" may be recommended when its business hours include 12:00, the expected time of the user U2. Alternatively, the price range (cost) of the "Restaurant" may be within the user U2's set budget. Furthermore, the recommendation display information d2 is displayed in a display format with a higher degree of recommendation than the recommendation display information d1. The display form indicating the degree of recommendation may be indicated by the color, size, highlighting, etc. of the arrow. For example, if user U1 rates "restaurant" higher than "cafe," the recommendation display information d2 may be displayed in a form indicating a higher degree of recommendation than the recommendation display information d1. Alternatively, if the number of users who rate "restaurant" higher than "cafe" is equal to or greater than a threshold, the recommendation display information d2 may be displayed in a form indicating a higher degree of recommendation than the recommendation display information d1. This allows user U2 to recognize that the restaurant is located in the direction of the highlighted arrow from his / her current location (first location) in the three-dimensional virtual space and that the restaurant (second location) will be open at the expected time of 12:00. User U2 can then recognize from the recommendation display information d2 that moving to the restaurant is more strongly recommended than moving to the café. This makes it easier for user U2 to move avatar U2a from his / her current location to the restaurant in the three-dimensional virtual space, allowing him / her to experience the restaurant in a simulated manner.

[0100] As described above, in the travel support system 1000 according to the present disclosure, first, user U1 records his / her real-life experiences at various locations in real space by taking pictures with the information terminal 100 and transmits the captured images to the travel support server 200. In response, the travel support server 200 generates travel record information for user U1 and registers the travel record information in the three-dimensional virtual space. This allows user U1 to play back the travel record information in the three-dimensional virtual space via the information terminal 100 and reminisce about his / her travel memories after the trip. Accordingly, user U1 can share the travel record information with his / her friend user U2. Specifically, the travel support server 200 receives user U2's designation as a sharing destination from user U1, and then additionally registers user U2 as a sharing destination in user U1's travel record information. In other words, the travel support server 200 registers the travel record information at the designated sharing destination so that it can be used in the three-dimensional virtual space. As a result, user U2 can, for example, simulate a trip he / she has never experienced before by playing back the shared travel record information in the three-dimensional virtual space before the trip. Alternatively, before traveling, while moving between specific locations in a three-dimensional virtual space, if the various conditions described above are met, user U2 can learn about and simulate the recommended locations visited by other users in the past. In particular, when multiple recommended locations are recommended, changing the display format according to the various conditions described above makes it easier for user U2 to visually grasp the differences in the recommendation level of each recommended location. For example, because user U2 can receive recommendations based on the travel histories and high ratings of multiple users with similar attribute information, even if they are not friends, user U2 can easily find travel destinations that suit his or her needs. In other words, the accuracy of recommendations is improved. This allows user U2 to efficiently plan his or her trip. Furthermore, such a trip plan increases the probability that user U2 will have a fulfilling trip experience. In other words, user U2 is more likely to have a highly satisfying trip experience. Therefore, the travel support system 1000 according to the present disclosure can help user U2 enrich his or her trip.

[0101] Furthermore, in the travel support system 1000 according to the present disclosure, steps S305 to S312 are repeated, thereby making it possible to recommend multiple locations one after another. In other words, unlike the case of simply recommending a single attraction, it is also possible to recommend a tour course in the order in which past users actually visited multiple locations. This promotes an increase in the number of tours and makes it easier to understand tourist trends.

[0102] Furthermore, travel planners can enjoy and easily consider their travel plans. Travel planners can also collect detailed local information from actual travelers in real time. Service providers of the travel support method disclosed herein can create travel opportunities. Service providers can also target advertisements more accurately according to the user's attributes (travel record information of users with similar attributes). This allows service providers to promote sales of tickets and tourism content.

[0103] Furthermore, because travel record information is automatically generated, travelers can easily record detailed travel records (scenery, impressions, route, time) as memories while enjoying their trip. Service providers can also expect to see an increase in tourism spending due to an increase in the rate of people visiting the destination. Service providers can also grasp detailed trends of travelers, which can be used for marketing purposes.

[0104] Furthermore, by automatically generating travel record information, travelers can relive their travel memories in a virtual space. Furthermore, by sharing their travel record information with others, the recipient can simulate a trip in a virtual space before actually traveling. In particular, even if the recipient is in a situation where it is difficult for them to actually travel, the shared travel record information allows them to simulate a trip in a virtual space. This facilitates the exchange of useful information between users and the creation of new friendships. Furthermore, travelers who share travel record information can easily and clearly learn about new travel routes, areas, and spots. Furthermore, service providers can create fan communities, create tour packages that meet consumer needs, and increase sales through purchases in a three-dimensional virtual space, in addition to creating travel opportunities. Furthermore, this embodiment can achieve various effects similar to those of the first to third embodiments described above.

[0105] <Embodiment 5> In the fifth embodiment, a case will be described in which tour record information (travel record information) and tour schedule information (travel schedule information) are generated on the side of a travel support terminal operated by a user.

[0106] Fig. 16 is a block diagram showing the configuration of information terminal 100a. Compared to information terminal 100 in Fig. 8 described above, information terminal 100a has a modified registration unit 132a and an additional generation unit 134. Other configurations of information terminal 100a are the same as those of information terminal 100 described above, and therefore redundant explanations will be omitted where appropriate.

[0107] The generation unit 134 generates tour record information including the means of transportation between the image capturing points estimated based on the distance between the image capturing points in each image and the difference between the image capturing dates and times of each image. Therefore, the generation unit 134 may estimate the means of transportation between the image capturing points based on the distance between the image capturing points in each image and the difference between the image capturing dates and times of each image.

[0108] Furthermore, the generation unit 134 may generate travel plan information based on the order in which to visit each location in the three-dimensional virtual space, that is, the travel route, and the planned date and time of visiting each location.

[0109] The registration unit 132a is an example of the registration unit 22 described above. The registration unit 132a associates the shooting locations of each image included in the travel record information with each location in the three-dimensional virtual space, and registers the travel record information so that it can be used by the second user. Specifically, the registration unit 132a registers the travel record information by transmitting a registration request including the travel record information generated by the generation unit 134 to the travel assistance server 200 via the network N. The registration unit 132a may also register the travel itinerary information by transmitting a registration request including the travel itinerary information generated by the generation unit 134 to the travel assistance server 200 via the network N.

[0110] The information terminal 100a can be used as an information terminal operated by both a user U1 who is a traveler and a user U2 who is planning to travel. Therefore, the generation unit 134 may generate second travel record information (second tour record information) based on the order of taking multiple images taken by the user U2 at various locations during the trip in real space. In this case, the registration unit 132a may register the second travel record information by associating the shooting locations of each image with the various locations in the three-dimensional virtual space, so that the second travel record information can be used by a third user. Here, the third user is a user other than the user U2, including the user U1.

[0111] FIG. 17 is a sequence chart showing the flow of the travel support process at the time of registration. The following description will focus on the differences from FIG. 12 described above, and redundant explanations will be omitted as appropriate. First, user U1 travels around from points SP1 to SPn while carrying information terminal 100a. Then, similar to the above-described steps S111, S121, ..., S1n1, information terminal 100a takes commemorative photos at each of points SP1 to SPn in response to the operation of user U1. After each photo is taken, information terminal 100a does not need to transmit the captured images, etc. to travel support server 200.

[0112] Thereafter, the information terminal 100a starts generating the travel record information in response to an operation by the user U1. Alternatively, the information terminal 100a may generate and update the travel record information as needed, regardless of an operation by the user U1, each time a photograph is taken at each location.

[0113] For example, if the number of locations at which images were taken is two or more, the information terminal 100a estimates the mode of transportation from the distance between the locations and the required time (S401). Then, the information terminal 100a generates travel record information as described above (S402). For example, as described above, the information terminal 100a may identify the order in which each image was taken from the date and time at which the images were taken, and generate travel record information that includes the order in which the images were taken. Furthermore, the information terminal 100a may generate travel record information that includes attribute information 1111 of the user U2 who is the operator. Furthermore, the information terminal 100a may generate travel record information that includes, as related information, comment information at each location input by the user U2.

[0114] Here, the information terminal 100a may play back the travel record information generated in step S402 in the three-dimensional virtual space (S403). For example, the information terminal 100a and the travel support server 200 may perform the processes of steps S301 to S304 in Fig. 13 described above. Then, the information terminal 100a may play back the travel record information by displaying on the screen on the screen the 3D data of the corresponding points in the three-dimensional virtual space in accordance with the shooting order of each point included in the travel record information (by moving the avatar).

[0115] Thereafter, the information terminal 100a transmits the travel record information generated in step S402 and information on the sharing destination users designated by user U1 to the travel assistance server 200 via the network N (S404). In response, the travel assistance server 200 adds the received sharing destination users to the received travel record information and updates the travel record information. Note that the information terminal 100a may generate the travel record information including the sharing destination user information in step S402. Then, the travel assistance server 200 registers the travel record information by associating each location in the three-dimensional virtual space with each shooting location included in the received travel record information (S405). At this time, the travel assistance server 200 may additionally register corresponding location information (position information in the three-dimensional virtual space) for each shooting location included in the received travel record information. Note that the information terminal 100a may generate the travel record information in step S402 by adding position information in the three-dimensional virtual space corresponding to each shooting location.

[0116] 18 is a sequence chart showing the flow of travel support processing during use. Here, it is assumed that user U2 uses the information terminal 100a-0 to use the three-dimensional virtual space. The information terminal 100a-0 has the same functions as the information terminal 100a described above.

[0117] First, the information terminal 100a-0 accepts a request from the user U2 to start using the three-dimensional virtual space (S411). In response to this, the information terminal 100a-0 transmits a request to start using the three-dimensional virtual space to the travel assistance server 200 via the network N. At this time, the request to start using the three-dimensional virtual space includes the user information of the user U2 and the location information of the starting point.

[0118] In response, the travel support server 200 identifies the travel record information with which the received user information is to be shared (S413).The travel support server 200 then identifies the content of the three-dimensional virtual space corresponding to the received location information of the starting point.Then, the travel support server 200 transmits the identified content of the three-dimensional virtual space and the travel record information to the information terminal 100a-0 via the network N (S414).

[0119] In response, the information terminal 100a-0 plays back the travel record information in the three-dimensional virtual space using the information received from the travel assistance server 200 (S415). This allows user U2 to simulate the travel record of user U1 in the three-dimensional virtual space by, for example, moving an avatar via the screen 123 of the information terminal 100a-0, while easily considering a group of locations that he or she would like to visit on his or her own trip. Then, the information terminal 100a-0 generates travel itinerary information for user U2 in response to the operation of user U2 (S416). Specifically, as described above, the information terminal 100a-0 generates travel itinerary information including user information of user U2, the order in which each location in the three-dimensional virtual space will be visited (the route to be visited), and the planned dates and times of visit for each location. Then, the information terminal 100a-0 transmits a registration request including the travel itinerary information to the travel assistance server 200 via the network N (S417).

[0120] In response to this, the travel assistance server 200 registers the received travel record information of the user U2 in the three-dimensional virtual space information 211 of the storage unit 210 (S418).

[0121] After that, user U2 starts using the three-dimensional virtual space using the information terminal 100a-0 at his travel destination. First, the information terminal 100a-0 accepts a request from user U2 to start using the three-dimensional virtual space (S421). In response to this, the information terminal 100a-0 transmits a request to start using the three-dimensional virtual space to the travel assistance server 200 via the network N. At this time, the request to start using the three-dimensional virtual space includes user information about user U2 and location information of the starting point desired by user U2.

[0122] In response, the travel support server 200 identifies travel itinerary information based on the received user information and location information (S423). Specifically, the travel support server 200 identifies the content of the three-dimensional virtual space corresponding to the received location information of the starting point. The travel support server 200 also identifies travel itinerary information including the received user information. Thereafter, the travel support server 200 transmits the identified content of the three-dimensional virtual space and travel itinerary information to the information terminal 100a-0 via the network N (S424).

[0123] In response, the information terminal 100a-0 uses the information received from the travel assistance server 200 to play back the travel plan information in the three-dimensional virtual space (S425). As a result, the user U2 can confirm the day's itinerary, for example, at a lodging at a travel destination, by experiencing a simulated experience based on the travel plan information in the three-dimensional virtual space the day before or before departure on the day itself. For example, the user U2 can confirm the route and means of transportation in his or her travel plan at the travel destination. This can help to enrich the user U2's trip. In addition, this embodiment can achieve various effects similar to those of the above-mentioned embodiments 1 to 4.

[0124] <Embodiment 6> In the sixth embodiment, when user U2 holds the travel support terminal over a predetermined point in the travel destination, recommendation display information for recommended locations based on user U1's travel record information is superimposed on the camera image displayed on a screen visible to user U2. In the sixth embodiment, the travel support terminal operated by user U2 is referred to as information terminal 100b-0. The information terminal 100b-0 is an example of the travel support terminals 1 and 1a described above. The display unit 133 of the information terminal 100b-0 displays recommendation display information on a screen 123 displaying the augmented reality space used by user U2, recommending travel to the recommended location based on user U2's current location and user U1's travel record information. The display unit 133 of the information terminal 100b-0 may display recommendation display information on the screen 123 displaying the augmented reality space using user U2's travel plan information instead of user U1's travel record information.

[0125] FIG. 19 is a sequence chart showing the flow of travel support processing during use. Here, it is assumed that user U2 uses the functions of the augmented reality space using the information terminal 100b-0. First, the information terminal 100b-0 accepts an operation by user U2 to start using the augmented reality space (S601). In response, the information terminal 100b-0 transmits attribute information, location information, and the current time of user U2 to the travel support server 200 via the network N (S602). Note that transmission of the current time may be omitted.

[0126] In response, the travel support server 200 identifies travel record information including attribute information whose similarity to the received attribute information is equal to or greater than a threshold (S603). If the travel support server 200 receives user information (such as identification information) and location information of user U2 from the information terminal 100b-0, it may identify travel record information with which the user information of user U2 is shared, instead of step S603. The travel support server 200 then identifies a first location corresponding to the received location information from the identified travel record information (S604). The travel support server 200 then determines a second location visited after the first location from the identified travel record information as a recommended location (S605). At this time, the travel support server 200 may also take the current time into consideration when determining the recommended location. The travel support server 200 then determines a display format according to the current time (S606). The travel support server 200 then generates recommendation display information for the recommended location based on the display format (S607). Thereafter, the travel assistance server 200 transmits the recommendation display information to the information terminal 100b-0 via the network N (S608). In response, the information terminal 100b-0 displays the received recommendation display information on the screen 123 in the augmented reality space (S609). Specifically, the information terminal 100b-0 displays the received recommendation display information superimposed on the image captured by the camera displayed on the screen 123. Then, steps S602 to S609 are repeated.

[0127] Thus, according to the sixth embodiment, user U2 can receive recommendations for travel from his / her current location to recommended locations based on the travel record information of experienced travelers by simply pointing the camera of his / her travel support terminal at a specific location in the travel destination. Therefore, user U2 can easily travel around the area based on the travel histories of various experienced travelers, without having to make a detailed travel plan in advance. In particular, since the next destination location is recommended based on the travel record information of a user (experienced traveler) whose attribute information is highly similar to that of user U2, it is highly likely that the location will be close to user U2's needs. This can help enrich user U2's trip. In particular, user U2 can receive recommendations based on the current time at the travel destination, which is highly convenient for user U2. In addition, this embodiment can achieve various effects similar to those of the first to fifth embodiments described above.

[0128] <Other embodiments> Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0129] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0130] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix A1) (Second user's terminal) an acquisition means for acquiring information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of taking the images, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; a display means for displaying a recommendation to travel to the recommended location on a screen displayed from the viewpoint of the second user; A travel assistance terminal equipped with: (Appendix A2) The display means displays, on the screen, recommendation display information for recommending travel to the recommended point. A travel assistance terminal as described in Appendix A1. (Appendix A3) When the second user visits a first location included in the tour record information, the display means displays the recommendation display information with a second location visited by the first user next as the recommended location based on the photographing order in the tour record information. A travel assistance terminal as described in Appendix A2. (Appendix A4) the cyclic record information includes the photographing time of the image; The display means displays the recommendation display information with a location determined from the tour record information as the recommended location based on time information when the second user visited the first location included in the tour record information and the photography time. A travel assistance terminal as described in Appendix A2. (Appendix A5) the circular record information includes first attribute information of the first user; The display means displays the recommendation display information based on the similarity between the first attribute information and the second attribute information of the second user and the browsing record information. A travel assistance terminal according to any one of Appendix A2 to Appendix A4. (Appendix A6) The display means displays the recommendation display information for a plurality of recommended locations in different display forms according to similarities between the first attribute information and the second attribute information included in the tour record information for the plurality of first users. Travel assistance terminal as described in Appendix A5. (Appendix A7) The display means displays the recommendation display information for a plurality of recommended locations on the screen based on the tour record information for a plurality of first users. A travel assistance terminal according to any one of Appendix A2 to Appendix A5. (Appendix A8) The display means displays the recommendation display information for each of the plurality of recommended points in a different display format in accordance with an evaluation by the first user who has visited each of the plurality of recommended points. Travel assistance terminal as described in Appendix A7. (Appendix A9) The display means displays the recommendation display information for each recommended point in a different display format depending on the cost associated with each recommended point. A travel assistance terminal as described in Appendix A7 or A8. (Appendix A10) The display means displays a recommendation to move to the recommended point on the screen that displays the three-dimensional virtual space used by the second user. A travel assistance terminal according to any one of Appendix A1 to Appendix A9. (Appendix A11) The display means displays, on the screen displaying the augmented reality space used by the second user, a recommendation to move to the recommended point based on the current location of the second user and the tour record information. A travel assistance terminal according to any one of Appendix A1 to Appendix A9. (Appendix A12) The image capturing apparatus further includes a generating unit for generating the travel record information including the means of travel between the image capturing points estimated based on the distance between the image capturing points in each image and the difference in the image capturing date and time of each image. A travel assistance terminal according to any one of Appendix A1 to Appendix A11. (Appendix A13) acquisition means for acquiring a plurality of images taken at various locations by the second user; a registration means for registering second cyclic record information generated based on the shooting order including the plurality of images, by associating the shooting locations of each image with respective locations in the three-dimensional virtual space, so that the second cyclic record information can be used by a third user; The travel support terminal according to any one of Appendix A1 to Appendix A12, further comprising: (Appendix B1) (Server) a generating means for generating tour record information based on the order of taking images including a plurality of images taken at each location by the first user; a registration means for registering the tour record information so that the second user can use the tour record information by associating the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space; A travel assistance device comprising: (Appendix B2) The display device further includes a display means for displaying recommendation display information for recommending travel to a recommended location based on the tour record information on a screen displayed from the viewpoint of the second user. 10. A travel assistance device as described in Appendix B1. (Appendix B3) When the second user visits a first location included in the tour record information, the display means displays the recommendation display information with a second location visited by the first user next as the recommended location based on the photographing order in the tour record information. 10. A travel assistance device as described in Appendix B2. (Appendix B4) the generating means generates the cyclic recording information including the shooting times of the plurality of images; The display means determines the recommended location from the tour record information based on time information when the second user visited the first location included in the tour record information and the photographing time, and displays the recommendation display information for the determined recommended location. 10. A travel assistance device as described in Appendix B2. (Appendix B5) the generating means generates the cyclic record information including first attribute information of the first user; The display means displays the recommendation display information based on the similarity between the first attribute information and the second attribute information of the second user and the browsing record information. A travel assistance device according to any one of appendices B2 to B4. (Appendix B6) The display means displays the recommendation display information for a plurality of recommended locations in different display forms according to similarities between the first attribute information and the second attribute information included in the tour record information for the plurality of first users. 10. A travel assistance device as described in Appendix B5. (Appendix B7) The display means displays the recommendation display information for a plurality of recommended locations on the screen based on the tour record information for a plurality of first users. A travel assistance device according to any one of appendices B2 to B5. (Appendix B8) The display means displays the recommendation display information for each of the plurality of recommended points in a different display format in accordance with an evaluation by the first user who has visited each of the plurality of recommended points. 10. A travel aid device as described in Appendix B7. (Appendix B9) The display means displays the recommendation display information for each recommended point in a different display format depending on the cost associated with each recommended point. 10. A travel assistance device according to claim B7 or B8. (Appendix B10) the registration means registers the tour record information so that the second user can use the tour record information in the three-dimensional virtual space; The display means displays the recommendation display information for the recommendation point on the screen that displays the three-dimensional virtual space used by the second user. 10. A travel assistance device according to any one of appendices B2 to B9. (Appendix B11) The display means displays the recommendation display information for the recommended point on the screen that displays the augmented reality space used by the second user, based on the current location of the second user and the tour record information. 10. A travel assistance device according to any one of appendices B2 to B9. (Appendix B12) The generating means generates the tour record information including the means of travel between the image capturing points estimated based on the distance between the image capturing points in each image and the difference between the image capturing dates and times of each image. A travel assistance device according to any one of appendices B1 to B11. (Appendix C1) (First user terminal) an acquisition means for acquiring a plurality of images taken at various locations by a first user; a registration means for registering the tour record information generated based on the photographing order including the plurality of images, by associating the photographing location of each image with each location in the three-dimensional virtual space, so that the tour record information can be used by a second user; A travel assistance terminal equipped with: (Appendix C2) the circular record information includes first attribute information of the first user; The registration means registers the tour record information so as to display recommendation display information for recommending travel to a recommended location based on similarity between the first attribute information and second attribute information of the second user and the tour record information. A travel assistance terminal as described in Appendix C1. (Appendix C3) The registration means registers the tour record information so that the second user can use the tour record information in the three-dimensional virtual space. A travel assistance terminal as described in Appendix C1 or C2. (Appendix C4) The travel record information includes a travel mode estimated based on the distance between the photographing points in each image and the difference between the photographing dates and times. A travel support terminal according to any one of appendices C1 to C3. (Appendix C5) the acquisition means acquires information about recommended locations determined based on second tour record information including a plurality of images taken by a third user at each location and generated based on the order of taking the images, the tour record information associating the image taking locations with each location in the three-dimensional virtual space, and location information of the first user; a first display means for displaying a screen displayed from the viewpoint of the first user in a manner that recommends travel to the recommended location; The travel support terminal according to any one of appendices C1 to C4, further comprising: (Appendix C6) a second display means for displaying information based on the tour record information at a photographing point included in the tour record information on a screen that displays the three-dimensional virtual space from the viewpoint of the first user; The travel support terminal according to any one of appendices C1 to C5, further comprising: (Appendix C7) The image capturing apparatus further includes a generating unit for generating the travel record information including the means of travel between the image capturing points estimated based on the distance between the image capturing points in each image and the difference in the image capturing date and time of each image. A travel assistance terminal according to any one of appendices C1 to C6. (Appendix D1) a first travel assistance terminal; a second travel assistance terminal; a travel assistance device; the first travel support terminal transmits a plurality of images taken by the first user at each location to the travel support device; The travel assistance device generating tour record information based on the order of photographing including the plurality of images received from the first travel support terminal; The photographing location of each image included in the tour record information is associated with each location in the three-dimensional virtual space, and the tour record information is registered so that the second user can use the second travel support terminal. Travel assistance system. (Appendix D2) The travel assistance device determining a recommended location based on the tour record information and the location information of the second user; The second travel assistance terminal acquiring information about the determined recommended points from the travel assistance device; A screen displayed from the viewpoint of the second user is displayed so as to recommend travel to the recommended location. 10. A travel assistance system as described in Appendix D1. (Appendix E1) (Processing method for the second user's terminal) The computer Acquire information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of taking the images, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; A screen displayed from the viewpoint of the second user is displayed so as to recommend travel to the recommended location. Travel support methods. (Appendix F1) (Server processing method) The computer generating tour record information based on the order of taking the images including the plurality of images taken at each location by the first user; The photographing location of each image included in the tour record information is associated with each location in the three-dimensional virtual space, and the tour record information is registered so that it can be used by a second user. Travel support methods. (Appendix G1) (Processing method for the first user's terminal) The computer acquiring a plurality of images taken at various locations by a first user; The tour record information generated based on the photographing order including the plurality of images is registered so that it can be used by a second user by associating the photographing location of each image with each location in the three-dimensional virtual space. Travel support methods. (Appendix H1) (Program on the second user's terminal) an acquisition process for acquiring information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of shooting, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; a recommendation display process for displaying a recommendation to travel to the recommended location on a screen displayed from the viewpoint of the second user; A travel assistance program that causes a computer to execute the above. (Appendix I1) (Server program) a generation process for generating tour record information based on the order of taking the images including the images taken at each location by the first user; a registration process of registering the tour record information so that the second user can use the tour record information by associating the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space; A travel assistance program that causes a computer to execute the above. (Appendix J1) (Program on the terminal of the first user) an acquisition process for acquiring a plurality of images taken at each location by a first user; a registration process for registering the tour record information generated based on the shooting order including the plurality of images, by associating the shooting locations of each image with each location in the three-dimensional virtual space, so that the tour record information can be used by a second user; A travel assistance program that causes a computer to execute the above.

[0131] Some or all of the elements (e.g., configurations and functions) described in Appendix A2 to Appendix A13 that are dependent on Appendix A1 {e.g., terminal} may also be dependent on Appendix B1 {e.g., device}, Appendix C1 {e.g., terminal}, Appendix D1 {e.g., system}, Appendix E1, F1, and G1 {e.g., method}, and Appendix H1, I1, and J1 {e.g., program} in the same dependency relationship as Appendix A2 to Appendix A13. Also, some or all of the elements (e.g., configurations and functions) described in Appendix B2 to Appendix B12 that are dependent on Appendix B1 {e.g., device}, Appendix C1 {e.g., terminal}, Appendix D1 {e.g., system}, Appendix E1, F1, and G1 {e.g., method}, and Appendix H1, I1, and J1 {e.g., program} in the same dependency relationship as Appendix B2 to Appendix B12. In addition, some or all of the elements (e.g., configurations and functions) described in Appendix C2 to Appendix C7 that are dependent on Appendix C1 {e.g., terminal} may also be dependent on Appendix A1 {e.g., terminal}, Appendix B1 {e.g., device}, Appendix D1 {e.g., system}, Appendix E1, F1, and G1 {e.g., method}, and Appendix H1, I1, and J1 {e.g., program} in the same dependency relationship as Appendix C2 to Appendix C7. Some or all of the elements described in any appendix may be applied to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]

[0132] 1. Travel assistance terminal 11 Acquisition Department 12 Registration Department 2 Travel support equipment 21 Generation part 22 Registration Department 1a Travel assistance terminal 13 Acquisition Department 14 Display section 1000 Travel Support System N Network SP1, SP2,...SPn points U1, U11, U12, U1n, U2 users 100, 100-0, 100-1, 100-2, 100-n, 100a, 100a-0, 100b-0 Information terminal 110 Storage section 111 User Information 1111 Attribute information 121 Photography Department 122 Location information acquisition unit 123 screens 131 Acquisition Department 132 Registration Department 132a Registration Department 133 Display section 134 Generation part 101 Memory 102 processors 103 Network Interface 104 Display 105 Camera 200 Travel support server 210 Storage section 211 Three-dimensional virtual space information 231 User Information 2311 Attribute information 241 Location Information 24n location information 251 Travel Record Information 2511 images 2512 3D data 2513 Shooting location 2514 Date and time of photo 2515 Shooting Order 2516 Related Information 2517 Transportation 2518 Attribute information 2519 Shared with 221 Acquisition Department 222 Generation part 223 Registration Department 224 Decision Section 225 Display section 201 Memory 202 processors 203 Network Interface 31 Three-dimensional virtual space screen d1 Recommendation display information U2a Avatar 32 Three-dimensional virtual space screen d2 Recommendation display information

Claims

1. an acquisition means for acquiring information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of taking the images, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; a display means for displaying a screen displayed from the viewpoint of the second user, the screen displaying the recommended location in a manner that recommends travel to the recommended location; A travel assistance terminal equipped with:

2. The display means displays, on the screen, recommendation display information for recommending travel to the recommended point. The travel assistance terminal according to claim 1.

3. The display means displays the recommendation display information with a second location visited by the first user next to the first location as the recommended location based on the photographing order in the tour record information when the second user visits a first location included in the tour record information. The travel assistance terminal according to claim 2.

4. the cyclic record information includes the photographing time of the image; The display means displays the recommendation display information with a location determined from the tour record information as the recommended location based on time information when the second user visited the first location included in the tour record information and the photography time. The travel assistance terminal according to claim 2.

5. the circularly recorded information includes first attribute information of the first user; The display means displays the recommendation display information based on the similarity between the first attribute information and the second attribute information of the second user and the tour record information.

4. The travel support terminal according to claim 2 or 3.

6. The display means displays the recommendation display information for a plurality of recommendation points in different display forms depending on similarities between the first attribute information and the second attribute information included in the tour record information for a plurality of the first users. The travel assistance terminal according to claim 5.

7. The display means displays the recommendation display information for a plurality of recommendation points on the screen based on the tour record information of a plurality of the first users.

4. The travel support terminal according to claim 2 or 3.

8. The display means displays the recommendation display information for each of the plurality of recommended points in a different display format in accordance with an evaluation by the first user who has visited each of the plurality of recommended points. The travel assistance terminal according to claim 7.

9. The display means displays the recommendation display information for each recommended point in a different display format depending on the cost associated with each recommended point. The travel assistance terminal according to claim 7.

10. The display means displays a recommendation to move to the recommended point on the screen that displays the three-dimensional virtual space used by the second user.

3. The travel support terminal according to claim 1 or 2.

11. The display means displays, on the screen displaying the augmented reality space used by the second user, a recommendation to move to the recommended point based on the current location of the second user and the tour record information.

3. The travel support terminal according to claim 1 or 2.

12. The image capturing apparatus further includes a generating unit for generating the travel record information including the means of travel between the image capturing points estimated based on the distance between the image capturing points in each image and the difference in the image capturing date and time of each image.

3. The travel support terminal according to claim 1 or 2.

13. an acquisition means for acquiring a plurality of images taken at each location by the second user; a registration means for registering second cyclic record information generated based on the shooting order of the plurality of images, by associating the shooting locations of each image with respective locations in the three-dimensional virtual space, so that the second cyclic record information can be used by a third user; The travel assistance terminal according to claim 1 or 2, further comprising:

14. a generating means for generating tour record information based on the order of taking the images including the images taken at each location by the first user; a registration means for registering the tour record information so that the second user can use the tour record information by associating the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space; A travel assistance device comprising:

15. The display device further includes a display unit for displaying recommendation display information for recommending travel to a recommended location based on the tour record information on a screen displayed from the viewpoint of the second user.

15. The travel assistance device of claim 14.

16. The display means displays the recommendation display information with a second location visited by the first user next to the first location as the recommended location based on the photographing order in the tour record information when the second user visits a first location included in the tour record information.

16. The travel assistance device of claim 15.

17. the generating means generates the cyclic recording information including the shooting times of the plurality of images; The display means determines the recommended location from the tour record information based on time information when the second user visited the first location included in the tour record information and the photography time, and displays the recommendation display information for the determined recommended location.

16. The travel assistance device of claim 15.

18. the generating means generates the circular record information including first attribute information of the first user; The display means displays the recommendation display information based on the similarity between the first attribute information and the second attribute information of the second user and the tour record information.

17. A travel assistance device according to claim 15 or 16.

19. The display means displays the recommendation display information for a plurality of recommendation points in different display forms depending on similarities between the first attribute information and the second attribute information included in the tour record information for a plurality of the first users.

19. The travel assistance device of claim 18.

20. The display means displays the recommendation display information for a plurality of recommendation points on the screen based on the tour record information of a plurality of the first users.

17. A travel assistance device according to claim 15 or 16.

21. The display means displays the recommendation display information for each of the plurality of recommended points in a different display format in accordance with an evaluation by the first user who has visited each of the plurality of recommended points.

21. A travel assistance device according to claim 20.

22. The display means displays the recommendation display information for each recommended point in a different display format depending on the cost associated with each recommended point.

21. A travel assistance device according to claim 20.

23. the registration means registers the tour record information so that the second user can use the tour record information in the three-dimensional virtual space; The display means displays the recommendation display information for the recommendation point on the screen that displays the three-dimensional virtual space used by the second user.

17. A travel assistance device according to claim 15 or 16.

24. The display means displays the recommendation display information for the recommendation point on the screen that displays the augmented reality space used by the second user, based on the current location of the second user and the tour record information.

17. A travel assistance device according to claim 15 or 16.

25. The generating means generates the tour record information including the means of travel between the image capturing points estimated based on the distance between the image capturing points in each image and the difference between the image capturing dates and times of each image.

16. A travel assistance device according to claim 14 or 15.

26. an acquisition means for acquiring a plurality of images taken at various locations by a first user; a registration means for registering tour record information generated based on the order of photographing the plurality of images, by associating the photographing locations of the images with respective locations in the three-dimensional virtual space, so that the tour record information can be used by a second user; A travel assistance terminal equipped with:

27. the circularly recorded information includes first attribute information of the first user; The registration means registers the tour record information so as to display recommendation display information for recommending travel to a recommended location based on similarity between the first attribute information and second attribute information of the second user and the tour record information.

27. The travel assistance terminal according to claim 26.

28. The registration means registers the tour record information so that the second user can use the tour record information in the three-dimensional virtual space.

28. A travel assistance terminal according to claim 26 or 27.

29. The travel record information includes a travel mode estimated based on the distance between the photographing points in each image and the difference between the photographing dates and times.

28. A travel assistance terminal according to claim 26 or 27.

30. the acquisition means acquires information about recommended locations determined based on second tour record information including a plurality of images taken by a third user at each location and generated based on the order of taking the images, the tour record information associating the locations at which the images were taken with each location in the three-dimensional virtual space, and location information of the first user; a first display means for displaying a screen displayed from the viewpoint of the first user in a manner that recommends travel to the recommended location; 28. The travel assistance terminal according to claim 26 or 27, further comprising:

31. a second display means for displaying information based on the tour record information at a photographing location included in the tour record information on a screen that displays the three-dimensional virtual space from the viewpoint of the first user; 28. The travel assistance terminal according to claim 26 or 27, further comprising:

32. The image capturing apparatus further includes a generating unit for generating the travel record information including the means of travel between the image capturing points estimated based on the distance between the image capturing points in each image and the difference in the image capturing date and time of each image.

28. A travel assistance terminal according to claim 26 or 27.

33. a first travel assistance terminal; a second travel assistance terminal; a travel assistance device; the first travel support terminal transmits a plurality of images taken by the first user at each location to the travel support device; The travel assistance device generating tour record information based on the order of photographing including the plurality of images received from the first travel support terminal; The photographing locations of the images included in the tour record information are associated with the respective locations in the three-dimensional virtual space, and the tour record information is registered so that the second user can use the second travel support terminal. Travel assistance system.

34. The travel assistance device determining a recommended location based on the tour record information and the location information of the second user; The second travel assistance terminal acquiring information about the determined recommended points from the travel assistance device; A screen displayed from the viewpoint of the second user is displayed so as to recommend travel to the recommended location.

34. The travel assistance system of claim 33.

35. The computer Acquire information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of taking the images, the tour record information associating the shooting locations of the images with each location in the three-dimensional virtual space, and location information of a second user; A screen displayed from the viewpoint of the second user is displayed so as to recommend travel to the recommended location. Travel support methods.

36. The computer generating tour record information based on the order of taking the images including the plurality of images taken at each location by the first user; The photographing locations of the images included in the tour record information are associated with the respective locations in the three-dimensional virtual space, and the tour record information is registered so that it can be used by a second user. Travel support methods.

37. The computer acquiring a plurality of images taken at various locations by a first user; The tour record information generated based on the photographing order including the plurality of images is registered so that it can be used by a second user by associating the photographing location of each image with each location in the three-dimensional virtual space. Travel support methods.

38. an acquisition process for acquiring information about recommended locations determined based on tour record information including a plurality of images taken by a first user at each location and generated based on the order of shooting, the tour record information associating the shooting locations of each image with each location in the three-dimensional virtual space, and location information of a second user; a recommendation display process for displaying a recommendation to travel to the recommended location on a screen displayed from the viewpoint of the second user; A travel assistance program that causes a computer to execute the above.

39. a generation process for generating circulating record information based on the order of taking the images including the images taken at each location by the first user; a registration process of registering the tour record information so that the second user can use the tour record information by associating the shooting locations of each image included in the tour record information with each location in the three-dimensional virtual space; A travel assistance program that causes a computer to execute the above.

40. an acquisition process for acquiring a plurality of images taken at each location by a first user; a registration process for registering the tour record information generated based on the shooting order including the plurality of images, by associating the shooting locations of each image with each location in the three-dimensional virtual space, so that the tour record information can be used by a second user; A travel assistance program that causes a computer to execute the above.

Images