Information processing device, information processing method, program, and recording medium

Abstract

To provide an information processing apparatus that can present, to a user, a scene that appears when the user arrives at a visiting spot.SOLUTION: An information processing apparatus comprises: an image acquisition unit that acquires, for each of a plurality of spots, a plurality of photographic images photographed in relation to the spot; a visiting spot information acquisition unit that acquires information indicating each of one or more visiting spots included in a route that is set based on a route setting condition designated by a user; a predicted arrival information acquisition unit that acquires information indicating a predicted arrival time at each of the visiting spots on the route; and a display image acquisition unit that acquires, from the plurality of photographic images, an image photographed in relation to the visiting spot and photographed at a time corresponding to the predicted arrival time, as an image for display to be displayed on a screen in association with each of the visiting spots on the route.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, a program, and a recording medium for processing information such as images.

Background Art

[0002] Conventionally, as described in Patent Document 1 using an information processing apparatus, an access plan creation system has been proposed to assist in creating an access plan for a user to visit access spots such as tourist spots and gourmet spots.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in a conventional information processing apparatus, an image reflecting the expected arrival time at a destination or a transit point is not displayed, so there is a problem that it is difficult to motivate a review of a drive plan such as changing the departure time or increasing the number of visited spots.

[0005] As an example of the problem to be solved by the present invention, there is provided an information processing apparatus that can provide reference information for a user to review a drive plan by presenting to the user what scenery can be seen at the time of arrival at each visited spot when displaying the created drive plan.

Means for Solving the Problems

[0006] The invention described in claim 1 is an information processing device comprising: an image acquisition unit that acquires a plurality of captured images related to each of a plurality of spots; a visit spot information acquisition unit that acquires information indicating each of one or more visit spots included in a route set based on route setting conditions specified by the user; an arrival prediction information acquisition unit that acquires information indicating the estimated time of arrival to each of the visit spots in the route; and a display image acquisition unit that acquires from the plurality of captured images an image taken related to the visit spot and taken at a time corresponding to the estimated time of arrival, as a display image to be displayed on the screen in association with each of the visit spots in the route.

[0007] The invention described in claim 10 is an information processing method performed by an information processing device, characterized in that it includes the steps of: acquiring a plurality of captured images taken in relation to each of a plurality of spots; acquiring information indicating each of one or more visit spots included in a route set based on route setting conditions specified by a user; acquiring information indicating the estimated time of arrival to each of the visit spots in the route; and acquiring from the plurality of captured images an image taken in relation to the visit spot and taken at a time corresponding to the estimated time of arrival, as a display image to be displayed on the screen in association with each of the visit spots in the route.

[0008] The invention described in claim 11 is a program characterized by causing an information processing device to perform the following steps: acquire a plurality of captured images taken in relation to each of a plurality of spots; acquire information indicating each of one or more visited spots included in a route set based on route setting conditions specified by a user; acquire information indicating the estimated time of arrival to each of the visited spots in the route; and acquire from the plurality of captured images an image taken in relation to the visited spot and taken at a time corresponding to the estimated time of arrival, as a display image to be displayed on the screen in association with each of the visited spots in the route.

[0009] The invention described in claim 12 is a recording medium characterized by recording a program that causes an information processing device to execute the following steps: acquiring a plurality of captured images related to each of a plurality of spots; acquiring information indicating each of one or more visited spots included in a route set based on route setting conditions specified by a user; acquiring information indicating the estimated time of arrival to each of the visited spots in the route; and acquiring from the plurality of captured images an image taken related to the visited spot and taken at a time corresponding to the estimated time of arrival, as a display image to be displayed on the screen in association with each of the visited spots in the route. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic diagram illustrating an example of the configuration of an information processing system according to an embodiment of the present invention. [Figure 2] This is a block diagram showing an example configuration of an information processing device in the information processing system of this embodiment. [Figure 3] This is a front view showing the touch panel, which is the operating section of the communication terminal in this information processing device. [Figure 4]This is a flowchart showing the processing operation of the information processing device in this embodiment. [Figure 5A] This schematic diagram shows an example of a display image (a daytime photograph taken on a clear day) that is displayed in correspondence with a location on a map shown on a communication terminal by the information processing device of this embodiment. [Figure 5B] This schematic diagram shows an example of a display image (evening photo) that is displayed in correspondence with a location on a map displayed on a communication terminal by the information processing device of this embodiment. [Figure 5C] This schematic diagram shows an example of a display image (night-time captured image) that is displayed in correspondence with a location on a map displayed on a communication terminal by the information processing device of this embodiment. [Figure 5D] This schematic diagram shows an example of a display image (a daytime image taken in light rain) that is displayed in correspondence with a location on a map shown on a communication terminal by the information processing device of this embodiment. [Figure 6] This is a front view showing the display of a map image on a communication terminal by the information processing device of this embodiment. [Figure 7] This is a front view showing another map image display on a communication terminal by the information processing device of this embodiment. [Modes for carrying out the invention]

[0011] Hereinafter, an information processing system 100 including an information processing device 10 according to an embodiment of the present invention will be described with reference to the drawings. Figure 1 is a schematic block diagram showing an example of the configuration of the information processing system 100 of this embodiment.

[0012] The information processing system 100 comprises an information processing device 10 and a communication terminal 101 that can communicate with each other over the Internet via a network NW. When a user inputs route setting conditions into the communication terminal 101, the information processing system 100 sets a route corresponding to the route setting conditions and displays images taken by other users at each of the one or more visit spots included in the set route, at times corresponding to the estimated arrival time of each said visit spot, on the screen of the communication terminal 101, in association with each said visit spot.

[0013] The information processing device 10 is a computer device that functions as an operational server device that provides map information and the like. The information processing device 10 is connected to multiple communication terminals 101 so that they can communicate with each other, and identifies each terminal based on identification information uniquely provided to each of the multiple communication terminals 101, and provides various services corresponding to each communication terminal 101. In the following description, for simplicity, one terminal representing the multiple communication terminals 101 will be simply referred to as communication terminal 101, and its configuration and operation will be described.

[0014] The communication terminal 101 is a computer device that communicates with the information processing device 10 wirelessly or via a wired connection over the internet and functions as a user interface device for the information processing device 10. Examples of communication terminals 101 include smartphones capable of internet communication, personal computers (PCs) (not shown), and tablet PCs with functions equivalent to those of a smartphone.

[0015] Furthermore, examples of communication terminals 101 include, for example, mobile communication devices (not shown) such as navigation systems or drive recorders mounted on vehicle VEs such as four-wheeled vehicles and two-wheeled vehicles. Note that the navigation system or drive recorder of the mobile communication device may be a tablet PC, notebook PC, smartphone, etc., which functions as a mobile communication device by running a predetermined navigation or drive recorder application that has been installed on it.

[0016] The communication terminal 101, which is a user interface device of the information processing apparatus 10, includes a touch panel or a display and an operation unit. In the communication terminal 101, a companion application for cooperation with the information processing apparatus 10 and other communication terminals is installed, and thereby communication settings such as setting of a URL (Uniform Resource Locator) and an access point AC, and setting of an encryption key are made. That is, the user can input various information to the information processing apparatus 10 and acquire information from the information processing apparatus 10 (for example, acquisition of information such as an overlapping display of a map and an image) via the touch panel or the display and the operation unit of the information processing apparatus 10.

[0017] [Information Processing Apparatus] As shown in FIG. 2, the information processing apparatus 10 includes a CPU (Central Processing Unit) 11, a storage device 12, an input unit 13 and an output unit 14 which are interfaces for replying to a processing request, input of information, and a processing result from a user to the user, and a communication unit 15, which are connected to each other by an internal bus (not shown). Various information and the like input via the input unit 13 and the communication unit 15 are acquired by the information processing apparatus 10.

[0018] Examples of the storage device 12 include a ROM (Read Only Memory), a RAM (Random Access Memory), an HDD (Hard Disk Drive), an SSD (Solid State Drive), and a flash memory. The storage device 12 stores various programs and data, provides a working area for the CPU 11, and stores programs executed by the CPU 11, an image DB (database) for information processing, a condition DB, a map DB, and the like.

[0019] Examples of the input unit 13 include a keyboard, a mouse, and a touch panel for pre-inputting data and the like. Examples of the output unit 14 include a display for state display of input data and the like. The input unit 13 and the output unit 14 may also include a USB (Universal Serial Bus) for connecting an external device, for example, a recording medium.

[0020] The CPU 11 controls the overall operation of the information processing device 10 according to the program of the operating system (OS) software installed in the storage device 12. The CPU 11 executes information processing according to various application software (such as cooperation applications for coordinating with the communication terminal 101 and other mobile communication devices) stored in the storage device 12, for example, according to application software for route searching.

[0021] The communication unit 15 communicates with the communication terminal 101 via the network NW to send and receive data. For example, the communication unit 15 obtains route search conditions, i.e., route setting conditions, specified by the user operating the touch panel or control unit of the communication terminal 101, via the network NW, and transmits the route set by the information processing device 10 based on the route setting conditions, as well as information associated with that route, to the communication terminal 101. The communication unit 15 also accesses other server devices via the network NW and receives various kinds of information.

[0022] The map database of the storage device 12 stores map information for all of Japan or a predetermined region, such as the Kanto region, which is used for route searching and displaying maps. The map database stores display map data that visualizes geographical features and roads, latitude and longitude data for identifying locations on Earth, and road data for route searching. The road data for route searching includes, for example, road attribute data that shows roads between intersections and intersection data that shows intersections. The road attribute data includes distance data for that road as well as travel time data for that road. The road attribute data may also include multiple travel time data that correspond to changes in traffic volume, congestion, etc., depending on the season and time of day.

[0023] The condition database in the storage device 12 stores the route setting conditions acquired by the communication unit 15. The route setting conditions and road data for route search are used to calculate the estimated time from departure to arrival. The route setting conditions include the departure point and destination specified by the user. The route setting conditions may include one or more visiting spots (intermediate points or stopovers) that the user wishes to visit between departing the departure point and arriving at the final destination. Furthermore, the route setting conditions may include at least one of the user's desired departure time, planned stay time at each visiting spot, or desired arrival time at the final destination. In addition, the route setting conditions may include information specifying which of the following conditions the user prioritizes when searching for a route: travel fare, travel time, travel distance, road width, etc.

[0024] The storage device 12 may also store a bookmark list BML of spots that the user has registered as places of interest. Images of bookmarked spots are linked to the list and stored in the image database, and the user can refer to the images of bookmarked spots when creating a drive plan by operating the communication terminal 101. Furthermore, in addition to bookmarked spots, the storage device 12 may also store a recommended spot list RSL, which is a list of recommended spots that are automatically recommended according to the user's preferences. Images of recommended spots are linked to the list and stored in the image database, and the communication terminal 101 can present the user with images of recommended spots that are within a predetermined distance while the user is traveling. Alternatively, when the user creates a drive plan, the communication terminal 101 can present the user with images of recommended spots that are located around the route of the drive plan.

[0025] Furthermore, the image database of the storage device 12 may store strings and photographic images (for example, photographic images described later) that are superimposed on the map image as information associated with the route.

[0026] The CPU 11 executes the application software stored in the storage device 12, thereby performing the following functions: (1) Image acquisition unit PSP, (2) Route setting unit RGU, (3) Calculation unit ETU, (4) Display image acquisition unit HISP, (5) It functions as the weather acquisition unit WSP.

[0027] (1) The captured image acquisition unit PSP accesses the network NW via the communication unit 15 and acquires multiple captured images that have been posted to, for example, an SNS (Social Networking Service) site, and which have information such as the shooting location, shooting direction, and shooting date and time attached to them, and stores them in the image DB of the storage device 12.

[0028] In this embodiment, the captured image acquisition unit PSP acquires posted images (also called posted images) from multiple captured images taken by multiple users at their respective destinations and posted on social media, etc., and stores the posted images, which are assigned shooting information such as the date and time of shooting, the location of shooting, the direction of shooting, the resolution, the weather, and the season, in the image database of the storage device 12 so that the necessary images can be searched based on the shooting information. To this end, the captured image acquisition unit PSP stores in the image database of the storage device 12, associating posted images taken in relation to a certain spot, that is, images taken near the location of the spot, based on at least the shooting location of the shooting information of the posted images. In this embodiment, "spot" means not only a location such as an intersection, tourist spot, or restaurant, but also a facility such as a store that a user visits or passes through, a landmark, etc., or an area with a predetermined extent from which it can be viewed.

[0029] Alternatively, the image acquisition unit PSP may identify posted images taken in relation to a particular spot based on the shooting position and shooting direction in the shooting information of the posted images, and store them in the image database of the storage device 12 in association with that spot. That is, the image acquisition unit PSP may pre-store the acceptable range of shooting position and shooting direction for each spot, and by comparing this acceptable range with the shooting position and shooting direction in the shooting information of the posted images, it may select posted images to be stored in association with each spot. By selecting only the images that satisfy the conditions for each spot, only images with representative compositions for each spot can be stored in the image database of the storage device 12.

[0030] Furthermore, the image acquisition unit PSP stores the submitted images and their corresponding shooting dates in the image database of the storage device 12, based on the shooting date and time of the submitted images, so that the necessary images can be searched. For example, the image acquisition unit PSP may store submitted images in the image database in periods divided by the shooting date and time of the submitted images. In this case, the images may be classified and stored in a way that allows identification of the year in which the submitted images were taken. The image acquisition unit PSP may also delete submitted images from the image database after a predetermined period (e.g., 3 years) has passed since the shooting date. The image acquisition unit PSP functions as an example of an image acquisition unit that acquires multiple images related to each of multiple spots.

[0031] (2) The route setting unit RGU sets a route on the map that includes one or more visit spots based on the map DB (road data for route search) in the storage device 12 and the route setting conditions specified by the user, and generates map image display data that includes the set route. Here, the route setting conditions include at least the departure point and the destination, and may also include at least one of the following: one or more visit spots that the user wishes to visit between departing the departure point and arriving at the final destination, the user's desired departure time, the planned duration of stay at each visit spot, or the desired arrival time at the final destination.

[0032] The route setting unit RGU may search for multiple routes as candidate routes, generate map image display data including the candidate routes, display it on the communication terminal 101, and obtain the route selected by the user from among the candidate routes. The route setting unit RGU functions as an example of a visitor spot information acquisition unit that acquires information indicating each of the one or more visitor spots included in a route set based on route setting conditions specified by the user.

[0033] (3) The calculation unit ETU calculates the estimated time of arrival at each of the destination spots along the route based on the route setting conditions. The calculation unit ETU may be configured to be able to use VICS (registered trademark) (Vehicle Information and Communication System) information via the internet through the communication unit 15, thereby enabling it to obtain road information including traffic congestion forecasts.

[0034] In the calculation unit ETU, the estimated arrival time is calculated for each spot, taking into account the traffic congestion conditions corresponding to the time of day along the route, i.e., the estimated travel time based on predetermined statistical information. If the route setting conditions specified by the user do not include the planned stay time at each visited spot, the route setting unit RGU determines the stay time for each of the multiple visited spots based on the average stay time for each spot obtained by a predetermined method. The calculation unit ETU functions as an example of an arrival time information acquisition unit that acquires information indicating the estimated arrival time to each visited spot along the route, and an estimated stay time identification unit that identifies the estimated stay time for each of one or more visited spots.

[0035] (4) The display image acquisition unit HISP acquires images from among multiple captured images (posted images) stored in the image DB of the storage device 12, images of visited spots taken at a time corresponding to the calculated estimated arrival time, and associates them with visited spots along the route to be displayed on the screen. It then transmits these images to the user's communication terminal 101 to display them.

[0036] The HISP display image acquisition unit acquires display images based on the condition that the image was taken at a time close to the estimated arrival time at the visited spot. For example, if the estimated arrival time at the visited spot is acquired as 8 PM today, the HISP will acquire the most recently taken image from among images taken within a specified period in the past (for example, within one week) that includes 8 PM (for example, between 7:30 PM and 8:30 PM), rather than an image taken at 9 AM on the same day at a different time.

[0037] The display image acquisition unit HISP may, if multiple images of a visited spot taken during the time range corresponding to the estimated arrival time exist in the image database of the storage device 12, prioritize posting images whose shooting direction meets predetermined criteria corresponding to the visited spot, or it may prioritize posting images with high resolution to narrow down the candidates. Alternatively, it may narrow down the candidates by combining the shooting direction and resolution.

[0038] The HISP display image acquisition unit functions as an example of a display image acquisition unit that selects from multiple captured images images that are related to the visited spot and were taken at a time corresponding to the estimated arrival time, and then displays them on the screen in association with each of the visited spots along the route.

[0039] (5) If the weather acquisition unit WSP of the information processing device 10 is configured to be able to use weather forecasts via the Internet, for example via the communication unit 15, it may acquire such weather forecasts as weather information for the estimated time of arrival around the spot to be visited. The weather acquisition unit WSP functions as an example of a forecast weather acquisition unit that acquires forecast information for each of the visited spots at the estimated time of arrival.

[0040] In this case, the weather acquisition unit WSP refers to past weather information based on the shooting location and date and time of the posted image, acquires weather information around multiple spots when the posted image was taken, and stores it in association with the posted image. Thus, if the information processing device 10 is equipped with a weather acquisition unit WSP capable of acquiring the predicted weather for each visited spot at the estimated arrival time, and the weather at the visited spot when the posted image of the visited spot was taken, the display image acquisition unit HISP acquires an image of the visited spot taken under weather conditions similar to the weather forecast around the visited spot at the estimated arrival time from among multiple display image candidates, and transmits it to the user's communication terminal 101 to display the display image. Here, "weather" includes information on so-called sky conditions such as "sunny," "rainy," and "snowy," as well as information such as wind strength and precipitation. "Similar weather" means that at least one of the sky conditions and wind / rain strength are in similar conditions. "Similar weather" does not mean that precipitation, wind speed, etc. are exactly the same, but rather that they fall within a similar numerical range. For example, in the case of precipitation, weather that falls within the same range, such as less than 5 mm per hour, 5 mm to 20 mm per hour, or more than 20 mm per hour, is referred to as "similar weather."

[0041] Up to this point, the explanation of the operation of the information processing system 100 has mainly focused on the operation in which, when a user inputs route setting conditions into the communication terminal 101, the information processing device 10 acquires a display image that is related to the visited spot and corresponds to the estimated arrival time, and displays it on the screen of the communication terminal 101. However, with this information processing system 100, after setting the route, the user can also change the route setting conditions (i.e., change the drive plan) while checking the display image corresponding to the estimated arrival time of the visited spot displayed on the communication terminal 101. This point will be explained in detail using Figures 3 to 7.

[0042] Figure 3 is a front view showing the operation unit and touch panel of the communication terminal 101, which displays a map and display images transmitted from the information processing device 10.

[0043] Based on the data transmitted from the information processing device 10, the communication terminal 101 displays the following on its touch panel: a map image display section MP in the center of the touch panel display screen GM, an item section UP above it that displays items for changing the drive plan (departure time, spot stay time, destination arrival time), and a selection / change section DW below the map image display section MP that displays a time bar TB on which the user can drag a slider SL for quantitative changes (changing time or date) related to the change item, which includes a string area CH indicating the change item selected by the user.

[0044] The HISP display image acquisition unit of the information processing device 10 allows the user to select items for changing the drive plan, such as departure time, planned stay time at each visited spot, and desired arrival time at the final destination. After the user selects items to change, a time bar TB is presented that allows the user to change the time of the selected items by moving a slider. When the user changes the time of an item, the ETU calculation unit recalculates the estimated arrival time at each visited spot, acquires an image taken at the time corresponding to the new estimated arrival time as a display image, and transmits it to the user's communication terminal 101 for display.

[0045] [Specific examples of the operation of the information processing device 10] Next, an example of the processing operation of the information processing device 10 in the information processing system of this embodiment will be described.

[0046] Figure 4 is a flowchart showing the image acquisition process for display in the information processing device 10 of this embodiment. The information processing device 10 performs the image acquisition process for display for users who have been registered and authenticated in advance for use.

[0047] The information processing device 10 (map operation server) acquires multiple posted images from multiple SNSs, each of which is accompanied by shooting information including at least the date and time of shooting and the location of shooting. The images are then classified according to the shooting time for each spot and stored in the image database of the storage device 12 (step S1).

[0048] The user operates the communication terminal 101 to specify route setting conditions by selecting the spot they wish to visit from a map in which images of their bookmarked spots are superimposed on the corresponding locations. The information processing device 10 obtains the route setting conditions from the communication terminal 101 via the communication unit 15, sets a route from the departure point to the final destination according to the route setting conditions, and generates a route image showing the route (step S2). Here, the stay time at each spot is determined based on the planned stay time for each visited spot specified in the route setting conditions, or the average stay time (statistical value) for each spot, and the estimated arrival time at each spot is calculated taking into account the traffic congestion situation (statistical information) corresponding to the time of day. In other words, in step S2, the information processing device 10 obtains information indicating each of the one or more visited spots included in the route set based on the route setting conditions specified by the user, and information indicating the estimated arrival time at each of those visited spots.

[0049] The information processing device 10 acquires images taken during the estimated arrival time period from the posted images corresponding to each visited spot, and uses these images as display images to show the status of each visited spot at the estimated arrival time. It then transmits the display image data, including the display images, to the user's communication terminal 101 so that it can be displayed on the display unit of the user's communication terminal 101 in correspondence with the location of each visited spot on the map (step S3).

[0050] According to the display image data transmitted from the information processing device 10 to the communication terminal 101 in step S3, the following items can be selected on the communication terminal 101 as items to change the drive plan (in other words, items to change the route setting conditions): departure time, planned stay time at each visited spot, and desired arrival time at the final destination.

[0051] If a predetermined time elapses without the user making a change selection, or if another operation is performed, the information processing device 10 terminates the image acquisition process for display (step S4;N).

[0052] As an example of a case where the user makes a change selection, as shown in Figure 6, when the system receives an operation in which the user has selected to change the departure time (step S4; Y), the information processing device 10 sends display image data showing the time bar TB below the map screen GM to the communication terminal 101 (step S5), prompting the user to change the departure time. When the user moves (drags) the slider SL of the time bar TB, the information processing device 10 changes (updates) the departure time based on the specification in the time bar TB (step S6). The information processing device 10 recalculates the estimated arrival time to each spot (step S7), acquires a new display image showing the status of each visited spot at the new estimated arrival time, and sends the display image data including the display image to the communication terminal 101 so that it can be displayed on the display unit of the communication terminal 101 in correspondence with the location of each visited spot on the map (step S8). After that, the system returns to step S4, and if the user continues to make a change selection, it proceeds to step S5; if the user does not make a change selection, the display image acquisition process ends.

[0053] In this way, users can change their planned departure time, planned stay time at each visited spot, and desired arrival time at their destination by manipulating the Time Bar TB. In conjunction with these changes, the displayed images also change according to the estimated arrival time at each visited spot.

[0054] Figures 5A to 5D are schematic diagrams showing several examples of display images that the information processing device 10 displays on the display unit of the communication terminal 101, corresponding to the location of each visited spot on the map. The captured image acquisition unit PSP has already acquired various posted images, each of which is a captured image of multiple spots, and which are accompanied by information such as the date and time of shooting, the location of shooting, the direction of shooting, the resolution, the weather, and the season. Figures 5A to 5D show examples of captured images of the same spot, "Tower B," taken on different dates or times. Figure 5A shows a bright captured image taken in the daytime on a sunny day, Figure 5B shows a slightly dark captured image taken in the evening, Figure 5C shows a dark captured image taken at night, and Figure 5D shows a slightly dark captured image taken during the daytime in light rain.

[0055] For example, if the initially set driving plan indicated an estimated arrival time at "Tower B" in the evening, then a slightly dark image taken in the evening, as shown in Figure 5B, would be displayed on the display unit of the communication terminal 101 as a display image showing the situation at the estimated arrival time at "Tower B".

[0056] Suppose a user, after reviewing the images of "Tower B," decides they want to arrive at "Tower B" at a time when the illuminations are more striking, and changes their departure time to a one-hour delay. In this case, the information processing device 10 reacquires the estimated arrival times for each visited spot, and as a display image corresponding to the new estimated arrival time for "Tower B," a dark image taken at night, as shown in Figure 5C, is displayed on the display unit of the communication terminal 101. Alternatively, suppose a user decides they want to arrive at their final destination, which they will visit after "Tower B," in the evening, and changes their desired arrival time for the final destination to two hours earlier. As a result, the information processing device 10 recalculates the time for the entire route in order to arrive at the final destination at the user's specified desired arrival time, and the departure time and estimated arrival times for each visited spot are advanced by about two hours. In this case, as a display image corresponding to the new estimated arrival time for "Tower B," a bright image taken during the day, as shown in Figure 5A, is displayed on the display unit of the communication terminal 101. Alternatively, if the weather around "Tower B" is rainy at the new estimated arrival time, a slightly dark photograph taken during daytime light rain, as shown in Figure 5D, may be displayed on the display of the communication terminal 101. At this time, display images corresponding to the new estimated arrival times will also be shown for other visited spots.

[0057] Thus, according to the present invention, it is possible to show the user what kind of scenery will be visible at the time of arrival at the destination, and the user can plan their drive while checking the image corresponding to the estimated time of arrival at the destination.

[0058] Furthermore, as another example of map image display on the user's communication terminal 101, as shown in Figure 7, if the user chooses to change the planned stay time at a visited spot, the communication terminal 101 may display a selection means including a string area CH for the user to select the visited spot whose planned stay time to be changed, and a time bar TB for adjusting the planned stay time for the selected visited spot, below the map screen GM, and also display a list of estimated arrival times and planned stay times for each visited spot. In this case, the captured image corresponding to the estimated arrival time for each visited spot may be displayed alongside the name of each visited spot.

[0059] According to this embodiment, images corresponding to the estimated arrival time at each visited spot, specifically images showing the status of each visited spot at the estimated arrival time, can be displayed on a map. As a result, when a user selects a visited spot, the system can search for a route to visit the spots, automatically set the duration of stay at each spot, and then present a driving plan that allows the user to anticipate their experience during their stay based on the displayed images.

[0060] Therefore, according to the information processing device 10 of this embodiment, it is possible to provide images as display images corresponding to the estimated arrival time at each visit spot, thereby motivating the user to visit each visit spot.

[0061] Furthermore, the drive plan generated by the information processing device 10 of this embodiment may be made available to multiple users via the Internet. Since the drive plan is accompanied by images corresponding to the estimated arrival time at each destination, it is easy for other users besides the user who created the drive plan to understand the entire plan, and it is possible to motivate other users to visit each destination.

[0062] Furthermore, if other recommended spots (spots automatically recommended according to the user's preferences) exist near the set route, the information processing device 10 may display images of those recommended spots taken during the time period when the route passes near those recommended spots, associating them with the map displayed on the communication terminal 101, and accept an operation from the user to add them as visited spots. If the user adds a spot as a visited spot, the device can re-search for and display the route including that recommended spot.

[0063] Furthermore, the user may create a drive plan by specifying a departure date several weeks to several months in the future through the operation of the communication terminal 101. In this case, since the departure date is not immediate, the season may have changed by the departure date, so it may not be desirable to display recently taken images as images showing the condition of the visited spots. Therefore, if the departure date is further in the future (for example, if the departure date is more than two weeks away), the information processing device 10 searches the image database of the storage device 12 for images taken at the same time one year prior to the departure date, and retrieves them as display images to show the condition of the visited spots specified by the user on the departure date. If no images taken at the same time one year prior to the departure date exist in the image database, images taken at the same time two years prior may be retrieved as display images.

[0064] In this embodiment of the information processing system 100, the information processing device 10 is described as searching for a route based on the operation of the communication terminal 101. However, the communication terminal 101 may perform some or all of the functions of the information processing device 10. As an example in this case, the communication terminal 101 may be equipped with a map database and search for a route within its own device. In this case, the communication terminal 101 transmits identification information of the visited spots included in the route set in its own device, and estimated arrival time information regarding the estimated arrival time at the visited spots, to the information processing device 10 via communication. The information processing device 10 acquires and stores in advance multiple images posted on SNS sites, etc., which have information such as the shooting location, shooting direction, and shooting date and time attached. When it receives identification information of a visited spot and estimated arrival time information from the communication terminal 101, it extracts the corresponding images and transmits them to the communication terminal 101. The communication terminal 101 may display the images acquired from the information processing device 10 on a display unit.

[0065] Therefore, according to the information processing system 100 of this embodiment, it is possible to provide images corresponding to the estimated arrival time at each visit spot as display images, thereby motivating users to visit each visit spot. [Explanation of Symbols]

[0066] 10 Information Processing Devices 101 Communication terminal PSP Image Acquisition Unit RGU Route Setting Unit ETU calculation part HISP display image acquisition unit WSP Weather Acquisition Unit

Claims

1. An image acquisition unit that acquires a captured image related to a spot, An arrival prediction information acquisition unit acquires information indicating the estimated time of arrival at a destination included in a route set based on route setting conditions, An operation acquisition unit that acquires an operation to change a change means that changes the time conditions included in the route setting conditions, A display image acquisition unit acquires images from the aforementioned captured images that are related to the visited spot and taken at a time corresponding to the estimated arrival time, and displays them on the screen in association with the visited spot. Equipped with, The display image includes an image showing the modification means, When the arrival prediction information acquisition unit receives an operation to change the time condition based on an operation on the image showing the change means, it acquires a new arrival prediction time for the visited spot. The information processing apparatus is characterized in that the display image acquisition unit acquires an image taken at a time corresponding to the new estimated arrival time from among the captured images, and uses that image as the display image.

2. The information processing apparatus according to Claim 1, wherein, when the departure date included in the route setting conditions is in the future, the display image acquisition unit acquires from the captured images an image taken on a date and time in a past year corresponding to the estimated arrival time and estimated arrival date as the display image.

3. It has a weather forecast acquisition unit that acquires weather forecast information for the visited spot at the estimated arrival time, The information processing apparatus according to claim 1, characterized in that the display image acquisition unit acquires from the captured images an image taken under weather conditions determined based on the weather forecast information for the visited spot at the estimated arrival time, as the display image.

4. The system includes a unit that determines the estimated length of stay at the aforementioned visit spot, The information processing device according to claim 1, wherein the arrival prediction information acquisition unit acquires the arrival prediction time corresponding to the expected stay time.

5. The information processing apparatus according to claim 1, characterized in that, when multiple images are captured for a single spot, the display image acquisition unit prioritizes acquiring the image whose resolution, shooting position, and shooting direction each meet predetermined criteria, and uses it as the display image.

6. The information processing apparatus according to claim 1, characterized in that the display image acquisition unit prioritizes acquiring the image with the most recent shooting date and time from among a plurality of captured images as the display image.

7. An information processing method performed by an information processing device, Image acquisition step to acquire images taken in relation to a spot, An arrival prediction information acquisition step obtains information indicating the estimated time of arrival at a destination included in the route set based on route setting conditions, An operation acquisition step to acquire an operation on a change means that changes the time conditions included in the route setting conditions, A display image acquisition step involves selecting from the aforementioned captured images images that are related to the visited spot and taken at a time corresponding to the estimated arrival time, and then acquiring these images as display images to be displayed on the screen in association with the visited spot. Includes, The display image acquisition step acquires the display image including an image showing the modification means, The arrival prediction information acquisition step, when the operation to change the time condition based on the operation on the image showing the change means is acquired by the operation acquisition step, acquires a new arrival prediction time for the visited spot, The information processing method is characterized in that the display image acquisition step involves acquiring an image taken at a time corresponding to the new estimated arrival time from among the captured images, as the display image.

8. In an information processing device, Image acquisition step to acquire images taken in relation to a spot, An arrival prediction information acquisition step obtains information indicating the estimated time of arrival at a destination included in the route set based on route setting conditions, An operation acquisition step to acquire an operation on a change means that changes the time conditions included in the route setting conditions, A display image acquisition step involves selecting from the aforementioned captured images images that are related to the visited spot and taken at a time corresponding to the estimated arrival time, and then acquiring these images as display images to be displayed on the screen in association with the visited spot. Make it run, The display image acquisition step acquires the display image including an image showing the modification means, The arrival prediction information acquisition step, when the operation to change the time condition based on the operation on the image showing the change means is acquired by the operation acquisition step, acquires a new arrival prediction time for the visited spot, The program is characterized in that the display image acquisition step acquires an image taken at a time corresponding to the new estimated arrival time from among the captured images, and uses that image as the display image.

9. A recording medium characterized by recording the program described in Claim 8.

Images