Information processing device, information processing method, program, and recording medium

Abstract

This information processing device comprises: a captured image acquiring unit for acquiring captured images captured at each of a plurality of locations; a specified information acquiring unit for acquiring specified information indicating a plurality of specified locations and a specified date and time corresponding to each of the plurality of specified locations; and a display image acquiring unit which, on the basis of imaging date and time information assigned to the captured images, acquires, for each specified location, a captured image captured at an imaging date and time defined on the basis of the specified date and time, from among the plurality of captured images captured at the specified location, as a display image to be displayed superimposed on a map including the plurality of specified locations.

Description

Information processing device, information processing method, program, and recording medium

[0001] The present invention relates to an information processing device, an information processing method, a program, and a recording medium, and more particularly to an information processing device, an information processing method, a program, and a recording medium for displaying a captured image superimposed on a map, for example.

[0002] Images representing spots such as stores and landmarks are displayed on a map. For example, an information processing system has been proposed that analyzes information posted on a social networking service, generates spot information including images of the stores and other locations, and displays the generated spot information superimposed on a map displayed in a navigation system (see, for example, Patent Literature 1).

[0003] Japanese Patent Application Laid-Open No. 2022-7576

[0004] One aspect of the present invention aims to solve the problem that, in an information processing system such as the above-mentioned conventional technology, the image displayed as spot information does not take into account so-called composition information, such as the shooting position and shooting direction, when the image was taken, so that the displayed image may not necessarily capture a landscape representative of the spot and may not convey the charm of the spot. Another aspect of the present invention aims to solve the problem that, in an information processing system such as the above-mentioned conventional technology, the image displayed as spot information does not take into account the circumstances when the image was taken, so that the displayed image may not necessarily match the current circumstances of the spot. Another aspect of the present invention aims to solve the problem that, in an information processing system such as the above-mentioned conventional technology, the image displayed as spot information does not take into account the weather when the image was taken, so that the displayed image may not necessarily match the current weather of the spot.

[0005] The description of these problems does not preclude the existence of other problems, and one embodiment of the present invention solves at least one of the above problems. Furthermore, problems other than these can be extracted from the description in the specification, drawings, claims, etc.

[0006] The present invention has been made in consideration of the above-mentioned points, and one of its objects is to provide an information processing device in an image display system that displays images of multiple locations superimposed on a map including the multiple locations, which is capable of displaying an image for each location that is close to the situation of the location at the current or specified date and time.

[0007] The invention described in claim 1 is an information processing device comprising: an image acquisition unit that acquires images taken at each of a plurality of locations; a designated information acquisition unit that acquires designated information indicating a plurality of designated locations and designated dates and times corresponding to each of the plurality of designated locations; and a display image acquisition unit that, based on the information on the shooting date and time attached to the image, acquires, for each of the designated locations, from among the plurality of images taken at the designated locations, an image taken at a shooting date and time determined based on the designated date and time, as a display image to be superimposed on a map including the plurality of designated locations.

[0008] The invention described in claim 6 is an information processing method executed by an information processing device, characterized in that it includes the steps of acquiring photographed images taken at each of a plurality of locations, acquiring designated information indicating a plurality of designated locations and designated dates and times corresponding to each of the plurality of designated locations, and acquiring, for each of the designated locations based on the information on the photographed date and time attached to the photographed images, from among the plurality of photographed images taken at the designated locations, an image taken at a photographed date and time determined based on the designated dates and times, as a display image to be superimposed on a map including the plurality of designated locations.

[0009] The invention described in claim 7 is a program that causes an information processing device to execute the following steps: acquiring photographed images taken at each of a plurality of locations; acquiring designated information indicating a plurality of designated locations and designated dates and times corresponding to each of the plurality of designated locations; and acquiring, for each of the designated locations based on the information on the shooting date and time attached to the photographed images, from among the plurality of photographed images taken at the designated locations, an image taken at a shooting date and time determined based on the designated date and time, as a display image to be superimposed on a map including the plurality of designated locations.

[0010] The invention described in claim 8 is a recording medium that records a program that causes an information processing device to execute the following steps: acquiring photographed images taken at each of a plurality of locations; acquiring designated information indicating a plurality of designated locations and designated dates and times corresponding to each of the plurality of designated locations; and acquiring, for each of the designated locations based on the information on the shooting date and time attached to the photographed images, from among the plurality of photographed images taken at the designated locations, an image taken at a shooting date and time determined based on the designated date and time, as a display image to be superimposed on a map including the plurality of designated locations.

[0011] 2B is a block diagram showing the overall configuration of an image display system of Example 1. FIG. 2C is a diagram showing an example of an image acquired by a captured image acquisition unit. FIG. 2D is a diagram showing an example of an image with a different composition from the image of FIG. 2A. FIG. 2E is a flowchart showing a processing routine for image display processing of Example 1. FIG. 2F is a diagram showing an example of an image superimposed on a map. FIG. 2G is a block diagram showing the overall configuration of an image display system of Example 1. FIG. 2H is a diagram showing an example of a display image when the image was taken in the daytime. FIG. 2I is a diagram showing an example of a display image when the image was taken in the nighttime. FIG. 2I is a flowchart showing a processing routine for image display processing of Example 2. FIG. 2H is a block diagram showing the overall configuration of an image display system of Example 3. FIG. 2I is a diagram showing an example of a display image when the weather at the time of shooting was sunny. FIG. 2I is a diagram showing an example of a display image when the weather at the time of shooting was rainy. FIG. 2I is a diagram showing an example of a display image when the weather at the time of shooting was snowy. FIG. 2I is a flowchart showing a processing routine for image display processing of Example 3.

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will now be described in detail. In the following description of each embodiment and in the accompanying drawings, substantially the same or equivalent parts are designated by the same reference numerals.

[0013] 1 is a block diagram showing the configuration of an image display system 100 of this embodiment. The image display system 100 is composed of a server device 10 and a plurality of terminal devices 20-1 to 20-n (n is an integer of 2 or more). Note that, since the terminal devices 20-1 to 20-n each have a common configuration, in the following explanation, one of the terminal devices 20-1 to 20-n will be referred to as "terminal device 20" and its configuration and operation will be explained.

[0014] The server device 10 includes a communication unit 11 , a photographed image acquisition unit 12 , a photographing condition setting unit 13 , a candidate image acquisition unit 14 , a location setting unit 15 , and a display image specification unit 16 .

[0015] The communication unit 11 is a communication device that transmits and receives data via a communication network, and is configured by a network adapter such as a NIC (Network Interface Card).

[0016] The captured image acquisition unit 12 accesses the communication network via the communication unit 11 and acquires captured images posted to a social networking service (SNS). In this embodiment, the captured image acquisition unit 12 acquires, from among a plurality of posted images posted to the SNS, images of scenery such as buildings and cityscapes, and images to which information on the shooting position and shooting direction (in other words, the shooting angle) is attached.

[0017] The shooting condition setting unit 13 sets the shooting position and shooting direction conditions for the image displayed on the image display system 100 of this embodiment. In the following description, the shooting position and shooting direction are collectively referred to as "composition." Note that the "composition" may also include elements other than the shooting position and shooting direction, such as information on angle of view correction by zooming the camera during shooting.

[0018] In this embodiment, the photographing condition setting unit 13 sets composition conditions for each location where each photographed image was taken, based on the plurality of photographed images acquired by the photographed image acquisition unit 12 .

[0019] For example, the photographing condition setting unit 13 identifies the most frequently photographed composition among a plurality of photographed images taken at a certain point and its surroundings as a representative composition of the photographed images at that point, and sets the composition conditions of the photographed images at that point based on the identified representative composition. Specifically, the photographing condition setting unit 13 identifies a composition near the median of the distribution of the photographing positions and photographing directions of the plurality of photographed images as a representative composition, and sets values ​​within a predetermined range including the median as the photographing position and photographing direction conditions, i.e., the composition conditions.

[0020] In this embodiment, a "point" refers to a predetermined area including, for example, an intersection, a facility such as a store, a landmark, etc. For example, if a convenience store is specified as a "point," an area of ​​several meters square including the store and its parking lot is included in the "point" of the convenience store.

[0021] 2A and 2B are diagrams showing examples of images taken at the same location, "Temple K," but with different compositions. Fig. 2A shows an image of Temple K photographed from the front, and Fig. 2B shows an image of Temple K photographed from diagonally in front.

[0022] For example, if there are more images posted on SNS in which Temple K is photographed from diagonally in front than in which it is photographed from the front, the photographing condition setting unit 13 identifies a composition such as that shown in Figure 2B as one of the representative compositions, and sets the composition conditions for the photographed image of Temple K based on the photographing position and direction.

[0023] The photographing condition setting unit 13 may set the photographing conditions for the photographed image not for each location but for each attribute of the photographed object. That is, for a photographed image at a certain location, if the photographed object is expected to be a building with a specific attribute, such as a shrine or temple, in consideration of the photographing position, the photographing condition setting unit 13 may extract composition conditions common to a plurality of photographed images of other shrines and temples and set them as composition conditions for the photographed image at that location.

[0024] The candidate image acquisition unit 14 acquires, as candidate images, photographed images that satisfy the conditions for composition set by the photographing condition setting unit 13 from among the plurality of photographed images acquired by the photographed image acquisition unit 12 .

[0025] The location setting unit 15 receives a designation signal from the terminal device 20 via the communication unit 11 that designates an "image display location," which is a location to be displayed as an image (i.e., a location to be displayed as an image superimposed on a map), and sets the image display location based on the received designation signal.

[0026] The image display points on the terminal device 20 are specified by a user through an input operation using the terminal device 20. In this embodiment, a plurality of points on a map displayed on the display of the terminal device 20 (in other words, at least two or more points displayed on the same map) are specified by the user through operation of the touch panel display. The point setting unit 15 of the server device 10 sets the plurality of points as image display points based on a specification signal from the terminal device 20.

[0027] The display image specifying unit 16 specifies, from among the candidate images acquired by the candidate image acquiring unit 14, a candidate image that corresponds to the image display location set by the location setting unit 15 as a display image.

[0028] The terminal device 20 is a small, portable terminal device having a communication function and an image capturing function, such as a smartphone or a tablet terminal.

[0029] The terminal device 20 includes a communication unit 21 , an imaging unit 22 , a display control unit 23 , a storage unit 24 , a display unit 25 , and an operation reception unit 26 .

[0030] The communication unit 21 transmits and receives data via a communication network. For example, the communication unit 21 uploads images captured by the imaging unit 22 to a social networking service (SNS). The communication unit 21 also receives display images transmitted from the server device 10.

[0031] The imaging unit 22 is a camera built into the terminal device 20. A user operates the imaging unit 22 to capture a landscape or the like, and generates a captured image to be posted on, for example, an SNS.

[0032] The display control unit 23 is a circuit block that controls the display of the display unit 25. In this embodiment, the display control unit 23 controls the display of the display unit 25 so that the image transmitted from the server device 10 is displayed.

[0033] The storage unit 24 is a storage device including a hard disk, etc. In this embodiment, the storage unit 24 stores a map to be displayed on the display unit 25.

[0034] The display unit 25 is composed of a display such as a liquid crystal display panel. The display unit 25 displays various information in accordance with the control of the display control unit 23. In this embodiment, the display unit 25 displays a map read from the storage unit 24. In addition, a plurality of images are displayed superimposed on the map.

[0035] The display unit 25 also functions as a touch panel display, that is, the user touches and operates the display unit 25 to input various pieces of information.

[0036] The operation receiving unit 26 receives an operation input made by the user using the touch panel display of the display unit 25 , and transmits a signal corresponding to the content of the operation input to the server device 10 via the communication unit 21 .

[0037] In this embodiment, the display unit 25 displays a map on the screen and receives designation of an image display point from the user on the map. Note that in this embodiment, multiple points displayed on the same map are designated as image display points. The operation reception unit 26 transmits information on the image display point designated by an operation using the touch panel display of the display unit 25 to the server device 10 via the communication unit 21.

[0038] Next, the processing operation of the server device 10 in the image display processing of this embodiment will be described.

[0039] FIG. 3 is a flowchart showing the processing routine of the image display process of this embodiment.

[0040] First, the captured image acquisition unit 12 accesses the communication network via the communication unit 11 and acquires a plurality of captured images with information about the shooting position and shooting direction from images posted on an SNS or the like (STEP 101).

[0041] The photographing condition setting unit 13 sets composition conditions for each location where each photographed image was taken or for each attribute of the subject, based on the plurality of photographed images acquired by the photographed image acquisition unit 12 (STEP 102).

[0042] The candidate image acquisition unit 14 extracts (acquires) the photographed images that satisfy the composition conditions set in STEP 102 as candidate images from the plurality of photographed images acquired in STEP 101 (STEP 103).

[0043] The location setting unit 15 accepts the setting of the image display location via the communication unit 11 (STEP 104).

[0044] Specifically, the user operates the touch panel display of the display unit 25 of the terminal device 20 to select a desired location on the map displayed on the display unit 25. In this embodiment, multiple locations displayed on the same map are selected. The communication unit 21 of the terminal device 20 transmits image display location designation information indicating the content of the selection to the server device 10. The location setting unit 15 of the server device 10 acquires the image display location designation information transmitted from the terminal device 20 via the communication unit 11.

[0045] The location setting unit 15 sets an image display location based on the designation information acquired via the communication unit 11 (STEP 105).

[0046] The display image specifying unit 16 specifies, from among the candidate images acquired in STEP 103, a candidate image that corresponds to the image display point set in STEP 105 as a display image (STEP 106).

[0047] The communication unit 11 transmits the display image specified in STEP 106 to the terminal device 20 (STEP 107).

[0048] Through the above-described processing routine, the display image is transmitted from the server device 10 to the terminal device 20 and displayed on the display unit 25 of the terminal device 20 .

[0049] 4 is a diagram showing an example of a display screen displayed on the display unit 25 of the terminal device 20 in the image display system 100 of this embodiment. Here, a case where "Temple K" and "Temple R" are set as image display points is shown.

[0050] At the position of Temple K on the map, one image that satisfies the composition conditions set by the photographing condition setting unit 13 is displayed from among the photographed images of Temple K acquired from images posted on SNS or the like. Similarly, at the position of Temple R on the map, one image that satisfies the composition conditions set by the photographing condition setting unit 13 is displayed from among the photographed images of Temple R acquired from images posted on SNS or the like.

[0051] As described above, in the image display system 100 of this embodiment, the shooting condition setting unit 13 of the server device 10 sets, for each of a plurality of locations, composition conditions (i.e., shooting position and shooting direction) for the captured image captured at that location. The display image specifying unit 16 acquires, from among the captured images captured at each of the plurality of image display locations set by the location setting unit 15, the captured images that satisfy the composition conditions set by the shooting condition setting unit 13 as display images corresponding to each of the plurality of image display locations.

[0052] Therefore, according to the image display system 100 of this embodiment, the server device 10 sets in advance conditions for the composition of the captured image for each location or for each attribute of the subject, and only images that satisfy the conditions are used as display images, so that the images superimposed on the map and displayed on the terminal device 20 can be images with a representative composition for each location. This also makes it possible to motivate users to visit each location.

[0053] Next, a second embodiment of the present invention will be described.

[0054] 5 is a block diagram showing the configuration of an image display system 200 according to this embodiment. The image display system 200 comprises a server device 30 and a plurality of terminal devices 20-1 to 20-n.

[0055] The server device 30 includes a communication unit 11, a photographed image acquisition unit 12, a specified information acquisition unit 31, a location date and time setting unit 32, a photographed information acquisition unit 33, and a display image acquisition unit .

[0056] The specified information acquisition unit 31 receives a specification signal specifying the image display location and "date and time" from the terminal device 20 via the communication unit 11, and acquires information on the specified location and specified date and time (hereinafter referred to as "specified information"). The location and date and time on the terminal device 20 are specified by an input operation by the user using the terminal device 20.

[0057] In this embodiment, of the multiple images taken at a specified location, the images taken under the conditions of the shooting date and time determined based on the specified date and time are acquired as display images. In this embodiment, the shooting date and time conditions of the images to be selected as display images are determined based on the "date" and "time period" of the specified date and time, and information on the "event" taking place on the specified date and time.

[0058] In this embodiment, which of "date," "time zone," and "event" should be given priority in determining the shooting date and time conditions of a display image (in other words, which of "date," "time zone," and "event" should be given priority in selecting a display image) is specified in accordance with the user's operation of the terminal device 20. That is, in this embodiment, the specification information acquired by the specification information acquisition unit 31 from the terminal device 20 includes information specifying which of "date," "time zone," and "event" should be given priority in determining the shooting date and time conditions of a display image.

[0059] The location date and time setting unit 32 sets the image display location based on the information on the designated location included in the designation information. The location date and time setting unit 32 also sets the target date and time for image display based on the information on the designated date and time included in the designation information.

[0060] In the image display system 200 of this embodiment, the user also specifies multiple locations (i.e., at least two or more locations to be displayed on the same map) by inputting information using the terminal device 20. As a result, specification information specifying the multiple locations is transmitted from the terminal device 20 to the server device 30, and the location date and time setting unit 32 sets the multiple locations as image display locations.

[0061] In addition, in this embodiment, the user can specify the "date and time" for each specified image display location. For example, the user specifies the planned date and time for visiting each of the multiple locations as the "date and time" for image display for each location. Alternatively, the user may specify the same date and time (e.g., the current date and time) for each of the multiple locations.

[0062] The location date and time setting unit 32 also acquires information about events (e.g., festivals, ceremonies, etc.) scheduled to be held at the image display location on the set target date and time. For example, the location date and time setting unit 32 acquires information about events scheduled to be held by accessing an event information database (not shown) on the network via the communication unit 11.

[0063] The photographing information acquisition unit 33 acquires information on the date and time of photographing for each of the multiple photographed images acquired by the photographed image acquisition unit 12. The photographing information acquisition unit 33 also acquires information on events that were taking place at the location when each photographed image was taken. The photographing information acquisition unit 33 acquires information on events that were taking place when each photographed image was taken, for example, by accessing an event information database (not shown) on the network via the communication unit 11.

[0064] The display image acquisition unit 34 acquires a display image from among the multiple captured images acquired by the captured image acquisition unit 12, based on the image display location set by the location date and time setting unit 32, information on the target date and time for image display, information on the event held at the target date and time, and the capture information (i.e., the capture date and time and event information) acquired by the capture information acquisition unit 33. In this embodiment, the display image acquisition unit 34 determines the capture date and time conditions for the captured images to be used as display images, based on designation information that specifies which of "date," "time zone," and "event" should be given priority in selecting a display image, and acquires a captured image that satisfies the capture date and time conditions as a display image.

[0065] Specifically, when selecting a display image with priority given to "date," the display image acquisition unit 34 sets a shooting date / time condition of being close to the specified date / time, and acquires, as the display image, a captured image that satisfies this condition. For example, when the current date / time is specified by the user and set as the target date / time for image display, the display image acquisition unit 34 acquires, as the display image, a captured image captured on the most recent date. Furthermore, when there are no images captured on the most recent date, for example, within the past two weeks, the display image acquisition unit 34 acquires, as the display image, the most recent captured image among images captured at the same time within a predetermined period (for example, within the past three years).

[0066] Furthermore, when a user specifies a future date and time and sets it as the target date and time for image display, the display image acquisition unit 34 acquires, as the display image, an image taken in the same season as the future date and time, as a condition for the capture date. For example, when a user specifies a date two months from today using a certain location as the specified location and sets that date as the target date and time for image display, the display image acquisition unit 34 acquires, as the display image, the most recent image taken within several days before and after the target date and time (e.g., within 10 days before and after) within a predetermined period in the past (e.g., within three years). Furthermore, for example, when there are images taken six months ago and one year ago, the display image acquisition unit 34 acquires, as the display image, an image taken at the same time one year ago, rather than the image taken six months ago, which is in a different season.

[0067] Furthermore, when selecting a display image with priority given to "time zone," the display image acquisition unit 34 acquires a display image with the condition that the image was taken in a time zone close to the time zone of the specified date and time. For example, if the user specifies 8:00 PM today and sets it as the target date and time for image display, the display image acquisition unit 34 acquires, as the display image, the most recent image taken within a predetermined period of time in the past (e.g., within one week) in a time zone that includes 8:00 PM (e.g., from 7:30 PM to 8:30 PM), rather than an image taken at 9:00 AM on the same day, which is a different time zone.

[0068] 6A and 6B are diagrams showing examples of images taken at the same location, "Temple K," but at different times of day. Fig. 6A shows an image taken during the day, and Fig. 6B shows an image taken at night. For example, if the specified date and time is after sunset, the display image acquisition unit 34 acquires the image shown in Fig. 6B as the display image, rather than the image shown in Fig. 6A.

[0069] Furthermore, when selecting a display image with priority given to "events," the display image acquisition unit 34 acquires a display image based on the condition that the image was taken when an event similar to the event scheduled to be held at the specified date and time was held in the past at the specified location. For example, if the event is held once a year at the same time, such as a summer festival, the display image acquisition unit 34 acquires, as the display image, an image taken when a similar event was held at the same time one year ago. For example, if the event is held on a fixed date every month, such as a regular market, the display image acquisition unit 34 acquires, as the display image, an image taken when the event was held, for example, one month ago.

[0070] In this embodiment, the user specifies the image display location and date and time, as well as the “date,” “time period,” and “event” to be used as the shooting date and time conditions for selecting images to be displayed, by operating the terminal device 20. The operation accepting unit 26 transmits specification information including these contents to the server device 30 via the communication unit 21.

[0071] Next, the processing operation of the server device 30 in the image display processing of this embodiment will be described.

[0072] FIG. 7 is a flowchart showing the processing routine of the image display process of this embodiment.

[0073] The communication unit 11 of the server device 30 receives the designation information transmitted from the terminal device 20. The designation information acquisition unit 31 acquires the received designation information (STEP 201).

[0074] The location date and time setting unit 32 sets an image display location based on the information about the designated location included in the designation information received in STEP 201. The location date and time setting unit 32 also sets a target date and time for image display based on the information about the designated date and time included in the designation information (STEP 202).

[0075] The photographing information acquisition unit 33 acquires information on the photographing date and time and information on events taking place at the image display point set in STEP 202 when the photograph was taken (STEP 203).

[0076] The display image acquisition unit 34 acquires a display image corresponding to each image display location based on the information on the image display location and the target date and time for image display set in STEP 202, and the information included in the specification information acquired in STEP 201 regarding whether the date, time zone, or event will be used as a condition for the shooting date and time of the display image (STEP 204).

[0077] The communication unit 11 transmits the display image acquired in STEP 204 to the terminal device 20 (STEP 205).

[0078] Through the above-described processing routine, the display image is transmitted from the server device 30 to the terminal device 20 and displayed on the display unit 25 of the terminal device 20 .

[0079] In the image display system 200 of this embodiment, a plurality of locations and the dates and times corresponding to each location are designated in response to a user operation on the terminal device 20, and are transmitted as designated information to the server device 30. The display image acquisition unit 34 of the server device 30 acquires, as display images, those images taken at each of the designated locations that satisfy a shooting date and time condition determined based on the designated date and time (for example, images taken on a nearby date, in the same time zone, or at the time of a similar event).

[0080] According to the image display system 200 of this embodiment, an image that is close to the current situation at each location or the situation at a future date and time desired by the user can be displayed on the display unit 25 of the terminal device 20 .

[0081] This allows the user to visually perceive the scene that would be expected if they actually visited the location, and also makes it possible to motivate the user to visit each location.

[0082] Next, a third embodiment of the present invention will be described.

[0083] 8 is a block diagram showing the configuration of an image display system 300 of this embodiment. The image display system 300 is made up of a server device 40 and a plurality of terminal devices 20-1 to 20-n.

[0084] The server device 40 includes a communication unit 11 , a photographed image acquisition unit 12 , a designated information acquisition unit 41 , a location date and time setting unit 42 , a weather information acquisition unit 43 , and a display image acquisition unit 44 .

[0085] The designated information acquisition unit 41 receives a designation signal designating an image display location and a target date and time for image display from the terminal device 20 via the communication unit 11, and acquires designated information including the designated location and the designated date and time.

[0086] The location date and time setting unit 42 sets the image display location based on the information on the designated location included in the designation information. The location date and time setting unit 42 also sets the target date and time for image display based on the information on the designated date and time included in the designation information.

[0087] In the image display system 300 of this embodiment, multiple locations are specified by the user through input operations using the terminal device 20, and the location date and time setting unit 32 sets the multiple locations as image display locations in response to this.

[0088] The weather information acquisition unit 43 acquires weather information that indicates the weather conditions at the image display location at the target date and time. For example, if the target date and time is a future date and time, the weather information acquisition unit 43 accesses a weather forecast database (not shown) on the network via the communication unit 11 and acquires information on the predicted weather at the image display location at the target date and time as weather information.

[0089] Here, "weather" includes information on weather conditions such as "clear," "rain," and "snow," as well as information on wind strength and precipitation (hereinafter referred to as wind and rain strength). In the following description, weather conditions in which at least one of the weather conditions and wind and rain strength is similar will be referred to as having the same weather. Note that "the same weather" does not mean that the precipitation and wind speed are strictly identical, but rather that they fall within a similar range of values. For example, in the case of wind strength, weather conditions that fall within the same range of wind speeds of 10 m / s or less, 10 to 20 m / s, and 20 m / s or more will be referred to as having the same weather.

[0090] The weather information acquisition unit 43 may acquire information on the predicted weather for the location of the subject of photography (i.e., the subject) separately from information on the predicted weather for the image display location where the image is taken. For example, if the image display location is a so-called scenic spot where a particular mountain, lake, etc. can be viewed in its entirety, the weather information acquisition unit 43 acquires, as weather information, the predicted weather for the particular mountain, lake, etc. that is associated in advance with the image display location as the subject location that is the location of the subject of photography at the image display location (scenic spot).

[0091] Furthermore, the weather information acquisition unit 43 acquires weather information at the shooting location at the shooting date and time for a photographed image taken at the image display location set by the location date and time setting unit 42, among the multiple photographed images acquired by the photographed image acquisition unit 12. For example, the weather information acquisition unit 43 accesses a weather information database (not shown) on the network via the communication unit 11 to acquire, as weather information, information about the weather at the time the photographed image was taken.

[0092] The display image acquisition unit 44 acquires a display image from among the multiple captured images acquired by the captured image acquisition unit 12 based on the image display location set by the location date and time setting unit 42, information on the target date and time for image display, and weather information acquired by the weather information acquisition unit 43.

[0093] Specifically, based on the weather information acquired by the weather information acquisition unit 43, the display image acquisition unit 44 acquires, as a display image, an image taken at the image display location set by the location date and time setting unit 42, where the weather at the time of shooting was the same as the weather predicted for the target date and time for image display.

[0094] 9A, 9B, and 9C are diagrams showing examples of images taken at the same location, "Temple K," but under different weather conditions at the time of the image capture. Fig. 9A shows an image taken on a sunny day, Fig. 9B shows an image taken on a rainy day, and Fig. 9C shows an image taken on a snowy day.

[0095] For example, if Temple K is set as the image display location and the forecast weather for the target date and time for image display is rainy, the display image acquisition unit 34 acquires the image taken in rainy weather in Figure 9B as the display image.

[0096] As described above, when the shooting location is a so-called scenic spot where a panoramic view of mountains, a lake, etc. is available, the display image acquisition unit 44 acquires, as a display image, a photographed image that was taken under weather conditions in which the weather at the shooting date and time of a subject location (e.g., a specific mountain, etc.) previously associated with the shooting location (scenic spot) is the same as the weather at the subject location predicted for the target date and time of image display. Alternatively, in such a case, the display image acquisition unit 44 may acquire, as a display image, a photographed image in which the combination of the weather at the shooting date and time of a subject location (e.g., a specific mountain, etc.) previously associated with the shooting location (scenic spot) and the weather at the shooting date and time of the shooting location (scenic spot) is the same as the combination of the weather at the subject location predicted for the target date and time of image display and the predicted weather at the shooting location.

[0097] Next, the processing operation of the server device 40 in the image display processing of this embodiment will be described.

[0098] FIG. 10 is a flowchart showing the processing routine of the image display process of this embodiment.

[0099] The communication unit 11 of the server device 30 receives the designation information transmitted from the terminal device 20. The designation information acquisition unit 41 acquires the received designation information (STEP 301).

[0100] The location date and time setting unit 42 sets the image display location based on the information on the designated location included in the designation information received in STEP 301. The location date and time setting unit 42 also sets the target date and time for image display based on the information on the designated date and time included in the designation information (STEP 302).

[0101] The weather information acquisition unit 43 accesses weather forecast information on the network via the communication unit 11 and acquires information on the weather forecast for the target date and time of the image display location set in STEP 302 (STEP 303).

[0102] The weather information acquisition unit 43 acquires information about the weather at the time of shooting for the image taken at the image display point set in STEP 302 (STEP 304).

[0103] The display image acquisition unit 44 acquires, as a display image, from among the images taken at the image display point set in STEP 302, those images in which the weather at the time of taking the image was the same as the predicted weather acquired in STEP 303 (STEP 305).

[0104] The communication unit 11 transmits the display image acquired in STEP 305 to the terminal device 20 (STEP 306).

[0105] Through the above-described processing routine, the display image is transmitted from the server device 40 to the terminal device 20 and displayed on the display unit 25 of the terminal device 20 .

[0106] In the image display system 300 of this embodiment, a plurality of locations and the dates and times corresponding to each location are designated in response to a user operation on the terminal device 20, and the designated information is transmitted to the server device 40. The weather information acquisition unit 43 of the server device 40 acquires information on the predicted weather at the designated location or the subject location at the designated date and time. The display image acquisition unit 44 acquires, as display images, images taken at the designated locations in which the weather at the time of shooting matches the predicted weather at the designated date and time, or images in which the weather at the subject location at the time of shooting matches the predicted weather at the subject location at the designated date and time.

[0107] According to the image display system 200 of this embodiment, it is possible to display images taken in weather conditions similar to the current weather at each location or subject location or the weather at a future date and time desired by the user on the display unit 25 of the terminal device 20. This allows the user to visually perceive the scenery that would be expected if they actually visited that location.

[0108] Therefore, the image display system 200 of this embodiment can motivate users to visit each location.

[0109] The present invention is not limited to the above-described embodiments. For example, in the above-described embodiments, the terminal devices 20 (20-1 to 20-n) are small, portable terminal devices such as smartphones and tablet devices. However, the type of the terminal device 20 is not limited to this, and may be, for example, a navigation device installed in a vehicle such as an automobile.

[0110] In the above-described first embodiment, the photographing condition setting unit 13 identifies a representative composition from among a plurality of photographed images for each location and sets the representative composition as the composition condition for the photographed image at that location. However, the method for setting the composition condition is not limited to this. For example, the user may specify a desired composition via communication with the terminal device 20, and the terminal device 20 may set the composition condition based on the specification. Alternatively, representative composition conditions may be stored in advance for each of a plurality of locations in association with the location.

[0111] Furthermore, in the above-described second embodiment, a case where a display image is acquired based on a date, time period, and event determined based on the specified date and time as conditions for the shooting date and time has been described as an example. However, factors for determining the shooting date and time conditions are not limited to these. For example, in the above-described second embodiment, when a display image is selected based on the "date," an image captured on a date close to the specified date and time is acquired as a display image. However, a display image may be selected based on whether the date is a weekday or a holiday, rather than simply whether the date is close or far. In other words, since it is generally expected that the degree of congestion differs between holidays and weekdays at tourist spots, if the specified date and time for image display is a holiday, an image captured on a holiday may be used as a display image, and if the specified date and time is a weekday, an image captured on a weekday may be used as a display image.

[0112] The configurations of the above-described embodiments can be combined as appropriate. For example, as in the first embodiment, composition conditions can be set, and from among the captured images that satisfy the conditions, a captured image whose shooting conditions and weather conditions match those at a specified date and time can be selected as the display image. Furthermore, by combining the second and third embodiments, a captured image whose shooting conditions and weather conditions are the same as those at a specified date and time can be selected as the display image. Furthermore, a user may prioritize these, and the display image may be acquired according to the priority.

[0113] REFERENCE SIGNS LIST 100 Image display system 10 Server device 11 Communication unit 12 Photographed image acquisition unit 13 Photographing condition setting unit 14 Candidate image acquisition unit 15 Location setting unit 16 Display image specification unit 20 Terminal device 21 Communication unit 22 Imaging unit 23 Display control unit 24 Storage unit 25 Display unit 26 Operation acceptance unit 31 Designated information acquisition unit 32 Location date and time setting unit 33 Photographed information acquisition unit 34 Display image specification unit 41 Designated information acquisition unit 42 Location date and time setting unit 43 Weather information acquisition unit 44 Display image acquisition unit

Claims

1. A captured image acquisition unit that acquires captured images captured at each of a plurality of points; a specific information acquisition unit that acquires specific information indicating a specific location and a current or future specific date and time; a display image acquisition unit that acquires, based on information on a shooting date and time added to the photographed image, a photographed image that was taken at a shooting date and time determined based on the current or future designated date and time from among the plurality of photographed images taken at the designated point, as a display image to be displayed by being superimposed on a map including the designated point; An information processing device comprising:

2. The information processing apparatus according to claim 1 , wherein the display image acquisition section acquires, from among the plurality of photographed images, a photographed image whose date of capture is closest to the specified date and time as the display image.

3. The information processing apparatus according to claim 1 , wherein the display image acquisition unit acquires, from among the plurality of captured images, an image captured during a time period determined based on the specified date and time as the display image.

4. The information processing device according to claim 1, characterized in that the display image acquisition unit acquires, from among the plurality of captured images, an image captured on a date and time when an event similar to the event to be held at the specified location on the specified date and time was held in the past as the display image.

5. an event information acquisition unit that acquires past event information, which is information on events that have been held in the past, and scheduled event information, which is information on events that are scheduled to be held in the future, at the specified location; 5 . The information processing apparatus according to claim 4 , wherein the display image acquisition unit identifies a date and time based on the past event information and the scheduled event information, and acquires an image captured at the identified date and time as the display image.

6. An information processing method executed by an information processing device, acquiring images captured at each of a plurality of points; acquiring designation information indicating a designated location and a current or future designated date and time; acquiring, based on information on a shooting date and time added to the photographed image, a photographed image taken at a shooting date and time determined based on the current or future designated date and time from among the plurality of photographed images taken at the specified point, as a display image to be displayed superimposed on a map including the designated point; 13. An information processing method comprising:

7. In the information processing device, acquiring images captured at each of a plurality of points; acquiring designation information indicating a designated location and a current or future designated date and time; acquiring, based on information on a shooting date and time added to the photographed image, a photographed image taken at a shooting date and time determined based on the current or future designated date and time from among the plurality of photographed images taken at the specified point, as a display image to be displayed superimposed on a map including the designated point; A program characterized by executing the above.

8. In the information processing device, acquiring images captured at each of a plurality of points; acquiring designation information indicating a designated location and a current or future designated date and time; acquiring, based on information on a shooting date and time added to the photographed image, a photographed image taken at a shooting date and time determined based on the current or future designated date and time from among the plurality of photographed images taken at the specified point, as a display image to be displayed superimposed on a map including the designated point; A recording medium for recording a program for executing the above.