Information processing device

Abstract

We provide an information processing device that effectively manages images from the field. [Solution] In a captured image management system in which a management server is connected to a user terminal via a communication network, the management server comprises an image input unit that receives input of captured images taken at a site, a shooting location specification unit that displays a site image representing the site and receives specification of the shooting location of the captured image on the site image, and a shooting location storage unit that stores the captured image, site image, shooting location, and shooting direction in association.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus.

Background Art

[0002] A system has been proposed that displays a real image of a destination and guides a user to the specified destination (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the system described in Patent Document 1, it takes time to manage the real image of the destination.

[0005] The present invention has been made in view of such a background, and an object thereof is to provide a technology capable of effectively managing on-site images.

Means for Solving the Problems

[0006] The main invention of the present invention for solving the above problems is an information processing apparatus, comprising: an image input unit that receives an input of a captured image of a site; a shooting location specifying unit that displays a site image representing the site and receives a specification of a shooting location of the captured image on the site image; and a shooting location storage unit that stores the captured image, the site image, the shooting location, and the shooting direction in association with each other.

[0007] Regarding other problems disclosed in the present application and their solutions, they will be clarified by the embodiments of the invention and the drawings.

Effects of the Invention

[0008] According to the present invention, on-site images can be effectively managed. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of the overall configuration of an image capture management system according to one embodiment of the present invention. [Figure 2] This figure shows an example of the hardware configuration of management server 2. [Figure 3] This figure shows an example of the software configuration for management server 2. [Figure 4] This figure shows an example of screen 30 that accepts the selection of a shooting location. [Figure 5] This diagram illustrates the process for determining whether an object has been photographed. [Figure 6] This figure shows an example of the display screen 40 for captured images. [Modes for carrying out the invention]

[0010] <Summary of the Invention> The embodiments of the present invention will be described by listing them. The present invention has, for example, the following configuration: [Item 1] An information processing device comprising: an image input unit that receives input of a captured image taken at a site; a shooting location designation unit that displays a site image representing the site and receives a designation of the shooting location of the captured image on the site image; and a shooting location storage unit that stores the captured image, the site image, the shooting location, and the shooting direction in association. [Item 2] An information processing device according to Item 1, wherein the shooting location designation unit receives input of the shooting direction along with the shooting location, and the shooting location storage unit stores the shooting direction in association with the captured image, the site image, and the shooting location. [Item 3] An information processing device according to Item 1, wherein the shooting location designation unit displays the captured image together with the site image. [Item 4] An information processing device according to Item 3, further comprising a site location storage unit that stores the location of the site on a map, the image input unit receiving a plurality of the captured images, and the shooting location designation unit, when the captured image contains GPS information, identifying the captured image that is within a predetermined distance from the site location and displaying the identified captured image. [Item 5] An information processing device according to Item 1, further comprising a site location storage unit that stores the location of the site on a map, the shooting location designation unit, when the captured image contains GPS information, displaying information on the site image indicating a location on the captured image corresponding to the location indicated by the GPS information. [Item 6] An information processing device according to Item 1, further comprising a tag information input unit that receives input of tag information indicating an object captured in the captured image, and a captured object storage unit that stores the captured image and the tag information in association. [Item 7] An information processing device as described in Item 6, further comprising a search unit that receives the designation of tag information, acquires the captured image corresponding to the designated tag information from the captured object storage unit, and displays the acquired captured image.[Item 8] An information processing device according to Item 1, wherein the site is a structure having multiple floors, further comprising a site image storage unit that stores site images for each floor, the shooting location designation unit receives a designation of a floor and displays the site image corresponding to the accepted floor, and the shooting location storage unit stores the captured image, the site image, the shooting location and the shooting direction in association with the floor. [Item 9] An information processing device according to Item 1, further comprising an object location designation unit that receives a designation of the location in which an object placed at the site is captured on the captured image, and a document designation unit that receives a designation of a document related to the designated object, and further comprising the shooting location storage unit that stores the location and the document in association with the captured image. [Item 10] An information processing device according to Item 9, further comprising a document storage unit that stores information indicating a plurality of documents, and an output unit that identifies and outputs documents that are not associated with the captured image. [Item 11] An information processing device according to Item 9, further comprising: an object storage unit that stores information indicating a plurality of objects placed at the site; and an output unit that identifies and outputs objects that are not associated with the captured image. [Item 12] An information processing device according to Item 1, further comprising: a placement location storage unit that stores the location of an object placed at the site within the site; a determination unit that determines whether an object has been photographed based on whether the object is placed on a straight line extending from the shooting location in the shooting direction; and a notification unit that notifies of an object that has not been photographed.[Item 13] An information processing device according to Item 12, wherein the image input unit acquires the field of view of the camera that took the captured image, and the determination unit identifies a shooting range based on the shooting location, the shooting direction and the field of view, and determines whether or not the object has been photographed based on whether or not the object is included in the identified shooting range. [Item 14] An information processing device according to Item 12, wherein the determination unit determines that the first object has not been photographed if another second object is located between the position and the first object on the straight line. [Item 15] An information processing device according to any one of Items 12 to 14, wherein the notification unit notifies of an object that has not been photographed from a predetermined number of shooting directions or more. [Item 16] An information processing device according to Item 1, further comprising: a placement location storage unit that stores the location of an object placed at the site within the site; and a shooting object identification unit that identifies the object located on a straight line extending from the shooting location in the shooting direction, wherein the shooting location storage unit further stores the identified object in association with the captured image.

[0011] <System Overview> The following describes a captured image management system according to one embodiment of the present invention. The captured image management system of this embodiment aims to manage images taken at a site (a place, space, area, etc., that has a predetermined volume in three dimensions). In particular, in this embodiment, the site refers to the place that is the subject of work. For example, a place that is the subject of inspection, monitoring, patrol, inspection, etc., can be considered a site. In registering where in the site an image taken at a site was taken, the captured image management system of this embodiment enables efficient management of captured images by specifying the shooting location on a site image representing the site (in this embodiment, a floor map is assumed, but any image that can identify a location within the site is acceptable, for example, a blueprint, design drawing, sketch, schematic diagram, etc.). In this embodiment, the captured image is assumed to be a panoramic image, in particular an image that captures the entire surroundings of the camera (hereinafter referred to as a 360-degree image), but it is not limited to a 360-degree image, and may be an image that captures within a predetermined field of view with a normal camera.

[0012] Figure 1 shows an example of the overall configuration of an image capture management system according to one embodiment of the present invention. The image capture management system of this embodiment is configured to include a management server 2. The management server 2 is connected to a user terminal 1 via a communication network 3. The communication network 3 is, for example, the internet and is constructed using public telephone lines, mobile phone lines, wireless communication channels, Ethernet (registered trademark), etc.

[0013] User terminal 1 is a computer operated by a user who intends to register images taken at a site. User terminal 1 can be, for example, a smartphone, tablet computer, or personal computer. The user may be the person who took the photos at the site, or the person who performs the task of registering the images taken at the site. User terminal 1 may also be operated by a user who intends to view the images taken at the site. Note that the user terminal 1 of the user who registers the images and the user terminal 1 of the user who views the images may be different.

[0014] Management Server 2 is a computer that manages the captured images. Management Server 2 may be a general-purpose computer such as a workstation or personal computer, or it may be logically implemented through cloud computing.

[0015] <Hardware Configuration of Management Server 2> Figure 2 shows an example of the hardware configuration of Management Server 2. Note that the illustrated configuration is just one example, and other configurations are also possible. Management Server 2 includes a CPU 201, memory 202, storage device 203, communication interface 204, input device 205, and output device 206. Storage device 203 stores various data and programs, such as a hard disk drive, solid state drive, or flash memory. Communication interface 204 is an interface for connecting to the communication network 3, such as an adapter for connecting to Ethernet®, a modem for connecting to a public telephone network, a wireless communication device for wireless communication, or a USB (Universal Serial Bus) connector or RS232C connector for serial communication. Input device 205 is for inputting data, such as a keyboard, mouse, touch panel, button, or microphone. Output device 206 is for outputting data, such as a display, printer, or speaker. Furthermore, each functional unit of the management server 2, which will be described later, is realized by the CPU 201 reading a program stored in the storage device 203 into memory 202 and executing it, and each storage unit of the management server 2 is realized as part of the storage area provided by memory 202 and storage device 203.

[0016] <Software Configuration of Management Server 2> FIG. 3 is a diagram showing an example of the software configuration of management server 2. The management server 2 includes an image input unit 211, a shooting location specifying unit 212, a tag information input unit 213, a search unit 214, an object position specifying unit 215, a document specifying unit 216, an output unit 217, a determination unit 218, a notification unit 219, a shooting object specifying unit 220, a shooting image display unit 221, a shooting location storage unit 231, a site position storage unit 232, a shooting object storage unit 233, a site image storage unit 2 34, a document storage unit 235, and an arrangement object storage unit 236.

[0017] <1.UI> In the shooting image management system of the present embodiment, a user interface that can easily set where the shooting image of the site was taken is provided for the shooting image of the site.

[0018] The image input unit 211 receives the input of the shooting image of the site. In the present embodiment, it is assumed that the image input unit 211 receives the input of a 360-degree image. The image input unit 211 can receive the input of the shooting image as a file, for example. The image input unit 211 may receive the file of the shooting image from the user terminal 1, for example, or may receive the input of the shooting image from the input device 205 of the management server 2. The image input unit 211 may receive a plurality of shooting images.

[0019] The site image storage unit 234 stores the site image representing the site. In the present embodiment, it is assumed that the site is a structure having multiple floors and the site image is a floor map by floor. The site image storage unit 234 can store the site image in association with the floor.

[0020] The shooting location storage unit 231 stores the shooting image, the site image, and the shooting location in association with each other. The shooting location storage unit 231 can also store the shooting direction. In the present embodiment, the shooting location storage unit 231 stores the shooting image, the site image, the shooting location, and the shooting direction in association with the information (site ID) for specifying the site.

[0021] The shooting location designation unit 212 displays a site image and accepts the designation of the shooting location of the image on the site image. The shooting location designation unit 212 can also accept the designation of the shooting direction. Furthermore, the shooting location designation unit 212 can display the image together with the site image. Figure 4 is a diagram showing an example of a screen 30 that accepts the designation of a shooting location. The screen 30 can be created as a web page, for example, and the shooting location designation unit 212 may be implemented by a first shooting location designation unit, which is implemented as a script (program) written in JavaScript, for example, and a second shooting location designation unit that receives the location specified by the first shooting location designation unit. The screen 30 includes a floor map display area 301 and a shooting image display area 302. The shooting location designation unit 212 can, for example, accept the designation of a floor and read the floor map (site image) corresponding to the accepted floor from the site image storage unit 234 and display it in the display area 301 of the screen 30. In the example in Figure 4, the image input unit 211 is assumed to have received multiple images, and the display area 302 can display multiple captured images in a list. The shooting location specification unit 212 can receive the specification of the captured image to be set. The shooting location specification unit 212 can receive the specification of the location (position on the floor map) where the captured image to be set was taken on the floor map displayed in the display area 301. In the example in Figure 4, the shooting location specification unit 212 can receive the location clicked on the floor map by the pointer 303 as the shooting location. The shooting location specification unit 212 can display a marker 304 on the floor map indicating the specified shooting location. The shooting location specification unit 212 can receive input of the shooting direction. In the example in Figure 4, after the user specifies the shooting location by clicking on the floor map, they can specify the shooting direction by dragging the pointer 303. The shooting location specification unit 212 can receive such a specification of the shooting direction. The shooting location designation unit 212 can register information indicating a captured image (captured image ID), information indicating a site image (site image ID), and coordinates on the image indicating the shooting location in the shooting location storage unit 231.When the shooting location designation unit 212 receives input for the shooting direction, it can register the shooting direction in the shooting location storage unit 231, in addition to the shooting image ID, on-site image ID, and coordinates.

[0022] The image management system of this embodiment can manage 360-degree images taken on-site. Furthermore, the image management system of this embodiment can provide a user interface on a floor map that allows users to input where on-site the image was taken and, if necessary, which direction the image was facing.

[0023] The site location memory unit 232 stores the location of the site on a map (site location). The site location can be represented, for example, by latitude and longitude. In addition to latitude and longitude, the site location may also include altitude or floor level in a structure. A representative point is set for each site, and the site location can be set to that representative point.

[0024] The shooting location designation unit 212 can identify a shooting image that is within a predetermined distance from the site location if the shooting image contains GPS information, and display the identified shooting image on the screen 30. The GPS information includes, for example, latitude and longitude.

[0025] In this way, the image management system of this embodiment can select a 360-degree image that corresponds to the location from among multiple 360-degree images if GPS information is set for the 360-degree image.

[0026] The shooting location designation unit 212 can display information on the floor map indicating a location on the captured image corresponding to the position indicated by the GPS information, if the captured image contains GPS information. For example, when a captured image is selected from the display field 302, the shooting location designation unit 212 can set a marker 304 on the floor map corresponding to the position on the floor map corresponding to the GPS information set in the captured image, and allow the user to move the marker 304.

[0027] In this way, the image management system of this embodiment can suggest the shooting location at the site if GPS information is set for the 360-degree image. The user can easily set the shooting location by adjusting the suggested location.

[0028] The tag information input unit 213 accepts input of tag information indicating equipment (objects) captured in the image. In the example shown in Figure 4, screen 30 includes an input field 305 for a new tag and a list 306 of previously set tags. The tag information input unit 213 can register the tag information entered in the input field 305 or the tag information selected from the list 306 in association with the captured image in the captured object storage unit 233.

[0029] The captured object storage unit 233 can store captured images and tag information in association.

[0030] In this way, the image management system of this embodiment can tag objects such as equipment that are captured in 360-degree images.

[0031] The search unit 214 accepts the specification of tag information, retrieves the captured image corresponding to the specified tag information from the capture object storage unit 233, and can display the retrieved captured image. In the example in Figure 4, the screen 30 is equipped with an input field 307, and the search unit 214 can search the capture object storage unit 233 for tag information that matches or is similar to the text entered in the input field 307.

[0032] In this way, the image management system of this embodiment allows searching for 360-degree images using tags. Therefore, for example, it is possible to easily search for images that depict a specific piece of equipment (object).

[0033] Furthermore, the shooting location designation unit 212 may accept a floor designation and display a site image corresponding to the accepted floor, and the shooting location storage unit 231 may store the shooting image, site image, shooting location, and shooting direction in association with the floor. This allows the image management system of this embodiment to link floor maps with 360-degree images. In other words, it is possible to specify which floor the photograph is of.

[0034] <2. Linking Equipment and Documents> Furthermore, the image management system of this embodiment can link equipment installed on site with documents. Documents may include, but are not limited to, equipment manuals and detailed drawings.

[0035] The object positioning unit 215 accepts the specification of the position of an object placed on the site as captured in the image. The object positioning unit 215 can register the specified position in the placed object storage unit 236.

[0036] The placement object storage unit 236 stores information indicating multiple objects placed at the site. The placement object storage unit 236 can store a specified location by associating an object ID that identifies an object such as equipment with a site ID that indicates the site and a site ID that indicates a site image.

[0037] The document specification unit 216 can accept the specification of a document related to a specified object. The document can be, for example, a PDF file or an image file. This allows a link to the document to be set on a web image.

[0038] The shooting location memory unit 231 can further store the object's position (icon position) and the document in association with the captured image.

[0039] In this embodiment of the image management system, icons can be embedded in 360-degree images, and objects such as equipment placed on-site can be associated with documents such as equipment manuals and detailed drawings.

[0040] The document storage unit 235 can store information indicating multiple documents. When an icon displayed on the captured image is selected, the document corresponding to the location of that icon can be identified from the shooting location storage unit 231, and the identified document can be read from the document storage unit 235 and displayed. The document storage unit 235 can be configured to store documents related to a given site by associating them with a site ID that indicates the site.

[0041] Furthermore, the output unit 217 can identify and output documents that are not associated with captured images. The output unit 217 can identify and output documents stored in the document storage unit 235 that correspond to the relevant location but are not registered in the shooting location storage unit 231.

[0042] In this way, the image management system of this embodiment can check whether all documents are associated with each other.

[0043] Furthermore, the output unit 217 can identify and output objects that are not associated with a captured image. For example, the output unit 217 can identify and output objects stored in the placement object storage unit 236 that are not stored in the shooting location storage unit 231 in association with a document.

[0044] In this way, the image management system of this embodiment can search for objects that are not associated with a document.

[0045] <3. Shooting Alerts> Furthermore, the image management system of this embodiment can issue various alerts regarding shooting at the site.

[0046] The determination unit 218 determines from the captured image whether or not an object placed at the site has been photographed. The determination unit 218 can determine if an object has been photographed by determining whether or not the object is placed on a straight line extended in the direction of shooting from a specified shooting location. Figure 5 is a diagram illustrating the process of determining whether an object has been photographed. In the example in Figure 5, the determination is made for object 311. For example, the determination unit 218 can determine whether or not an object exists on a straight line 313, which is an extension of the shooting direction 312 from the shooting location indicated by the marker 304, by determining whether or not the straight line 313 intersects with object 311. In this case, the placement object storage unit 236 can store not only the position but also the shape and size of the object. The object memory unit 236 can identify the area occupied by the object on the field image (which can be represented by, for example, a polygon or an ellipse) according to the stored position, shape, and size, and determine the intersection of this area with the straight line 313.

[0047] The notification unit 219 notifies of objects that have not been photographed. The notification unit 219 may either notify of objects that have not been photographed on the screen 30, or it may send a message to the user terminal 1 that lists the objects that have not been photographed.

[0048] In this way, the image management system of this embodiment can provide an alert if equipment placed on site is not captured in the image.

[0049] Furthermore, the image input unit 211 may acquire the field of view of the camera that captured the image, and the determination unit 218 may identify the shooting range based on the shooting location, shooting direction, and field of view, and determine whether or not an object was captured based on whether or not the object is included in the identified shooting range. The image input unit 211 may allow the user to input the camera's field of view, or if the captured image contains information indicating the field of view, for example, by EXIF ​​(Exchangeable image file format), the determination unit 211 may acquire the field of view from the captured image. For example, in the example of Figure 5, the determination unit 218 can identify the area between the lines 315 and 316 as the shooting range according to the field of view 314.

[0050] In this way, the image management system of this embodiment can also take the field of view into consideration and determine whether or not equipment has been photographed based on whether it is within a predetermined field of view.

[0051] Furthermore, the determination unit 218 can determine that the first object has not been photographed if another second object is located between the shooting location and the first object on a straight line. When the determination unit 218 determines whether or not object 317 has been photographed, it determines whether or not another object exists on the straight line 313. In the example in Figure 5, since object 311 exists between the shooting location indicated by marker 304 and object 317, the determination unit 218 can determine that object 317 has not been photographed.

[0052] In this way, the image management system of this embodiment can check whether the equipment at the site has been captured in a photograph.

[0053] Furthermore, the notification unit 219 can notify of objects that have not been photographed from a predetermined number of shooting directions or more. For example, the determination unit 218 identifies objects placed on site from the placement object storage unit 236, and for each identified object, it determines whether or not the object has been photographed in each photographed image registered in the shooting location storage unit 231. The notification unit 219 can notify if, for each object, there are not a predetermined number of photographed images in which the object has been determined to have been photographed. The notification unit 219 may, for example, display an alert on the screen 30, or send an alert to the user terminal 1.

[0054] In this way, the image management system of this embodiment can check that the equipment at the site has been photographed from multiple directions.

[0055] Furthermore, the object identification unit 220 can identify objects located on a straight line extending from the shooting location in the shooting direction. The object identification unit 220 can identify objects that exist on a straight line 313 extending from the shooting location indicated by the marker 304 in the shooting direction 312 (objects that intersect the straight line 313) as objects captured in the captured image. The object identification unit 220 may also identify only the object closest to the shooting location as a captured object. For example, in the example in Figure 5, since object 311 exists between the shooting location indicated by the marker 304 and object 317, the object identification unit 220 can determine that object 317 was not captured. Alternatively, the object identification unit 220 may identify objects included in the shooting range from straight line 315 to straight line 316, taking into account the field of view 314, as captured objects, or it may identify only objects included in the shooting range that do not have other objects between the shooting location and the object's position as captured objects.

[0056] The shooting location memory unit 231 can further store identified objects in association with the captured image, and the shooting object identification unit 220 can register the identified objects in association with the captured image in the shooting location memory unit 231.

[0057] The captured image display unit 221 displays the captured image. Figure 6 shows an example of the captured image display screen 40. The screen 40 can be implemented as a web page, for example, and the captured image display unit 221 can send screen data written in HTML, for example, to the user terminal 1 to display the web page. In addition, a program such as JavaScript can be set on the web page and run on the user terminal 1.

[0058] The display screen 40 shows a floor map 401. Pressing button 402 allows the user to switch floors. The captured image display unit 221 can allow the user to specify a floor in response to the press of button 402, and can read the on-site image corresponding to the specified floor and display it as the floor map 401. The captured image display unit 221 can also obtain the shooting location corresponding to the on-site image from the shooting location memory unit 231 and display a marker 403 at the obtained shooting location. When a marker 403 is selected on the floor map 401, the captured image display unit 221 can identify the captured image corresponding to the shooting location indicated by the selected marker 403 from the shooting location memory unit 231 and display the identified captured image on the display unit 404 of the screen 40. The captured image display unit 221 can also display a portion of a 360-degree image on the display unit 404, and the displayed portion of the 360-degree image can be changed in response to operations such as dragging or swiping on the display unit 404.

[0059] Furthermore, if an icon position corresponding to the captured image is set in the shooting location memory unit 231, the captured image display unit 221 can display the icon 405 superimposed on the captured image. If the icon 405 is selected in the display unit 404, the captured image display unit 221 can retrieve and display the corresponding document.

[0060] In this way, images taken from a selected shooting location on the floor map 401 can be displayed, and related documents such as descriptions and detailed drawings of objects captured within the images can also be displayed.

[0061] Although these embodiments have been described above, they are intended to facilitate understanding of the present invention and are not intended to limit its interpretation. The present invention can be modified and improved without departing from its spirit, and equivalents thereof are also included.

[0062] For example, in this embodiment, only one user terminal 1 is displayed, but there may be multiple user terminals 1.

[0063] Furthermore, while this embodiment explains that it is possible to check whether or not the image is being captured from a predetermined number of locations, it is also possible to check not only the number of locations, but also whether or not the shooting directions are distributed in all directions. For example, it is possible to check whether the angle between two adjacent lines of multiple lines pointing from the object's position to the shooting location is less than or equal to a predetermined angle, and to issue an alert if it is not less than or equal to the predetermined angle.

[0064] Furthermore, in this embodiment, icons and documents are set up on a one-to-one basis, but multiple documents may be associated with a single icon. For example, the document storage unit 235 can manage versions in association with document IDs, and when icon 405 is clicked, it will display the latest version of the document. It can also accept version selection, allowing different versions of documents to be displayed according to user instructions. In this case, for example, maintenance history documents can be viewed retrospectively.

[0065] Furthermore, the system may also take into account the date and time the captured image was taken. In this case, the shooting location memory unit 231 can store the shooting date and time in association with the image. The shooting date and time may be obtained from the EXIF ​​information contained in the captured image, or, if the camera is being controlled, the date and time at the time of shooting may be obtained, or the user may be allowed to input it. In this case, the system may also accept a specified shooting date and display markers 403 on the floor map 401 only for the captured images corresponding to the specified shooting time, making them selectable. Alternatively, the system may also accept a specified time period and display markers 403 on the floor map 401 only for the captured images taken during the specified time period, making them selectable.

[0066] Alternatively, images taken at the same location but at different times may be registered. In this case, the shooting location memory unit 231 will store multiple images associated with the shooting location. When displaying images, the most recent image will be displayed, and images taken at past points in time can also be displayed upon user instruction. [Explanation of Symbols]

[0067] 1 User terminal 2 Management server 3 Communication network 211 Image input unit 212 Shooting location specification unit 213 Tag information input unit 214 Search unit 215 Object location specification unit 216 Document specification unit 217 Output unit 218 Judgment unit 219 Notification unit 220 Shooting object identification unit 221 Shooting image display unit 231 Shooting location storage unit 232 Site location storage unit 233 Shooting object storage unit 234 Site image storage unit 235 Document storage unit 236 Placement object storage unit

Claims

1. An information processing device comprising: an image input unit that receives input of a photograph taken at a site; a shooting location designation unit that displays a site image representing the site and receives a designation of the shooting location of the photograph on the site image; and a shooting location storage unit that stores the photograph, the site image, and the shooting location in association.

2. An information processing device according to claim 1, wherein the shooting location designation unit receives input of the shooting direction along with the shooting location, and the shooting location storage unit stores the shooting direction in association with the shooting image, the site image, and the shooting location.

3. An information processing device according to claim 1, wherein the shooting location designation unit displays the shooting image together with the on-site image.

4. An information processing device according to claim 3, further comprising a site location storage unit that stores the location of the site on a map, the image input unit receiving a plurality of the captured images, and the shooting location designation unit, when the captured image contains GPS information, identifying the captured image that is within a predetermined distance from the site location and displaying the identified captured image.

5. An information processing device according to claim 1, further comprising a site location storage unit that stores the location of the site on a map, wherein the shooting location designation unit displays information on the site image indicating a location on the shooting image corresponding to the location indicated by the GPS information when the shooting image includes GPS information.

6. An information processing device according to claim 1, further comprising: a tag information input unit that receives input of tag information indicating an object captured in the captured image; and a captured object storage unit that stores the captured image and the tag information in association.

7. An information processing device according to claim 6, further comprising a search unit that receives the designation of tag information, acquires the captured image corresponding to the designated tag information from the captured object storage unit, and displays the acquired captured image.

8. An information processing device according to claim 1, wherein the site is a structure having multiple floors, further comprising a site image storage unit that stores site images for each floor, the shooting location designation unit receives a designation of a floor and displays the site image corresponding to the accepted floor, and the shooting location storage unit stores the shooting image, the site image, and the shooting location in association with the floor.

9. An information processing device according to claim 1, further comprising: an object position designation unit that receives a designation of the position in which an object placed at the site is captured on the captured image; and a document designation unit that receives a designation of a document related to the designated object, wherein the shooting location storage unit further stores the position and the document in association with the captured image.

10. An information processing device according to claim 9, further comprising: a document storage unit that stores information indicating a plurality of documents; and an output unit that identifies and outputs documents that are not associated with the captured image.

11. An information processing device according to claim 9, further comprising: an object storage unit that stores information indicating a plurality of objects placed at the site; and an output unit that identifies and outputs objects that are not associated with the captured image.

12. An information processing device according to claim 1, further comprising: a placement location storage unit that stores the location of an object placed at the site within the site; a shooting location designation unit that receives input of a shooting direction along with the shooting location, and a determination unit that determines whether the object has been photographed based on whether the object is placed on a straight line extending from the shooting location in the shooting direction; and a notification unit that notifies of an object that has not been photographed.

13. An information processing apparatus according to claim 12, wherein the image input unit acquires the field of view of the camera that took the captured image, and the determination unit identifies a shooting range based on the shooting location, the shooting direction and the field of view, and determines whether or not the object has been photographed based on whether or not the object is included in the identified shooting range.

14. An information processing device according to claim 12, wherein the determination unit determines that the first object has not been photographed if another second object is located between the position and the first object on the straight line.

15. An information processing apparatus according to any one of claims 12 to 14, wherein the notification unit notifies an object that has not been photographed from a predetermined number of the shooting directions.

16. An information processing device according to claim 1, further comprising: a placement location storage unit that stores the location of an object placed at the site within the site; and a shooting object identification unit that identifies the object located on a straight line extending from the shooting location in the shooting direction, wherein the shooting location storage unit further stores the identified object in association with the captured image.

Images