Information processing device

Abstract

To enable effective management of images of a site. [Solution] This information processing device is characterized by comprising an image input unit that accepts input of a photographed image of a site, a photographing location designation unit that displays a site image representing the site and accepts designation of the photographing location of the photographed image on the site image, and a photographing location memory unit that stores the photographed image, site image, photographing location, and photographing direction in association with each other.

Description

[Technical field]

[0001] The present invention relates to an information processing device. [Background technology]

[0002] A system has been proposed that displays an actual image of a destination and guides a user to the destination specified by the user (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-219293 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the system described in Patent Document 1, managing actual images of the destination takes time and effort.

[0005] The present invention has been made in view of the above background, and has an object to provide a technique capable of effectively managing images at a site. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing device comprising an image input unit that accepts input of a photographed image of a site, a photographing location designation unit that displays a site image representing the site and accepts designation of the photographing location of the photographed image on the site image, and a photographing location memory unit that stores the photographed image, the site image, the photographing location, and the photographing direction in association with each other.

[0007] Other problems and solutions disclosed in this application will be made clear in the description of the preferred embodiments of the invention and the drawings. Effect of the Invention

[0008] According to the present invention, images of a site can be effectively managed. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of the overall configuration of a photographed image management system according to an embodiment of the present invention; [Diagram 2] 2 is a diagram illustrating an example of a hardware configuration of a management server 2. FIG. [Diagram 3] 2 illustrates an example of the software configuration of a management server 2. FIG. [Figure 4] FIG. 13 is a diagram showing an example of a screen 30 for accepting designation of a shooting location. [Diagram 5] 11A and 11B are diagrams illustrating a process for determining whether an object has been photographed. [Figure 6] FIG. 4 is a diagram showing an example of a display screen 40 for a captured image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] <Summary of the Invention> The present invention will be described below with reference to the preferred embodiments thereof. [Item 1] an image input unit that receives an input of a photographed image of the site; a photographing location designation unit that displays a site image representing the site and accepts designation of a photographing location of the photographed image on the site image; a photographing location storage unit that stores the photographed image, the on-site image, the photographing location, and the photographing direction in association with each other; An information processing device comprising: [Item 2] Item 1. The information processing device according to item 1, the photography location designation unit accepts input of the photography location and the photography direction; the photographing location storage unit stores the photographed image, the on-site image, and the photographing location in association with the photographing direction; An information processing device comprising: [Item 3] Item 1. The information processing device according to item 1, the photography location designation unit displays the photographed image together with the on-site image; An information processing device comprising: [Item 4] Item 3. The information processing device according to item 3, A site position storage unit that stores a position on a map of the site is further provided, The image input unit receives a plurality of the captured images, the photography location designation unit, when the photographed image contains GPS information, identifies the photographed image that is within a predetermined distance from the location of the site, and displays the identified photographed image; An information processing device comprising: [Item 5] Item 1. The information processing device according to item 1, A site position storage unit that stores a position on a map of the site is further provided, the photographing location designation unit, when the photographed image includes GPS information, displays, on the site image, information indicating a location on the photographed image corresponding to a position indicated by the GPS information; An information processing device comprising: [Item 6] Item 1. The information processing device according to item 1, a tag information input unit that receives input of tag information indicating an object captured in the captured image; a photographed object storage unit that stores the photographed image and the tag information in association with each other; The information processing device further comprising: [Item 7] Item 6. The information processing device according to item 6, a search unit that receives designation of the tag information, acquires the photographic image corresponding to the designated tag information from the photographic object storage unit, and displays the acquired photographic image; An information processing device comprising: [Item 8] Item 1. The information processing device according to item 1, the site is a multi-story structure; A site image storage unit that stores the site image for each floor, The photography location designation unit receives designation of the floor and displays the site image corresponding to the received floor; the photographing location storage unit stores the photographed image, the on-site image, the photographing location, the photographing direction, and the floor in association with each other; An information processing device comprising: [Item 9] Item 1. The information processing device according to item 1, an object position designation unit that accepts designation of a position at which an object placed at the site is captured on the captured image; a document specification unit that accepts specification of a document related to the specified object; Further equipped with the photographing location storage unit further stores the location and the document in association with the photographed image; An information processing device comprising: [Item 10] Item 9. The information processing device according to item 9, a document storage unit that stores information indicating a plurality of said documents; an output unit that identifies and outputs documents that are not associated with the captured image from among the documents; The information processing device further comprising: [Item 11] Item 9. The information processing device according to item 9, an object storage unit that stores information indicating a plurality of the objects disposed at the site; an output unit that identifies and outputs objects that are not associated with the captured image among the objects; The information processing device further comprising: [Item 12] Item 1. The information processing device according to item 1, a placement position storage unit that stores positions of objects placed in the scene; a determination unit that determines whether the object has been photographed based on whether the object is located on a straight line extending from the photographing location in the photographing direction; a notification unit that notifies the user of the object that has not been photographed; The information processing device further comprising: [Item 13] Item 13. The information processing device according to item 12, The image input unit acquires an angle of view of a camera that captured the captured image, the determination unit specifies a shooting range based on the shooting location, the shooting direction, and the angle of view, and determines whether or not the object has been photographed based on whether or not the object is included in the specified shooting range; An information processing device comprising: [Item 14] Item 13. The information processing device according to item 12, the determination unit determines that the first object has not been photographed when another second object is disposed on the straight line between the position and the first object; An information processing device comprising: [Item 15] 15. The information processing device according to any one of claims 12 to 14, the notification unit notifies the user of the object that has not been photographed from a predetermined number of the imaging directions; An information processing device comprising: [Item 16] Item 1. The information processing device according to item 1, a placement position storage unit that stores positions of objects placed in the scene; a photographing object specifying unit for specifying the object disposed on a straight line extending from the photographing location in the photographing direction; Further equipped with the photographing location storage unit further stores the specified object in association with the photographed image; An information processing device comprising:

[0011] <System Overview> Hereinafter, a photographed image management system according to an embodiment of the present invention will be described. The photographed image management system of this embodiment is intended to manage images taken at a site (a place, space, area, etc., having a predetermined volume in three dimensions). In particular, in this embodiment, the site refers to a place where work is performed. For example, a place that is the subject of inspection, monitoring, patrol, inspection, etc., can be considered as a site. In this embodiment, the photographed image management system registers where a photographed image of a site was taken at the site, and allows efficient management of the photographed image by specifying the photographing position on a site image (in this embodiment, a floor map is assumed, but any image that can identify a location within the site may be used, such as a blueprint, design drawing, floor plan, or schematic diagram) that represents the site. In this embodiment, the photographed image is assumed to be a panoramic image, particularly an image taken of the entire circumference of a camera (hereinafter referred to as a 360-degree image), but it is not limited to a 360-degree image and may be an image taken within a predetermined angle of view with a normal camera.

[0012] 1 is a diagram showing an example of the overall configuration of a photographed image management system according to one embodiment of the present invention. The photographed image management system of this embodiment is configured to include a management server 2. The management server 2 is communicably connected to a user terminal 1 via a communication network 3. The communication network 3 is, for example, the Internet, and is constructed by a public telephone line network, a mobile phone line network, a wireless communication path, Ethernet (registered trademark), etc.

[0013] The user terminal 1 is a computer operated by a user who wishes to register a photographed image of a site. The user terminal 1 is, for example, a smartphone, a tablet computer, a personal computer, or the like. The user may be a person who photographed the site, or a person who performs the task of registering the photographed image of the site. The user terminal 1 may also be operated by a user who wishes to view the photographed image of the site. The user terminal 1 of the user who registers the photographed image may be separate from the user terminal 1 of the user who views the photographed image.

[0014] The management server 2 is a computer that manages captured images. The management server 2 may be a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

[0015] <Hardware configuration of Management Server 2> FIG. 2 is a diagram showing an example of the hardware configuration of the management server 2. Note that the illustrated configuration is an example, and other configurations may be used. The management server 2 includes a CPU 201, a memory 202, a storage device 203, a communication interface 204, an input device 205, and an output device 206. The storage device 203 is, for example, a hard disk drive, a solid state drive, or a flash memory that stores various data and programs. The communication interface 204 is an interface for connecting to the communication network 3, and is, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone line network, a wireless communication device for wireless communication, a USB (Universal Serial Bus) connector or an RS232C connector for serial communication, etc. The input device 205 is, for example, a keyboard, a mouse, a touch panel, a button, a microphone, etc. that input data. The output device 206 is, for example, a display, a printer, a speaker, etc. that output data. Each functional unit of the management server 2 described below is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the management server 2 is realized as part of the storage area provided by the memory 202 and the storage device 203.

[0016] <Software configuration of Management Server 2> 3 is a diagram showing an example of the software configuration of the management server 2. The management server 2 includes an image input unit 211, a shooting location designation unit 212, a tag information input unit 213, a search unit 214, an object position designation unit 215, a document designation unit 216, an output unit 217, a determination unit 218, a notification unit 219, a shooting object identification unit 220, a shot image display unit 221, a shooting location storage unit 231, a site position storage unit 232, a shooting object storage unit 233, a site image storage unit 234, a document storage unit 235, and a placement object storage unit 236.

[0017] <1.UI> The photographed image management system of this embodiment provides a user interface that allows easy setting of where on-site an image was taken.

[0018] The image input unit 211 accepts input of a captured image of a site. In this embodiment, it is assumed that the image input unit 211 accepts input of a 360-degree image. The image input unit 211 can accept input of the captured image as a file, for example. The image input unit 211 may receive a file of the captured image from the user terminal 1, for example, or may accept input of the captured image from the input device 205 of the management server 2. The image input unit 211 may accept a plurality of captured images.

[0019] The site image storage unit 234 stores a site image representing the site. In this embodiment, the site image storage unit 234 assumes that the site is a structure having multiple floors, and the site image is a floor map for each floor. The site image storage unit 234 can store the site image in association with the floor.

[0020] The shooting location storage unit 231 stores the photographed image, the on-site image, and the shooting location in association with each other. The shooting location storage unit 231 can also store the shooting direction. In this embodiment, the shooting location storage unit 231 stores the photographed image, the on-site image, the shooting location, and the shooting direction in association with information (on-site ID) that identifies the site.

[0021] The shooting location designation unit 212 displays the site image and accepts the designation of the shooting location of the photographed image on the site image. The shooting location designation unit 212 can also accept the designation of the shooting direction. The shooting location designation unit 212 can also display the photographed image together with the site image. FIG. 4 is a diagram showing an example of a screen 30 that accepts the designation of the shooting location. The screen 30 can be created as a Web page, for example, and the shooting location designation unit 212 can be implemented by a first shooting location designation unit that is embedded in the Web page and is realized as a script (program) written in JavaScript or the like, and a second shooting location designation unit that receives the location designated from the first shooting location designation unit. The screen 30 includes a display field 301 for a floor map and a display field 302 for a photographed image. The shooting location designation unit 212 can, for example, accept the designation of a floor, read out a floor map (site image) corresponding to the accepted floor from the site image storage unit 234, and display it in the display field 301 of the screen 30. In the example of FIG. 4, it is assumed that the image input unit 211 receives a plurality of images, and the display field 302 can display a list of a plurality of photographed images. The photographing location designation unit 212 can accept the designation of the photographed image to be set. The photographing location designation unit 212 can accept the designation of the location (position on the floor map) where the photographed image to be set was taken on the floor map displayed in the display field 301. In the example of FIG. 4, the photographing location designation unit 212 can accept the position clicked on the floor map by the pointer 303 as the photographing location. The photographing location designation unit 212 can display a marker 304 indicating the designated photographing location on the floor map. The photographing location designation unit 212 can accept the input of the photographing direction. In the example of FIG. 4, after the user clicks on the floor map to designate the photographing location, the user can drag the pointer 303 to designate the photographing direction. The photographing location designation unit 212 can accept such a designation of the photographing direction. The photography location designation unit 212 can register in the photography location storage unit 231 information indicating a photographed image (photographed image ID), information indicating an on-site image (on-site image ID), and coordinates on the image indicating the photography location in association with each other.When the photography location designation unit 212 receives an input of the photography direction, it can register the photography direction in the photography location storage unit 231 in addition to the photographed image ID, the on-site image ID, and the coordinates.

[0022] The photographed image management system of this embodiment can manage 360-degree images taken at the site. In addition, the photographed image management system of this embodiment can provide a user interface for inputting, on a floor map, where at the site the image was taken and, if necessary, which direction the image was taken in.

[0023] The site position storage unit 232 stores the position of the site on the map (site position). The site position can be expressed by, for example, latitude and longitude. The site position may include the altitude or the floor of a structure in addition to the latitude and longitude. A representative point is set for each site, and the site position can be set to that representative point.

[0024] When the photographed image includes GPS information, the photographing location designation unit 212 can specify the photographed image within a predetermined distance from the site position and display the specified photographed image on the screen 30. The GPS information includes, for example, latitude and longitude.

[0025] In this way, in the photographed image management system of this embodiment, if GPS information is set for a 360-degree image, it is possible to pick out a 360-degree image that corresponds to the site from among multiple 360-degree images.

[0026] When the photographed image includes GPS information, the photographing location designation unit 212 can display information indicating a location on the photographed image corresponding to the position indicated by the GPS information on the floor map. For example, when a photographed image is selected from the display field 302, the photographing location designation unit 212 can set a marker 304 at a position on the floor map corresponding to the GPS information set in the photographed image and allow the user to move the marker 304.

[0027] In this way, in the photographed image management system of this embodiment, when GPS information is set for a 360-degree image, the photographing position on-site can be suggested. The user can easily set the photographing position by adjusting the suggested position.

[0028] The tag information input unit 213 accepts input of tag information indicating a facility (object) shown in a photographed image. In the example of Fig. 4, the screen 30 includes an input field 305 for a new tag and a list 306 of set tags. The tag information input unit 213 can register the tag information input in the input field 305 or the tag information selected from the list 306 in the photographed object storage unit 233 in association with the photographed image.

[0029] The photographed object storage section 233 can store the photographed image and the tag information in association with each other.

[0030] In this manner, the captured image management system of this embodiment can tag objects such as facilities captured in 360-degree images.

[0031] The search unit 214 can receive the designation of tag information, obtain a photographed image corresponding to the designated tag information from the photographed object storage unit 233, and display the obtained photographed image. In the example of Fig. 4, the screen 30 has an input field 307, and the search unit 214 can search the photographed object storage unit 233 for tag information that matches or is similar to the text inputted in the input field 307.

[0032] In this way, the photographed image management system of this embodiment can search for 360-degree images using tags, making it easy to search for photographed images that show a particular facility (object), for example.

[0033] The photography location designation unit 212 may receive a designation of a floor and display a site image corresponding to the received floor, and the photography location storage unit 231 may store the photographed image, the site image, the photography location, the photography direction, and the floor in association with each other. This allows the photographed image management system of this embodiment to link the floor map with the 360-degree image. In other words, it is possible to designate which floor the photograph is on.

[0034] <2. Associating facilities with documents> In addition, the photographed image management system of the present embodiment can associate equipment installed at the site with documents. The documents can be, for example, equipment instructions or detailed drawings, but are not limited to these.

[0035] The object position designation unit 215 accepts designation of a position where an object placed at the site is captured on a photographed image. The object position designation unit 215 can register the designated position in the positioned object storage unit 236.

[0036] The placement object storage unit 236 stores information indicating a plurality of objects placed at a site. The placement object storage unit 236 can store a specified position in association with an object ID that identifies an object such as equipment, a site ID that indicates the site, and a site ID that indicates a site image.

[0037] The document specification unit 216 can accept specification of a document related to a specified object. The document can be, for example, a PDF file or an image file. This allows a link to the document to be set on the Web image.

[0038] The photographing location storage unit 231 can further store the object position (icon position) and document in association with the photographed image.

[0039] In the captured image management system of this embodiment, icons can be embedded in 360-degree images, and objects such as equipment located at the site can be associated with documents such as equipment instructions and detailed drawings.

[0040] The document storage unit 235 can store information indicating a plurality of documents. When an icon displayed on a photographed image is selected, a document corresponding to the position of the icon is identified from the photographing location storage unit 231, and the identified document can be read out and displayed from the document storage unit 235. The document storage unit 235 can store documents related to a site in association with a site ID indicating the site.

[0041] Furthermore, the output unit 217 can specify and output documents that are not associated with a photographed image from among the documents. The output unit 217 can specify and output documents that are associated with the site and are not registered in the photographed location storage unit 231 from among the documents stored in the document storage unit 235.

[0042] In this manner, the captured image management system of this embodiment can check whether all documents have been associated with each other.

[0043] Furthermore, the output unit 217 can specify and output objects that are not associated with a photographed image. For example, the output unit 217 can specify and output objects that are not associated with a document and stored in the photographing location storage unit 231 among objects stored in the arranged object storage unit 236.

[0044] In this manner, the captured image management system of this embodiment can search for objects that are not linked to a document.

[0045] <3. Shooting Alert> Furthermore, the photographed image management system of this embodiment can issue various alerts regarding on-site photographing.

[0046] The determination unit 218 determines whether an object arranged at the site is photographed based on the photographed image. The determination unit 218 can determine whether an object has been photographed based on whether an object is arranged on a straight line extending from a designated photographing location in the photographing direction. FIG. 5 is a diagram for explaining a process of determining whether an object has been photographed. In the example of FIG. 5, a determination is made for an object 311. For example, the determination unit 218 can determine whether an object exists on a straight line 313 extending from a photographing location indicated by a marker 304 in a photographing direction 312 based on whether the straight line intersects with the object 311. In this case, the arranged object storage unit 236 can store not only the position but also the shape and size of the object. The determination unit 218 can specify an area (for example, it can be displayed by a polygon or an ellipse) occupied by the object on the site image according to the position, shape, and size stored in the arranged object storage unit 236, and determine an intersection between this area and the straight line 313.

[0047] The notification unit 219 notifies the user of an object that has not been photographed. The notification unit 219 may notify the user of an object that has not been photographed on the screen 30, or may transmit to the user terminal 1 a message describing the object that has not been photographed.

[0048] In this manner, the photographed image management system of this embodiment can issue an alert that equipment installed at the site is not captured in the image.

[0049] Also, the image input unit 211 may acquire the angle of view of the camera that captured the captured image, and the determination unit 218 may specify the capture range based on the capture location, capture direction, and angle of view, and determine whether or not an object has been captured based on whether or not the object is included in the specified capture range. The image input unit 211 may allow the user to input the angle of view of the camera, or may acquire the angle of view from the captured image when the captured image includes information indicating the angle of view, for example, by EXIF ​​(Exchangeable image file format). For example, in the example of FIG. 5, the determination unit 218 may specify the area between the lines 315 and 316 as the capture range according to the angle of view 314.

[0050] In this manner, the photographed image management system of the present embodiment can determine whether or not the equipment has been photographed based on whether or not it is within a predetermined range of the angle of view, taking into consideration the angle of view as well.

[0051] Furthermore, when another second object is disposed on the straight line between the shooting location and the first object, the determination unit 218 can determine that the first object has not been photographed. When the determination unit 218 determines whether or not the object 317 has been photographed, the determination unit 218 determines whether or not another object exists on the straight line 313. In the example of Fig. 5, since the object 311 exists between the shooting location indicated by the marker 304 and the object 317, the determination unit 218 can determine that the object 317 has not been photographed.

[0052] In this manner, the photographed image management system of this embodiment can check whether or not on-site equipment has been photographed reliably.

[0053] Furthermore, the notification unit 219 can notify an object that has not been photographed from a predetermined number of shooting directions or more. For example, the determination unit 218 identifies objects that are placed at the site from the placement object storage unit 236, and for each of the identified objects, determines whether or not the object has been photographed in each photographed image registered in the shooting location storage unit 231. For each object, when there are not a predetermined number or more of photographed images that are determined to have photographed the object, the notification unit 219 can notify that fact. For example, the notification unit 219 may display an alert on the screen 30, or may transmit an alert to the user terminal 1.

[0054] In this manner, the photographed image management system of this embodiment makes it possible to check that photographs of on-site equipment are being taken from multiple directions.

[0055] The photographed object identifying unit 220 can identify an object located on a straight line extending from the photographing location in the photographing direction. The photographed object identifying unit 220 can identify an object existing on a straight line 313 extending from the photographing location indicated by the marker 304 in the photographing direction 312 (an object intersecting the straight line 313) as an object photographed in the photographed image. The photographed object identifying unit 220 may identify only an object closest to the photographing location among the identified objects as a photographed object. For example, in the example of FIG. 5, since the object 311 exists between the photographing location indicated by the marker 304 and the object 317, the photographed object identifying unit 220 can determine that the object 317 has not been photographed. The photographed object identifying unit 220 may identify an object included in the photographing range from the straight line 315 to the straight line 316 as a photographed object in consideration of the angle of view 314, or may identify only an object included in the photographing range in which no other object exists between the photographing location and the object position as a photographed object.

[0056] The shooting location storage unit 231 can further store the specified object in association with the photographed image, and the photographed object specification unit 220 can register the specified object in association with the photographed image in the shooting location storage unit 231.

[0057] The captured image display unit 221 displays the captured image. Fig. 6 is a diagram showing an example of a display screen 40 for the captured image. The screen 40 can be realized as a Web page, for example, and the captured image display unit 221 can transmit screen data described in HTML, for example, for displaying the Web page, to the user terminal 1. In addition, a program such as JavaScript can be set on the Web page and run on the user terminal 1.

[0058] A floor map 401 is displayed on the display screen 40. When a button 402 is pressed, the floor can be switched. The captured image display unit 221 can allow the user to specify a floor in response to pressing of the button 402, and can read out a site image corresponding to the specified floor and display it as the floor map 401. In addition, the captured image display unit 221 can acquire a shooting position corresponding to the site image from the shooting location storage unit 231, and display a marker 403 at the acquired shooting position. When the marker 403 is selected on the floor map 401, the captured image display unit 221 can identify a captured image corresponding to the shooting location indicated by the selected marker 403 from the shooting location storage unit 231, and display the identified captured image on the display unit 404 of the screen 40. In addition, the captured image display unit 221 can display a part of the 360-degree image on the display unit 404, and can change the displayed part of the 360-degree image in response to an operation such as dragging or swiping on the display unit 404.

[0059] Furthermore, the photographed image display unit 221 can display the icon 405 superimposed on the photographed image when an icon position corresponding to the photographed image is set in the photographing location storage unit 231. When the icon 405 is selected on the display unit 404, the photographed image display unit 221 can obtain and display the corresponding document.

[0060] In this way, it is possible to display an image taken from a shooting location selected from the floor map 401, and also to display related documents such as an explanation or detailed drawing of an object photographed in the image.

[0061] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention, and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit of the present invention, and equivalents thereof are also included in the present invention.

[0062] For example, in this embodiment, only one user terminal 1 is shown, but multiple user terminals 1 may exist.

[0063] In addition, in this embodiment, it has been described that it is possible to check whether or not an image is taken from a predetermined number of shooting locations, but it is also possible to check not only the number but also whether or not the shooting directions are distributed all around. For example, it is possible to check whether the angle between two adjacent straight lines from the object position to the shooting position, with the object position as the center, is equal to or less than a predetermined angle, and to issue an alert if the angle is not equal to or less than the predetermined angle.

[0064] In addition, in this embodiment, icons and documents are set in a one-to-one relationship, but multiple documents may be linked to one icon. For example, the document storage unit 235 may manage versions in association with document IDs, and when the icon 405 is clicked, the latest version of the document may be displayed, and furthermore, the version selection may be accepted so that different versions of the document may be displayed in response to an instruction from the user. In this case, for example, documents in the maintenance history may be viewed retroactively.

[0065] Also, the date and time of shooting of the captured image may be taken into consideration. In this case, the shooting location storage unit 231 may store the date and time of shooting in association with each other. The date and time of shooting may be acquired from EXIF ​​information included in the captured image, or the date and time of shooting may be acquired when controlling the camera, or an input from the user may be accepted. In this case, the designation of the shooting date may be accepted, and the marker 403 may be displayed on the floor map 401 only for the captured image corresponding to the designated shooting time, so that the image can be selected. Also, the designation of the time period may be accepted, and the marker 403 may be displayed on the floor map 401 only for the captured image captured during the designated time period, so that the image can be selected.

[0066] Also, photographed images taken at different times in the same photographing location may be registered. In this case, a plurality of photographed images are registered in association with the photographing location in the photographing location storage unit 231. When photographed images are displayed, the latest photographed image is displayed, and it is possible to display photographed images taken at past times according to an instruction from the user. [Explanation of symbols]

[0067] 1 User terminal 2 Management Server 3. Communication Network 211 Image input unit 212 Shooting location designation section 213 Tag information input section 214 Search Department 215 Object position specification section 216 Document Specification Section 217 Output section 218 Judgment section 219 Information Department 220 Shooting object identification unit 221 Photographed image display section 231 Shooting location memory section 232 Field position storage unit 233 Shooting Object Memory Unit 234 On-site image storage unit 235 Document Storage Unit 236 Placement object storage unit

Claims

1. an image input unit that receives an input of a photographed image of the site; a photographing location designation unit that displays a site image representing the site and accepts designation of a photographing location of the photographed image and an input of a photographing direction on the site image; a photographing location storage unit that stores the photographed image, the on-site image, the photographing location, and the photographing direction in association with each other; a placement position storage unit that stores positions of objects placed in the scene; a determination unit that determines whether the object has been photographed based on whether the object is located on a straight line extending from the photographing location in the photographing direction; a notification unit that notifies the user of the object that has not been photographed; An information processing device comprising:

2. 2. The information processing device according to claim 1, the photographing location designation unit displays the photographed image together with the on-site image; An information processing device comprising:

3. The information processing device according to claim 2, A site position storage unit that stores a position on a map of the site is further provided, The image input unit receives a plurality of the photographed images, the photography location designation unit, when the photographed image contains GPS information, identifies the photographed image within a predetermined distance from the location of the site and displays the identified photographed image; An information processing device comprising:

4. 2. The information processing device according to claim 1, A site position storage unit that stores a position on a map of the site is further provided, the photography location designation unit, when the photographed image includes GPS information, displays information indicating a photography location corresponding to a location indicated by the GPS information on the site image; An information processing device comprising:

5. 2. The information processing device according to claim 1, a tag information input unit that receives input of tag information indicating the object captured in the captured image; a photographed object storage unit that stores the photographed image and the tag information in association with each other; The information processing device further comprising:

6. An information processing device according to claim 5, a search unit that receives designation of the tag information, acquires the photographic image corresponding to the designated tag information from the photographic object storage unit, and displays the acquired photographic image; An information processing device comprising:

7. 2. The information processing device according to claim 1, the site is a multi-story structure; A site image storage unit that stores the site image for each floor, The photography location designation unit receives designation of the floor and displays the site image corresponding to the received floor; the photographing location storage unit stores the photographed image, the on-site image, the photographing location, the photographing direction, and the floor in association with each other; An information processing device comprising:

8. 2. The information processing device according to claim 1, an object position designation unit that accepts designation of a position at which the object placed at the site is captured on the captured image; a document designation unit that accepts designation of a document related to the designated object from documents related to the site; Further equipped with the photographing location storage unit further stores the designated location and the designated document in association with the photographed image; An information processing device comprising:

9. An information processing device according to claim 8, a document storage unit that stores information indicating a plurality of documents related to the site; an output unit that identifies and outputs documents that are not associated with the captured images from among the documents related to the site; The information processing device further comprising:

10. An information processing device according to claim 8, an object storage unit that stores information indicating a plurality of the objects disposed at the site; an output unit that identifies and outputs objects that are not associated with the captured image among the objects; The information processing device further comprising:

11. An information processing device according to claim 1, The image input unit acquires an angle of view of a camera that captured the captured image, the determination unit specifies a shooting range based on the shooting location, the shooting direction, and the angle of view, and determines whether or not the object has been photographed based on whether or not the object is included in the specified shooting range; An information processing device comprising:

12. An information processing device according to claim 1, the determination unit determines that the first object has not been photographed when another second object is disposed on the straight line between the position and the first object; An information processing device comprising:

13. An information processing device according to claim 1, the notification unit notifies the user of the object that has not been photographed from a predetermined number of the imaging directions; An information processing device comprising:

14. An information processing device according to claim 1, the photographing location storage unit further stores the object photographed in the photographed image in association with the photographed image; An information processing device comprising:

15. Receiving an input of an image taken of a site; displaying a site image representing the site, and accepting input of a location where the photographed image is taken and an input of a direction in which the photographed image is taken on the site image; storing the photographed image, the on-site image, the photographing location, and the photographing direction in association with each other; storing locations within the scene of objects located at the scene; determining whether the object has been photographed based on whether the object is located on a straight line extending from the photographing location in the photographing direction; and notifying the user of the object that has not been photographed.

16. Receiving an input of an image taken of a site; displaying a site image representing the site, and accepting input of a location where the photographed image is taken and an input of a direction in which the photographed image is taken on the site image; storing the photographed image, the on-site image, the photographing location, and the photographing direction in association with each other; storing locations within the scene of objects located at the scene; determining whether the object has been photographed based on whether the object is located on a straight line extending from the photographing location in the photographing direction; and notifying the user of the object that has not been photographed.

Images