Information processing method, information processing device, and information processing program

Abstract

This information processing method for a computer includes: displaying, on a display, an overhead view on which a plurality of imaging location icons are superimposed; dividing the overhead view into a plurality of regions, where the plurality of imaging location icons are associated respectively with imaging data captured at imaging locations corresponding to the plurality of imaging location icons, and annotation information is assigned to the imaging data associated with at least one first imaging location icon included in the plurality of imaging location icons; and displaying, on the display, a first region that includes the first imaging location icon, from among the plurality of regions, in a mode different from that of a second region that does not include the first imaging location icon, from among the plurality of regions.

Description

Information processing method, information processing device, and information processing program

[0001] The present disclosure relates to a technique for changing the display mode of an image displayed on a display.

[0002] The technology described in Patent Document 1 discloses a display device having an image display means, a map display means, and a change means. The image display means displays an image in an image display area of ​​a display screen. The map display means displays a map in the map display area of ​​the display screen. The change means changes the scale of the map displayed in the map display area so that the scale increases as the number of captured images per unit area near the image capturing position of the image displayed in the image display area increases.

[0003] The technology described in Patent Literature 1 cannot clarify the location of a shooting location icon linked to image data to which annotation information is added, so the number of processing steps required by a computer to confirm the location of a shooting location icon linked to image data to which annotation information is added increases, which increases the burden on the computer.

[0004] JP 2009-237243 A

[0005] The present disclosure has been made based on the above-mentioned problems, and aims to provide a technology that suppresses an increase in the burden on a computer by clarifying the location of a shooting location icon to which annotation information is attached.

[0006] An information processing method according to one aspect of the present disclosure is an information processing method on a computer, which includes displaying a bird's-eye view on a display with a plurality of shooting location icons superimposed thereon, each of the plurality of shooting location icons being linked to shooting data taken at a shooting location corresponding to the plurality of shooting location icons, and the shooting data linked to at least one first shooting location icon included in the plurality of shooting location icons being given annotation information, dividing the bird's-eye view into a plurality of areas, and displaying a first area of ​​the plurality of areas that includes the first shooting location icon on the display in a manner different from a second area of ​​the plurality of areas that does not include the first shooting location icon.

[0007] According to the present disclosure, the location of a shooting location icon to which annotation information is added can be clarified, thereby suppressing an increase in the load on a computer.

[0008] 1 is a block diagram showing an example of the overall configuration of an information processing system in this embodiment. FIG. 2 is a block diagram showing another example of the overall configuration of the information processing system. FIG. 3 is a flowchart showing an example of the flow of processing performed in the information processing system. FIG. 4 is a diagram showing an example of a display screen displayed on a display by an information terminal. FIG. 5 is a diagram showing an example of a display screen displayed on a display by an information terminal that has accepted an operation to reduce and display a blueprint. FIG. 6 is a diagram showing a display screen that is displayed on a display when an information terminal accepts an operation to specify that area V shown in FIG. 2 is to be enlarged. FIG. 7 is a diagram showing an example of a status icon. FIG. 8 is a diagram showing an example of a display screen that is displayed on a display in modified example (3). FIG. 9 is a diagram showing an example of a display screen that is displayed on a display in modified example (8).

[0009] (Findings that form the basis of the present disclosure) A user interface is being developed that displays multiple photography location icons indicating locations where actual photographs of a construction site were taken on a two-dimensional blueprint of the site, such as a construction site, and when one photography location icon is selected, displays an image taken at the photography location indicated by that icon. This allows a construction site manager to understand the situation at the construction site without visiting the construction site.

[0010] In the above-described user interface, annotation information may be added to the photography data associated with at least one of the multiple photography location icons. When multiple photography location icons are displayed on a blueprint, it is difficult for the user to determine which photography location icon's photography data has annotation information added to it. In this case, the user may need to input an operation into the computer to search for the photography location icon whose photography data has annotation information added to it. This increases the number of processing steps on the computer, ultimately increasing the burden on the computer.

[0011] It is difficult to solve such problems with the technology described in Patent Document 1. Patent Document 1 merely discloses a technology for increasing the scale of a map based on the number of images captured per unit area, but does not disclose a technology for clarifying the location of a shooting location icon to which annotation information is added to the shooting data.

[0012] In order to solve the above problems, the following techniques are disclosed.

[0013] (1) An information processing method according to one aspect of the present disclosure is an information processing method for a computer, which includes displaying a bird's-eye view on a display with multiple shooting location icons superimposed thereon, each of the multiple shooting location icons being linked to shooting data taken at a shooting location corresponding to the multiple shooting location icons, and the shooting data linked to at least one first shooting location icon included in the multiple shooting location icons being given annotation information, dividing the bird's-eye view into multiple areas, and displaying a first area of ​​the multiple areas that includes the first shooting location icon on the display in a manner different from a second area of ​​the multiple areas that does not include the first shooting location icon.

[0014] According to this configuration, the first area including the first photographing location icon can be displayed on the display in a different manner from the second area not including the first photographing location icon. In other words, the first area including the first photographing location icon, which is a photographing location icon to which annotation information has been added to the photographing data, can be made to stand out. This makes it possible to clarify the location of the photographing location icon to which annotation information has been added to the photographing data. This eliminates the need to input an operation into the computer to search for the photographing location icon to which annotation information has been added to the photographing data, thereby preventing an increase in the number of processing steps on the computer. As a result, an increase in the burden on the computer can be prevented.

[0015] (2) In the information processing method described in (1) above, the method may further include detecting an expansion or contraction of the bird's-eye view, and displaying the first area on the display in a manner different from that of the second area may be performed in response to the detection of an expansion or contraction of the bird's-eye view.

[0016] According to this configuration, the display mode of the first area can be made different from that of the second area by using the enlargement or reduction of the bird's-eye view as a trigger.

[0017] (3) In the information processing method described in (1) or (2) above, displaying the first area on the display in a manner different from that of the second area may include changing the display manner of the first area based on the number of first shooting location icons contained in the first area.

[0018] According to this configuration, the display mode of the first area changes based on the number of first image capture location icons. In this way, for example, the display mode of the first area differs between when the first area includes a large number of first image capture location icons and when the first area includes a small number of first image capture location icons. This allows the user to understand the number of first image capture location icons included in the first area.

[0019] (4) In the information processing method described in any one of (1) to (3) above, displaying the first area on the display in a manner different from that of the second area may include displaying the total number of the first shooting location icons in the first area.

[0020] This configuration allows the user to clearly understand the total number of first imaging location icons included in the first area.

[0021] (5) In the information processing method described in any one of (1) to (4) above, the annotation information includes label information indicating the status of the subject related to the shooting data, and displaying the first area on the display in a manner different from that of the second area may include displaying the first area in a manner different from that of the second area for each type of label information assigned to the shooting data of the first shooting location icon.

[0022] According to this configuration, the display mode of the first area changes depending on the type of label information assigned to the shooting data of the first shooting location icon, making it easier for the user to understand the type of label information assigned to the shooting data of the first shooting location icon.

[0023] (6) In the information processing method described in any one of (1) to (5) above, the annotation information may include comment information indicating a comment added to the shooting data, and further include detecting input of a keyword, and displaying the first area on the display in a manner different from that of the second area may include identifying a keyword-attached area in the first area that includes the first shooting location icon to which comment information including the keyword has been added to the shooting data, and making the display manner of the keyword-attached area different from that of the second area.

[0024] According to this configuration, it is possible to clarify the location of the first shooting location icon to which comment information including a keyword is added to the shooting data.

[0025] (7) In the information processing method described in any one of (1) to (6) above, displaying the first area on the display in a manner different from that of the second area may include making the display manner of the first shooting location icon different from that of at least one second shooting location icon included in the plurality of shooting location icons, the second shooting location icon having no annotation information added to the shooting data.

[0026] According to this configuration, the display mode of the first photographing location icon, whose photographing data has annotation information added thereto, can be made different from that of the second photographing location icon, whose photographing data has no annotation information added thereto, thereby making it clear which of the multiple photographing location icons displayed on the display has annotation information added thereto.

[0027] (8) The information processing method described in (7) above may further include detecting an expansion or contraction of the bird's-eye view, and determining whether the degree of overlap between the first shooting location icon and the second shooting location icon is equal to or greater than a standard degree of overlap in accordance with the detection of the expansion or contraction of the bird's-eye view, and displaying the first area on the display in a manner different from that of the second area may include, when the degree of overlap between the first shooting location icon and the second shooting location icon is equal to or greater than the standard degree of overlap, making the display manner of the first shooting location icon different from the display manner of the second shooting location icon.

[0028] If the degree of overlap between the first photographing location icon and the second photographing location icon is equal to or greater than the reference degree of overlap, the visibility of the first photographing location icon may be reduced.

[0029] In contrast, with the above configuration, when the degree of overlap is equal to or greater than the reference degree of overlap, the first shooting location icon is displayed on the display in a manner different from that of the second shooting location icon, thereby making the location of the first shooting location icon clearer.

[0030] (9) In the information processing method described in any one of (1) to (8) above, dividing the bird's-eye view into the plurality of regions may include setting grid-like boundaries on the bird's-eye view.

[0031] According to this configuration, the bird's-eye view is divided into multiple regions by grid-like boundaries, allowing the shape of each region to be set to a simple shape. This improves the visibility of the bird's-eye view compared to when the shape of each region is set to a complex shape. As a result, the location of the first shooting location icon becomes clearer.

[0032] (10) In the information processing method described in any one of (1) to (9) above, the bird's-eye view may include floor plan information indicating the shapes of each of a plurality of spaces included in the building, and further include detecting an enlargement or reduction of the bird's-eye view, and dividing the bird's-eye view into the plurality of regions may include setting boundary lines on the bird's-eye view that have shapes that follow the shapes of each of the plurality of spaces based on the floor plan information in response to the detection of an enlargement or reduction of the bird's-eye view.

[0033] According to this configuration, boundary lines that correspond to the shapes of each of the spaces in the building are set on the bird's-eye view based on the floor plan information. This allows the spaces in the building to correspond to the areas on the blueprint. By displaying the first area differently from the second area in this state, it is possible to clarify in which space of the building the first photography location icon is located.

[0034] (11) In the information processing method described in any one of (1) to (10) above, the bird's-eye view is linked to functional information indicating the function of each of a plurality of spaces in a building, and further includes detecting an enlargement or reduction of the bird's-eye view, and dividing the bird's-eye view into a plurality of areas may include setting boundaries on the bird's-eye view so that the bird's-eye view is divided into each function of the plurality of spaces in accordance with the detection of an enlargement or reduction of the bird's-eye view.

[0035] According to this configuration, the blueprint is divided into a plurality of areas according to the functions of the spaces of the building, so that the function of the area in which the first photographing location icon is placed can be clarified.

[0036] (12) In the information processing method described in any one of (1) to (11) above, the bird's-eye view includes a first floor map corresponding to a first floor included in a building and a second floor map corresponding to a second floor different from the first floor included in the building, and displaying the first area on the display in a manner different from that of the second area may include displaying, on the display, a floor map of the first floor map and the second floor map that includes the first shooting location icon in a manner different from that of a floor map that does not include the first shooting location icon.

[0037] This configuration makes it possible to clarify on which floor of the building the first photographing location icon is located.

[0038] (13) The information processing method described in any one of (1) to (12) above may further include detecting an enlargement of the bird's-eye view; when the enlargement of the bird's-eye view is detected, determining whether the enlargement rate is equal to or greater than a reference enlargement rate; when the enlargement rate is equal to or greater than the reference enlargement rate, identifying the position of a first range of the bird's-eye view displayed on the display and the positions and number of the first shooting location icons included in a second range of the bird's-eye view not displayed on the display; and displaying guidance information indicating the positions and number of the first shooting location icons included in the second range on the display together with the first range.

[0039] According to this configuration, when the first range of the blueprint is displayed on the display, guidance information indicating the positions and number of first photographing location icons that exist outside the display screen of the display (second range of the blueprint) can be presented to the user, allowing the user to easily grasp the positions and number of first icons that exist outside the display screen of the display.

[0040] Furthermore, the present disclosure can be realized not only as an information processing method that executes the characteristic processes described above, but also as an information processing device having a characteristic configuration corresponding to the characteristic processes executed by the information processing method. Furthermore, the present disclosure can also be realized as a computer program that causes a computer to execute the characteristic processes included in such an information processing method. Therefore, the same effects as those of the above information processing method can also be achieved in the following other aspects.

[0041] (14) An information processing device according to another aspect of the present disclosure is an information processing device including a processor, which performs the following operations: displaying a bird's-eye view on a display with multiple shooting location icons superimposed thereon; each of the multiple shooting location icons being linked to shooting data taken at a shooting location corresponding to the multiple shooting location icons, and the shooting data linked to at least one first shooting location icon included in the multiple shooting location icons being given annotation information; dividing the bird's-eye view into multiple areas; and displaying a first area of ​​the multiple areas that includes the first shooting location icon on the display in a manner different from a second area of ​​the multiple areas that does not include the first shooting location icon.

[0042] (15) An information processing program according to yet another aspect of the present disclosure causes a computer to display on a display a bird's-eye view on which multiple shooting location icons are superimposed, each of which is linked to shooting data taken at a shooting location corresponding to the multiple shooting location icons, and the shooting data linked to at least one first shooting location icon included in the multiple shooting location icons is given annotation information, divide the bird's-eye view into multiple areas, and display on the display a first area of ​​the multiple areas that includes the first shooting location icon in a manner different from a second area of ​​the multiple areas that does not include the first shooting location icon.

[0043] The present disclosure can also be realized as an information processing system operated by such an information processing program. Needless to say, such a program can be distributed on a non-transitory recording medium such as a computer-readable CD-ROM, or via a communication network such as the Internet.

[0044] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each of the embodiments described below represents a specific example of the present disclosure. The numerical values, shapes, components, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in an independent claim that represents a top-level concept will be described as optional components. Furthermore, in all embodiments, the respective contents can be combined.

[0045] 1 is a block diagram showing an example of the overall configuration of an information processing system 1 according to the present embodiment. The information processing system 1 includes a server 10, an information terminal 20, and an image capturing device 30.

[0046] The server 10 is an example of an information processing device and a computer. The server 10, the information terminal 20, and the imaging device 30 are connected to each other so as to be able to communicate with each other via a network NT. An example of the network NT is the Internet. The server 10 is, for example, a cloud server configured with one or more computers. However, this is just one example, and the server 10 may be configured as an edge server or may be implemented in the information terminal 20. The aspect in which the server 10 is implemented in the information terminal 20 is an example of the aspect in which the information terminal 20 is configured as an information processing device.

[0047] The information terminal 20 is a terminal operated by a user. The user is, for example, a manager of a predetermined space that is photographed by the imaging device 30. The predetermined space is, for example, a building construction site. However, this is just one example, and the predetermined space may also be a construction site, factory, store, office, etc. The information terminal 20 may be configured as a portable computer such as a smartphone or tablet computer, or as a stationary computer. Although one information terminal 20 is illustrated in the example of FIG. 1, multiple information terminals may be connected to the server 10 via the network NT. The information terminal 20 includes a communication unit 21, a processor 22, a display 23, and an operation unit 24.

[0048] FIG. 2 is a block diagram showing another example of the overall configuration of the information processing system 1. As shown in FIG. 2, the information processing system 1 may include a PC 50 connected to the network NT. The PC 50 is an information processing terminal installed in a location other than the work site, such as an office located away from the work site. The PC 50 may be configured using various information processing terminals, such as a desktop PC, a laptop PC, a smartphone, or a tablet computer. A design drawing 200 (FIGS. 4 and 5), which will be described later, may be displayed on a display (not shown) that is attached to or connected to the PC 50.

[0049] The communication unit 21 is a communication interface that connects the information terminal 20 to the network NT. The communication unit 21 transmits to the server 10 signals indicating various instructions that the operation unit 24 has received from the user.

[0050] The processor 22 is configured by, for example, a CPU (Central Processing Unit), and displays the design drawing of a predetermined space transmitted from the server 10 on the display 23. The design drawing is an example of a bird's-eye view. The design drawing is a diagram showing the design of a construction site. In detail, the design drawing is a bird's-eye view of a building including columns, walls, or materials. The bird's-eye view may be a bird's-eye view or a view from a high place. The design drawing may be a floor plan, blueprint, map, perspective view, or the like of the construction site.

[0051] The display 23 is configured with various display devices such as a liquid crystal display and an organic EL display, and displays various display screens under the control of the processor 22 .

[0052] The operation unit 24 is configured with, for example, a keyboard, a touch panel, a mouse, etc. The user operates the operation unit 24 to input various instructions to the information terminal 20.

[0053] The image capturing device 30 is, for example, an omnidirectional camera that captures image data (images) at a predetermined frame rate. An omnidirectional camera, also known as a 360-degree camera, is a camera that can capture image data in all directions (360 degrees). The image capturing device 30 is, for example, a portable image capturing device carried by a photographer. The photographer may be, for example, a construction site worker or site supervisor. The image capturing device 30 may be a regular camera. The image capturing device 30 includes an image sensor, an operation device, a communication circuit, a signal processing circuit, etc. The image capturing device 30 may be a portable computer such as a smartphone or tablet computer. The image capturing device 30 has a communication unit 40. The communication unit 40 connects the information terminal 20 and the image capturing device 30 to each other so that they can communicate with each other via a short-range wireless communication path such as Bluetooth (registered trademark) or a wireless LAN.

[0054] The photographer downloads the blueprint of the site from the server 10 to the information terminal 20, displays it on the information terminal 20, and connects the information terminal 20 and the camera device 30 via a wireless LAN or the like. A start shooting button is then displayed on the information terminal 20. The photographer presses the start shooting button while pointing the camera device 30 in a predetermined direction to begin shooting. The predetermined direction is a direction that aligns with the blueprint displayed on the display 23. The predetermined direction is, for example, north, but is not limited to this. The photographer moves around the site while taking photos with the camera device 30. This generates multiple pieces of shooting data (image data). When the photographer reaches the end point of the shooting, he presses the end shooting button displayed on the information terminal 20. At this time, the photographer touches the blueprint displayed on the information terminal 20 to indicate the end point of the shooting on the blueprint. Note that when starting shooting with the camera device 30, the photographer may also touch the blueprint displayed on the information terminal 20 to specify the start point of the shooting. When the photographer indicates the end point of photography, transfer of multiple pieces of photography data begins from the photography device 30 to the information terminal 20. The transferred multiple pieces of photography data are temporarily stored in the information terminal 20. The photographer operates the information terminal 20 to upload the multiple pieces of photography data stored in the information terminal 20 to the server 10.

[0055] When the server 10 acquires multiple pieces of photography data from the information terminal 20, it uses Visual SLAM (Simultaneous Localization and Mapping) technology to analyze the location information of each piece of photography data on the blueprint based on the photography start point, photography end point, and multiple pieces of photography data, and assigns (links) the location information on the blueprint to each piece of photography data. Two-dimensional coordinate axes are defined on the blueprint. Therefore, the location information on the blueprint for each piece of photography data is defined by two-dimensional coordinate values. Based on the location information on the blueprint for each piece of photography data, the server 10 superimposes photography location icons indicating the photography locations of each piece of photography data on the blueprint. This generates a blueprint on which multiple photography location icons are superimposed. This series of processes is executed, for example, by the acquisition unit 111 (described later) of the server 10.

[0056] The on-site worker displays the design drawing generated by the server 10 on the information terminal 20 at an appropriate timing. That is, the design drawing on which multiple photography location icons are superimposed is displayed on the information terminal 20. Then, by designating (e.g., touching) a specific photography location icon from among the multiple photography location icons, the photography data can be called up and displayed. Annotation information can also be added to the photography data.

[0057] Annotation information is a type of meta information that is added to shooting data. The annotation information according to the present embodiment includes comment information and label information. One or both of the comment information and the label information are added to the shooting data.

[0058] Comment information is text (character string) that a worker performing a specified task on-site adds to specified photographic data. For example, a worker adds text such as "Work will begin on April 1st. From Worker X of Company A" to specified photographic data. This text is comment information. The comment information added to photographic data by a worker is stored in the image information storage unit 122 of the memory 12 in a state linked to the photographic data. Note that not only workers but also people such as the site supervisor of the construction site may add comment information to photographic data.

[0059] The label information indicates the status of the construction site (an example of a subject) related to the photographic data. The label information according to this embodiment includes three types of class labels: "Not started," "In progress," and "Completed." The worker assigns an appropriate class label to the photographic data depending on the status of the construction site captured in the photographic data.

[0060] Specifically, a worker assigns a class label according to the progress of a predetermined task being performed at a construction site captured in the photographic data. For example, a worker assigns a class label of "not started" to photographic data that captures a construction site where a worker has not yet started work. A worker assigns a class label of "in progress" to photographic data that captures a construction site where work is in progress. A worker assigns a class label of "completed" to photographic data that captures a construction site where work has been completed. Class labels may be assigned by a site supervisor or the like.

[0061] The above class labels are merely examples, and the worker may assign a wide variety of class labels depending on the status of the subject. In other words, the class labels that the worker assigns to the photographic data are not limited to "not started," "in progress," and "completed."

[0062] In addition to the annotation information described above, various meta information is added to the photographic data captured by the photographing device 30. For example, meta information such as photographing date and time information and a blueprint ID is added to each photographic data. The photographing date and time information indicates the year, month, day, time, etc. when the photograph was taken. The blueprint ID is identification information used, for example, when identifying a blueprint corresponding to the construction site where the photograph was taken. The meta information such as the photographing date and time information and the blueprint ID is generated by the information terminal 20 or the photographing device 30 and added to each photographic data. Note that if the photographing device 30 or the information terminal 20 is equipped with a position sensor such as a GPS sensor, information indicating the latitude and longitude of the photographing location may be added to each photographic data.

[0063] The server 10 includes a processor 11 , a memory 12 , and a communication unit 13 .

[0064] The processor 11 is configured by, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), etc. The processor 11 includes an acquisition unit 111 and a display control unit 113. The acquisition unit 111 and the display control unit 113 may be realized by the processor 11 executing an information processing program, or may be configured by a dedicated hardware circuit such as an ASIC.

[0065] The acquisition unit 111 acquires the photographic data sent from the photographing device 30 and the meta information attached to the photographic data. The acquisition unit 111 also executes the VSLAM process described above to generate a design drawing on which multiple photographic location icons are superimposed.

[0066] The acquisition unit 111 acquires a display instruction from the information terminal 20 by communicating with the information terminal 20 or the PC 50 using the communication unit 13. The display instruction is an instruction input by the user to the information terminal 20 or the PC 50. The display instruction is an instruction requesting that a blueprint on which multiple shooting location icons are superimposed be displayed on the display 23 of the information terminal 20 or the display of the PC 50. The display instruction includes a blueprint ID that is an identifier of the blueprint that the user requests to be displayed on the display 23. Below, it is assumed that an instruction requesting that a blueprint on which multiple shooting location icons are superimposed be displayed on the display 23 of the information terminal 20 is input as a display instruction.

[0067] The display control unit 113 generates various instructions for controlling the information terminal 20 and transmits them to the information terminal 20. Upon receiving the instructions generated by the display control unit 113, the information terminal 20 displays, on the display 23, a blueprint on which multiple shooting location icons are superimposed. Furthermore, upon receiving the instructions, the information terminal 20 divides the blueprint into multiple regions. For example, the information terminal 20 sets at least one boundary line on the blueprint for dividing the blueprint into multiple regions. Furthermore, upon receiving the instructions, the information terminal 20 displays, on the display 23, a first region of the multiple regions that includes a first shooting location icon (described later) in a different manner from a second region of the multiple regions that does not include the first shooting location icon.

[0068] The memory 12 is configured with a non-volatile rewritable storage device such as a hard disk drive, a solid state drive, etc. The memory 12 includes a design drawing information storage unit 121 and an image information storage unit 122.

[0069] The blueprint information storage unit 121 stores at least one blueprint. The blueprint information storage unit 121 also stores a blueprint ID assigned to each of the at least one blueprint and location information for each of the at least one blueprint. The location information for a blueprint is information indicating the geographical location of a specific space to which the blueprint corresponds. For example, if the blueprint corresponds to a construction site, information indicating the latitude and longitude of the construction site is stored in the blueprint information storage unit 121. Specifically, the latitude and longitude corresponding to key points on the blueprint (e.g., the four corners of the blueprint) are stored.

[0070] The image information storage unit 122 stores a plurality of pieces of photographic data sent from the information terminal 20 to the server 10 and meta information assigned to each of the plurality of pieces of photographic data.

[0071] The meta information stored in the image information storage unit 122 may include information such as a shooting ID, a shooting period ID, a shooting direction, and location information of a shooting location icon.

[0072] The shooting ID is an identifier assigned to each piece of shooting data. The shooting period ID is an identifier for the shooting period. The shooting period refers to the period from the start to the end of the shooting operation. The shooting direction indicates the direction in which the shooting device 30 was facing when each piece of shooting data was captured. The position information of the shooting location icon indicates the display position of the shooting location icon on the blueprint. The position information of the shooting location icon is represented, for example, by coordinate values ​​in a two-dimensional coordinate system defined on the blueprint.

[0073] The communication unit 13 is a communication interface that connects the server 10 to a network.

[0074] FIG. 3 is a flowchart showing an example of the flow of processing performed in the information processing system 1.

[0075] In step S1, the information terminal 20 displays a blueprint on the display 23. Specifically, in step S1, a user operates the operation unit 24 to input a display instruction to the information terminal 20. Upon receiving the display instruction, the information terminal 20 transmits the display instruction to the server 10. The acquisition unit 111 of the server 10, which has received the display instruction, reads out the blueprint indicated by the blueprint ID included in the display instruction from the blueprint information storage unit 121 of the memory 12. At this time, the acquisition unit 111 uses the blueprint ID as a key to read out various information from the image information storage unit 122 of the memory 12, such as shooting data having a shooting ID associated with the blueprint ID, location information indicating the display position on the blueprint of a shooting location icon indicating the shooting location of the shooting data, and annotation information assigned to the shooting data. The acquisition unit 111 inputs the information read out from the memory 12 to the display control unit 113. The display control unit 113 generates an instruction based on the information acquired from the acquisition unit 111. Specifically, the acquisition unit 111 generates and transmits instructions to display the design drawing read out by the acquisition unit 111 on the display 23 and to superimpose boundary lines for dividing the design drawing into multiple areas on the design drawing.

[0076] FIG. 4 is a diagram showing an example of a display screen 400 that the information terminal 20 displays on the display 23 in accordance with instructions received from the display control unit 113. As shown in FIG. 4, the display screen 400 includes a design drawing 200 on which multiple photography location icons are superimposed. In the example shown in FIG. 4, the multiple photography location icons include photography location icons 501 to 515. For ease of explanation, reference numerals are not assigned to photography location icons other than the photography location icons 501 to 515 in FIG. 4. Hereinafter, each of the multiple photography location icons is composed of a circular image. Each of the multiple photography location icons is associated with at least one piece of photography data taken at the photography location indicated by the multiple photography location icon. Hereinafter, unless otherwise specified, it is assumed that one photography location icon is associated with one piece of photography data.

[0077] The annotation information is added to the shooting data of at least one of the multiple shooting location icons. Hereinafter, a shooting location icon with annotation information added to the shooting data will be referred to as a first shooting location icon. Also, hereinafter, a shooting location icon with no annotation information added to the shooting data will be referred to as a second shooting location icon. In other words, the multiple shooting location icons include at least one first shooting location icon with annotation information added to the shooting data and at least one second shooting location icon with no annotation information added to the shooting data.

[0078] As shown in Fig. 4, the display screen 400 includes grid-like boundaries L (grid lines). That is, boundaries L including a plurality of vertical lines and a plurality of horizontal lines that intersect at right angles are drawn on the display screen 400. The boundaries L divide the design drawing 200 into a plurality of regions. In the example shown in Fig. 4, the plurality of regions are formed in a square shape. However, this is merely an example, and the plurality of regions may also be formed in a rectangular shape.

[0079] In step S2, the display control unit 113 determines whether or not it has detected enlargement or reduction of the blueprint. Specifically, the display control unit 113 communicates with the information terminal 20. The display control unit 113 then determines whether or not the information terminal 20 has received from the user an operation requesting that the blueprint be enlarged or reduced and displayed on the display 23 (hereinafter referred to as an enlargement / reduction operation). If the information terminal 20 has received the enlargement / reduction operation, the display control unit 113 determines that it has detected enlargement or reduction (YES in step S2). In this case, the process proceeds to step S3. On the other hand, if the information terminal 20 has not received the enlargement / reduction operation, the display control unit 113 determines that it has not detected enlargement or reduction (NO in step S2). In this case, the process proceeds to step S4.

[0080] In step S3, the information terminal 20 redraws the boundary line L according to the magnification ratio of the design drawing. For example, assume that in step S2, the information terminal 20 receives an operation to reduce the design drawing 200 (an operation to reduce the magnification ratio of the design drawing). Also, assume that the magnification ratio of the design drawing 200 shown in FIG. 4 is 100%, and the enlargement / reduction operation includes an operation to request setting the magnification ratio of the design drawing 200 to 80%. In this case, the information terminal 20 displays the design drawing 200 with the magnification ratio set to 80% on the display screen 400. At this time, the information terminal 20 redraws the boundary line L according to the magnification ratio specified by the user (magnification ratio 80%). Specifically, the spacing between the multiple vertical lines, the spacing between the multiple horizontal lines, the number of vertical lines, or horizontal lines included in the boundary line L is adjusted in response to the reduction of the design drawing 200.

[0081] Fig. 5 is a diagram showing an example of a display screen 401 displayed on the display 23 by the information terminal 20 that has accepted an operation to reduce and display the design drawing 200. The display screen 401 shown in Fig. 5 includes the design drawing 200 that has been reduced in size compared to the design drawing 200 shown in Fig. 4. The display screen 401 also includes boundary lines L that were redrawn in the processing of step S3. The boundary lines L divide the design drawing 200 into a plurality of areas, from area A1 to area A16.

[0082] Incidentally, some (e.g., two) of the multiple photographing location icons may be displayed on the display 23 in an overlapping state. For example, if the blueprint 200 is reduced while maintaining the display size of each of the multiple photographing location icons on the display screen, the photographing location icons may become crowded, resulting in two photographing location icons being displayed on the display 23 in an overlapping state. Specifically, in FIG. 5 , a photographing location icon 501 and a photographing location icon 502 are displayed on the display screen 401 in an overlapping state. Assume that the photographing location icon 501 is a first photographing location icon, and the photographing location icon 502 is a second photographing location icon. Here, if the overlapping degree between the first photographing location icon and the second photographing location icon is equal to or greater than a reference overlapping degree, the first photographing location icon is hidden by the second photographing location icon, reducing the visibility of the first photographing location icon. The overlapping degree refers to the ratio of the area of ​​the second photographing location icon to the area of ​​the first photographing location icon.

[0083] Therefore, in step S4, the display control unit 113 according to the present embodiment determines whether the degree of overlap between the first and second image capture location icons is equal to or greater than a reference degree of overlap. If the degree of overlap is equal to or greater than the reference degree of overlap (YES in step S4), the display control unit 113 transmits, in step S5, to the information terminal 20 an instruction to change the display mode of the first image capture location icon to a different display mode from that of the second image capture location icon.

[0084] Specifically, in step S4, the display control unit 113 identifies a first image capture location icon from among the multiple image capture location icons displayed on the display 23. Subsequently, the display control unit 113 identifies a second image capture location icon superimposed on the first image capture location icon. The display control unit 113 then determines whether the degree of overlap between the first image capture location icon and the second image capture location icon is equal to or greater than a reference degree of overlap. The reference degree of overlap is not particularly limited, but may be, for example, 50%. If the degree of overlap between the first image capture location icon and the second image capture location icon is equal to or greater than the reference degree of overlap (YES in step S4), the process proceeds to step S5. On the other hand, if the degree of overlap between the first image capture location icon and the second image capture location icon is less than the reference degree of overlap (NO in step S4), the process proceeds to step S6.

[0085] In step S4, if there is no second image capturing location icon superimposed on the first image capturing location icon, the display control unit 113 determines NO in step S4.

[0086] Furthermore, in step S4, the display control unit 113 may determine whether multiple second image capture location icons are superimposed on one first image capture location icon. If multiple second image capture location icons are superimposed on one first image capture location icon, the display control unit 113 may determine whether the ratio of the total area of ​​the multiple second image capture location icons to the area of ​​the first image capture location icon is equal to or greater than a reference overlapping degree. If the ratio of the total area of ​​the multiple second image capture location icons to the area of ​​the first image capture location icon is equal to or greater than the reference overlapping degree, the display control unit 113 may determine YES in step S4.

[0087] In step S5, the display control unit 113 transmits to the information terminal 20 an instruction to change the display mode of the first photographing location icon to a different mode from that of the second photographing location icon. The instruction to change the display mode of the first photographing location icon to a different mode from that of the second photographing location icon is, for example, an instruction to hide the second photographing location icon. Assume that the photographing location icon 502 shown in FIG. 5 is the second photographing location icon, the photographing location icon 501 is the first photographing location icon, and the photographing location icon 502 overlaps with the photographing location icon 501 by a degree of overlap equal to or greater than the reference degree of overlap. In this case, the display control unit 113 transmits to the information terminal 20 an instruction to hide the photographing location icon 502.

[0088] Furthermore, in step S5, the display control unit 113 may transmit to the information terminal 20 an instruction to place the first photographing location icon in the foreground so that the display mode of the first photographing location icon differs from the display mode of the second photographing location icon. For example, assume that the display screen 401 shown in FIG. 5 includes a first layer on which the blueprint 200 is drawn, a second layer on which a photographing location icon 501 (first photographing location icon) is drawn, and a third layer on which a photographing location icon 502 (second photographing location icon) is drawn. In this case, the display control unit 113 transmits to the information terminal 20 an instruction to place the second layer in the foreground. In this way, the photographing location icon 501 is displayed preferentially over the photographing location icon 502 on the display screen 401.

[0089] In step S5, the display control unit 113 may also transmit to the information terminal 20 an instruction to make the radius of the first image capture location icon larger than that of the second image capture location icon. The display control unit 113 may also transmit to the information terminal 20 an instruction to change the image constituting the first image capture location icon into a rectangular image. The display control unit 113 may also transmit to the information terminal 20 an instruction to add a border line to the periphery of the circular image constituting the first image capture location icon.

[0090] Furthermore, in step S5, the display control unit 113 may transmit to the information terminal 20 an instruction to make the radius of the second image capture location icon superimposed on the first image capture location icon smaller than the radius of the first image capture location icon. Furthermore, the display control unit 113 may transmit to the information terminal 20 an instruction to change the transparency of the second image capture location icon superimposed on the first image capture location icon to make it transparent. In this way, the display control unit 113 improves the visibility of the first image capture location icon.

[0091] In step S6, the display control unit 113 selects one shooting location icon from among the multiple shooting location icons.

[0092] In step S7, the display control unit 113 identifies the area to which the photography location icon selected in step S6 belongs. The display control unit 113 determines the area to which the photography location icon belongs based on the position (coordinates) of the center point of the photography location icon. For example, assume that the photography location icon 501 shown in FIG. 5 was selected by the display control unit 113 in step S6. Here, as shown in FIG. 5, the center point 501P of the photography location icon 501 is located inside area A10. In this case, the display control unit 113 identifies that the photography location icon 501 belongs to area A10.

[0093] In step S8, the display control unit 113 checks whether annotation information has been added to the shooting data of the shooting location icon selected in step S6. In other words, it checks whether the given shooting location icon is the first shooting location icon.

[0094] In step S9, the display control unit 113 determines whether the processes of steps S7 and S8 have been executed for all of the photography location icons superimposed on the design drawing 200. If the processes of steps S7 and S8 have been executed for all of the photography location icons (YES in step S9), the process proceeds to step S10. If the processes of steps S7 and S8 have not been executed for all of the photography location icons (NO in step S9), the process returns to step S6. That is, the display control unit 113 repeats the processes of steps S6 to S9 until it has identified the areas to which all of the photography location icons belong and executed the process of determining whether all of the photography location icons are first photography location icons. Note that if the display control unit 113 determines NO in step S9 and returns to step S6, the display control unit 113 newly selects a photography location icon for which the processes of steps S7 and S8 have not been executed from among the multiple photography location icons.

[0095] In addition, in step S9, the display control unit 113 may determine YES in step S9 if it has been able to perform the processing of steps S7 and S8 for all shooting location icons included in the area currently displayed on the display of the design drawing 200.

[0096] In step S10, the display control unit 113 determines the content of the annotation information added to the shooting data of the first shooting location icon for each area.

[0097] In step S11, the display control unit 113 determines the number of first shooting location icons for each area.

[0098] In step S12, the display control unit 113 identifies a first area and a second area. The first area is an area that includes at least one first image capture location icon. The second area is an area that does not include a first image capture location icon. For example, area A10 shown in FIG. 5 includes one first image capture location icon. In this case, area A10 corresponds to the first area. On the other hand, for example, area A14 does not include a first image capture location icon. In other words, it is assumed that area A14 does not include a single image capture location icon (first image capture location icon) that has annotation information added to the image capture data. In this case, area A14 corresponds to the second area.

[0099] In step S13, the display control unit 113 generates an instruction to display the first area on the display 23 in a format different from that of the second area, and transmits this instruction to the information terminal 20. The display control unit 113 generates the instruction based on at least one of the content of the comment indicated by the comment information, the type of label information, and the number of first shooting location icons. Having acquired this instruction, the information terminal 20 displays the first area on the display 23 in a format different from that of the second area. Details of the processing executed by the display control unit 113 in step S13 will be described below using an example.

[0100] (First Example) The display control unit 113 according to the first example generates an instruction to change the display mode of the first area based on the number of first shooting location icons included in the first area.

[0101] Specifically, the display control unit 113 according to the first example changes the display size of the first area depending on the number of first image capture location icons included in the first area. That is, the display control unit 113 changes the display size of the first area so that the more first image capture location icons the first area includes, the larger the display size of the first area. For example, assume that area A7 shown in FIG. 5 includes four first image capture location icons, area A10 includes one first image capture location icon, and area A14 does not include any first image capture location icons. In this case, when the display size of area A7 is X1, the display size of area A10 is X2, and the display size of area A14 is X3, the display control unit 113 instructs the information terminal 20 to change the display size of the first area so that the relationship "X1 > X2 > X3" holds. The display size of the first area refers to the area of ​​one first area on the display screen.

[0102] Furthermore, the display control unit 113 according to the first example may change the color of the first area depending on the number of first image capture location icons included in the first area. For example, the display control unit 113 may instruct the information terminal 20 to display a first area including one or two first image capture location icons in green, a first area including three or four first image capture location icons in yellow, and a first area including five or more first image capture location icons in red.

[0103] In this way, by changing the display mode of the first area depending on the number of first photographing location icons, the user can intuitively understand the number of first photographing location icons included in the first area.

[0104] (Second Example) The display control unit 113 according to the second example generates an instruction requesting that the total number of first photographing location icons be displayed in the first area.

[0105] 5 is the first area, and area A6 includes a total of four first shooting location icons. In this case, the display control unit 113 instructs the information terminal 20 to display the character "4" in area A6.

[0106] In this way, by displaying the total number of first image capturing location icons on the display screen 401, the user can intuitively understand the total number of first image capturing location icons for each first area.

[0107] (Third Example) Fig. 6 is a diagram for explaining the processing of the display control unit 113 according to the third example. Fig. 6 is a diagram showing a display screen 402 that is displayed on the display 23 when the information terminal 20 receives an operation specifying that the area VI shown in Fig. 4 be enlarged.

[0108] On the display screen 402, the design drawing 200 is divided into multiple areas, from area B1 to area B16, by boundary lines L. Area B3 includes a photography location icon 503, area B5 includes a photography location icon 504, area B8 includes a photography location icon 505, area B9 includes a photography location icon 506, area B15 includes a photography location icon 507, and area B16 includes a photography location icon 508. The photography data of the photography location icon 503 is assigned label information of "not started," the photography data of the photography location icon 504 is assigned label information of "in progress," and the photography data of the photography location icon 505 is assigned label information of "completed." In other words, the photography location icon 503, the photography location icon 504, and the photography location icon 505 are first photography location icons to which annotation information has been assigned. Therefore, areas B3, B5, and B8 are first areas.

[0109] The display control unit 113 according to the third example instructs the information terminal 20 to display the first area in a different manner for each type of label information linked to the first photographing location icon. For example, the display control unit 113 instructs the information terminal 20 to display on the display 23 the first area including the first photographing location icon to which the label information of "not started" has been assigned in red, the first area including the first photographing location icon to which the label information of "being handled" has been assigned in yellow, and the first area including the first photographing location icon to which the label information of "handled" has been assigned in green.

[0110] Explaining with reference to FIG. 6 , as described above, area B3 includes a photography location icon 503. The photography data of the photography location icon 503 has been assigned label information of "not started." In this case, the display control unit 113 displays area B3 in red. Area B5 includes a photography location icon 504. The photography data of the photography location icon 504 has been assigned label information of "in progress." In this case, the display control unit 113 displays area B5 in yellow. Area B8 includes a photography location icon 505. The photography data of the photography location icon 505 has been assigned label information of "completed." In this case, the display control unit 113 displays area B8 in green.

[0111] In this way, the display control unit 113 according to the third example changes the color of the first area to which the first image capture location icon belongs according to the type of label information attached to the image capture data of the first image capture location icon. This allows the user to understand the type of label information attached to the first image capture location icon. Furthermore, the user can immediately understand the status of each area.

[0112] (Example 4) The display control unit 113 in Example 4 instructs the information terminal 20 to display multiple colors in the first area when one first area contains multiple first shooting location icons and different types of label information are assigned to the multiple first shooting location icons.

[0113] For example, suppose that the photographing location icon 505 in area A7 shown in Figure 5 is assigned the label information of "not started," the photographing location icon 509 and the photographing location icon 510 in area A7 are assigned the label information of "in progress," and the photographing location icon 511 in area A7 is assigned the label information of "completed."

[0114] In this case, the display control unit 113 first divides the area A7 into three parts: a left part LE, a center part CE, and a right part RI. Then, the display control unit 113 instructs the information terminal 20 to display the left part LE in a color corresponding to the type of "not started", for example, red. The display control unit 113 also instructs the information terminal 20 to display the center part CE in a color corresponding to the type of "in progress", for example, yellow. The display control unit 113 also instructs the information terminal 20 to display the right part RI in a color corresponding to the type of "completed progress", for example, green.

[0115] In this way, the user can intuitively understand that one first area contains multiple first shooting location icons, and that different types of label information are assigned to the shooting data of the multiple first shooting location icons.

[0116] Furthermore, the display control unit 113 according to the fourth example divides the area A7 into three parts: a left part LE, a center part CE, and a right part RI, and displays the left part LE in red. In this way, by displaying the left part LE, which is believed to be the part that attracts the human gaze, in red, which is a conspicuous color, it is possible to guide the user to pay attention to the area A7.

[0117] The display control unit 113 according to the fourth example may display the total number of first photographing location icons in the first area for each type of label information. For example, in area A7, there is one first photographing location icon (photographing location icon 505) to which label information of "not started" is assigned, two first photographing location icons (photographing location icon 509 and photographing location icon 510) to which label information of "in progress" is assigned, and one first photographing location icon (photographing location icon 511) to which label information of "resolved" is assigned. In this case, the display control unit 113 transmits to the information terminal 20 an instruction to display the character "1" in the left portion LE of area A7 displayed in red, the character "2" in the center portion CE displayed in yellow, and the character "1" in the right portion RI displayed in green. In this way, the user can intuitively understand that there is one first photographing location icon in area A7 that has been given the label information "not started", two first photographing location icons that have been given the label information "in progress", and one first photographing location icon that has been given the label information "completed".

[0118] Furthermore, the display control unit 113 according to the fourth example may instruct the information terminal 20 to display a status icon 600 ( FIG. 7 ) in the area A7. FIG. 7 is a diagram illustrating an example of the status icon 600. The status icon 600 is composed of multiple circles, each having a different radius and color, and each having its center located at the same coordinate on the blueprint. As described above, the area A7 contains one first photographing location icon labeled "Not Started," two first photographing location icons labeled "In Progress," and one first photographing location icon labeled "Completed." In this case, the status icon 600 includes a first circle 601, a second circle 602, and a third circle 603. The first circle 601 is a circular image displayed in a color corresponding to the "Not Started" label, for example, red. The second circle 602 is a circular image displayed in a color corresponding to the "In Progress" label, for example, yellow. The third circle 603 is a circular image displayed in a color corresponding to the label information of "dealt with", for example, green. The radius of the first circle 601 is larger than the radius of the second circle 602, which is larger than the radius of the third circle 603. The centers of the first circle 601 to the third circle 603 are arranged at the same position (coordinate). The first circle 601 displays the total number of first photographing location icons in area A7 that have been assigned the label information of "not started". That is, "1" is displayed. The second circle 602 displays the total number of first photographing location icons in area A7 that have been assigned the label information of "in treatment". That is, "2" is displayed. The third circle 603 displays the total number of first photographing location icons in area A7 that have been assigned the label information of "in treatment". That is, "1" is displayed.

[0119] By displaying this status icon 600 in area A7, the user can intuitively understand that there is one first photographing location icon in area A7 to which label information of "not started" has been assigned, two first photographing location icons to which label information of "being handled" has been assigned, and one first photographing location icon to which label information of "handled" has been assigned.

[0120] (Fifth Example) The display control unit 113 according to the fifth example detects the input of a keyword. Then, the display control unit 113 identifies a keyword-attached area in the first area that includes a first shooting location icon to which comment information including the keyword has been attached to shooting data, and differentiates the display mode of the keyword-attached area from the display mode of the second area.

[0121] Specifically, the display control unit 113 according to the fifth example transmits a predetermined instruction to the information terminal 20, causing a keyword input field (not shown) to be displayed on the display 23 of the information terminal 20. The user then inputs a keyword into the keyword input field via the operation unit 24. The keyword input by the user is acquired by the acquisition unit 111 via the communication unit 13. When the display control unit 113 detects that the acquisition unit 111 has acquired the keyword, it identifies a keyword-associated area. The keyword-associated area refers to a first area including a first photography location icon to which comment information including the keyword is added to photography data. For example, assume that comment information indicating a comment such as "There is a shortage of wood on May 1st. From Worker X of Company A" is added to photography data of the photography location icon 512 included in area A14 shown in FIG. 5 . Here, assume that the user inputs the keyword "Company A" into the keyword input field. In this case, the display control unit 113 identifies area A14 as a keyword-associated area.

[0122] The display control unit 113, having identified the keyword-attached region, instructs the information terminal 20 to change the display mode of the keyword-attached region to a different mode from the display mode of the second region. Specifically, the display control unit 113 makes the display size of the keyword-attached region relatively larger than the display size of the second region. For example, when the display size of the keyword-attached region A14 is Y1 and the display size of the second region A14 is Y2, the display control unit 113 changes the display size of the keyword-attached region so that "Y1 > Y2" holds. In addition, the display control unit 113 may blink the keyword-attached region. For example, suppose that the shooting data of the shooting location icon 512 in region A14 is assigned not only comment information but also label information indicating "addressed." In this case, the display control unit 113 blinks region A14 in green.

[0123] In this way, by displaying the keyword-attached area in a different display mode from the second area, the user can easily grasp the location of the first shooting location icon to which comment information including the keyword entered by the user is attached.

[0124] Furthermore, the display control unit 113 according to the fifth example may change the display mode of the keyword-attached area depending on the number of first shooting location icons (hereinafter referred to as keyword-attached icons) to which comment information including a keyword is attached. For example, the more keyword-attached icons a keyword-attached area includes, the larger the keyword-attached area may be displayed.

[0125] (Sixth Example) The display control unit 113 according to the sixth example displays, on the blueprint, a photography location icon that matches the period entered by the user. If the photography location icon that matches the period entered by the user is a first photography location icon, the display control unit 113 displays the first area including the first photography location icon in a manner different from that of the second area.

[0126] The display control unit 113 according to the sixth example first displays a period input field (not shown) on the display 23. The period input field is an input field for receiving a period specification from the user.

[0127] Here, it is assumed that the user inputs information specifying the period "April 1, 2024 - April 30, 2024" into the period input field. In this case, the display control unit 113 displays on the display 23 the shooting location icons linked to the shooting data taken between April 1, 2024 and April 30, 2024.

[0128] An example will be described using the area A11 shown in FIG. 5 . When the display control unit 113 detects that the user has input information specifying a period, it checks the shooting date and time assigned to the shooting data of the shooting location icons included in area A11. For example, it is assumed that the shooting data of shooting location icon 513 included in area A11 is assigned information indicating that the photo was taken on April 1, 2024. It is also assumed that the shooting data of shooting location icon 514 in area A11 is assigned information indicating that the photo was taken on May 1, 2024. It is also assumed that the shooting data of shooting location icon 515 in area A11 is assigned information indicating that the photo was taken on June 1, 2024. In this case, the display control unit 113 displays only the shooting location icon 513 in area A11. On the other hand, it does not display the shooting location icons 514 and 515 in area A11.

[0129] Here, if the photographing location icon 513 is the first photographing location icon, the display control unit 113 treats the area A11 as the first area. Then, the display control unit 113 makes the display mode of the area A11 (first area) different from that of the second area. For example, if the photographing data of the photographing location icon 513 is assigned label information indicating "not started," the display control unit 113 displays the area A11 in red.

[0130] Furthermore, suppose that the user inputs information specifying the period "May 1, 2024 - May 31, 2024" into the period input field. In this case, the display control unit 113 displays in the area A11 the shooting location icon 514 linked to the shooting data taken on May 1. Here, it is assumed that the shooting data of the shooting location icon 514 is given label information indicating "in progress." In this case, the display control unit 113 displays the area A11 in yellow, for example.

[0131] Also, suppose that the user inputs information specifying the period "June 1, 2024 - June 30, 2024" into the period input field. In this case, the display control unit 113 displays in the area A11 the shooting location icon 515 linked to the shooting data taken on June 1. Here, it is assumed that the shooting data of the shooting location icon 515 has been assigned label information indicating "addressed." In this case, the display control unit 113 displays the area A11 in green, for example.

[0132] In this way, the user can intuitively understand the progress of work at the construction site. In the previous example, the user can intuitively understand that the worker started work in area A11 in April 2024, that the work was ongoing as of May 2024, and that the work was completed in June 2024.

[0133] If the user inputs information specifying the period "July 1, 2024 - July 31, 2024" in the period input field, the display control unit 113 does not display a shooting location icon in the area A11. In this case, the display control unit 113 treats the area A11 as the second area.

[0134] Furthermore, a single photography location icon may be linked to multiple pieces of photography data taken at different photography dates and times. For example, the photography location icon 516 shown in area A8 is linked to first photography data, second photography data, and third photography data. The first photography data is data taken on April 1st at the photography location indicated by the photography location icon 516. The second photography data is data taken on May 1st at the photography location indicated by the photography location icon 516. The third photography data is data taken on June 1st at the photography location indicated by the photography location icon 516. The first photography data is assigned label information indicating a status of "not started," the second photography data is assigned label information indicating a status of "in progress," and the third photography data is assigned label information indicating a status of "completed."

[0135] Here, suppose that the user inputs information specifying the period "April 1, 2024 - April 30, 2024" into the period input field. In this case, the display control unit 113 displays area A8, which is an area including the shooting location icon 516, in green based on the first shooting data among the shooting data linked to the shooting location icon 516. Furthermore, if the user inputs information specifying the period "May 1, 2024 - May 31, 2024" into the period input field, the display control unit 113 displays area A8 in yellow. Furthermore, if the user inputs information specifying the period "June 1, 2024 - June 30, 2024," the display control unit 113 displays area A8 in red.

[0136] (Seventh Example) The display control unit 113 according to the seventh example instructs the information terminal 20 to make the display mode of the first image capture location icon different from the display mode of the second image capture location icon. For example, the display control unit 113 instructs the information terminal 20 to make the color of the first image capture location icon different from the color of the second image capture location icon. Alternatively, the display control unit 113 instructs the information terminal 20 to configure the first image capture location icon with a rectangular image and the second image capture location icon with a circular image. Alternatively, the display control unit 113 may make the first image capture location icon different from the second image capture location icon by any appropriate method.

[0137] The display methods according to the first to seventh examples described above are merely examples. The display control unit 113 may display the first area on the display 23 in a manner different from that of the second area using a method different from the display methods according to the first to seventh examples. Furthermore, the display methods according to the first to seventh examples described above may be combined as appropriate.

[0138] According to the information processing system 1 described above, the first area including the first photographing location icon can be displayed on the display 23 in a different manner from the second area not including the first photographing location icon. In other words, the first area including the first photographing location icon, which is a photographing location icon to which annotation information has been added to the photographing data, can be made to stand out. This makes it possible to clarify the location of the photographing location icon to which annotation information has been added to the photographing data. As a result, there is no need to input an operation into the server 10 or the like to search for the photographing location icon to which annotation information has been added to the photographing data, which prevents an increase in the processing steps of the server 10 or the like. This prevents an increase in the burden on the server 10 or the like.

[0139] The present disclosure can employ the following modifications.

[0140] (1) The processes in steps S2 and S3 in Fig. 3 are not essential. Also, the processes in steps S4 and S5 in Fig. 3 are not essential.

[0141] (2) The display control unit 113 may execute the processes of steps S4 and S5 in FIG. 3 to make the display of the first area different from that of the second area.

[0142] (3) The blueprint may include floor plan information indicating the shapes of each of the spaces included in the building. When the display control unit 113 detects that the blueprint has been enlarged or reduced, the display control unit 113 may set a boundary line L on the blueprint that follows the shapes of each of the spaces based on the floor plan information.

[0143] Lines indicating walls of a building (an example of floor plan information) may be drawn on the blueprint. For example, lines indicating partition walls separating one room from another, or lines indicating partition walls separating a room from a hallway, may be drawn on the blueprint. When lines indicating walls are drawn on the blueprint and the magnification of the blueprint is set to a predetermined magnification (e.g., 50%), the display control unit 113 may set a boundary line L along the lines indicating the walls. FIG. 8 is a diagram showing an example of a display screen 403 displayed on the display 23 in this modified example. In the example shown in FIG. 8, boundary lines L are set along the partition walls between rooms R1 and R2, between room R1 and hallway H1, and the like.

[0144] According to this modification, the display control unit 113 can change the display mode for each space, such as a room or a hallway, in a building. For example, if the image capture data of a specific image capture location icon in room R2 is labeled "not started," the display control unit 113 displays room R2 in red. Furthermore, if the image capture data of a specific image capture location icon in room R3 is labeled "completed," the display control unit 113 displays room R3 in green. Furthermore, with regard to a second area such as room R1, the display control unit 113 does not particularly change the display mode. In this way, the user can easily grasp the status of each space in the building, for example, the progress of a specific task in each space, for each space.

[0145] Furthermore, the display control unit 113 according to this modification may set additional boundaries within each region to further divide the regions into smaller areas. In this case, the display control unit 113 may set additional boundaries so that each region is divided into a plurality of areas having similar shapes to the respective regions.

[0146] (4) The display control unit 113 may divide the blueprint into sections by function. For example, the blueprint may be divided into a plurality of areas, such as a conference room area, a living room area, and an elevator area.

[0147] In detail, functional information indicating the functions of each of a plurality of spaces in the building is linked to the blueprint according to this modification. For example, information indicating that a certain space described on the blueprint has the function of a "conference room," that another space described on the blueprint has the function of a "corridor (passageway)," that yet another space described on the blueprint has the function of a "living room," and that yet another space described on the blueprint has the function of an "elevator" are linked to the blueprint.

[0148] When the display control unit 113 according to this modification detects that the blueprint has been enlarged or reduced, it sets boundary lines L on the blueprint so that the blueprint is divided into sections for each function of a plurality of spaces. For example, when the enlargement rate of the blueprint is set to a predetermined rate, the display control unit 113 sets boundary lines L so that spaces having the functions of a conference room are displayed together as a conference room area, spaces having the functions of a hallway are displayed together as a hallway area, spaces having the functions of a living room are displayed together as a living room area, and spaces having the functions of an elevator are displayed together as an elevator area.

[0149] In this way, the blueprint is divided into areas based on the function of each space in the building, allowing the user to easily grasp the progress of work in each area, etc.

[0150] (5) When the magnification rate of the blueprint is set to a predetermined magnification rate (for example, a magnification rate of 30%), the display control unit 113 may draw boundary lines L so that the blueprint is divided into four areas (regions), such as an east area, a west area, a south area, and a north area.

[0151] (6) In the first embodiment, an example in which the blueprint 200 is stored in the blueprint information storage unit 121 has been described. However, the blueprints stored in the blueprint information storage unit 121 are not limited to the blueprint 200. The blueprint information storage unit 121 may store blueprints including a first floor map corresponding to a first floor of the building and a second floor map corresponding to a second floor of the building. The first floor map may be, for example, a floor plan showing the layout of the first floor of the building. The second floor map may be, for example, a floor plan showing the layout of the second floor of the building. In other words, the blueprint may be image data displaying a list of floor maps of the first floor and the second floor of the building. The display control unit 113 may display multiple image capture location icons on each of the first and second floor maps. The first and second floor maps may treat the floor map including the first image capture location icon as a first area and the floor map not including the first image capture location icon as a second area, and the display of the first area may be different from the second area.

[0152] (7) The blueprint may display a map (an example of a bird's-eye view) on the display 23. The map is an area map showing the locations of buildings, facilities, and the like. The display control unit 113 may display grid lines on the map to divide the map into multiple regions. The display control unit 113 may display multiple photography location icons on the map. The display control unit 113 may display a first region, of the multiple regions on the map, that includes a first photography location icon in a different manner from a second region that does not include the first photography location icon.

[0153] (8) The display control unit 113 may display guidance information on the display 23 when the magnification ratio specified by the user is equal to or greater than the reference magnification ratio.

[0154] The display control unit 113 according to this modification first detects that the user has input an operation to enlarge the blueprint. Next, the display control unit 113 displays the blueprint, set to the user-specified magnification, on the display 23. Hereinafter, a portion of the entire blueprint that is displayed on the display 23 based on the user's enlargement operation will be referred to as the first range RA1 ( FIG. 9 ). Furthermore, the entire blueprint, except for the first range RA1, will be referred to as the second range. In other words, the portion of the entire blueprint that is displayed on the display 23 will be referred to as the first range RA1, and the portion that is not displayed on the display 23 (the portion outside the display screen) will be referred to as the second range.

[0155] Next, the display control unit 113 determines whether the magnification ratio of the blueprint specified by the user is equal to or greater than the reference magnification ratio. If the magnification ratio specified by the user is equal to or greater than the reference magnification ratio, the display control unit 113 identifies the position of the first range RA1. Specifically, it acquires position information of the first range RA1 on the blueprint 200. The position information of the first range RA1 on the blueprint 200 includes coordinate values ​​on the blueprint 200 of key points (e.g., four corners) of the first range RA1. Next, the display control unit 113 identifies the positions and number of first photographing location icons included in the second range. Specifically, it acquires position information (coordinate values) and the number of first photographing location icons present in the second range on the blueprint 200. At this time, the display control unit 113 acquires the relative positional relationship between the position on the blueprint of the first photographing location icon present in the second range and the position on the blueprint 200 of the first range RA1 for each first photographing location icon present in the second range. Next, the display control unit 113 displays on the display 23 guidance information indicating the position and number on the blueprint of each of the first photographing location icons included in the second range.

[0156] 9 is a diagram showing an example of a display screen 404 displayed on the display 23 in this modified example. As shown in FIG. 9, the display screen 404 includes a first range display field C1 and a guidance information display field C2. The first range display field C1 displays the first range RA1. The guidance information display field C2 displays guidance information. The guidance information display field C2 in this modified example includes 12 squares arranged around the first range display field C1.

[0157] Assume that the display control unit 113 has determined that one first shooting location icon exists in a portion of the second range located to the upper left of the first range RA1. In this case, the display control unit 113 displays the number "1" in the square C21 located to the upper left of the first range display field C1 on the display screen 404.

[0158] Also, assume that the display control unit 113 has determined that there are three first shooting location icons in the portion of the second range located to the lower left of the first range RA1. In this case, the display control unit 113 displays the number "3" in the square C22 located to the lower left of the first range display field C1 on the display screen 404.

[0159] Also, suppose that there are two first shooting location icons in the second range located to the lower right of the first range RA1. In this case, the display control unit 113 displays the number "2" in the square C23 located to the lower right of the first range display field C1 on the display screen 404.

[0160] In addition, the display control unit 113 may change the color and display size of the squares contained in the guidance information display field C2 based on the content of the annotation information attached to the shooting data of the first shooting location icon (such as the type of label information and the content of the comment included in the comment information) and the total number of first shooting location icons.

[0161] According to the configuration of this modification, when the first range RA1 of the design plan 200 is displayed on the display screen 404, it is possible to present to the user guidance information indicating the positions and number of first photographing location icons that exist outside the display screen (second range). In this way, the user can easily grasp the positions and number of first icons that exist outside the display screen.

[0162] If the magnification ratio of the design drawing specified by the user is less than the reference magnification ratio, the display control unit 113 does not display the guidance information on the display 23 .

[0163] The technology according to the present disclosure is useful in the technical field of displaying images on a display.

Claims

1. An information processing method on a computer, comprising: displaying on a display a bird's-eye view on which a plurality of photographing location icons are superimposed; each of the plurality of photographing location icons is linked to photographing data taken at a photographing location corresponding to the plurality of photographing location icons, and the photographing data linked to at least one first photographing location icon included in the plurality of photographing location icons is given annotation information; dividing the bird's-eye view into a plurality of areas; and displaying on the display a first area of ​​the plurality of areas that includes the first photographing location icon in a manner different from a second area of ​​the plurality of areas that does not include the first photographing location icon.

2. The information processing method according to claim 1, further comprising detecting an enlargement or reduction of the bird's-eye view, and displaying the first area on the display in a manner different from that of the second area in response to the detection of the enlargement or reduction of the bird's-eye view.

3. An information processing method as described in claim 1 or 2, wherein displaying the first area on the display in a manner different from that of the second area includes changing the display manner of the first area based on the number of first shooting location icons contained in the first area.

4. An information processing method as described in claim 1 or 2, wherein displaying the first area on the display in a manner different from that of the second area includes displaying a total number of the first shooting location icons in the first area.

5. The information processing method of claim 1 or 2, wherein the annotation information includes label information indicating a status of a subject related to the shooting data, and displaying the first area on the display in a manner different from that of the second area includes displaying the first area in a manner different from that of the second area for each type of label information assigned to the shooting data of the first shooting location icon.

6. The information processing method of claim 1 or 2, wherein the annotation information includes comment information indicating a comment added to the shooting data, and further includes detecting input of a keyword, and displaying the first area on the display in a manner different from that of the second area includes: identifying a keyword-attached area in the first area that includes the first shooting location icon in which comment information including the keyword is added to the shooting data, and making the display manner of the keyword-attached area different from that of the second area.

7. The information processing method of claim 1, wherein displaying the first area on the display in a manner different from that of the second area includes making the display manner of the first photographing location icon different from the display manner of at least one second photographing location icon included in the multiple photographing location icons, the second photographing location icon having no annotation information added to the photographing data.

8. The information processing method of claim 7, further comprising: detecting an enlargement or reduction of the bird's-eye view; and determining whether or not the degree of overlap between the first photographing location icon and the second photographing location icon is equal to or greater than a reference degree of overlap in response to the detection of the enlargement or reduction of the bird's-eye view; and displaying the first area on the display in a manner different from that of the second area includes, when the degree of overlap between the first photographing location icon and the second photographing location icon is equal to or greater than the reference degree of overlap, making the display manner of the first photographing location icon different from the display manner of the second photographing location icon.

9. The information processing method according to claim 1 or 2, wherein dividing the bird's-eye view into the plurality of regions includes setting grid-like boundaries on the bird's-eye view.

10. The information processing method of claim 1, wherein the bird's-eye view includes floor plan information indicating the shapes of each of a plurality of spaces contained in a building, and further includes detecting an enlargement or reduction of the bird's-eye view, and dividing the bird's-eye view into a plurality of regions includes setting boundaries on the bird's-eye view that have a shape that follows the shapes of each of the plurality of spaces based on the floor plan information in response to the detection of the enlargement or reduction of the bird's-eye view.

11. The information processing method of claim 1, wherein the bird's-eye view is linked to functional information indicating the function of each of a plurality of spaces in a building, and further includes detecting an enlargement or reduction of the bird's-eye view, and dividing the bird's-eye view into a plurality of regions includes setting boundaries on the bird's-eye view so that the bird's-eye view is divided according to the function of the plurality of spaces in response to the detection of the enlargement or reduction of the bird's-eye view.

12. The information processing method of claim 1 or 2, wherein the bird's-eye view includes a first floor map corresponding to a first floor included in a building and a second floor map corresponding to a second floor different from the first floor included in the building, and displaying the first area on the display in a manner different from that of the second area includes displaying, of the first floor map and the second floor map, a floor map including the first shooting location icon on the display in a manner different from that of a floor map not including the first shooting location icon.

13. An information processing method according to claim 1 or 2, further comprising: detecting an enlargement of the bird's-eye view; when detecting an enlargement of the bird's-eye view, determining whether or not the magnification rate is equal to or greater than a reference magnification rate; when the magnification rate is equal to or greater than the reference magnification rate, identifying a position of a first range of the bird's-eye view displayed on the display and the positions and number of the first shooting location icons included in a second range of the bird's-eye view not displayed on the display; and displaying on the display, together with the first range, guidance information indicating the positions and number of the first shooting location icons included in the second range.

14. An information processing device including a processor, the processor performing the following operations on the display: displaying a bird's-eye view on which a plurality of shooting location icons are superimposed; each of the plurality of shooting location icons is linked to shooting data taken at a shooting location corresponding to the plurality of shooting location icons, and the shooting data linked to at least one first shooting location icon included in the plurality of shooting location icons is given annotation information; dividing the bird's-eye view into a plurality of areas; and displaying on the display a first area of ​​the plurality of areas that includes the first shooting location icon in a manner different from a second area of ​​the plurality of areas that does not include the first shooting location icon.

15. An information processing program that causes a computer to execute the following steps: display a bird's-eye view on a display with multiple shooting location icons superimposed thereon; each of the multiple shooting location icons is linked to shooting data taken at a shooting location corresponding to the multiple shooting location icons, and the shooting data linked to at least one first shooting location icon included in the multiple shooting location icons is given annotation information; divide the bird's-eye view into a plurality of areas; and display on the display a first area of ​​the multiple areas that includes the first shooting location icon in a manner different from a second area of ​​the multiple areas that does not include the first shooting location icon.

Images