Information processing method, information processing device, and information processing program

Abstract

The information processing method is an information processing method in a computer, and includes: displaying, on a display, a bird's-eye view in which a plurality of imaging point icons are superimposed, each of the plurality of imaging point icons being associated with imaging data captured at an imaging point corresponding to the plurality of imaging point icons, and each of the plurality of imaging point icons being associated with imaging data captured at an imaging point corresponding to the plurality of imaging point icons; annotation information is given to the photographing data associated with at least one first photographing site icon included in the plurality of photographing site icons; dividing the aerial view into a plurality of areas; and displaying, on the display, a first region including the first imaging site icon among the plurality of regions so as to be different from a second region not including the first imaging site icon among the plurality of regions.

Description

Technical Field

[0001] This disclosure relates to techniques for changing the way images displayed on a monitor are displayed. Background Technology

[0002] Patent Document 1 discloses a display device comprising an image display unit, a map display unit, and a modification unit. The image display unit displays an image in the image display area of ​​the display screen. The map display unit displays a map in the map display area of ​​the display screen. The modification unit modifies the map's scale such that the more images are captured per unit area near the image capture position of the image displayed in the image display area, the larger the scale of the map displayed in the map display area.

[0003] In the technology described in Patent Document 1, the location of the shooting location icon associated with the image data with annotation information cannot be clearly identified. Therefore, in order to determine the location of the shooting location icon associated with the image data with annotation information, the computer processing steps increase, and the computer's workload increases.

[0004] Prior art literature

[0005] Patent documents

[0006] Patent Document 1: Japanese Patent Application Publication No. 2009-237243 Summary of the Invention

[0007] This disclosure is made based on the aforementioned issues, and its purpose is to provide a technique for reducing the increased computer load by clearly defining the location of the shooting location icon with annotation information.

[0008] One aspect of this disclosure relates to an information processing method in a computer, comprising: displaying a bird's-eye view on a display screen with multiple overlapping shooting location icons, wherein each of the multiple shooting location icons is associated with shooting data taken at a shooting location corresponding to the multiple shooting location icons, and the shooting data associated with at least one first shooting location icon included in the multiple shooting location icons is given annotation information; dividing the bird's-eye view into multiple regions; and displaying a first region among the multiple regions, including the first shooting location icon, in a manner different from a second region among the multiple regions, excluding the first shooting location icon, on the display screen.

[0009] According to this disclosure, the location of the shooting location icon with annotation information can be clearly identified. Therefore, it is possible to reduce the increase in computer load. Attached Figure Description

[0010] Figure 1This is a block diagram illustrating an example of the overall structure of the information processing system in this embodiment.

[0011] Figure 2 This is a block diagram illustrating another example of the overall structure of an information processing system.

[0012] Figure 3 This is a flowchart illustrating an example of a processing flow performed in an information processing system.

[0013] Figure 4 This is an example of an information terminal displaying a screen on a monitor.

[0014] Figure 5 This diagram illustrates an example of an information terminal receiving an operation to reduce the size of the design drawing and displaying it on a monitor.

[0015] Figure 6 This indicates that the information terminal has received the specified message. Figure 2 The image shown is displayed on the monitor when the area V is magnified.

[0016] Figure 7 This is an example diagram showing a status icon.

[0017] Figure 8 This is a diagram showing an example of a display screen shown on a monitor in variant example (3).

[0018] Figure 9 This is a diagram showing an example of a display screen shown on a monitor in variant example (8). Detailed Implementation

[0019] (The understanding that forms the basis of this disclosure)

[0020] The following user interface is being developed: On a two-dimensional design drawing of a construction site, multiple camera location icons are displayed, representing the actual locations where photos were taken. When a camera location icon is selected, an image taken at that location is displayed. This allows construction site managers to monitor the construction site's condition without physically visiting the site.

[0021] In the user interface described above, annotation information is sometimes assigned to shooting data associated with at least one of multiple shooting location icons. However, when multiple shooting location icons are displayed on the design, it is not easy for the user to determine which icon's shooting data has been annotated. In this case, the user sometimes needs to input an operation into the computer to find the shooting location icon with the annotated information. This increases the number of processing steps for the computer, resulting in a greater computer load.

[0022] Such a problem is difficult to solve using the technology described in Patent Document 1. Patent Document 1 only discloses a technology for increasing the map scale based on the number of images taken per unit area, but does not disclose a technology for clearly identifying the location icons of the shooting locations that have been annotated in the shooting data.

[0023] To address the above problems, the following technology has been disclosed.

[0024] (1) An information processing method in one aspect of the present disclosure is an information processing method in a computer, comprising: displaying a bird's-eye view on a display with multiple shooting location icons superimposed, wherein each of the multiple shooting location icons is associated with shooting data taken at a shooting location corresponding to the multiple shooting location icons, and the shooting data associated with at least one first shooting location icon included in the multiple shooting location icons is given annotation information; dividing the bird's-eye view into multiple regions; and displaying a first region among the multiple regions that includes the first shooting location icon in a manner different from a second region among the multiple regions that does not include the first shooting location icon on the display.

[0025] According to this structure, the first area, including the first shooting location icon, can be displayed on the screen in a different manner than the second area, which does not include the first shooting location icon. In other words, the first area, including the shooting location icon with annotation information for the shooting data (i.e., the first shooting location icon), can be made prominent. This clarifies the location of the shooting location icon with annotation information for the shooting data. Since it is not necessary to input the operation of finding the shooting location icon with annotation information for the shooting data into the computer, the increase in computer processing steps can be reduced. As a result, the increase in computer load can be reduced.

[0026] (2) In the information processing method described in (1) above, the information processing method may also include: detecting the zoom in or zoom out of the bird's-eye view, and displaying the first region on the display in a manner different from that of the second region based on the detection of the zoom in or zoom out of the bird's-eye view.

[0027] Based on this structure, the display method of the first area can be different from that of the second area by using the zooming in or zooming out of the bird's-eye view as a trigger.

[0028] (3) In the information processing method described in (1) or (2) above, displaying the first area in a manner different from that of the second area on the display may also include: changing the display mode of the first area based on the number of the first shooting location icons included in the first area.

[0029] Based on this structure, the display method of the first area varies according to the number of icons representing the first shooting location. Thus, for example, the display method of the first area differs depending on whether it includes a large number of icons representing the first shooting location or a small number of icons representing the first shooting location. Therefore, it allows the user to understand the number of icons representing the first shooting location included in the first area.

[0030] (4) In any of the information processing methods described in (1) to (3) above, displaying the first area in a manner different from that of the second area on the display may include: displaying the total number of the first shooting location icons in the first area.

[0031] Based on this structure, users can clearly understand the total number of the first shooting location icons included in the first area.

[0032] (5) In any of the information processing methods described in (1) to (4) above, the annotation information may include label information indicating the state of the subject related to the shooting data, and displaying the first area in a different manner than the second area on the display includes: displaying the first area in a different manner according to each type of the label information assigned to the shooting data of the first shooting location icon.

[0033] According to this structure, since the display method of the first area varies depending on the type of label information assigned to the shooting data of the first shooting location icon, it is possible for users to easily understand the type of label information assigned to the shooting data of the first shooting location icon.

[0034] (6) In any of the information processing methods described in (1) to (5) above, the annotation information may include comment information representing comments assigned to the shooting data, and the information processing method may further include: detecting the input of keywords, and displaying the first area in a manner different from that of the second area on the display, including: determining a region with keywords in the first area, the region with keywords including the first shooting location icon that assigns comment information including the keywords to the shooting data; and making the display mode of the region with keywords different from that of the second area.

[0035] Based on this structure, the location of the first shooting location icon in the shooting data can be clearly identified by assigning comment information including keywords to the shooting data.

[0036] (7) In any of the information processing methods described in (1) to (6) above, displaying the first area in a manner different from that of the second area on the display may include: displaying the first shooting location icon in a manner different from that of at least one second shooting location icon included in the plurality of shooting location icons and the second shooting location icon for which the annotation information is not assigned to the shooting data.

[0037] According to this structure, the display methods of the first shooting location icon, which has annotation information assigned to the shooting data, and the second shooting location icon, which does not have annotation information assigned to the shooting data, can be different. Therefore, it is possible to clearly identify which of the multiple shooting location icons displayed on the screen has annotation information assigned to it.

[0038] (8) In the information processing method described in (7) above, the information processing method may also include: detecting the zoom in or zoom out of the bird's-eye view; and determining whether the overlap between the first shooting location icon and the second shooting location icon is greater than or equal to a reference overlap based on the detection of the zoom in or zoom out of the bird's-eye view, and displaying the first area in a manner different from that of the second area on the display, including: when the overlap between the first shooting location icon and the second shooting location icon is greater than or equal to the reference overlap, making the display mode of the first shooting location icon different from that of the second shooting location icon.

[0039] If the overlap between the first and second location icons is greater than the baseline overlap, there is concern that the visual recognizability of the first location icon may be reduced.

[0040] In response, based on the above structure, when the overlap is greater than the baseline overlap, the first shooting location icon is displayed on the screen in a different way than the second shooting location icon, thus making the location of the first shooting location icon clearer.

[0041] (9) In any of the information processing methods described in (1) to (8) above, dividing the bird's-eye view into the plurality of regions may also include: setting grid-shaped boundary lines for the bird's-eye view.

[0042] According to this structure, since the bird's-eye view is divided into multiple regions by grid-like boundary lines, the shape of each region can be set to a simple shape. Therefore, compared to setting the shapes of each region to complex shapes, the visual recognizability of the bird's-eye view is improved. As a result, the location of the first shooting location icon is more clearly defined.

[0043] (10) In any of the information processing methods described in (1) to (9) above, the bird's-eye view may include layout information representing the shapes of the multiple spaces included in the building, and the information processing method may further include: detecting the zoom-in or zoom-out of the bird's-eye view, and dividing the bird's-eye view into the multiple regions includes: based on the detection of the zoom-in or zoom-out of the bird's-eye view, setting the boundary lines of the shapes along the shapes of the multiple spaces in the bird's-eye view based on the layout information.

[0044] Based on this structure and layout information, the boundary lines of the shapes of the various spaces within the building are set in the bird's-eye view. Thus, the various spaces within the building correspond to various areas on the design drawings. By displaying the first area in a different manner than the second area in this state, it becomes clear which space within the building contains the icon for the first shooting location.

[0045] (11) In any of the information processing methods described in (1) to (10) above, the bird's-eye view may also include functional information representing the functions of multiple spaces of a building. The information processing method further includes: detecting the zoom-in or zoom-out of the bird's-eye view and dividing the bird's-eye view into multiple regions by: setting boundary lines in the bird's-eye view based on the detection of the zoom-in or zoom-out of the bird's-eye view, such that the bird's-eye view is divided according to each function of the multiple spaces.

[0046] According to this structure, since the design drawing is divided into multiple areas according to the functions of the multiple spaces in the building, the function of the area with the first shooting location icon can be clearly defined.

[0047] (12) In any of the information processing methods described in (1) to (11) above, the bird's-eye view may include: a first floor plan corresponding to the first floor of the building and a second floor plan corresponding to a second floor of the building that is different from the first floor. Displaying the first area in a manner different from the second area on the display includes: displaying the floor plan that includes the first shooting location icon in the first floor plan and the second floor plan in a manner different from the floor plan that does not include the first shooting location icon on the display.

[0048] Based on this structure, it is possible to clearly identify which floor of the building will have the first shooting location icon.

[0049] (13) In any of the information processing methods described in (1) to (12) above, the information processing method may further include: detecting the magnification of the bird's-eye view; when the magnification of the bird's-eye view is detected, determining whether the magnification rate is greater than or equal to a reference magnification rate; when the magnification rate is greater than or equal to the reference magnification rate, determining the position of the first shooting location icon displayed in the first range of the bird's-eye view on the display, and the position and number of the first shooting location icon not displayed in the second range of the bird's-eye view included in the display; and displaying guidance information indicating the position and number of the first shooting location icon included in the second range together with the first range on the display.

[0050] According to this structure, when the first area of ​​the design drawing is displayed on the monitor, guidance information indicating the location and number of the first shooting location icons that exist outside the display screen (the second area of ​​the design drawing) can be provided to the user. In this way, the user can easily grasp the location and number of the first icons that exist outside the display screen.

[0051] Furthermore, this disclosure can be implemented not only as an information processing method that performs the characteristic processes described above, but also as an information processing apparatus having a characteristic structure corresponding to the characteristic processes performed by the information processing method. Additionally, it can be implemented as a computer program that causes a computer to execute the characteristic processes included in such an information processing method. Therefore, the following other methods can also achieve the same effect as the information processing method described above.

[0052] (14) Another aspect of the information processing apparatus involved in this disclosure includes a processor that performs the following processing: displaying a bird's-eye view on a display with multiple shooting location icons superimposed, wherein each of the multiple shooting location icons is associated with shooting data taken at a shooting location corresponding to the multiple shooting location icons, and the shooting data associated with at least one first shooting location icon included in the multiple shooting location icons is given annotation information; dividing the bird's-eye view into multiple regions; and displaying a first region among the multiple regions that includes the first shooting location icon in a manner different from a second region among the multiple regions that does not include the first shooting location icon on the display.

[0053] (15) The information processing program involved in another aspect of this disclosure causes a computer to perform the following processing: displaying a bird's-eye view on a display with multiple shooting location icons superimposed, wherein, in each of the multiple shooting location icons, shooting data taken at a shooting location corresponding to the multiple shooting location icons is associated, and the shooting data associated with at least one first shooting location icon included in the multiple shooting location icons is given annotation information; dividing the bird's-eye view into multiple regions; and displaying a first region among the multiple regions that includes the first shooting location icon in a manner different from a second region among the multiple regions that does not include the first shooting location icon on the display.

[0054] This disclosure can also be implemented as an information processing system operating according to such an information processing program. Furthermore, it is of course possible to distribute such a program via a non-transitory recording medium such as a computer-readable CD-ROM or a communication network such as the Internet.

[0055] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Furthermore, the embodiments described below represent specific examples of the present disclosure. The numerical values, shapes, constituent elements, steps, and order of steps shown in the following embodiments are examples and are not intended to limit the present disclosure. Additionally, constituent elements in the following embodiments that are not described as independent technical solutions representing the highest-level concept are described as arbitrary constituent elements. Furthermore, various elements can be combined in all embodiments.

[0056] (Implementation Method 1)

[0057] Figure 1 This is a block diagram illustrating an example of the overall structure of the information processing system 1 in this embodiment. The information processing system 1 includes: a server 10, an information terminal 20, and a camera 30.

[0058] Server 10 is an example of an information processing device and a computer. Server 10, information terminal 20, and imaging device 30 are communicatively connected to each other via a network NT. An example of network NT is the Internet. Server 10 is, for example, a cloud server composed of one or more computers. However, this is just one example; server 10 can also be composed of an edge server or installed on information terminal 20. The way server 10 is installed on information terminal 20 is an example of the way information terminal 20 is composed of an information processing device.

[0059] Information terminal 20 is a user-operated terminal. The user, for example, is a manager of a given space captured by camera device 30. The given space is, for example, a construction site of a building. However, this is just one example; the given space could also be a construction site, factory, shop, or office space, etc. Information terminal 20 can be, for example, a portable computer such as a smartphone or tablet, or a fixed-position computer. Figure 1 The example diagram shows one information terminal 20, but multiple information terminals can be connected to the server 10 via a network NT. The information terminal 20 includes a communication unit 21, a processor 22, a display 23, and an operation unit 24.

[0060] Figure 2 This is another block diagram illustrating the overall structure of information processing system 1. For example... Figure 2 As shown, the information processing system 1 may also include a PC 50 connected to a network NT. The PC 50 is an information processing terminal located in a non-site location, such as an office in a location far from the site. The PC 50 can be composed of various information processing terminals, such as a fixed-position personal computer, a laptop computer, a smartphone, or a tablet computer. (See design diagram 200 described later.) Figure 4 , Figure 5 It can also be displayed on a monitor (not shown) that is set in or connected to the PC50.

[0061] The communication unit 21 is the communication interface that connects the information terminal 20 to the network NT. The communication unit 21 sends signals representing various instructions received by the operation unit 24 from the user to the server 10.

[0062] Processor 22, for example, a CPU (Central Processing Unit), displays the design drawings of a given space sent from server 10 on display 23. The design drawing is an example of a bird's-eye view. A design drawing is a drawing representing the design of a construction site. Specifically, a design drawing is a bird's-eye view of a building including columns, walls, or materials. A bird's-eye view can be a view from above or a view taken from a high vantage point. A design drawing can also be a top view, blueprint, map, or perspective view of the construction site.

[0063] The display 23 is composed of various display devices such as liquid crystal displays and organic EL displays, and displays various display screens under the control of the processor 22.

[0064] The operation unit 24 may consist of, for example, a keyboard, a touch panel, and a mouse. The user operates the operation unit 24 to input various instructions into the information terminal 20.

[0065] The shooting device 30 is, for example, a wide-angle camera that captures shooting data (images) at a given frame rate. A wide-angle camera, also known as a 360-degree camera, is a camera capable of acquiring shooting data from all 360 degrees. The shooting device 30 is, for example, a portable shooting device held by a person. The person capturing the data may be, for example, a construction worker or site supervisor. Alternatively, the shooting device 30 may also be a conventional camera. The shooting device 30 includes an image sensor, an operating device, communication circuitry, signal processing circuitry, etc. The shooting device 30 may also be a portable computer such as a smartphone or tablet computer. The shooting device 30 has a communication unit 40. The communication unit 40 communicatively connects the information terminal 20 and the shooting device 30 via a near-field wireless communication path such as Bluetooth (registered trademark) or wireless LAN.

[0066] The photographer downloads the site design from server 10 to information terminal 20 and displays it on the information terminal 20. The information terminal 20 and the shooting device 30 are connected via wireless LAN or similar means. A shooting start button is then displayed on the information terminal 20. The photographer, with the shooting device 30 facing a given direction, presses the shooting start button to begin shooting. The given direction is used to align the shooting device 30 with the design displayed on the monitor 23. Figure 1 The direction is given, for example, north, but is not limited to this. The photographer moves around the location while taking pictures based on the shooting device 30. This generates multiple sets of shooting data (image data). When the photographer reaches the end point of the shooting, they press the end-of-shoot button displayed on the information terminal 20. At this time, the photographer touches the design diagram displayed on the information terminal 20 to indicate the end point of the shooting on the design diagram. Alternatively, when starting shooting based on the shooting device 30, the photographer can also touch the design diagram displayed on the information terminal 20 to specify the start point of the shooting. When the photographer indicates the end point of the shooting, the transmission of multiple sets of shooting data from the shooting device 30 to the information terminal 20 begins. The transmitted multiple sets of shooting data are temporarily stored in the information terminal 20. The multiple sets of shooting data stored in the information terminal 20 are uploaded to the server 10 by the photographer operating the information terminal 20.

[0067] When server 10 acquires multiple shooting data from information terminal 20, it analyzes the positional information of each shooting data on the design map using Visual SLAM (Simultaneous Localization and Mapping) technology, based on the shooting start location, shooting end location, and multiple shooting data, and assigns positional information (associations) to each shooting data on the design map. The design map defines two-dimensional coordinate axes. Therefore, the positional information of each shooting data on the design map is defined by two-dimensional coordinate values. Based on the positional information of each shooting data on the design map, server 10 overlaps the shooting location icons representing the shooting locations of each shooting data with the design map. This generates a design map with multiple overlapping shooting location icons. This series of processes is performed, for example, by the acquisition unit 111 of server 10, described later.

[0068] On-site personnel can periodically display the design drawing generated by server 10 on information terminal 20. Specifically, information terminal 20 displays a design drawing with multiple overlapping shooting location icons. Furthermore, by specifying a particular shooting location icon (e.g., by touching it), shooting data can be retrieved and displayed. Additionally, annotation information can be added to the shooting data.

[0069] Annotation information is a type of metadata assigned to captured data. In this embodiment, the annotation information includes comment information and tag information. One or both of the comment information and tag information are assigned to the captured data.

[0070] Comment information is text (strings) assigned to given photographic data by workers performing a given task on-site. For example, a worker might assign the text "April 1st, work begins. From Worker X of Company A" to given photographic data. This text is comment information. The comment information assigned to the photographic data by workers is stored in the image information storage unit 122 of memory 12 in a state associated with the photographic data. Furthermore, not only workers, but also on-site supervisors and other personnel at the construction site can assign comment information to the photographic data.

[0071] The tag information indicates the status of the construction site (an example of the subject) related to the captured data. The tag information in this embodiment includes three categories: "Not Under Work," "In Process," and "Processed." Workers assign appropriate category tags to the captured data based on the status of the construction site as captured in the data.

[0072] Specifically, workers assign category labels based on the progress of a given task at the construction site as captured in the photographic data. For example, for photographic data showing a construction site where workers have not yet started work, the workers assign the category label "Not Started." Conversely, for photographic data showing a construction site where work is in progress, the workers assign the category label "Processing." Finally, for photographic data showing a construction site where work has been completed, the workers assign the category label "Processed." Category labels can also be assigned by on-site supervisors, etc.

[0073] The category labels mentioned above are just one example; operators can assign various category labels based on the state of the subject. In other words, the category labels assigned to the shooting data by operators are not limited to "not started," "in progress," or "processed."

[0074] In addition to the aforementioned annotation information, various metadata is assigned to the captured data by the imaging device 30. For example, each captured data set includes metadata such as the shooting date and time, and the design drawing ID. The shooting date and time information indicates the year, month, day, and time when the shooting took place. The design drawing ID is identification information used when determining the design drawing corresponding to the construction site that was photographed. The shooting date and time information, design drawing ID, and other metadata are generated by the information terminal 20 or the imaging device 30 and assigned to each captured data set. Furthermore, if the imaging device 30 or the information terminal 20 is equipped with a location sensor such as a GPS sensor, information indicating the latitude and longitude of the shooting location can also be assigned to each captured data set.

[0075] Server 10 includes processor 11, memory 12, and communication unit 13.

[0076] The processor 11 may be composed of, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The processor 11 includes an acquisition unit 111 and a display control unit 113. The acquisition unit 111 and the display control unit 113 may be implemented by the processor 11 executing information processing programs, or they may be constructed by dedicated hardware circuits such as ASICs.

[0077] The acquisition unit 111 acquires the shooting data sent from the shooting device 30 and the metadata assigned to the shooting data. In addition, the acquisition unit 111 performs the VSLAM processing described above to generate a design drawing with multiple overlapping shooting location icons.

[0078] The acquisition unit 111 communicates with the information terminal 20 or PC 50 via the communication unit 13 to acquire a display instruction from the information terminal 20. The display instruction is an instruction input by the user into the information terminal 20 or PC 50. The display instruction requests the display of a design drawing with multiple overlapping shooting location icons on the display 23 of the information terminal 20 or the display of the PC 50. The display instruction includes an identifier of the design drawing requested by the user to be displayed on the display 23, i.e., the design drawing ID. Hereinafter, we envision the case where an instruction to display a design drawing with multiple overlapping shooting location icons on the display 23 of the information terminal 20 is input as a display instruction.

[0079] The display control unit 113 generates various instructions for controlling the information terminal 20 and sends them to the information terminal 20. Upon receiving the instructions generated by the display control unit 113, the information terminal 20 displays a design drawing with multiple overlapping shooting location icons on the display 23. Furthermore, the information terminal 20 divides the design drawing into multiple regions. For example, the information terminal 20 sets at least one boundary line on the design drawing to divide it into multiple regions. Additionally, the information terminal 20 displays a first region, which includes the first shooting location icon (described later), on the display 23 in a different manner than a second region, which does not include the first shooting location icon.

[0080] The memory 12 is composed of a non-volatile, rewritable storage device such as a hard disk drive or a solid-state drive. The memory 12 includes a design information storage unit 121 and an image information storage unit 122.

[0081] The design drawing information storage unit 121 stores at least one design drawing. Additionally, the design drawing information storage unit 121 stores: a design drawing ID assigned to each of the at least one design drawing, and location information for each of the at least one design drawing. The location information of the design drawing refers to information indicating the geographical location of a given space to which the design drawing corresponds. For example, if the design drawing corresponds to a construction site, information indicating the latitude and longitude of the construction site is stored in the design drawing information storage unit 121. Specifically, it stores the latitude and longitude corresponding to key points of the design drawing (e.g., the four corners of the design drawing).

[0082] The image information storage unit 122 stores: multiple captured data sent from the information terminal 20 to the server 10, and metadata assigned to each of the multiple captured data.

[0083] The metadata stored in the image information storage unit 122 may also include information such as shooting ID, shooting period ID, shooting direction, and location information of the shooting location icon.

[0084] The shooting ID is an identifier assigned to each shooting data. The shooting period ID is an identifier for the shooting period. The shooting period refers to the time from the start to the end of the shooting action. The shooting direction indicates the direction in which the shooting device 30 faces when shooting each data. The location information of the shooting location icon indicates the display position of the shooting location icon on the design drawing. The location information of the shooting location icon is represented, for example, by coordinate values ​​in a two-dimensional coordinate system specified in the design drawing.

[0085] The communication unit 13 is the communication interface that connects the server 10 to the network.

[0086] Figure 3 This is a flowchart illustrating an example of the processing flow performed in information processing system 1.

[0087] In step S1, the information terminal 20 displays the design drawing on the display 23. Specifically, in step S1, the user operates the operation unit 24 and inputs a display instruction into the information terminal 20. The information terminal 20, having received the display instruction, sends the display instruction to the server 10. The acquisition unit 111 of the server 10, having received the display instruction, reads the design drawing represented by the design drawing ID included in the display instruction from the design drawing information storage unit 121 of the memory 12. At this time, the acquisition unit 111 uses the design drawing ID as a key to read various information from the image information storage unit 122 of the memory 12, including shooting data with a shooting ID corresponding to the design drawing ID, position information of the shooting location icon indicating the shooting location of the shooting data on the design drawing, and annotation information assigned to the shooting data. The acquisition unit 111 inputs the information read from the memory 12 into the display control unit 113. The display control unit 113 generates an instruction based on the information obtained from the acquisition unit 111. Specifically, the generation command displays the design drawing read by the acquisition unit 111 on the display 23, and sends an instruction to overlap the boundary lines used to divide the design drawing into multiple regions with the design drawing.

[0088] Figure 4 This diagram illustrates an example of an information terminal 20 displaying a screen 400 on a display 23 according to instructions received from the display control unit 113. (See diagram for example.) Figure 4 As shown, the display screen 400 includes a design drawing 200 with multiple overlapping shooting location icons. Figure 4 In the example shown, multiple shooting location icons include shooting location icons 501 to 515. Furthermore, for ease of explanation, in Figure 4In this document, location icons other than 501 to 515 are not marked with symbols. Each location icon is composed of a circular image. Each location icon is associated with at least one piece of data captured at the location represented by each icon. Unless otherwise specified, each piece of data is assumed to be associated with one location icon.

[0089] The aforementioned annotation information is assigned to the shooting data of at least one of the multiple shooting location icons. Hereinafter, the shooting location icon with the annotation information is referred to as the first shooting location icon. Furthermore, hereafter, the shooting location icon without the annotation information is referred to as the second shooting location icon. That is, the multiple shooting location icons include: at least one first shooting location icon with the annotation information, and at least one second shooting location icon without the annotation information.

[0090] In addition, such as Figure 4 As shown, the display screen 400 includes grid-like boundary lines L. That is, the display screen 400 is filled with boundary lines L, including multiple orthogonal vertical lines and multiple horizontal lines. These boundary lines L divide the design drawing 200 into multiple areas. Figure 4 In the example shown, multiple regions are formed into a square shape. However, this is just one example; multiple regions can also be formed into a rectangular shape.

[0091] In step S2, the display control unit 113 determines whether zooming in or out of the design drawing has been detected. Specifically, the display control unit 113 communicates with the information terminal 20. Furthermore, the display control unit 113 determines whether the information terminal 20 has received a request from the user to zoom in or out of the design drawing and display it on the display 23 (hereinafter referred to as a zoom-in / zoom-out operation). If the information terminal 20 receives a zoom-in / zoom-out operation, the display control unit 113 determines that zooming in or out has been detected (yes in step S2). In this case, the process proceeds to step S3. On the other hand, if the information terminal 20 does not receive a zoom-in / zoom-out operation, the display control unit 113 determines that zooming in or out has not been detected (no in step S2). In this case, the process proceeds to step S4.

[0092] In step S3, the information terminal 20 redraws the boundary line L according to the magnification of the design drawing. For example, in step S2, assume that the information terminal 20 receives an operation to reduce the magnification of the design drawing 200 (an operation to decrease the magnification of the design drawing). Additionally, Figure 4The magnification of the design drawing 200 shown is set to 100%. Suppose a request to set the magnification of the design drawing 200 to 80% is included in the zoom-in / zoom-out operation. In this case, the information terminal 20 displays the design drawing 200 with the magnification set to 80% on the display screen 400. Furthermore, at this time, the information terminal 20 redraws the boundary line L according to the magnification specified by the user (80%). Specifically, depending on the reduction of the design drawing 200, the arrangement spacing of the multiple vertical lines, the arrangement spacing of the multiple horizontal lines, and the number of vertical or horizontal lines included in the boundary line L are adjusted.

[0093] Figure 5 This is an example of an information terminal 20 receiving an operation to reduce the size of the design drawing 200 and displaying it on a display screen 401 on a monitor 23. Figure 5 The display screen 401 shown includes and Figure 4 The design drawing 200 shown is compared to a scaled-down design drawing 200. Additionally, the display screen 401 includes the boundary line L, which was redrawn during the processing in step S3. Through this boundary line L, the design drawing 200 is divided into multiple regions from region A1 to region A16.

[0094] Furthermore, some (e.g., two) of the multiple location icons are sometimes displayed on the display 23 in an overlapping manner. For example, when the design drawing 200 is reduced while maintaining the display size of each location icon on its respective screen, the location icons are densely packed, and thus, two location icons are sometimes displayed on the display 23 in an overlapping manner. Specifically, in Figure 5 In the display screen 401, shooting location icons 501 and 502 are displayed in an overlapping state. Assume shooting location icon 501 is the first shooting location icon and shooting location icon 502 is the second shooting location icon. Here, when the overlap between the first and second shooting location icons is greater than a baseline overlap, the first shooting location icon is hidden by the second shooting location icon, reducing the visual recognizability of the first shooting location icon. The overlap refers to the proportion of the area of ​​the second shooting location icon relative to the area of ​​the first shooting location icon.

[0095] Therefore, in step S4, the display control unit 113 according to this embodiment determines whether the overlap between the first shooting location icon and the second shooting location icon is greater than or equal to a reference overlap. Furthermore, if the overlap is greater than or equal to the reference overlap (if yes in step S4), in step S5, the display control unit 113 sends an instruction to the information terminal 20 to make the display mode of the first shooting location icon different from that of the second shooting location icon.

[0096] Specifically, in step S4, the display control unit 113 determines a first shooting location icon from among the multiple shooting location icons displayed on the display 23. Next, the display control unit 113 determines a second shooting location icon that overlaps with the first shooting location icon. Furthermore, the display control unit 113 determines whether the overlap between the first and second shooting location icons is greater than or equal to a reference overlap. The reference overlap is not particularly limited, for example, it is 50%. If the overlap between the first and second shooting location icons is greater than or equal to the reference overlap (yes in step S4), the process proceeds to step S5. On the other hand, if the overlap between the first and second shooting location icons is less than the reference overlap (no in step S4), the process proceeds to step S6.

[0097] Furthermore, in step S4, if there is no second shooting location icon that overlaps with the first shooting location icon, the display control unit 113 determines no in step S4.

[0098] Furthermore, in step S4, the display control unit 113 can also determine whether multiple second shooting location icons overlap with a first shooting location icon. Furthermore, if multiple second shooting location icons overlap with a first shooting location icon, it can also determine whether the ratio of the total area of ​​the multiple second shooting location icons to the area of ​​the first shooting location icon is greater than or equal to a reference overlap. And if the ratio of the total area of ​​the multiple second shooting location icons to the area of ​​the first shooting location icon is greater than or equal to a reference overlap, it can also be determined as yes in step S4.

[0099] In step S5, the display control unit 113 sends an instruction to the information terminal 20 to make the display mode of the first shooting location icon different from that of the second shooting location icon. This instruction to make the display mode of the first shooting location icon different from that of the second shooting location icon could, for example, be an instruction to set the second shooting location icon to not be displayed. Figure 5 The shooting location icon 502 shown is the second shooting location icon, and the shooting location icon 501 is the first shooting location icon. Assume that shooting location icon 502 overlaps shooting location icon 501 by a reference overlap degree or more. In this case, the display control unit 113 sends the following instruction to the information terminal 20: Set shooting location icon 502 to not be displayed.

[0100] Additionally, in step S5, the display control unit 113 may send an instruction to the information terminal 20 to display the first shooting location icon differently from the second shooting location icon. For example, assuming... Figure 5The display screen 401 shown includes: a first layer with the design drawing 200 drawn on it, a second layer with shooting location icons 501 (first shooting location icon) drawn on it, and a third layer with shooting location icons 502 (second shooting location icon) drawn on it. In this case, the display control unit 113 sends an instruction to the information terminal 20 to configure the second layer at the top. Thus, in the display screen 401, shooting location icon 501 is displayed with priority over shooting location icon 502.

[0101] Additionally, in step S5, the display control unit 113 may also send an instruction to the information terminal 20 to make the radius of the first shooting location icon larger than that of the second shooting location icon. Furthermore, the display control unit 113 may also send an instruction to the information terminal 20 to change the image constituting the first shooting location icon into a quadrilateral image. Additionally, the display control unit 113 may also send an instruction to the information terminal 20 to add a border line to the periphery of the circular image constituting the first shooting location icon.

[0102] Additionally, in step S5, the display control unit 113 may also send an instruction to the information terminal 20 to make the radius of the second shooting location icon, which overlaps with the first shooting location icon, smaller than the radius of the first shooting location icon. Furthermore, the display control unit 113 may also send an instruction to the information terminal 20 to change the transmittance of the second shooting location icon that overlaps with the first shooting location icon, making it transparent. In this way, the display control unit 113 improves the visual recognizability of the first shooting location icon.

[0103] In step S6, the display control unit 113 selects a shooting location icon from a plurality of shooting location icons.

[0104] In step S7, the display control unit 113 determines the area to which the shooting location icon selected in step S6 belongs. The display control unit 113 determines the area to which the shooting location icon belongs based on the position (coordinates) of the center point of the shooting location icon. For example, assuming... Figure 5 The shooting location icon 501 shown is selected by the display control unit 113 in step S6. Here, as... Figure 5 As shown, the center point 501P of the shooting location icon 501 is located inside area A10. In this case, the display control unit 113 determines the area A10 to which the shooting location icon 501 belongs.

[0105] In step S8, the display control unit 113 confirms whether annotation information has been assigned to the shooting data of the shooting location icon selected in step S6. That is, it confirms whether any shooting location icon is the first shooting location icon.

[0106] In step S9, the display control unit 113 determines whether the processing of steps S7 and S8 has been successfully performed on all the shooting location icons displayed overlapping with the design drawing 200. If the processing involved in steps S7 and S8 has been successfully performed on all the shooting location icons (yes in step S9), the process proceeds to step S10. If the processing of steps S7 and S8 has not been successfully performed on all the shooting location icons (no in step S9), the process returns to step S6. That is, the display control unit 113 repeats the processing of steps S6 to S9 until the area to which all the shooting location icons belong is determined and the processing of determining whether all the shooting location icons are the first shooting location icons is performed on all the shooting location icons. Furthermore, if the display control unit 113 determines no in step S9 and the process returns to step S6, the display control unit 113 selects a new shooting location icon from the multiple shooting location icons for which the processing of steps S7 and S8 has not been performed.

[0107] Furthermore, in step S9, if the display control unit 113 has successfully performed the processing of all the shooting location icons included in the area currently displayed on the display in the design drawing 200, it may determine in step S9 that it is yes.

[0108] In step S10, the display control unit 113 determines the content of the annotation information assigned to the shooting data of the first shooting location icon according to each area.

[0109] In step S11, the display control unit 113 controls the number of first shooting location icons for each area.

[0110] In step S12, the display control unit 113 determines a first region and a second region. The first region is the region that includes at least one icon of the first shooting location. The second region is the region that does not include the icon of the first shooting location. For example, suppose... Figure 5 The area A10 shown includes one icon for the first shooting location. In this case, area A10 corresponds to the first area. On the other hand, suppose, for example, area A14 does not include the icon for the first shooting location. That is, suppose that none of the shooting location icons (the icons for the first shooting location) for which annotation information is given to the shooting data exist in area A14. In this case, area A14 corresponds to the second area.

[0111] In step S13, the display control unit 113 generates an instruction to display the first area on the display 23 in a manner different from that of the second area, and sends the instruction to the information terminal 20. The display control unit 113 generates the instruction based on at least one of the following: the content of the comment information, the type of tag information, and the number of icons for the first shooting location. Upon receiving the instruction, the information terminal 20 displays the first area on the display 23 in a manner different from that of the second area. The details of the processing performed by the display control unit 113 in step S13 will be explained below with examples.

[0112] (Example 1) The display control unit 113 involved in Example 1 generates an instruction to change the display mode of the first area based on the number of first shooting location icons included in the first area.

[0113] Specifically, in the first example, the display control unit 113 adjusts the display size of the first area based on the number of first shooting location icons included in the first area. That is, the display control unit 113 adjusts the display size of the first area so that the more first shooting location icons included in the first area, the larger the display size of the first area. For example, consider... Figure 5 The diagram shows a scenario where area A7 includes four icons of the first shooting location, area A10 includes one icon of the first shooting location, and area A14 includes none. In this case, the display control unit 113 instructs the information terminal 20 to change the display size of the first area, such that when the display size of area A7 is set to X1, the display size of area A10 is set to X2, and the display size of area A14 is set to X3, the relationship "X1>X2>X3" holds true. Furthermore, the display size of the first area refers to the area of ​​one first area on the display screen.

[0114] Furthermore, the display control unit 113 involved in the first example can also change the color of the first area according to the number of first shooting location icons included in the first area. For example, the display control unit 113 can also instruct the information terminal 20 to display the first area with one or two first shooting location icons in green, the first area with three or four first shooting location icons in yellow, and the first area with five or more first shooting location icons in red.

[0115] In this way, by changing the display method of the first area according to the number of first shooting location icons, users can intuitively understand the number of first shooting location icons included in the first area.

[0116] (Example 2) The display control unit 113 involved in Example 2 generates an indication of the total number of icons of the first shooting location to be displayed in the first area.

[0117] For example, suppose Figure 5 The area A6 shown is the first area, which includes a total of 4 first shooting location icons. In this case, the display control unit 113 instructs the information terminal 20 to display the text "4" in area A6.

[0118] In this way, if the total number of the first shooting location icons is displayed on the display screen 401, the user can intuitively understand the total number of the first shooting location icons in each first area.

[0119] (Example 3) Figure 6 This diagram illustrates the processing of the display control unit 113 involved in the third example. Figure 6 This indicates that the information terminal 20 received the specified... Figure 4 The image shown in the zoomed-in area VI is displayed on the display screen 402 of the monitor 23.

[0120] In display screen 402, design drawing 200 is divided into multiple regions from region B1 to region B16 by boundary line L. Specifically, region B3 includes shooting location icon 503, region B5 includes shooting location icon 504, region B8 includes shooting location icon 505, region B9 includes shooting location icon 506, region B15 includes shooting location icon 507, and region B16 includes shooting location icon 508. The shooting data for shooting location icon 503 is labeled "Not yet started," the shooting data for shooting location icon 504 is labeled "Processing," and the shooting data for shooting location icon 505 is labeled "Processed." That is, shooting location icons 503, 504, and 505 are the first shooting location icons with annotation information assigned to the shooting data. Therefore, regions B3, B5, and B8 constitute the first region.

[0121] In the third example, the display control unit 113 instructs the information terminal 20 to display the first area in different ways according to each type of label information associated with the first shooting location icon. For example, the display control unit 113 instructs the information terminal 20 to display the first area of ​​the first shooting location icon, which includes the label information "not started," in red on the display 23, to display the first area of ​​the first shooting location icon, which includes the label information "processing," in yellow on the display 23, and to display the first area of ​​the first shooting location icon, which includes the label information "processed," in green on the display 23.

[0122] Reference Figure 6To elaborate, as described above, area B3 includes a shooting location icon 503. The shooting data for shooting location icon 503 is labeled "Not Started." In this case, the display control unit 113 displays area B3 in red. Additionally, area B5 includes a shooting location icon 504. The shooting data for shooting location icon 504 is labeled "Processing." In this case, the display control unit 113 displays area B5 in yellow. Furthermore, area B8 includes a shooting location icon 505. The shooting data for shooting location icon 505 is labeled "Processed." In this case, the display control unit 113 displays area B8 in green.

[0123] Thus, in the third example, the display control unit 113 changes the color of the first area to which the first shooting location icon belongs, based on the type of label information assigned to the shooting data of the first shooting location icon. This allows the user to understand the type of label information assigned to the first shooting location icon. Furthermore, it allows the user to immediately understand the status of each area.

[0124] (Example 4) In Example 4, the display control unit 113 instructs the information terminal 20 to display multiple colors in the first area when a first area includes multiple first shooting location icons and different types of label information are assigned to the multiple first shooting location icons.

[0125] For example, suppose that for each Figure 5 The shooting location icon 505 in area A7 is labeled "Not yet started", the shooting location icons 509 and 510 in area A7 are labeled "In progress", and the shooting location icon 511 in area A7 is labeled "Processed".

[0126] In this case, the display control unit 113 first divides area A7 into three parts: the left part LE, the central part CE, and the right part RI. Then, the display control unit 113 instructs the information terminal 20 to display the left part LE using a color corresponding to the "not started" type, such as red. Additionally, the display control unit 113 instructs the information terminal 20 to display the central part CE using a color corresponding to the "processing" type, such as yellow. Finally, the display control unit 113 instructs the information terminal 20 to display the right part RI using a color corresponding to the "processed" type, such as green.

[0127] In this way, users can intuitively understand that a single first area includes multiple first shooting location icons, and that the shooting data of multiple first shooting location icons is assigned different types of label information.

[0128] Furthermore, in the fourth example, the display control unit 113 divides area A7 into three parts: the left part LE, the central part CE, and the right part RI, and displays the left part LE in red. In this way, if the left part LE, which is considered to be easily focused on by the human eye, is displayed in a conspicuous color, namely red, it can induce the user to focus on area A7.

[0129] The display control unit 113 involved in the fourth example can also display the total number of first shooting location icons in the first area according to each type of tag information. For example, in area A7, there is one first shooting location icon (shooting location icon 505) with the tag information "not started", two first shooting location icons (shooting location icons 509 and 510) with the tag information "processing", and one first shooting location icon (shooting location icon 511) with the tag information "processed". In this case, the display control unit 113 sends an instruction to the information terminal 20 to display the text "1" in the left part LE (red), the text "2" in the center part CE (yellow), and the text "1" in the right part RI (green) of area A7. In this way, users can intuitively understand that there is one first shooting location icon in area A7 that is labeled "not started", two first shooting location icons that are labeled "in progress", and one first shooting location icon that is labeled "processed".

[0130] Additionally, the display control unit 113 involved in the fourth example can also instruct the information terminal 20 to display the status icon 600 in area A7. Figure 7 ). Figure 7This diagram illustrates an example of a status icon 600. The status icon 600 consists of multiple circles, each with a different radius, a different color, and whose center points are arranged on the same coordinates on the design drawing. As described above, in area A7, there is one first shooting location icon labeled "Not in Progress," two first shooting location icons labeled "Processing," and one first shooting location icon labeled "Processed." In this case, the status icon 600 includes a first circle 601, a second circle 602, and a third circle 603. The first circle 601 is an image of a circle displayed in a color corresponding to the "Not in Progress" label, such as red. The second circle 602 is an image of a circle displayed in a color corresponding to the "Processing" label, such as yellow. The third circle 603 is an image of a circle displayed in a color corresponding to the "Processed" label, such as green. The radius of circle 601 is larger than that of circle 602, and the radius of circle 602 is larger than that of circle 603. The centers of circles 601 to 603 are located at the same position (coordinates). In circle 601, the total number of first shooting location icons labeled "Not in Progress" in area A7 is displayed. That is, "1" is displayed. In circle 602, the total number of first shooting location icons labeled "In Progress" in area A7 is displayed. That is, "2" is displayed. In circle 603, the total number of first shooting location icons labeled "In Progress" in area A7 is displayed. That is, "1" is displayed.

[0131] If the status icon 600 is displayed in area A7, users can intuitively understand that there is one first shooting location icon in area A7 with the label "not started", two first shooting location icons with the label "processing", and one first shooting location icon with the label "processed".

[0132] (Example 5) The display control unit 113 involved in Example 5 detects the input of keywords. Furthermore, the display control unit 113 determines the area with keywords in the first area, the area with keywords includes a first shooting location icon that assigns comment information including keywords to the shooting data, and makes the display mode of the area with keywords different from the display mode of the second area.

[0133] Specifically, in the fifth example, the display control unit 113 sends a given instruction to the information terminal 20, causing the display 23 of the information terminal 20 to display a keyword input field (not shown). Furthermore, the user inputs a keyword into the keyword input field via the operation unit 24. The keyword input by the user is acquired by the acquisition unit 111 via the communication unit 13. When the display control unit 113 detects that the acquisition unit 111 has acquired a keyword, it determines the area containing the keyword. The area containing the keyword refers to a first area including a first shooting location icon that assigns comment information including the keyword to the shooting data. For example, assuming that for... Figure 5 The area A14 shown includes the shooting data of the shooting location icon 512, and is assigned comment information indicating "May 1st, timber shortage. From Company A, Operator X". Here, it is assumed that the user enters the keyword "Company A" into the keyword input field. In this case, the display control unit 113 identifies area A14 as the area containing the keyword.

[0134] The display control unit 113, which identifies the area containing keywords, instructs the information terminal 20 to display the area containing keywords differently from the second area. Specifically, the display control unit 113 makes the display size of the area containing keywords relatively larger than the display size of the second area. For example, the display control unit 113 changes the display size of the area containing keywords so that when the display size of area A14, which is the area containing keywords, is set to Y1, and the display size of area A14, which is the second area, is set to Y2, "Y1>Y2" holds true. Furthermore, the display control unit 113 can also make the area containing keywords blink. For example, suppose that not only is comment information assigned to the shooting data of the shooting location icon 512 in area A14, but also a "processed" label is assigned. In this case, the display control unit 113 makes area A14 blink in green.

[0135] In this way, if the area containing keywords is displayed differently from the second area, users can easily find the location of the first shooting location icon, which includes the comment information containing their own entered keywords.

[0136] Furthermore, the display control unit 113 involved in Example 5 can also change the display method of the keyword-bearing area based on the number of first shooting location icons (hereinafter referred to as keyword-bearing icons) that have been assigned comment information including keywords. For example, the more keyword-bearing icons the keyword-bearing area includes, the larger the keyword-bearing area will be displayed.

[0137] (Example 6) In Example 6, the display control unit 113 displays a shooting location icon that matches the period input by the user in the design drawing. Furthermore, when the shooting location icon that matches the period input by the user is the first shooting location icon, the display control unit 113 displays the first area including the first shooting location icon in a different manner than the second area.

[0138] In Example 6, the display control unit 113 first causes the display 23 to show a period input field (not shown). The period input field is an input field used to receive a specified period from the user.

[0139] Here, it is assumed that the user enters information specifying the period "April 1, 2024 - April 30, 2024" in the period input field. In this case, the display control unit 113 causes the display 23 to display icons of the shooting locations associated with the shooting data taken between April 1, 2024 and April 30, 2024.

[0140] by Figure 5 Taking area A11 as an example, the display control unit 113, upon detecting that the user has entered information for a specified period, confirms the shooting date and time assigned to the shooting data of the shooting location icons included in area A11. For example, suppose the shooting data of shooting location icon 513 included in area A11 is assigned information indicating that it was taken on April 1, 2024. Also suppose the shooting data of shooting location icon 514 in area A11 is assigned information indicating that it was taken on May 1, 2024. Suppose the shooting data of shooting location icon 515 in area A11 is assigned information indicating that it was taken on June 1, 2024. In this case, the display control unit 113 causes only shooting location icon 513 to be displayed in area A11. On the other hand, shooting location icons 514 and 515 are not displayed in area A11.

[0141] Here, when the shooting location icon 513 is the first shooting location icon, the display control unit 113 treats area A11 as the first area. Furthermore, the display control unit 113 displays area A11 (the first area) differently from the second area. For example, if the shooting data for the shooting location icon 513 is labeled "not started," the display control unit 113 displays area A11 in red.

[0142] Additionally, suppose the user enters information specifying a period of "May 1, 2024 - May 31, 2024" in the period input field. In this case, the display control unit 113 causes area A11 to display a shooting location icon 514 associated with shooting data taken on May 1st. Here, suppose the shooting data of shooting location icon 514 is labeled "Processing". In this case, the display control unit 113 displays area A11 in yellow, for example.

[0143] Additionally, suppose the user enters information specifying a period of "June 1, 2024 - June 30, 2024" in the period input field. In this case, the display control unit 113 causes area A11 to display the shooting location icon 515 associated with shooting data taken on June 1st. Here, suppose the shooting data of shooting location icon 515 is labeled "processed". In this case, the display control unit 113 displays area A11 in green, for example.

[0144] In this way, users can intuitively understand the progress of the work on the construction site. In the previous example, users can intuitively understand that in area A11, the workers started the work in April 2024, the work was in progress in May 2024, and the work was completed in June 2024.

[0145] Furthermore, if the user enters information specifying a period of "July 1, 2024 - July 31, 2024" in the period input field, the display control unit 113 will not display the shooting location icon in area A11. In this case, the display control unit 113 will treat area A11 as the second area.

[0146] Additionally, sometimes a single location icon is associated with multiple data points taken on different dates and times. For example, location icon 516 in area A8 is associated with data points 1, 2, and 3. Data point 1 was taken on April 1st at the location indicated by location icon 516. Data point 2 was taken on May 1st at the location indicated by location icon 516. Data point 3 was taken on June 1st at the location indicated by location icon 516. Data point 1 is labeled as "not started," data point 2 is labeled as "processing," and data point 3 is labeled as "processed."

[0147] Here, assume the user enters information specifying the period "April 1, 2024 - April 30, 2024" in the period input field. In this case, the display control unit 113 displays the area including the shooting location icon 516, i.e., area A8, in green based on the first shooting data among the shooting data associated with the shooting location icon 516. Furthermore, if the user enters information specifying the period "May 1, 2024 - May 31, 2024" in the period input field, the display control unit 113 displays area A8 in yellow. Additionally, if the user enters information specifying the period "June 1, 2024 - June 30, 2024", the display control unit 113 displays area A8 in red.

[0148] (Example 7) In Example 7, the display control unit 113 instructs the information terminal 20 to display the first shooting location icon differently from the second shooting location icon. For example, the display control unit 113 instructs the information terminal 20 to make the colors of the first shooting location icon and the second shooting location icon different. Alternatively, the display control unit 113 instructs the information terminal 20 to construct the first shooting location icon using a quadrilateral image and the second shooting location icon using a circular image. Otherwise, the display control unit 113 only needs to make the first shooting location icon and the second shooting location icon different in an appropriate way.

[0149] The display methods described in examples 1 to 7 above are merely examples. The display control unit 113 may also display the first region on the display 23 in a manner different from that of the second region, using a method different from that described in examples 1 to 7. Alternatively, the display methods described in examples 1 to 7 above may be appropriately combined.

[0150] According to the information processing system 1 described above, the first area including the first shooting location icon can be displayed on the display 23 in a different manner than the second area that does not include the first shooting location icon. In other words, the first area including the shooting location icon (i.e., the first shooting location icon) with annotation information on the shooting data can be made prominent. Therefore, the location of the shooting location icon with annotation information on the shooting data can be clearly identified. As a result, since it is not necessary to input the operation for finding the shooting location icon with annotation information on the shooting data into the server 10, etc., the increase in processing steps of the server 10, etc., can be reduced. Therefore, the increased burden on the server 10, etc., can be reduced.

[0151] The following variations are possible with respect to this disclosure.

[0152] (1) Figure 3 The processes involved in steps S2 and S3 are not mandatory. Additionally, Figure 3The processing involved in steps S4 and S5 is not mandatory.

[0153] (2) The display control unit 113 can also perform the following to make the display of the first area different from that of the second area: Figure 3 The processing involved in steps S4 and S5.

[0154] (3) The design drawing may also include layout information showing the shape of each of the multiple spaces included in the building. Furthermore, when the display control unit 113 detects that the design drawing is zoomed in or out, it may set the boundary line L of the shape along the shape of each of the multiple spaces in the design drawing based on the layout information.

[0155] In design drawings, lines indicating the walls of a building are sometimes included (an example of layout information). For example, lines indicating partition walls separating one room from another, or lines indicating partition walls separating one room from a corridor, are sometimes included in the design drawings. If the display control unit 113 has included lines indicating walls in the design drawings and the magnification of the design drawings is set to a given magnification (e.g., 50%), it can also set boundary lines L along the lines indicating walls. Figure 8 This is a diagram illustrating an example of the display screen 403 shown on the display 23 in this modified example. Figure 8 In the example shown, boundary lines L are set along the partition walls configured between room R1 and room R2, and the partition walls configured between room R1 and corridor H1.

[0156] According to this modified example, the display control unit 113 can display different modes for each space in the building, such as rooms and corridors. For example, if the shooting data of a given shooting location icon in room R2 is labeled "not started," the display control unit 113 displays room R2 in red. Conversely, if the display control unit 113 assigns the shooting data of a given shooting location icon in room R3 to the label "processed," it displays room R3 in green. Furthermore, the display control unit 113 does not specifically change the display mode for the second area, such as rooms R1. In this way, the user can easily grasp the status of each space in the building, such as the progress of a given task in each space.

[0157] Furthermore, the display control unit 113 involved in this modification can also set additional boundary lines for more finely dividing each region within each region. In this case, the display control unit 113 can also set other boundary lines, so that each region is divided into multiple blocks having a shape similar to that of each region.

[0158] (4) The display control unit 113 can also be divided into design drawings according to function. For example, the design drawings can be divided into multiple areas such as conference room area, living room area, and elevator area.

[0159] In detail, the design drawings involved in this variation include functional information indicating the respective functions of multiple spaces in the building. For example, information indicating that a space in the design drawings functions as a "meeting room," another space in the design drawings functions as a "corridor (passageway)," yet another space in the design drawings functions as a "living room," and yet another space in the design drawings functions as an "elevator," etc., are associated with the design drawings.

[0160] In this modified example, the display control unit 113, upon detecting zooming in or out of the design drawing, sets a boundary line L on the design drawing, thereby dividing the design drawing according to the function of each of the multiple spaces. For example, when the zoom level of the design drawing is set to a given zoom level, the display control unit 113 sets the boundary line L so that spaces with the function of a conference room are displayed as a conference room block, spaces with the function of a corridor are displayed as a corridor block, spaces with the function of a living room are displayed as a living room block, and spaces with the function of an elevator are displayed as an elevator block.

[0161] In this way, because the design drawings are divided into blocks based on the functions of each space in the building, users can easily grasp the progress of the work in each block.

[0162] (5) When the magnification of the design drawing is set to a given magnification (e.g., 30%), the display control unit 113 can also draw out the boundary line L, so that the design drawing is divided into four blocks (areas): the east block, the west block, the south block, and the north block.

[0163] (6) In Embodiment 1, an example of storing design drawing 200 in design drawing information storage unit 121 was described, but the design drawings stored in design drawing information storage unit 121 are not limited to design drawing 200. Design drawing information storage unit 121 may also store design drawings including a first floor plan corresponding to the first floor of a building and a second floor plan corresponding to the second floor of a building. The first floor plan is, for example, a layout plan showing the layout of the first floor of a building. The second floor plan is, for example, a layout plan showing the layout of the second floor of a building. That is, the design drawing may also be image data showing a view of the first and second floor plans of a building. The display control unit 113 may also display multiple shooting location icons in each of the first and second floor plans. Furthermore, the floor plans including the first shooting location icon in the first and second floor plans may be treated as a first area, and the floor plans not including the first shooting location icon may be treated as a second area, making the display of the first area different from that of the second area.

[0164] (7) The design drawing can also display a map (an example of a bird's-eye view) on the display 23. The map is a block map showing the location of buildings, facilities, etc. The display control unit 113 can also make the map display grid lines to divide the map into multiple areas. The display control unit 113 can also make the map display multiple shooting location icons. The display control unit 113 can also display the first area, which includes the first shooting location icon, in a different way than the second area, which does not include the first shooting location icon.

[0165] (8) When the magnification specified by the user is higher than the reference magnification, the display control unit 113 can also display the guidance information on the display 23.

[0166] First, the display control unit 113 in this modified example detects that the user has input an operation to zoom in on the design drawing. Next, the display control unit 113 displays the design drawing at the magnification set to the user-specified magnification level on the display 23. Hereinafter, the range of a portion of the entire design drawing displayed on the display 23 based on the user's zoom-in operation is referred to as the first range RA1. Figure 9 Furthermore, the area outside the first range RA1 within the overall design drawing is referred to as the second range. That is, the portion of the overall design drawing displayed on the display 23 is referred to as the first range RA1, and the portion not displayed on the display 23 (the portion existing outside the display screen) is referred to as the second range.

[0167] Next, the display control unit 113 determines whether the magnification of the design drawing specified by the user is higher than or equal to a reference magnification. If the magnification specified by the user is higher than or equal to a reference magnification, the display control unit 113 determines the position of the first range RA1. Specifically, it acquires the position information of the first range RA1 on the design drawing 200. The position information of the first range RA1 on the design drawing 200 includes the coordinate values ​​of key points (e.g., the four corners) of the first range RA1 on the design drawing 200. Next, the display control unit 113 determines the position and number of the first shooting location icons included in the second range. Specifically, it acquires the position information (coordinate values) and number of each first shooting location icon existing in the second range on the design drawing 200. At this time, the display control unit 113 acquires the relative positional relationship between the position of the first shooting location icon existing in the second range on the design drawing and the position of the first range RA1 on the design drawing 200 for each first shooting location icon existing in the second range. Next, the display control unit 113 displays guidance information on the display 23 indicating the position and number of each of the first shooting location icons included in the second range on the design drawing.

[0168] Figure 9 This is a diagram illustrating an example of the display screen 404 shown on the display 23 in this modified example. (See diagram for example.) Figure 9 As shown, display screen 404 includes a first range display bar C1 and a guide information display bar C2. The first range display bar C1 displays the first range RA1. The guide information display bar C2 displays guide information. In this variation, the guide information display bar C2 includes 12 squares arranged around the first range display bar C1.

[0169] Imagine the following scenario: the display control unit 113 determines that there is a first shooting location icon in the upper left part of the second range relative to the first range RA1. In this case, the display control unit 113 marks the number "1" in the square C21 located in the upper left direction of the first range display bar C1 on the display screen 404.

[0170] Furthermore, consider the following scenario: the display control unit 113 determines that there are three first shooting location icons in the lower left portion of the second range relative to the first range RA1. In this case, the display control unit 113 marks the number "3" in the square C22 located in the lower left direction of the first range display bar C1 on the display screen 404.

[0171] Additionally, assuming that there are two first shooting location icons in the lower right portion of the second range relative to the first range RA1, the display control unit 113 marks the number "2" in the square C23 located in the lower right direction of the first range display bar C1 on the display screen 404.

[0172] In addition, the display control unit 113 can also change the color and display size of the squares included in the guidance information display bar C2 based on the content of the annotation information (type of label information, content of comments included in the comment information, etc.) assigned to the shooting data of the first shooting location icon and the total number of the first shooting location icons.

[0173] According to the structure involved in this modified example, when the first range RA1 of the design drawing 200 is displayed on the display screen 404, guidance information indicating the position and number of the first shooting location icons existing outside the display screen (the second range) can be provided to the user. In this way, the user can easily grasp the position and number of the first icons existing outside the display screen.

[0174] Furthermore, if the magnification of the design drawing specified by the user is insufficient to the reference magnification, the display control unit 113 will not cause the display 23 to display guidance information.

[0175] Industrial availability

[0176] The technology disclosed herein is useful in the field of displaying images in a monitor.

Claims

1. An information processing method, which is an information processing method in a computer, comprising: A bird's-eye view with multiple shooting location icons superimposed is displayed on the monitor, wherein each of the multiple shooting location icons is associated with shooting data taken at the shooting location corresponding to the multiple shooting location icons, and the shooting data associated with at least one first shooting location icon included in the multiple shooting location icons is given annotation information. The bird's-eye view is divided into multiple areas; and The first region, which includes the first shooting location icon, is displayed on the display in a manner different from the second region, which does not include the first shooting location icon, among the plurality of regions.

2. The information processing method according to claim 1, wherein, The information processing method further includes: detecting whether the bird's-eye view is zoomed in or out. Based on the zoom-in or zoom-out detection of the bird's-eye view, the first region is displayed on the display in a manner different from that of the second region.

3. The information processing method according to claim 1 or 2, wherein, Displaying the first area in a manner different from that of the second area on the display includes: changing the display method of the first area based on the number of the first shooting location icons included in the first area.

4. The information processing method according to claim 1 or 2, wherein, Displaying the first area in a manner different from that of the second area on the display includes: displaying the total number of the first shooting location icons in the first area.

5. The information processing method according to claim 1 or 2, wherein, The annotation information includes label information indicating the state of the subject in relation to the captured data. Displaying the first region in a manner different from that of the second region on the display includes: displaying the first region in a different manner according to each type of the tag information assigned to the shooting data of the first shooting location icon.

6. The information processing method according to claim 1 or 2, wherein, The annotation information includes commentary information representing comments assigned to the captured data. The information processing method further includes: detecting keyword input. Displaying the first region on the display in a manner different from that of the second region includes: Identify the keyword-bearing regions within the first region, the keyword-bearing regions including the first shooting location icon that has been assigned comment information containing the keyword to the shooting data; and The display method of the area containing the keyword is different from that of the second area.

7. The information processing method according to claim 1, wherein, Displaying the first region in a manner different from that of the second region on the display includes: displaying the first shooting location icon differently from the display of at least one second shooting location icon included in the plurality of shooting location icons, and the second shooting location icon for which the annotation information of the shooting data is not assigned.

8. The information processing method according to claim 7, wherein, The information processing method further includes: Detecting the zoom-in or zoom-out of the bird's-eye view; and Based on the zoom-in or zoom-out detection of the bird's-eye view, it is determined whether the overlap between the first shooting location icon and the second shooting location icon is greater than or equal to a baseline overlap. Displaying the first area in a manner different from that of the second area on the display includes: when the overlap between the first shooting location icon and the second shooting location icon is greater than or equal to the reference overlap, making the display manner of the first shooting location icon different from that of the second shooting location icon.

9. The information processing method according to claim 1 or 2, wherein, Dividing the bird's-eye view into the multiple regions includes setting grid-like boundary lines for the bird's-eye view.

10. The information processing method according to claim 1, wherein, The bird's-eye view includes layout information showing the shape of each of the multiple spaces included in the building. The information processing method further includes: detecting whether the bird's-eye view is zoomed in or out. Dividing the bird's-eye view into the multiple regions includes: based on the layout information obtained by zooming in or out of the bird's-eye view, setting the boundary lines of the shapes along the respective shapes of the multiple spaces in the bird's-eye view.

11. The information processing method according to claim 1, wherein, The bird's-eye view includes functional information representing the functions of multiple spaces within the building. The information processing method further includes: detecting whether the bird's-eye view is zoomed in or out. Dividing the bird's-eye view into the plurality of regions includes: setting boundary lines in the bird's-eye view based on magnification or reduction of the bird's-eye view, such that the bird's-eye view is divided according to each function of the plurality of spaces.

12. The information processing method according to claim 1 or 2, wherein, The bird's-eye view includes: a first-floor view corresponding to the first floor of the building, and a second-floor view corresponding to a second floor of the building that is different from the first floor. Displaying the first area in a manner different from that of the second area on the display includes displaying the floor plan of the first floor plan and the floor plan of the second floor plan that includes the first shooting location icon in a manner different from the floor plan that does not include the first shooting location icon on the display.

13. The information processing method according to claim 1 or 2, wherein, The information processing method further includes: Detecting the magnification of the bird's-eye view; If the magnification of the bird's-eye view is detected, it is determined whether the magnification rate is above the reference magnification rate; When the magnification is greater than or equal to the reference magnification, determine the positions of the first shooting location icons displayed in the first range of the bird's-eye view on the display, and the positions and number of such icons not displayed in the second range of the display on the bird's-eye view; and Guidance information indicating the location and number of the first shooting location icons included in the second range is displayed on the display along with the first range.

14. An information processing apparatus, comprising a processor, the processor performing the following processing: An aerial view is displayed on the monitor, overlaid with icons of multiple shooting locations. Each of the plurality of shooting location icons is associated with shooting data taken at the shooting location corresponding to the plurality of shooting location icons, and the shooting data associated with at least one first shooting location icon included in the plurality of shooting location icons is given annotation information; The bird's-eye view is divided into multiple areas; and The first region, which includes the first shooting location icon, is displayed on the display in a manner different from the second region, which does not include the first shooting location icon, among the plurality of regions.

15. An information processing program that causes a computer to perform the following processing: An aerial view is displayed on the monitor, overlaid with icons of multiple shooting locations. Each of the plurality of shooting location icons is associated with shooting data taken at the shooting location corresponding to the plurality of shooting location icons, and the shooting data associated with at least one first shooting location icon included in the plurality of shooting location icons is given annotation information; The bird's-eye view is divided into multiple areas; and The first region, which includes the first shooting location icon, is displayed on the display in a manner different from the second region, which does not include the first shooting location icon, among the plurality of regions.

Images