Information processing method, information processing device, and information processing program

Abstract

This information processing method includes displaying, on an information terminal display, an overhead view with which specific locations are associated, and displaying, in the overhead view, a plurality of imaging location icons that indicate imaging locations, images captured at the imaging locations being associated with the plurality of imaging point icons, wherein the displaying includes reducing the number of imaging location icons displayed within a first prescribed range that does not include the specific locations.

Description

Information processing method, information processing device, and information processing program

[0001] The present disclosure relates to a technique for displaying a shooting location icon on a bird's-eye view map.

[0002] Patent Document 1 discloses a construction image photography instruction system that includes accepting an operation to specify a desired location on construction drawing data displayed on a display unit, creating a photography instruction to photograph a construction site corresponding to the specified location, displaying an icon indicating the photography instruction on the design drawing data, and linking an image of the construction site photographed based on the photography instruction to the icon.

[0003] However, the technology of Patent Document 1 merely discloses linking images taken at a specified location to an icon, and therefore cannot reduce the amount of data to be stored by thinning out the images according to a desired rule.

[0004] International Publication No. 2022 / 145021

[0005] The present disclosure has been made to solve such problems, and aims to provide a technology that efficiently reduces data volume by efficiently thinning out multiple shooting location icons that are linked to images.

[0006] An information processing method in one aspect of the present disclosure is an information processing method in a computer, which includes displaying a bird's-eye view linked to a specific location on a display of an information terminal, and displaying on the bird's-eye view a plurality of shooting location icons indicating shooting locations, each of which is linked to an image taken at the shooting location, and the displaying includes reducing the number of shooting location icons displayed within a first predetermined range that does not include the specific location.

[0007] According to the present disclosure, the data volume can be efficiently reduced by efficiently thinning out a plurality of shooting location icons linked to images.

[0008] 1 is an overall configuration diagram of an information processing system according to a first embodiment. FIG. 2 is a diagram showing an example of a blueprint image according to the first embodiment. FIG. 3 is a flowchart showing the processing of the information processing system according to the first embodiment. FIG. 4 is a flowchart showing an example of the processing of the information processing system according to a first modification of the first embodiment. FIG. 5 is a flowchart showing the processing of the information processing system according to a third modification of the first embodiment. FIG. 6 is an overall configuration diagram of an information processing system according to a third embodiment. FIG. 7 is a diagram showing a blueprint image to which the processing of the third embodiment has been applied. FIG. 8 is a flowchart showing the processing of the information processing system according to the third embodiment.

[0009] (Findings underlying the present disclosure) A user interface is being developed that displays multiple photography location icons indicating locations where actual photographs of a construction site were taken on a two-dimensional blueprint of the construction site, etc., and when one photography location icon is selected, displays an image taken at the photography location indicated by that icon. This allows a construction site manager to understand the situation at the construction site without visiting the construction site.

[0010] In such a user interface, if all images captured by a camera at a specified frame rate were to be saved, the data volume would be enormous, straining memory resources. A construction site has important and unimportant locations. By thinning out the location icons around unimportant locations, images associated with those location icons would not be saved. This allows a large number of images around important locations to be saved, preserving the amount of information, while a small number of images around unimportant locations can be saved, efficiently reducing the amount of data in memory.

[0011] The present disclosure has been made based on such knowledge, and aims to provide a technology that can efficiently reduce data volume by efficiently thinning out multiple shooting location icons that are linked to images.

[0012] (1) An information processing method in one aspect of the present disclosure is an information processing method in a computer, which includes displaying a bird's-eye view linked to a specific location on a display of an information terminal, and displaying a plurality of shooting location icons indicating shooting locations, each of which is linked to an image taken at the shooting location, on the bird's-eye view, and the displaying includes reducing the number of shooting location icons displayed within a first predetermined range that does not include the specific location.

[0013] According to this configuration, the number of photography location icons displayed within a first predetermined range that does not include the specific location is reduced, and multiple photography location icons are displayed on the bird's-eye view map. Therefore, a large number of images can be saved around the specific location, which is an important location, to maintain a large amount of information, while a small number of images can be saved around unimportant locations. As a result, by efficiently thinning out the multiple photography location icons associated with images, data volume can be efficiently reduced.

[0014] (2) In the information processing method described in (1) above, the specific location may be a coordinate on the bird's-eye view that has been set in advance, and reducing the number of images displayed may include reducing the number of image-capturing location icons displayed within the first specified range to be less than the number of image-capturing location icons displayed within a second specified range that includes the specific location.

[0015] According to this configuration, the number of photography location icons displayed around locations other than the specific location is reduced compared to the number of photography location icons displayed around the specific location, so that images taken in the surrounding area including the specific location that the user considers important can be saved with priority, thereby efficiently reducing data volume.

[0016] (3) In the information processing method described in (1) above, in the information processing method described in (1) or (2) above, the specific location may be a shooting location indicated by a shooting location icon to which annotation information is linked.

[0017] According to this configuration, it is possible to display more shooting location icons around shooting locations linked to annotation information than shooting location icons around shooting locations not linked to annotation information, so that images taken at shooting locations that should call attention can be saved with priority.

[0018] (4) In the information processing method described in (1) above, on the bird's-eye view, a predetermined area surrounding the shooting location is defined for each of the multiple shooting location icons, and the displaying includes extracting shooting location icons from the multiple shooting location icons so that the predetermined areas do not overlap, and displaying the extracted shooting location icons, and the specific location is the shooting location indicated by the extracted shooting location icon, and the first predetermined range may be the predetermined area defined for a shooting location icon other than the extracted shooting location icon.

[0019] According to this configuration, the shooting location icons are extracted and displayed so that the predetermined areas do not overlap, so that the shooting location icons can be thinned out efficiently.

[0020] (5) In the information processing method described in (2) above, reducing the number of images to be displayed may include leaving, among the image capture location icons located within the first specified range, those image capture location icons to which annotation information is linked.

[0021] According to this configuration, the shooting location icon linked to the annotation information remains within a first predetermined range that does not include a specific location, thereby avoiding a situation in which the annotation information and the image linked to the annotation information are not saved.

[0022] (6) In the information processing method described in any one of (1) to (5) above, the number of the shooting location icons displayed within the first specified range may be set to a value that can maintain a predetermined resolution for the shooting location.

[0023] According to this configuration, it is possible to prevent excessive thinning of the shooting location icons within the first predetermined range, which would otherwise result in a significant loss of information within that range.

[0024] (7) In the information processing method described in (2) or (3) above, the number of the shooting location icons displayed within the second specified range may be set to a value that matches the frame rate of the shooting.

[0025] According to this configuration, in the second predetermined range, the number of shooting location icons displayed is in accordance with the frame rate, so that detailed information about that range can be saved.

[0026] (8) In the information processing method described in (2) or (3) above, the bird's-eye view may be a bird's-eye view of a building including pillars, walls, or materials, and the number of the photographing location icons displayed within the second specified range may be set to a value such that the photographing location indicated by one photographing location icon is located on one side of the pillar, wall, or material, and the photographing location indicated by another photographing location icon is located on the other side of the pillar, wall, or material.

[0027] According to this configuration, the number of displays in the second specified range can be set so that a space that could not be photographed in an image taken at one shooting location because it was blocked by a pillar, wall, or material can be photographed at another shooting location.

[0028] (9) In the information processing method described in (2) or (3) above, the multiple shooting location icons are each linked to the shooting time of the corresponding image, and reducing the number of images displayed may include displaying the shooting location icons in a number such that, within the first specified range, the time interval between the shooting times linked to adjacent shooting location icons is a first time interval, and displaying the shooting location icons in a number such that, within the second specified range, the time interval between the shooting times linked to adjacent shooting location icons is a second time interval that is shorter than the first time interval.

[0029] According to this configuration, the number of displayed image capture location icons in the first predetermined range can be made smaller than the number of displayed image capture location icons in the second predetermined range using the image capture time.

[0030] (10) In the information processing method described in any of (1) to (5) above, reducing the number of images displayed may include displaying the shooting location icons so that the distance between adjacent shooting location icons is a first distance within the first specified range, and displaying the shooting location icons so that the distance between adjacent shooting location icons is a second distance shorter than the first distance within the second specified range.

[0031] According to this configuration, the number of displayed photographing location icons in the first predetermined range can be made smaller than the number of displayed photographing location icons in the second predetermined range using the distance.

[0032] (11) In another aspect of the present disclosure, an information processing device includes a processor that executes the following operations: displaying a bird's-eye view on a display of an information terminal, in which a specific location is set; and displaying, on the bird's-eye view, a plurality of shooting location icons indicating shooting locations, each of which is linked to an image taken at the shooting location; and the displaying includes reducing the number of shooting location icons displayed within a first predetermined range that does not include the specific location.

[0033] This configuration makes it possible to provide an information processing device that can efficiently reduce data volume.

[0034] (12) In another aspect of the present disclosure, an information processing program causes a computer to execute the following: displaying a bird's-eye view on a display of an information terminal, in which a specific location is set; and displaying, on the bird's-eye view, a plurality of shooting location icons indicating shooting locations, each of which is linked to an image taken at the shooting location; and the displaying includes reducing the number of shooting location icons displayed within a first predetermined range that does not include the specific location.

[0035] According to this configuration, it is possible to provide an information processing program that can efficiently reduce data volume.

[0036] The present disclosure can also be realized as an information processing system operated by such an information processing program. Needless to say, such a computer program can be distributed on a non-transitory computer-readable recording medium such as a CD-ROM or via a communication network such as the Internet.

[0037] Note that each of the embodiments described below represents a specific example of the present disclosure. The numerical values, shapes, components, steps, and step orders shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims that represent the highest concept are described as optional components. Furthermore, in all of the embodiments, the respective contents can be combined.

[0038] (Embodiment 1) FIG. 1 is an overall configuration diagram of an information processing system 1 according to embodiment 1. The information processing system 1 is a system that displays a greater number of photography location icons within a predetermined range that includes a specific location than the number of photography location icons located outside the predetermined range. The information processing system 1 includes a server 10, an information terminal 20, a photography device 30, and a communication device 40. The server 10 (an example of an information processing device and a computer), the information terminal 20, and the communication device 40 are connected to each other so as to be able to communicate with each other via a network NT. An example of a network is the Internet. The server 10 is, for example, a cloud server configured with one or more computers. However, this is just one example, and the server 10 may be configured as an edge server or may be implemented in the information terminal 20. The aspect in which the server 10 is implemented in the information terminal 20 is an example of the aspect in which the information terminal 20 is configured as an information processing device.

[0039] The information terminal 20 is carried by a user. The user is, for example, a manager of a predetermined space in which the image capturing device 30 captures images. The predetermined space is, for example, a construction site. However, this is just one example, and the predetermined space may be a construction site, a factory, a store, an office, etc. The information terminal 20 may be configured as a portable computer such as a smartphone or a tablet computer, or as a stationary computer. The information terminal 20 displays images on a display under the control of the server 10. Although one information terminal 20 is illustrated in the example of FIG. 1, multiple information terminals may be connected to the server 10 via a network. The information terminal 20 includes a communication unit 21, a processor 22, a display 23, and an operation unit 24.

[0040] The communication unit 21 is a communication interface that connects the information terminal 20 to the network NT. The communication unit 21 transmits instruction signals indicating various instructions received from the user by the operation unit 24 to the server 10. The communication unit 21 receives display data for displaying various display screens from the server 10.

[0041] The processor 22 is configured by, for example, a central processing unit, and displays on the display 23 a display screen indicated by the display data received by the communication unit 21 .

[0042] The display 23 is configured with various display devices such as a liquid crystal display and an organic EL display, and displays various display screens under the control of the processor 22 .

[0043] The operation unit 24 is composed of a keyboard, a touch panel, a mouse, etc., and accepts various instructions input by the user.

[0044] The communication device 40 is configured as a mobile information terminal such as a smartphone or a tablet computer, and connects the photographing device 30 to the network NT. The communication device 40 and the photographing device 30 are connected via a short-range wireless communication path such as Bluetooth (registered trademark). The communication device 40 is carried by the photographer.

[0045] The image capturing device 30 is, for example, an omnidirectional camera that captures images at a predetermined frame rate. An omnidirectional camera is also called a 360-degree camera, and is a camera that can capture images in all directions of 360 degrees. The image capturing device 30 is, for example, a portable image capturing device carried by a photographer. The photographer is, for example, a worker or site supervisor at a construction site. The image capturing device 30 may also be a regular camera.

[0046] The photographer moves within a predetermined space while photographing the construction site with the photographing device 30. When the photographing is completed, the photographing device 30 transmits photographing information including the series of photographed images to the server 10 via the communication device 40.

[0047] The photography information includes the photographed image, the photography start point, the photography end point, and a blueprint ID corresponding to the predetermined space. The blueprint ID is an identifier for identifying the blueprint of the predetermined space.

[0048] At the shooting start position, the photographer points the shooting direction of the shooting device 30 northward, presses the shooting button of the shooting device 30, starts shooting, and when the shooting end point is reached, presses the shooting button again to end shooting.

[0049] The start and end points of photography are specified by the photographer inputting instructions specifying the positions on a blueprint screen of a predetermined space displayed on the display of the communication device 40. Two-dimensional coordinate axes are defined on the blueprint screen. Therefore, the start and end points of photography are each defined by two-dimensional coordinate values. The start and end points of photography are used by the server 10 to specify the location of each photography point and the photography direction of each image.

[0050] A specific location is linked to the blueprint. The specific location is set, for example, by the photographer inputting an instruction specifying the location on the blueprint of a specific space displayed on the display of the communication device 40. However, this is just one example, and the specific location may also be set by a user who has viewed the blueprint inputting an instruction specifying the location on the blueprint displayed on the display of the information terminal 20.

[0051] The server 10 includes a processor 11, a memory 12, and a communication unit 13. The processor 11 is configured, for example, by a central processing unit (CPU). The processor 11 includes an instruction receiving unit 111 and a display control unit 112. The instruction receiving unit 111 and the display control unit 112 may be realized by the processor 11 executing an information processing program, or may be configured by a dedicated hardware circuit such as an ASIC.

[0052] The instruction receiving unit 111 acquires an instruction by the user input to the information terminal 20. In particular, the instruction receiving unit 111 detects the input of an instruction by the user when the communication unit 13 receives an instruction signal indicating an instruction transmitted from the information terminal 20. The instruction includes a display instruction to display a design plan on the display 23 of the information terminal 20, and a selection instruction to select one photography location icon from multiple photography location icons displayed on the design plan.

[0053] The display control unit 112 displays a blueprint linked to a specific location on the display 23. When the instruction receiving unit 111 acquires a display instruction, the display control unit 112 displays the blueprint on the display of the information terminal 20. The blueprint is an example of a bird's-eye view. The display instruction includes a blueprint ID. The display control unit 112 reads out the blueprint indicated by this blueprint ID from the blueprint information storage unit 121 and displays it on the display 23.

[0054] The display control unit 112 displays a plurality of photography location icons on the design drawing displayed on the display 23. The photography location icons indicate photography locations, and are linked to images taken at the photography locations.

[0055] The display control unit 112 reduces the number of photography location icons displayed outside the specified range compared to the number of photography location icons displayed within the specified range. The specified range includes the specific location. The specified range is an example of a second specified range that includes the specific location. The area outside the specified range is an example of a first specified range. The specified range is a square range with one side defined by α and centered on the coordinates indicating the specific location. However, this is just one example, and the specified range may also be a circular range with a certain radius and centered on the specific location.

[0056] The number of photographing location icons displayed outside the predetermined range may be set to a value that can maintain a predetermined resolution for the photographing locations. The resolution for the photographing locations is a resolution set based on the number of photographing location icons displayed that is necessary for the manager to understand the situation outside the predetermined range on the design drawing.

[0057] The number of photographing location icons displayed within a predetermined range may be set to a value that matches the frame rate of the photographing device 30. Setting the number of photographing location icons to a value that matches the frame rate of photographing means that the photographing location icons are displayed for each frame rate of the photographing device 30.

[0058] A blueprint is a bird's-eye view of a building including pillars, walls, or materials. The number of photography location icons displayed within a predetermined range may be set so that one photography location icon indicates a photography location located on one side of the pillar, wall, or material, and another photography location icon indicates a photography location located on the other side of the pillar, wall, or material. The other side of the pillar, wall, or material refers to, for example, the back or side of the pillar, wall, or material. A blueprint is a drawing showing the design of a construction site, and may be a floor plan, blueprint, map, perspective view, or the like of the construction site. A bird's-eye view can also be referred to as a bird's-eye view, and may be a view from above or a view from a high place.

[0059] The display control unit 112 may display the image capture location icons at a number such that the time interval between image capture times associated with adjacent image capture location icons is a first time interval outside the predetermined range. The first time interval may be a time interval determined in advance based on a value that can be maintained for the resolution related to the image capture location.

[0060] The display control unit 112 may display the photography location icons in a number such that, within a predetermined range, the time interval between photography times associated with adjacent photography location icons is a second time interval that is shorter than the first time interval. The second time interval may be a time interval determined in advance based on a value that matches the frame rate of the above-mentioned photography device 30. The second time interval may be a time interval determined in advance such that the photography location indicated by one photography location icon is located on one side of a pillar, wall, or material, and the photography location indicated by another photography location icon is located on the other side of the pillar, wall, or material.

[0061] The memory 12 is configured as a non-volatile rewritable storage device such as a hard disk drive or a solid state drive. The memory 12 includes a blueprint information storage unit 121 and an image information storage unit 122. The blueprint information storage unit 121 stores blueprint information. The blueprint information is an image showing a blueprint of a specified space. The blueprint information is associated with a blueprint ID that identifies the blueprint.

[0062] The image information storage unit 122 stores image information including the photography information transmitted from the photography device 30. The image information includes multiple images, the photography start point, the photography end point, and the blueprint ID included in the photography information transmitted from the photography device 30, as well as meta information for each image. The image information is generated each time the photography information described above is transmitted. The meta information includes the photography ID, photography period ID, photography time, photography direction, and photography location.

[0063] The shooting ID is an identifier of the shooting location. The shooting period ID is an identifier of the shooting period. The shooting period refers to the period from when the photographer starts shooting to when he finishes shooting. The shooting time is the date and time when the image was shot. The shooting direction is the shooting direction of each image in the shooting device 30. The shooting location is composed of a position (two-dimensional coordinate value) that indicates the shooting location of the image.

[0064] The photography ID is an identifier of the photography location. The photography period ID is an identifier of the photography period. The blueprint ID is an identifier of the blueprint of the specified space corresponding to the image.

[0065] The communication unit 13 is a communication interface that connects the server 10 to a network.

[0066] Fig. 2 is a diagram showing an example of a blueprint image 200 in embodiment 1. The blueprint image 200 is displayed on the display 23 under the control of the display control unit 112. The left diagram of Fig. 2 shows a blueprint image 200X to which the processing according to this embodiment has not been applied, and the right diagram of Fig. 2 shows an example of a blueprint image 200 to which the processing according to this embodiment has been applied.

[0067] In the blueprint image 200X, the processing according to this embodiment is not applied, and therefore a plurality of photographing location icons 210 are displayed at regular intervals.

[0068] In the blueprint image 200, a plurality of specific locations 220 are set on the blueprint. The display control unit 112 divides the blueprint into a predetermined range 230 that includes the specific locations 220 and a range outside the predetermined range 230. The display control unit 112 displays a greater number of photography location icons 210 within the predetermined range 230 than the number of photography location icons 210 outside the predetermined range 230.

[0069] FIG. 3 is a flowchart showing the processing of the information processing system 1 according to the first embodiment.

[0070] In step S1, the operation unit of the communication device 40 accepts an operation to input a shooting start point (hereinafter referred to as a start point). For example, the photographer inputs an operation to specify the start point on a blueprint screen displayed on the display of the communication device 40. The photographer may specify the start point by tapping on the blueprint screen, or may specify the coordinate value of the start point.

[0071] Next, in step S2, the camera device 30 starts capturing images and acquires multiple images at multiple capturing locations. At the site, the camera operator points the camera device 30 in the capturing direction north and inputs a command to start capturing images to the camera device 30, thereby starting the capturing operation in the specified space.

[0072] Next, in step S3, the operation unit of the communication device 40 accepts an operation to input a shooting end point (hereinafter referred to as the end point). For example, the photographer inputs an operation to specify the end point on the blueprint screen displayed on the display of the communication device 40. The photographer may specify the end point by tapping on the blueprint screen, or may specify the shooting end point by inputting the coordinate values ​​of the end point.

[0073] Next, in step S4 , the communication device 40 acquires, from the photographing device 30 , photographing information including a plurality of images photographed by the photographing device 30 during the photographing period, and uploads the acquired photographing information to the server 10 .

[0074] Next, in step S5, the display control unit 112 calculates the shooting points of each of the multiple images included in the shooting information acquired in step S4 using a self-location estimation process. As the self-location estimation process, VSLAM (Visual Simultaneous Localization and Mapping) can be adopted.

[0075] For example, the display control unit 112 detects feature points from each of the multiple images included in the shooting information through image processing. Feature points are distinctive points that indicate the outline of an object included in the image. The display control unit 112 performs a self-position estimation process on each of the multiple images using at least two of the multiple images in which feature points are set, and calculates relative coordinate values ​​of the shooting point, which is the self-position corresponding to each image. The display control unit 112 aligns the direction of the shooting point corresponding to each image by utilizing the fact that the shooting device 30 is set to face north at the start of the shooting operation. The display control unit 112 calculates absolute coordinate values ​​of the shooting point corresponding to each image from the relative coordinate values ​​of the shooting point corresponding to each image, based on the coordinate values ​​of the start point and end point included in the shooting information, and calculates the calculated absolute coordinate values ​​as the coordinate values ​​of the shooting point corresponding to each image.

[0076] Next, in step S6, the display control unit 112 sets a notable photography point x from among the multiple photography points calculated in step S5, and starts processing for the set notable photography point x. Here, the explanation is given assuming that there are N (N is an integer of 2 or more) photography points. The display control unit 112 sets the notable photography points in order of the photography time. x is an index that specifies the photography point, and takes on a value of x = 1 to N.

[0077] Next, in step S7, the display control unit 112 determines whether or not the noteworthy photography point x is within the predetermined range 230. If the noteworthy photography point x is within the predetermined range 230 (YES in step S7), the process proceeds to step S8. On the other hand, if the noteworthy photography point x is not within the predetermined range 230 (NO in step S7), the process proceeds to step S10. The display control unit 112 may determine that the noteworthy photography point x is within the predetermined range 230 if the coordinates of the noteworthy photography point x are within a coordinate region that defines the predetermined range 230.

[0078] Next, in step S8, the display control unit 112 determines whether the shooting time associated with the target shooting point x corresponds to the timing defined by the second time interval. If the shooting time corresponds to the timing defined by the second time interval (YES in step S8), the process proceeds to step S9. If the shooting time does not correspond to the timing defined by the second time interval (NO in step S8), the process returns to step S6.

[0079] The display control unit 112 may determine that the shooting time associated with the first noted shooting location x (= 1) falls within the timing defined by the second time interval. For the second or subsequent noted shooting locations x, the display control unit 112 may calculate the time difference between the shooting time associated with the noted shooting location x and the shooting time associated with the immediately preceding saved shooting location, and if the time difference falls within the second time interval, may determine that the shooting time associated with the noted shooting location x falls within the timing defined by the second time interval.

[0080] Next, in step S9, the display control unit 112 sets the noted photography point x as a saved photography point.

[0081] In step S10, the display control unit 112 determines whether the shooting time associated with the target shooting point x corresponds to the timing defined by the first time interval. If the shooting time corresponds to the timing defined by the first time interval (YES in step S10), the process proceeds to step S9. If the shooting time does not correspond to the timing defined by the first time interval (>second time interval) (NO in step S10), the process returns to step S6.

[0082] The display control unit 112 may determine that the shooting time associated with the first noted shooting location x (=1) falls within the timing defined by the first time interval. For the second or subsequent noted shooting locations x, the display control unit 112 may calculate the time difference between the shooting time associated with the noted shooting location x and the shooting time associated with the immediately preceding saved shooting location, and if the time difference falls within the first time interval, may determine that the shooting time associated with the noted shooting location x falls within the timing defined by the first time interval.

[0083] Next, in step S11, the display control unit 112 determines whether or not processing has been completed for all of the notable photography points x. If processing has not been completed for all of the notable photography points x, the process returns to step S6, and the next notable photography point x is set. On the other hand, if processing has been completed for all of the notable photography points x, that is, if processing has been completed for the notable photography point x (=N), the process proceeds to step S12.

[0084] Next, in step S12, the display control unit 112 stores the image associated with the saved photography location in the image information storage unit 122. In detail, the display control unit 112 adds meta information to the image associated with the saved photography location and stores the image in the image information storage unit 122.

[0085] Next, in step S13, the display control unit 112 displays the photography location icons 210 at the saved photography locations in the blueprint image 200. As a result, the blueprint image 200 is displayed on the display 23 in which the number of photography location icons 210 displayed within the predetermined range 230 is greater than the number of photography location icons 210 displayed outside the predetermined range 230, as shown in FIG.

[0086] As described above, according to the first embodiment, the number of displayed photography location icons outside the predetermined range 230 is reduced compared to the number of displayed photography location icons within the predetermined range 230. Therefore, it is possible to store images taken in the surrounding area including the specific location 220 that the user considers important, and to efficiently reduce the data volume.

[0087] (First Modification of First Embodiment) In this modification, the image capture location icon 210 is displayed in real time during image capture. Fig. 4 is a flowchart showing the processing of the information processing system 1 in the first modification of the first embodiment. This flowchart starts when the photographer inputs an instruction to start image capture into the image capture device 30 on-site.

[0088] In step S21, the image capturing device 30 captures an image including a plurality of markers. The plurality of markers are, for example, artificial markers placed at predetermined positions on the construction site, and have a specific shape and pattern. QR codes (registered trademark) or AR markers can be used as the markers. Each of the plurality of markers is associated with an ID. From this ID, the display control unit 112 can identify the coordinates on the blueprint image 200 corresponding to the positions where the markers are placed. The image captured in step S21 is uploaded to the server 10 by the communication device 40.

[0089] Next, in step S22, the photographing device 30 captures one image.

[0090] Next, in step S23, the communication device 40 acquires the one image acquired in step S22 from the photographing device 30, and uploads the acquired image to the server 10.

[0091] Next, in step S24, the display control unit 112 calculates the shooting point of the latest image acquired in step S23 using the self-position estimation process. Here, the calculated shooting point is called a target shooting point.

[0092] In detail, the display control unit 112 detects feature points from the latest image and previous images, and calculates the relative coordinate values ​​of the latest shooting location from the positional relationship between the feature points in the previous images and the feature points in the latest image. The display control unit 112 aligns the direction of the shooting location of the latest image by utilizing the fact that the image capturing device 30 is set facing north at the start point. The display control unit 112 calculates the absolute coordinate values ​​of the shooting location corresponding to the latest image from the relative coordinate values ​​of the shooting location using the coordinate values ​​of multiple marker locations.

[0093] Next, in step S25, the display control unit 112 determines whether the target shooting point is within the predetermined range 230. Details of this process are the same as those of step S7 in Fig. 3. If NO in step S25, the process proceeds to step S30, and if YES in step S25, the process proceeds to step S26.

[0094] Next, in step S26, it is determined whether the photographing time associated with the photographing point of interest corresponds to the timing defined by the second time interval. Details of this process are the same as those of step S8 in FIG. 3. If the answer is YES in step S26, the process proceeds to step S27. If the answer is NO in step S26, the process returns to step S22. In this case, the processes from step S23 onwards are executed for the next acquired image.

[0095] Next, in step S30, it is determined whether the photographing time associated with the photographing point of interest corresponds to the timing defined by the first time interval. The details of this process are the same as those of step S10 in FIG. 3. If the answer is YES in step S30, the process proceeds to step S27. If the answer is NO in step S30, the process returns to step S22. In this case, the processes from step S23 onwards are executed on the next acquired image.

[0096] Next, in step S27, the image associated with the noted photography location is stored in the image information storage unit 122. In detail, the display control unit 112 adds meta information to the image associated with the saved photography location and stores the image in the image information storage unit 122.

[0097] Next, in step S28, the display control unit 112 displays a photography location icon 210 at the photography location of interest in the blueprint image 200. In this case, the photography location icon 210 is displayed on the blueprint image 200 displayed on the display of the communication device 40. Furthermore, when the blueprint image 200 is displayed on the display of the information terminal 20, the photography location icon 210 may also be displayed on this blueprint image 200.

[0098] Next, in step S29, the display control unit 112 determines whether the photographing operation has ended. The display control unit 112 may determine that the photographing operation has ended if an instruction to end photographing is input to the photographing device 30. If the photographing operation has not ended (NO in step S29), the process returns to step S22. In this case, the processes from step S23 onward are executed for the next acquired image. On the other hand, if the photographing operation has ended (YES in step S29), the process ends.

[0099] In this way, according to the first modification of the first embodiment, the shooting location icon 210 can be displayed on the blueprint image 200 in real time during the shooting operation.

[0100] (Variant 2 of Embodiment 1) In this variant, the display control unit 112 displays the shooting location icons outside the predetermined range 230 so that the distance between adjacent shooting location icons is a first distance, and displays the shooting location icons within the predetermined range 230 so that the distance between adjacent shooting location icons is a second distance that is shorter than the first distance.

[0101] FIG. 5 is a flowchart showing an example of processing by the information processing system 1 according to the second modification of the first embodiment.

[0102] The processes of steps S41, S42, S43, S44, S45, S46, S47, S49, S51, S52, and S53 are the same as steps S1, S2, S3, S4, S5, S6, S7, S9, S11, S12, and S13 in FIG.

[0103] In step S48, the display control unit 112 determines whether the adjacent distance of the noted photography location x corresponds to the second distance. If the adjacent distance corresponds to the second distance (YES in step S48), the process proceeds to step S49. If the adjacent distance does not correspond to the second distance (NO in step S48), the process returns to step S46. The adjacent distance is the distance between the noted photography location x and the immediately preceding saved photography location.

[0104] In step S50, the display control unit 112 determines whether the adjacent distance of the attention shooting point x is the first distance (> the second distance). If the adjacent distance is the first distance (YES in step S50), the process proceeds to step S49. If the adjacent distance is not the first distance (NO in step S50), the process returns to step S46.

[0105] In this way, according to the information processing system 1 in the second variant of the first embodiment, the number of displayed shooting location icons 210 outside the specified range 230 can be made smaller than the number of displayed shooting location icons 210 within the specified range 230 by using distance.

[0106] (Modification 3 of Embodiment 1) Modification 1 and Modification 2 of Embodiment 1 are combined. Fig. 6 is a flowchart showing the processing of the information processing system 1 in Modification 3 of Embodiment 1.

[0107] The processes of steps S61, S62, S63, S64, S65, S67, S68, and S69 are the same as steps S21, S22, S23, S24, S25, S27, S28, and S29 in FIG.

[0108] In step S66, the display control unit 112 determines whether the adjacent distance of the target shooting point corresponds to the second distance. If the adjacent distance corresponds to the second distance (YES in step S66), the process proceeds to step S67. If the adjacent distance does not correspond to the second distance (NO in step S66), the process returns to step S62.

[0109] In step S70, the display control unit 112 determines whether the adjacent distance of the target shooting point corresponds to the first distance (> the second distance). If the adjacent distance corresponds to the first distance (YES in step S70), the process proceeds to step S67. If the adjacent distance does not correspond to the first distance (NO in step S70), the process returns to step S62.

[0110] As described above, according to the third modification of the first embodiment, in a mode in which the photographing location icons 210 are displayed in real time during a photographing operation, the number of photographing location icons 210 to be displayed can be determined using the adjacent distance.

[0111] In the second embodiment, the shooting location indicated by the shooting location icon 210 associated with the annotation information is set as the specific location. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted.

[0112] 7 is a diagram showing the overall configuration of an information processing system 1A according to embodiment 2. The information processing system 1A differs from the information processing system 1 in that an annotation information storage unit 123 is added to the memory 12 and the processor 11 includes a display control unit 112A.

[0113] The annotation information storage unit 123 stores annotation information. The annotation information is information including comments and annotation areas attached to an image. The comments are messages written by users who have viewed an image displayed on the display 23, noting points that they have noticed. The comments are input using the information terminal 20 or the communication device 40. This allows the user to call the attention of other users.

[0114] An annotation area is an area set on an image by a user, and is an area that indicates an annotation object related to a comment. The annotation area is set using the operation unit 24. For example, in the case of a construction site, the annotation object corresponds to a construction member. For example, when a user wants to add a comment to a door, an annotation area is set by surrounding the door with a frame, and the comment is entered in association with this annotation area. Annotation information is associated with a shooting ID. This makes it possible to identify which image the annotation information is set to.

[0115] In the second embodiment, the display control unit 112A sets, as the specific location, the photography location indicated by the photography location icon 210 associated with the annotation information 330. Therefore, the predetermined range 230 is a certain range that includes the photography location indicated by the photography location icon 210 associated with the annotation information 330.

[0116] FIG. 8 is a diagram showing an image 300 on which annotation information 330 is displayed. The image 300 is an image captured by the image capturing device 30. The annotation information 330 is input in advance, for example, by the photographer. After completing a capture operation, the photographer displays an image 300 of a capture location that caught their attention on the display of the communication device 40. The photographer inputs annotation information 330 for the displayed image 300 using the operation unit of the communication device 40. The annotation information 330 input in the communication device 40 is linked to the capture ID of the image 300 and transmitted from the communication device 40 to the server 10. The server 10 stores the annotation information 330 transmitted from the communication device 40 in the annotation information storage unit 123.

[0117] The annotation information 330 may be input in advance by the user using the information terminal 20. For example, the user uses the operation unit 24 to input an instruction to select one of the multiple photography location icons 210 displayed on the blueprint image 200, and causes the display 23 to display the image 300 linked to the one photography location icon 210.

[0118] The following describes how annotation information 330 is input, taking the information terminal 20 as an example. When a user presses an edit button (not shown) using the operation unit 24 on an image 300 displayed on the display 23, a comment input field (not shown) is displayed on the left or right edge of the blueprint image 200. The user uses the operation unit 24 to designate an annotation object in the image 300 with a frame (not shown). The area designated by this frame becomes the annotation area 310. The user also uses the operation unit 24 to input a comment related to the annotation area 310 in the comment input field. The information terminal 20 transmits information including the annotation area 310 and comment information 320 indicating the comment input using the operation unit 24 as annotation information 330 to the server 10 using the communication unit 21. A photography ID is associated with this annotation information 330. The instruction receiving unit 111 of the server 10 associates the annotation information 330 received by the communication unit 13 with the shooting ID of the image 300 and stores the information in the annotation information storage unit 123. As a result, the annotation information 330 and the image 300 are linked together using the shooting ID as a key.

[0119] 9 is a flowchart showing the processing of the information processing system 1A in embodiment 2. The processing of steps S81 to S83 is the same as the processing of steps S1 to S3 in FIG.

[0120] In step S84, the communication device 40 receives an instruction from the photographer to input annotation information 330. The photographer may input annotation information 330 for one or more of the images captured during the shooting period. The photographer may input multiple pieces of annotation information 330 for one image.

[0121] Next, in step S85, the communication device 40 acquires, from the imaging device 30, imaging information including a plurality of images captured by the imaging device 30 during the imaging period, and uploads the acquired imaging information to the server 10. Furthermore, the communication device 40 uploads to the server 10 the annotation information 330 input in step S84.

[0122] Next, in step S86, the display control unit 112 applies the self-position estimation process to each uploaded image, similar to step S5 in FIG. 3, to calculate the shooting point of each image.

[0123] Next, in step S87, the display control unit 112 sets an image of interest Gx from among the multiple images uploaded in step S85, and starts processing the set image of interest Gx. Here, the explanation is given assuming that there are N images (N is an integer equal to or greater than 2). The display control unit 112 sets the image of interest Gx in order of oldest photographing time. x is an index specifying the image, and takes on a value of x=1 to N.

[0124] Next, in step S88, the display control unit 112 determines whether or not the target image Gx is linked to annotation information 330. The display control unit 112 can make this determination by searching whether or not annotation information 330 linked to the shooting ID of the target image Gx is stored in the annotation information storage unit 123.

[0125] If the annotation information 330 is linked to the target image Gx (YES in step S88), the process proceeds to step S89; if the annotation information 330 is not linked to the target image Gx (NO in step S88), the process proceeds to step S91.

[0126] Next, in step S89, the photographing location of the target image Gx is set as the saved photographing location.

[0127] Next, in step S91, the display control unit 112A determines whether the shooting location of the target image Gx is located within the predetermined range 230. If the shooting location of the target image Gx is located within the predetermined range 230 (YES in step S91), the process proceeds to step S89, and if the shooting location of the target image Gx is outside the predetermined range 230 (NO in step S91), the process returns to step S87. In this case, the processes from step S88 onwards are executed for the next target image Gx.

[0128] Next, in step S90, it is determined whether processing has been completed for all images of interest Gx. If processing has not been completed for all images of interest Gx, the process returns to step S87, and the next image of interest Gx is set. On the other hand, if processing has been completed for all images of interest Gx, i.e., if processing has been completed for image of interest Gx (=N), the process proceeds to step S92.

[0129] The processes in steps S92 and S93 are the same as steps S12 and S13 in FIG.

[0130] In this way, according to the information processing system 1A in embodiment 2, it is possible to display more shooting location icons around shooting locations linked to annotation information 330 than shooting location icons around shooting locations not linked to annotation information, so that it is possible to focus on saving images taken at shooting locations that should call attention to the situation.

[0131] (First Modification of Second Embodiment) In the first modification of the second embodiment, only the shooting location icons 210 associated with the annotation information 330 are displayed.

[0132] 10 is a flowchart showing the processing of information processing system 1A in Modification 1 of Embodiment 2. The processing of steps S101, S102, S103, S104, S105, S106, S107, S108, S109, S110, S112, and S113 is the same as S81, S82, S83, S84, S85, S86, S87, S88, S89, S90, S92, and S93 in FIG.

[0133] In step S111, the display control unit 112A executes a thinning process, which is a process of not setting the shooting location of the target image Gx as a saved shooting location.

[0134] As described above, according to the first modification of the second embodiment, the display control unit 112A sets, as the saved photography location, only the photography location where the image associated with the annotation information 330 was taken. The display control unit 112A displays only the photography location icon 210 indicating the saved photography location on the blueprint image 200. The display control unit 112A saves, in the image information storage unit 122, only the images taken at the saved photography location.

[0135] This avoids a situation in which annotation information and images linked to the annotation information are not saved.

[0136] (Variation 2 of Embodiment 2) The thinning process shown in step S111 may be the same as the process shown in Embodiment 1. The specific location 220 is the annotation information 330. In other words, the display control unit 112 leaves the image capture location icons 210 linked to the annotation information 330 among the image capture location icons 210 located outside the predetermined range 230 (within a first predetermined range) without thinning them out. The display control unit 112 leaves the image capture location icons 210 linked to the annotation information 330 among the image capture location icons 210 located within the predetermined range 230 (within a second predetermined range) without thinning them out.

[0137] In detail, even if a shooting location icon 210 located outside the specified range 230 is a shooting location icon 210 that is subject to thinning, the display control unit 112A will leave the shooting location icon 210 without thinning it out if annotation information 330 is linked to it.

[0138] The photographing location icons 210 that are to be thinned out outside the predetermined range 230 are photographing location icons 210 whose photographing times do not fall within the timing defined by the first time interval. Alternatively, the photographing location icons 210 that are to be thinned out outside the predetermined range 230 are photographing location icons 210 that indicate photographing locations whose adjacent distances do not fall within the first distance.

[0139] The display control unit 112A leaves a shooting location icon 210 that is located within a specified range 230 and is subject to thinning, without thinning it out, if the shooting location icon 210 is associated with annotation information 330.

[0140] The photographing location icons 210 that are to be thinned out within the predetermined range 230 are photographing location icons 210 whose photographing times do not fall within the timing defined by the second time interval. Alternatively, the photographing location icons 210 that are to be thinned out within the predetermined range 230 are photographing location icons 210 that indicate photographing locations whose adjacent distances do not fall within the first distance.

[0141] (Variant 3 of Embodiment 2) In Variant 2 of Embodiment 2, the process of setting a shooting location associated with annotation information 330 as a saved shooting location may be applied only to shooting location icons 210 located outside the specified range 230.

[0142] (Fourth Modification of Second Embodiment) The display control unit 112 may execute the processes shown in the second embodiment and the first and second modifications of the second embodiment in real time during the shooting operation.

[0143] (Embodiment 3) In embodiment 3, a photography location icon 210 is extracted from a plurality of photography location icons 210 so that predetermined areas set for the photography location icons 210 do not overlap. In embodiment 3, the same components as those in embodiments 1 and 2 are denoted by the same reference numerals, and description thereof will be omitted.

[0144] 11 is a diagram showing the overall configuration of an information processing system 1B according to Embodiment 3. The information processing system 1B differs from the information processing system 1A in that the processor 11 includes a display control unit 112B.

[0145] The display control unit 112B sets a predetermined area surrounding the photography location for each of the multiple photography location icons 210 on the blueprint image 200.

[0146] The display control unit 112B extracts the photography location icons 210 from the plurality of photography location icons 210 so that the predetermined areas do not overlap. The display control unit 112B displays the extracted photography location icons 210. Note that in the third embodiment, the specific location corresponds to the photography location indicated by the extracted photography location icon 210. In the third embodiment, the first predetermined range corresponds to the predetermined area defined in the photography location icon 210 other than the extracted photography location icon 210.

[0147] FIG. 12 is a diagram showing a blueprint image 200 to which the processing of the third embodiment has been applied. The photography location icons 210 are displayed so that their centers are located at the photography location P. The display control unit 112B sets a predetermined area 401 surrounding the photography location P for each photography location icon 210. The photography location icons 210 have a circular shape with a predetermined radius. The photography location icons 210 may have a polygonal shape such as a triangle or a rectangle. The predetermined area 401 has a circular shape with a larger radius than the photography location icon 210. However, this is just an example, and the predetermined area 401 may be configured as a polygon with a larger area than the photography location icon 210. Although the predetermined area 401 is shown in FIG. 12 for ease of explanation, the predetermined area 401 is not displayed.

[0148] The photography location icons 210 displayed on the blueprint image 200 are photography location icons 210 extracted by the display control unit 112B. Therefore, none of the photography location icons 210 displayed on the blueprint image 200 overlaps the predetermined area 401. This is because the photography location icons 210 overlapping the predetermined area 401 are not extracted by the display control unit 112B as display targets.

[0149] 13 is a flowchart showing the processing of the information processing system 1B in embodiment 3. The processing of steps S121, S122, S123, S124, and S125 is the same as steps S1, S2, S3, S4, and S5 in FIG.

[0150] In step S126, the display control unit 112B sets predetermined areas for the start point icon and the end point icon. The start point icon is the shooting location icon 210 associated with the uploaded image with the oldest shooting time. The end point icon is the shooting location icon 210 associated with the uploaded image with the most recent shooting time.

[0151] Next, in step S127, the display control unit 112B sets the start point icon as a comparison source icon, which is the shooting location icon 210 that has been confirmed to be saved.

[0152] Next, in step S128, the display control unit 112B sets the shooting location icon 210 adjacent to the start point icon as the comparison destination icon. The shooting location icon 210 adjacent to the start point icon is the shooting location icon 210 linked to the image with the second oldest shooting time among the uploaded images.

[0153] Next, in step S129, the display control unit 112B sets a predetermined area 401 for the comparison target icon.

[0154] Next, in step S130, display control unit 112B determines whether the comparison target icon is the end point icon. If the comparison target icon is not the end point icon (NO in step S130), the process proceeds to step S131. If the comparison target icon is the end point icon (YES in step S130), the process proceeds to step S136.

[0155] Next, in step S131, the display control unit 112B determines whether the predetermined area 401 of the comparison source icon overlaps with the predetermined area 401 of the comparison target icon. If the predetermined area 401 of the comparison source icon overlaps with the predetermined area 401 of the comparison target icon (YES in step S131), the display control unit 112B deletes the comparison target icon (step S132).

[0156] Next, in step S133, the display control unit 112B updates the comparison target icon to the shooting location icon 210 with the next oldest shooting time after the deleted comparison target icon, and returns the process to step S129. As a result, the shooting location icons 210 are sequentially set as comparison target icons in order of oldest shooting time, based on the currently set comparison source icon.

[0157] On the other hand, if the predetermined area 401 of the comparison source icon does not overlap with the predetermined area 401 of the comparison target icon (NO in step S131), the display control unit 112B sets the comparison target icon as a saved icon and sets this comparison target icon as the comparison source icon (step S134). As a result, the comparison target icon whose predetermined area 401 does not overlap with the currently set comparison source icon is saved and set as the next comparison source icon.

[0158] Next, in step S135, the display control unit 112B updates the comparison target icon (step S135), and returns the process to step S129. As a result, the shooting location icons 210 are sequentially updated as comparison target icons in order of oldest shooting time, starting from the updated comparison source icon.

[0159] Next, in step S136, the display control unit 112B stores the image associated with the save icon in the image information storage unit 122. Here, the end point icon is set to the save icon. This is because the end point icon indicates the end point entered by the user, and so it is appropriate to leave it. Note that the end point icon is set to the save icon even if the predetermined area 401 overlaps with an adjacent save icon.

[0160] Next, in step S137, the display control unit 112B displays a save icon on the design drawing image 200. As a result, the design drawing image 200 shown in FIG.

[0161] In this way, according to the information processing system 1B of embodiment 3, shooting location icons 210 are extracted and displayed from among multiple shooting location icons 210 so that the specified areas 401 do not overlap, so that the shooting location icons can be thinned out efficiently.

[0162] If the start point icon and end point icon are not displayed, it will cause a sense of incongruity to the user who inputs the start point and end point. In this configuration, the start point icon and end point icon are always left, so that the sense of incongruity to the user is prevented.

[0163] The present disclosure is useful for remotely monitoring a site.

Claims

1. An information processing method in a computer, comprising: displaying, on a display of an information terminal, a bird's-eye view linked to a specific location; and displaying, on the bird's-eye view, a plurality of shooting location icons indicating shooting locations, each of which is linked to an image taken at the shooting location, wherein the displaying includes reducing the number of shooting location icons displayed within a first specified range that does not include the specific location.

2. The information processing method of claim 1, wherein the specific location is a coordinate on the bird's-eye view that has been set in advance, and reducing the number of icons displayed includes reducing the number of shooting location icons displayed within the first specified range to be less than the number of shooting location icons displayed within a second specified range that includes the specific location.

3. The information processing method according to claim 1, wherein the specific location is a shooting location indicated by a shooting location icon to which annotation information is linked.

4. An information processing method as described in claim 1, wherein, on the bird's-eye view, a predetermined area surrounding the shooting location is defined for each of the multiple shooting location icons, and the displaying includes: extracting shooting location icons from the multiple shooting location icons so that the predetermined areas do not overlap; and displaying the extracted shooting location icons, wherein the specific location is the shooting location indicated by the extracted shooting location icon, and the first predetermined range is the predetermined area defined for a shooting location icon other than the extracted shooting location icon.

5. The information processing method according to claim 2, wherein reducing the number of images displayed includes leaving, among the image capture location icons located within the first specified range, image capture location icons to which annotation information is linked.

6. An information processing method according to claim 1 or 2, wherein the number of the shooting location icons displayed within the first specified range is set to a value that can maintain a predetermined resolution related to the shooting locations.

7. The information processing method according to claim 2 or 3, wherein the number of the shooting location icons displayed within the second specified range is set to a value that matches a frame rate of the shooting.

8. An information processing method as described in claim 2 or 3, wherein the bird's-eye view is a bird's-eye view of a building including pillars, walls, or materials, and the number of the shooting location icons displayed within the second specified range is set to a value such that the shooting location indicated by one shooting location icon is located on one side of the pillar, wall, or material, and the shooting location indicated by another shooting location icon is located on the other side of the pillar, wall, or material.

9. The information processing method of claim 2 or 3, wherein each of the multiple shooting location icons is linked to a shooting time of a corresponding image, and reducing the number of icons displayed includes: displaying the shooting location icons in a number such that, within the first specified range, the time interval between the shooting times linked to adjacent shooting location icons is a first time interval; and displaying the shooting location icons in a number such that, within the second specified range, the time interval between the shooting times linked to adjacent shooting location icons is a second time interval shorter than the first time interval.

10. The information processing method of claim 2 or 3, wherein reducing the number of images displayed includes: displaying the shooting location icons such that the distance between adjacent shooting location icons within the first specified range is a first distance; and displaying the shooting location icons such that the distance between adjacent shooting location icons within the second specified range is a second distance shorter than the first distance.

11. An information processing device including a processor, wherein the processor executes the following steps: displaying a bird's-eye view on a display of an information terminal, in which a specific location is set; and displaying on the bird's-eye view a plurality of shooting location icons indicating shooting locations, the plurality of shooting location icons being linked to images taken at the shooting locations; and the displaying includes reducing the number of shooting location icons displayed within a first predetermined range that does not include the specific location.

12. An information processing program that causes a computer to execute the following steps: displaying a bird's-eye view on an information terminal display, in which a specific location is set; and displaying on the bird's-eye view a plurality of shooting location icons indicating shooting locations, the plurality of shooting location icons being linked to images taken at the shooting locations, wherein the displaying includes reducing the number of shooting location icons displayed within a first specified range that does not include the specific location.

Images