Information processing method, information processing device, and information processing program
The information processing method addresses the inefficiency of checking related images around a photographing point by displaying linked second images information alongside the primary image, reducing processing steps and computational burden while maintaining the display of multiple photographing locations images.
Patent Information
- Application Number
- PCT/JP2024/038600
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-10
- Filing Date
- 2024-10-30
- Publication Date
- 2025-05-08
AI Technical Summary
Existing technologies require increased processing steps and computational burden to check for related images around the photographing point of a displayed image, without providing a method to do so efficiently while maintaining the display of images taken at multiple photographing locations.
An information processing method that displays a bird's-eye image with multiple photographing point icons, allowing users to select a photographing point icon to view the corresponding image, and simultaneously displays information about linked second images taken at different times or locations within a predetermined range.
Enables users to check for related images around the photographing point without increasing processing steps, thereby reducing computational burden while maintaining the display of images from multiple locations.
Smart Images

Figure JP2024038600_08052025_PF_FP_ABST
Abstract
Description
Information processing method, information processing device, and information processing program
[0001] The present disclosure relates to a technique for displaying images captured at multiple capture locations.
[0002] Patent document 1 discloses a technology for displaying an image taken at a first location among a series of multiple shooting locations, and superimposing icons indicating shooting locations adjacent to the first location on the image.
[0003] However, Patent Document 1 does not disclose a method for checking whether or not there are images related to the surroundings of the shooting location of the image currently being displayed, which are different from the images taken at the multiple shooting locations, while maintaining the display of images taken at each of the multiple shooting locations. Therefore, achieving this in Patent Document 1 poses a problem of increasing the number of processing steps and increasing the burden on the computer.
[0004] Japanese Patent Application Laid-Open No. 2021-72627
[0005] The present disclosure has been made to solve such problems, and aims to provide a technology that enables a user to check whether there are any related images around the shooting location of the image being displayed, without increasing the number of processing steps.
[0006] An information processing method in one aspect of the present disclosure is an information processing method in a computer, which includes displaying a bird's-eye view image on a display of a terminal device with multiple shooting location icons representing multiple shooting locations superimposed thereon, and when selection of a first shooting location icon, which is one of the multiple shooting location icons, is detected, displaying a first image taken at the first shooting location indicated by the first shooting location icon on the display, wherein displaying the first image includes, when a second image different from the multiple images taken at the multiple shooting locations is linked to a position within a predetermined range of the first shooting location, displaying information indicating the second image on the first image.
[0007] 1 is an overall configuration diagram of an information processing system. FIG. 2 is a diagram showing an example of a design drawing displayed on the display of an information terminal. FIG. 3 is a diagram showing an example of a display screen displayed on the display when a first shooting location icon is selected. FIG. 4 is a diagram showing an example of a first image. FIG. 5 is a diagram showing another example of a display screen displayed on the display when a first shooting location icon is selected. FIG. 6 is a diagram showing an example of a display screen on which a second image is displayed. FIG. 7 is an explanatory diagram of a method for determining whether a target position is included in a displayed image. A flowchart showing processing of the information processing system. FIG. 8 is a diagram showing an example of a display of an image showing the shooting direction of the second image. An explanatory diagram of a display method ... A flowchart showing a modified example of processing of the information processing system.
[0008] (Background to the present disclosure) A user interface is being developed that displays multiple photography location icons representing multiple photography locations where the construction site was actually photographed on a two-dimensional blueprint of the construction site, etc., and when one photography location icon is selected, displays an image photographed at the photography location indicated by that icon. This allows the construction site manager to understand the situation at the construction site without visiting the construction site.
[0009] In addition, a function is being considered for such a user interface that allows the user to check whether or not there is a second image taken near the first photographing location on a different date and time from the first image while maintaining the display of the first image taken at the first photographing location indicated by the selected first photographing location icon. It is also being considered to facilitate the operation of displaying the second image when it exists. This allows the supervisor to easily check the progress of the construction work.
[0010] In Patent Document 1, when checking for the presence or absence of a second image while maintaining the display of a first image, it is necessary to perform processing such as displaying a screen for inputting an instruction to check for the presence or absence of a second image, and processing to accept the instruction and check for the presence or absence of a second image, which increases the number of processing steps on the computer and increases the burden on the computer.
[0011] Therefore, the inventors have conducted extensive research into technology that can maintain the display of images taken at each of multiple shooting locations, while allowing a user to check for the presence or absence of images related to the surrounding area of the shooting location of the image currently being displayed that are different from the images taken at those multiple shooting locations, without increasing the number of processing steps, and have come up with the present disclosure described below.
[0012] (1) An information processing method in one aspect of the present disclosure is an information processing method in a computer, which includes displaying a bird's-eye view image on a display of a terminal device with multiple shooting location icons representing multiple shooting locations superimposed thereon, and when selection of a first shooting location icon, which is one of the multiple shooting location icons, is detected, displaying a first image taken at the first shooting location indicated by the first shooting location icon on the display, wherein displaying the first image includes, when a second image different from the multiple images taken at the multiple shooting locations is linked to a position within a predetermined range of the first shooting location, displaying information indicating the second image on the first image.
[0013] According to this configuration, when selection of the first photographing location icon is detected, a first image photographed at the first photographing location is displayed on the display, and when a second image is linked to a position within a predetermined range of the first photographing location, information indicating the second image is displayed on the first image. This makes it possible to check whether there are any images related to the surroundings of the photographing location of the currently displayed image, other than the images photographed at the multiple photographing locations, while maintaining the display of images photographed at each of the multiple photographing locations, without increasing the number of processing steps.
[0014] (2) In the information processing method described above in (1), the second image may be an image taken at a different date and time from the plurality of images.
[0015] In this case, it is possible to check whether there are any images related to the surrounding area of the shooting location of the first image being displayed that were taken on a different date and time from the multiple images, without increasing the number of processing steps.
[0016] (3) In the information processing method described in (1) or (2) above, the information indicating the second image may include an icon indicating the second image.
[0017] In this case, if there is a second image related to the vicinity of the first shooting location, an icon representing the second image is displayed while maintaining the display of the first image. Therefore, a user who selects the first shooting location icon can intuitively grasp, while viewing the first image, that there is a second image related to a position near the first shooting location.
[0018] (4) In the information processing method described in any one of (1) to (3) above, the first image may be composed of an omnidirectional image, and displaying information indicating the second image may include, if a display image, which is an image of the first image displayed on the display, does not include a target position, which is a position to which the second image is linked, displaying information indicating the second image on a side closer to the target position than the center of the display image.
[0019] In this case, information indicating the second image is displayed closer to the target position than the center of the displayed image, so that the relative position of the position to which the second image is linked with respect to the displayed image can be easily grasped.
[0020] (5) In the information processing method described in any one of (1) to (3) above, the first image may be composed of an omnidirectional image, and displaying information indicating the second image may include, if a display image, which is an image of the first image displayed on the display, includes a target position, which is a position to which the second image is linked, displaying information indicating the second image at the target position in the display image.
[0021] In this case, information indicating the second image is displayed at the target position included in the display image, so that the position to which the second image is linked can be easily grasped.
[0022] (6) In the information processing method described above in (5), the information indicating the second image may include an image indicating a direction in which the second image was captured.
[0023] In this case, the information indicating the second image displayed at the target position in the display image includes an image indicating the shooting direction of the second image, so that not only the position to which the second image is linked but also the shooting direction of the second image at that position can be easily grasped.
[0024] (7) In the information processing method described in any one of (4) to (6) above, displaying information indicating the second image may include identifying the position of a pixel of the second image in the first image by pattern matching, and identifying the position of the pixel as the target position.
[0025] In this case, the positions of the pixels of the second image in the first image can be properly determined, and therefore, particularly when the first image is an omnidirectional image, the positional relationship in the elevation angle direction between the first image and the second image can also be properly determined.
[0026] (8) The information processing method described in any one of (1) to (7) above may further include, when a selection of information indicating the second image is detected, displaying the second image on the display instead of the first image.
[0027] In this case, when information showing the second image is displayed on the first screen, the user can instantly check the contents of the second image by selecting the information showing the second image.
[0028] (9) In the information processing method described in any one of (1) to (8) above, the information indicating the second image may differ depending on whether the second image is composed of an omnidirectional image or a two-dimensional image.
[0029] In this case, when there is a second image related to the surroundings of the first photographing location, it is possible to further determine whether the second image is composed of an omnidirectional image or a two-dimensional image.
[0030] (10) In the information processing method described in any one of (1) to (9) above, if the image displayed on the display includes a second shooting location that is different from the first shooting location among the plurality of shooting locations, the information indicating the image taken at the second shooting location may be displayed in a manner different from the information indicating the second image.
[0031] In this case, when a second photographing location different from the first photographing location is displayed on the display, information showing the image photographed at the second photographing location is displayed in a manner different from the information showing the second image, thereby enabling the user to further confirm that there are images photographed at the second photographing location around the first photographing location.
[0032] (11) In the information processing method described in any one of (1) to (10) above, displaying the bird's-eye view image may include, if the second image is linked to a position within a predetermined range of any one of the plurality of shooting locations, further superimposing a position icon indicating the position to which the second image is linked on the bird's-eye view image, and may further include, if selection of the position icon is detected, displaying the second image linked to the position indicated by the position icon on the display.
[0033] In this case, depending on whether or not a location icon is superimposed on the bird's-eye image, it is possible to easily determine whether or not a second image is linked to the periphery of any of the multiple shooting locations indicated by the multiple shooting location icons superimposed on the bird's-eye image. Furthermore, by selecting a location icon superimposed on the bird's-eye image, it is possible to determine the details of the second image linked to the location indicated by the location icon.
[0034] Furthermore, the present disclosure can be realized not only as an information processing method that executes the characteristic processes described above, but also as an information processing device or the like that has a characteristic configuration corresponding to the characteristic processes executed by the information processing method. Furthermore, the present disclosure can also be realized as a computer program that causes a computer to execute the characteristic processes included in such an information processing method. Therefore, the same effects as those of the above information processing method can also be achieved in the following other aspects.
[0035] (12) In another aspect of the present disclosure, an information processing device includes a processor that executes the following: displaying a bird's-eye view image on a display of a terminal device, on which multiple shooting location icons indicating multiple shooting locations are superimposed; and, when detecting selection of a first shooting location icon, which is one of the multiple shooting location icons, displaying a first image taken at the first shooting location indicated by the first shooting location icon on the display; and displaying the first image includes, when a second image different from the multiple images taken at the multiple shooting locations is linked to a position within a predetermined range of the first shooting location, displaying information indicating the second image on the first image.
[0036] (13) In yet another aspect of the present disclosure, an information processing program causes a computer to execute the following steps: displaying, on a display of a terminal device, a bird's-eye view image on which multiple shooting location icons indicating multiple shooting locations are superimposed; and, when selection of a first shooting location icon, which is one of the multiple shooting location icons, displaying on the display a first image taken at the first shooting location indicated by the first shooting location icon, when selection of the first shooting location icon, which is one of the multiple shooting location icons, is detected; and displaying the first image includes, when a second image, different from the multiple images taken at the multiple shooting locations, is linked to a position within a predetermined range of the first shooting location, displaying information indicating the second image on the first image.
[0037] The present disclosure can also be realized as an information processing system operated by such an information processing program. Needless to say, such a computer program can be distributed on a computer-readable non-transitory recording medium such as a CD-ROM or via a communication network such as the Internet.
[0038] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that each of the embodiments described below represents a specific example of the present disclosure. The numerical values, shapes, components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in an independent claim that represents a superordinate concept will be described as optional components. Furthermore, in all embodiments, the respective contents can be combined.
[0039] 1 is an overall configuration diagram of an information processing system 1. The information processing system 1 is a system that displays an image selected from a series of multiple images taken at multiple shooting locations, and enables a user to check whether there are any images linked to the shooting location of the image currently being displayed.
[0040] 1, the information processing system 1 includes a server 10, an information terminal 20 (an example of a terminal device), an imaging device 30, and a communication device 40. The server 10 (an example of an information processing device and a computer), the information terminal 20, and the communication device 40 are connected to each other so as to be able to communicate with each other via a network NT. An example of the network NT is the Internet.
[0041] The server 10 is, for example, a cloud server configured with one or more computers. However, this is just one example, and the server 10 may be configured as an edge server or may be implemented in the information terminal 20. The aspect in which the server 10 is implemented in the information terminal 20 is an example of the aspect in which the information terminal 20 is configured as an information processing device.
[0042] The information terminal 20 is carried by a user. The user is, for example, a manager of a predetermined space in which the image capturing device 30 captures images. The predetermined space is, for example, a construction site. However, this is just one example, and the predetermined space may be a construction site, factory, store, office, etc. The information terminal 20 may be configured as a portable computer such as a smartphone or tablet computer, or as a stationary computer. The information terminal 20 displays various images and screens on the display in accordance with display instructions from the server 10. Although one information terminal 20 is illustrated in the example of FIG. 1, multiple information terminals may be connected to the server 10 via the network NT. The information terminal 20 includes a communication unit 21, a processor 22, a display 23, and an operation unit 24.
[0043] The communication unit 21 is a communication interface that connects the information terminal 20 to the network NT. The communication unit 21 transmits various instructions received from the user by the operation unit 24 to the server 10. The communication unit 21 receives various image and screen display instructions from the server 10.
[0044] The processor 22 is configured by, for example, a central processing unit, and displays various images and screens on the display 23 in accordance with display instructions for various images and screens received by the communication unit 21 .
[0045] The display 23 is configured with various display devices such as a liquid crystal display, an organic EL (Electro-Luminescence) display, etc., and displays various images and screens under the control of the processor 22.
[0046] The operation unit 24 is composed of a keyboard, a touch panel, a mouse, etc., and accepts various instructions input by the user.
[0047] The communication device 40 is configured as a mobile information terminal such as a smartphone or a tablet computer, and connects the photographing device 30 to the network NT. The communication device 40 and the photographing device 30 are connected via a short-range wireless communication path such as Bluetooth (registered trademark).
[0048] The image capturing device 30 is, for example, an omnidirectional camera that captures images at a predetermined frame rate. An omnidirectional camera is also called a 360-degree camera, and is a camera that can capture images in all directions of 360 degrees. The image capturing device 30 is, for example, a portable image capturing device carried by a photographer. The photographer is, for example, a worker or site supervisor at a construction site. The image capturing device 30 may also be a regular camera.
[0049] The photographer moves through the construction site while photographing the construction site with the camera device 30. At the shooting start position, the photographer points the camera device 30 in a direction based on the shooting direction of the camera device 30 (hereinafter referred to as the reference direction), and presses the shooting button on the camera device 30. This causes the camera device 30 to start capturing images at a predetermined frame rate. For this reason, the shooting point is defined in frame cycle units. However, this results in an enormous amount of data, so the shooting point may be defined for each predetermined time period (e.g., 1 second, 5 seconds, 10 seconds, 1 minute, etc.). When the photographer reaches the shooting end point, he or she presses the shooting button again. This causes the camera device 30 to end shooting. When shooting ends, the camera device 30 transmits the series of captured images to the communication device 40. In the following description, the reference direction is north. However, the reference direction is not limited to north, and may be another direction.
[0050] Furthermore, a photographer may use the camera device 30 to individually capture images of the surroundings of a specific photography location in order to check the progress of work at a series of photography locations photographed in the past. In this case, the images captured by the camera device 30 may be two-dimensional images or 360-degree omnidirectional images. In this case, when the photography is completed, the camera device 30 transmits the captured images and the photography direction of the images to the communication device 40. Note that if the captured images are two-dimensional images, the photography direction of the images is represented, for example, by a two-dimensional polar coordinate vector with the north direction as the reference direction. If the captured images are omnidirectional images, the photography direction of the images is represented, for example, by a three-dimensional polar coordinate vector with the north direction as the reference direction.
[0051] The communication device 40 receives the series of images transmitted by the image capture device 30. In this case, the communication device 40 displays a blueprint of the construction site and accepts the photographer's specification of the start and end positions of the image capture on the blueprint. The start and end positions of the image capture are identified by the photographer inputting instructions specifying the positions on the blueprint screen of the construction site displayed on the display of the communication device 40. Two-dimensional coordinate axes are defined on the blueprint screen. For example, the east-west direction on the blueprint is defined as the horizontal axis or X-axis, and the north-south direction is defined as the vertical axis or Y-axis. Therefore, the start and end positions of the image capture are each defined by two-dimensional coordinate values. The communication device 40 transmits image capture information including the series of captured images to the server 10 via the network NT.
[0052] The photography information is generated each time a photography operation is performed. One photography operation refers to a series of operations performed by a worker holding the photography device 30 at a construction site from the start to the end of photography. A single photography operation captures multiple images. The photography information includes the multiple images captured and meta information for each of the multiple images. The meta information includes the photography ID, photography date and time, blueprint ID, photography start point, and photography end point.
[0053] The shooting ID is an identifier for identifying the shooting operation. The shooting date and time is the date and time when the image was shot. The shooting date and time is obtained, for example, by a clock provided in the shooting device 30. The blueprint ID is an identifier for identifying the blueprint of a specified space corresponding to the image. The shooting start point and shooting end point are used to specify the shooting location and shooting direction of each image.
[0054] The communication device 40 also receives images of the surroundings of a specific photography location transmitted by the photography device 30. In this case, the communication device 40 displays a blueprint of the construction site, in the same manner as when specifying the photography start point and photography end point, and accepts the photographer's specification of the photography location on the blueprint from which the received image was taken. The communication device 40 transmits photography information including the received image to the server 10 via the network NT. In this case, the photography information includes the image received from the photography device 30 and meta information of the image. The meta information of the image includes the photography ID, photography date and time, blueprint ID, photography location, and photography direction.
[0055] The server 10 includes a processor 11, a memory 12, and a communication unit 13. The processor 11 is configured, for example, by a central processing unit (CPU). The processor 11 includes an instruction receiving unit 111 and a display control unit 112. The instruction receiving unit 111 and the display control unit 112 may be realized by the processor 11 executing an information processing program, or may be configured by a dedicated hardware circuit such as an ASIC. The information processing program may be recorded on a non-transitory computer-readable recording medium.
[0056] The communication unit 13 is a communication interface that connects the server 10 to the network NT. The communication unit 13 receives the photographing information transmitted by the communication device 40. The communication unit 13 receives various instructions from the user from the information terminal 20. The communication unit 13 transmits various image and screen display instructions to the information terminal 20.
[0057] The memory 12 is configured as a non-volatile rewritable storage device such as a hard disk drive or a solid state drive, etc. The memory 12 includes a design drawing information storage unit 121 and an image information storage unit 122.
[0058] The blueprint information storage unit 121 stores blueprint information. Blueprint information is information that associates a blueprint ID with a blueprint of a specific space identified by the blueprint ID. A blueprint is a drawing that shows the design of a construction site, and may be a floor plan, blueprint, map, perspective drawing, etc. of the construction site. A blueprint is an example of a bird's-eye view image. A bird's-eye view image can also be referred to as a bird's-eye view image, and may be an image viewed from above or an image viewed from a high place.
[0059] The image information storage unit 122 stores image information. The image information is information that associates an image with meta information for that image. The meta information includes a shooting ID, shooting date and time, blueprint ID, shooting location, and shooting direction. Specifically, the processor 11 creates image information based on the shooting information received by the communication unit 13, and stores the created image information in the image information storage unit 122.
[0060] In detail, if the meta information contained in the shooting information received by the communication unit 13 includes the shooting location and shooting direction, the processor 11 creates image information that corresponds the image contained in the shooting information with the meta information contained in the shooting information, and stores the created image information in the image information storage unit 122.
[0061] On the other hand, if the meta information included in the shooting information received by the communication unit 13 includes a shooting start point and a shooting end point, the processor 11 uses Visual SLAM (Simultaneous Localization and Mapping) technology to identify the shooting point of each image from the shooting start point, the shooting end point, and the multiple images included in the shooting information. The shooting point of each image is represented by two-dimensional coordinate values on the design drawing. The processor 11 also uses Visual SLAM technology to identify the shooting direction of each image. The shooting direction of each image is represented, for example, by a three-dimensional polar coordinate vector with north as the reference direction.
[0062] The processor 11 adds the identified shooting location and shooting direction of each image to the meta information of each image included in the shooting information. The processor 11 creates image information that associates the meta information with each image included in the shooting information, and stores the created image information in the image information storage unit 122. Note that instead of the processor 11 calculating the shooting location and shooting direction of each image, the communication device 40 may calculate the shooting location and shooting direction of each image and include the calculated shooting location and shooting direction of each image in the meta information of each image that is transmitted to the server 10.
[0063] The instruction receiving unit 111 acquires an instruction by the user input via the information terminal 20. In particular, when the communication unit 13 receives an instruction by the user from the information terminal 20, the instruction receiving unit 111 detects the input of the instruction. The instruction includes, for example, an instruction to select a blueprint, an instruction to specify the shooting date and time, an instruction to select a shooting location icon, an instruction to change the display angle of view, and the like.
[0064] The instruction to select a blueprint is an instruction to select a blueprint corresponding to the design ID input by the user as the blueprint to be processed. The instruction to specify a photography date and time is an instruction to specify the photography date and time input by the user as the photography date and time to be processed. A photography location icon is an icon that is superimposed on the position of a photography location included in a blueprint. The instruction to select a photography location icon is an instruction to select a photography location icon selected by the user from multiple photography location icons superimposed on the blueprint as the photography location icon to be processed. The instruction to change the display angle of view is an instruction to change the angle of view of the image displayed on the display 23 of the information terminal 20 (hereinafter referred to as the display image).
[0065] When the instruction receiving unit 111 detects input of an instruction to select a blueprint, the display control unit 112 reads out the blueprint selected by the selection instruction from the blueprint information storage unit 121. The display control unit 112 displays the read out blueprint on the display 23 of the information terminal 20. When the instruction receiving unit 111 detects input of an instruction to specify a photography date and time, the display control unit 112 displays multiple photography location icons indicating multiple photography locations at the photography date and time specified by the specification instruction, superimposed on the blueprint. In addition, the display control unit 112 displays lines connecting adjacent photography location icons, indicating the trajectory of the photographer's movement during photography, superimposed on the blueprint.
[0066] Furthermore, an image (hereinafter, a second image) different from the multiple images taken at one of the multiple photography locations indicated by the multiple photography location icons may be linked to a position within a predetermined range of the photography location. A position within a predetermined range of the photography location refers to a position within a certain distance range from the photography location.
[0067] The second image is, for example, an image taken at a different date and time from the multiple images taken at multiple shooting locations indicated by multiple shooting location icons stored in the image information storage unit 122. The second image is not limited to this, and may also be an image taken at a shooting location different from the multiple shooting locations on the same date and time as the multiple images taken at the multiple shooting locations indicated by the multiple shooting location icons stored in the image information storage unit 122. A second image linked to a position within a predetermined range of a shooting location is a second image associated with that position as a shooting location in the image information stored in the image information storage unit 122.
[0068] In this way, when the second image is linked to a position within a predetermined range of any of the multiple shooting locations indicated by the multiple shooting location icons, the display control unit 112 further superimposes and displays a position icon indicating the position to which the second image is linked on the blueprint.
[0069] Fig. 2 is a diagram showing an example of a design drawing 200 displayed on the display 23 of the information terminal 20. Fig. 2 shows an example in which six photography location icons 201, one position icon 202, and a trajectory 203 are superimposed on the design drawing 200. In this example, the photography location icon 201 is composed of a circular image. This indicates that a series of multiple images taken at six photography locations A indicated by the six photography location icons 201 are omnidirectional images.
[0070] On the other hand, the position icon 202 is configured with a triangular image. This indicates that the second image linked to the position P indicated by the position icon 202, which is within a predetermined range of the shooting location Aa indicated by the shooting location icon 201a, is a two-dimensional image (planar image). When the second image linked to the position P indicated by the position icon 202 is an omnidirectional image (360-degree image), the display control unit 112 displays the position icon 202 in a form different from that of the shooting location icon 201 (for example, a diamond shape).
[0071] The trajectory 203 is made up of lines connecting adjacent photography location icons 201. In this example, the trajectory 203 indicates the trajectory of the photographer who took images at six photography locations A indicated by the six photography location icons 201. The photography location icon 201a located at the tip of the trajectory 203 indicates the photography start location Aa, and the photography location icon 201b located at the rear end of the trajectory 203 indicates the photography end location Ab.
[0072] Therefore, a user looking at the blueprint 200 in the example of Figure 2 can easily understand that there is a second image, a two-dimensional image, taken individually at a position P within a predetermined range of the starting point Aa of the shooting, and the shooting location A and type (omnidirectional image) of six images taken in a single shooting operation in the specified space shown in the blueprint 200.
[0073] Here, it is assumed that the user selects a photography location icon 201 indicating one photography location A from the plurality of photography location icons 201 displayed on the display 23 of the information terminal 20, and the instruction receiving unit 111 detects input of an instruction to select the photography location A. Hereinafter, the photography location icon 201 indicating the one photography location A selected by the user will be referred to as a first photography location icon 201a. The photography location A indicated by the first photography location icon 201a will be referred to as a first photography location Aa.
[0074] In this case, the display control unit 112 reads out the image taken at the first imaging point Aa from the image information storage unit 122 and displays the read out image on the display 23 of the information terminal 20. Hereinafter, the image taken at the first imaging point Aa will be referred to as the first image. When a second image is linked to a position within a predetermined range of the first imaging point Aa, the display control unit 112 displays information indicating the second image on the first image.
[0075] In detail, when the position to which the second image is linked (hereinafter, the target position) is not included in the image of the first image displayed on the display 23 (hereinafter, the display image), the display control unit 112 displays information indicating the second image on a side of the display image closer to the target position than the center. On the other hand, when the display image includes the target position, the display control unit 112 displays information indicating the second image at the target position within the display image.
[0076] In other words, when the shooting location of the second image is not included in the angle of view of the displayed image, the display control unit 112 displays information indicating the second image closer to the position corresponding to the shooting location of the second image than the center of the displayed image. On the other hand, when the shooting location of the second image is included in the angle of view of the displayed image displayed on the display 23, the display control unit 112 displays information indicating the second image at a position in the displayed image corresponding to the shooting location of the second image.
[0077] 3 is a diagram showing an example of a display screen 300 that is displayed on the display 23 when the first photographing location icon 201a is selected. The display screen 300 includes a design plan display field 310 and a detailed image display field 320. When the instruction receiving unit 111 detects input of an instruction to select the first photographing location Aa, the display control unit 112 displays the design plan 200 with the photographing location icon 201 and the like superimposed in the design plan display field 310 of the display screen 300, and displays an image 301a with a predetermined angle of view extracted from the first image in the detailed image display field 320.
[0078] The display control unit 112 further superimposes the shooting date and time 323 of the first image in the upper left corner of the detailed image display field 320. The display position of the shooting date and time 323 of the first image is not limited to the upper left corner of the detailed image display field 320, and may be, for example, the upper right corner of the detailed image display field 320. The display control unit 112 may also be configured not to display the shooting date and time 323 of the first image in the detailed image display field 320.
[0079] Fig. 4 is a diagram showing an example of the first image 301. More specifically, when the first image 301 is an omnidirectional image as shown in Fig. 4, the display control unit 112 extracts an image 301a with a predetermined angle of view that can be displayed in the detailed image display field 320 from the first image 301, and displays the extracted image 301a in the detailed image display field 320 as shown in Fig. 3.
[0080] In Fig. 4, the symbol P indicates the position (target position) to which the second image is linked. Fig. 3 shows an example in which the target position P, which is the shooting point of the second image, is not included within the angle of view of the display image 301a of the first image 301 displayed on the display 23, and therefore the display control unit 112 displays an icon 322 indicating the second image as information indicating the second image on the left side of the display image 301a, which is closer to the target position P than the center of the display image 301a. Details of the process by which the display control unit 112 determines whether the target position P is included in the display image 301a will be described later.
[0081] When the distance from the center of the display image 301a to the target position P to the left in the first image 301 is shorter than the distance from the center of the display image 301a to the target position P to the right, the display control unit 112 displays an icon 322 indicating the second image on the left side, closer to the target position P than the center of the display image 301a.
[0082] On the other hand, when the distance from the center of display image 301a to target position P in the right direction in first image 301 is shorter than the distance from the center of display image 301a to target position P in the left direction in first image 301, display control unit 112 displays icon 322 representing the second image on the right side of display image 301a, closer to target position P than the center. In this case, icon 322 displayed on the right side of display image 301a, closer to target position P than the center, may be an icon obtained by horizontally inverting icon 322 shown in Fig. 3. Furthermore, the form of icon 322 representing the second image may differ depending on whether the second image is composed of an omnidirectional image or a two-dimensional image.
[0083] Here, suppose that an operation is performed to slide the display image 301a displayed in the detailed image display field 320 in a certain direction. In this case, the information terminal 20 transmits to the server 10 an instruction to change the display angle of view, indicating that the angle of view of the image 301a displayed in the detailed image display field 320 should be changed by the amount of the slide in that direction. When the instruction receiving unit 111 detects the input of the change instruction, the display control unit 112 changes the angle of view of the image 301a displayed in the detailed image display field 320 by the amount indicated by the change instruction in the direction opposite to the direction indicated by the change instruction.
[0084] 5 is a diagram showing another example of the display screen 300 displayed on the display 23 when the first shooting location icon 201a is selected. For example, as shown in FIG. 3, assume that a portion of the first image 301a near the center thereof is displayed in the detailed image display field 320. In this case, when an operation to slide the image 301a to the left is performed, the display control unit 112 extracts an image 301b (FIG. 4) from the first image 301 shown in FIG. 4 that has been changed to the right by the amount indicated by the change instruction, which is opposite to the direction indicated by the change instruction detected by the instruction receiving unit 111, and displays the image 301b in the detailed image display field 320 as shown in FIG. 5.
[0085] 5 shows an example in which the display control unit 112 displays an icon 324 indicating the second image at the target position P in the display image 301b, because the target position P, which is the shooting point of the second image, is included within the angle of view of the display image 301b of the first image 301 that is displayed on the display 23. Note that, similar to the icon 322 indicating the second image, the form of the icon 324 indicating the second image may differ depending on whether the second image is configured as an omnidirectional image or a two-dimensional image.
[0086] When an operation to select the icon 324 indicating the second image is performed, the information terminal 20 transmits to the server 10 a display instruction for the second image indicated by the icon 324. Similarly, when an operation to select the position icon 202 superimposed on the design drawing 200 displayed in the design drawing display field 310 is performed, the information terminal 20 transmits to the server 10 a display instruction for the second image linked to the position P indicated by the position icon 202.
[0087] Fig. 6 is a diagram showing an example of the display screen 300 displaying the second image 302. When the instruction receiving unit 111 detects input of an instruction to display the second image 302, the display control unit 112 displays the second image 302 indicated by the display instruction in the detailed image display field 320, instead of the first image 301, as shown in Fig. 6 .
[0088] The display control unit 112 further superimposes the shooting date and time 325 of the second image 302 displayed in the detailed image display field 320 in the upper left corner of the detailed image display field 320. The display position of the shooting date and time 325 is not limited to the upper left corner of the detailed image display field 320, and may be, for example, the upper right corner of the detailed image display field 320. The display control unit 112 may also be configured not to display the shooting date and time 325 of the second image 302 in the detailed image display field 320.
[0089] The display control unit 112 further displays a re-display icon 311 at the bottom end of the blueprint display field 310 for re-displaying in the detailed image display field 320 the first image 301 that was displayed in the detailed image display field 320 immediately before displaying the second image 302. The display position of the re-display icon 311 is not limited to the bottom end of the blueprint display field 310, and may be, for example, an area in the blueprint display field 310 where the blueprint 200 is not displayed, such as the top end of the blueprint display field 310.
[0090] When an operation to select the re-display icon 311 is performed, the information terminal 20 transmits an instruction to re-display the first image 301 to the server 10. When the instruction receiving unit 111 detects the input of the re-display instruction, the display control unit 112 displays, in the detailed image display field 320, the first image 301 that was displayed in the detailed image display field 320 immediately before the second image 302 was displayed, in place of the second image 302, as shown in FIG.
[0091] In the above example, the appearance of icon 322 (Figure 3) indicating the second image displayed in display image 301a that does not include target position P is different from the appearance of icon 324 (Figure 5) indicating the second image 302 displayed in display image 301b that includes target position P, but the appearances of the two icons 322, 324 may be the same.
[0092] The process described above in which the display control unit 112 displays images, etc. on the display 23 of the information terminal 20 is realized by the display control unit 112 sending a display instruction including image data of the image to be displayed on the display 23 and the display screen, etc., to the information terminal 20 using the communication unit 13.
[0093] (Method of determining whether or not target position P is included in displayed image) Next, details of the process performed by the display control unit 112 to determine whether or not target position P is included in the displayed image will be described. Fig. 7 is an explanatory diagram of a method of determining whether or not target position P is included in the displayed image. The X-axis in Fig. 7 indicates the east-west direction, which is the horizontal axis of the design drawing 200, with the +X direction indicating the east direction and the -X direction indicating the west direction. The Y-axis indicates the north-south direction, which is the vertical axis of the design drawing 200, with the +Y (upward) direction indicating the north direction and the -Y (downward) direction indicating the south direction.
[0094] The coordinates (x a , y a 7 indicates the coordinates of the photographing point A of the first image 301, which is the display image displayed in the detailed image display field 320, that is, the coordinates of the first photographing point Aa indicated by the first photographing point icon 201a selected on the design drawing 200. p , y p ) indicates the coordinates of the photographing point of the second image 302, which is located at a position closer to the first photographing point Aa than the predetermined distance d, that is, the coordinates of the target position P.
[0095] Here, the angle φ is measured counterclockwise from the north direction (+Y (upward) direction) which is the reference direction of the shooting direction. 1 From the rotated direction (hereinafter referred to as the first direction), the angle φ counterclockwise from the north direction 2 A predetermined angle of view φ (=φ 2 -φ 1 ) is displayed in the detailed image display field 320.
[0096] When the first image 301 is first displayed in the detailed image display field 320 (FIGS. 3 and 5), the display control unit 112 adjusts the angle φ 1 The initial value of the angle φ is −φ / 2. 2 Assuming that the initial value of the angle φ is φ / 2, an image having a predetermined angle of view φ is extracted from the first image 301, and the extracted image is displayed in the detailed image display field 320. 1 and angle φ 2The initial value of the angle φ is not limited to this, and may be set in advance to another angle. After that, the display control unit 112 changes the angle of view of the image displayed in the detailed image display field 320 in response to the instruction to change the display angle of view detected by the instruction receiving unit 111. 1 and angle φ 2 It is possible to grasp the following.
[0097] Therefore, the display control unit 112 calculates the coordinates (x a , y a ) to the coordinates of the target position P (x p , y p If the direction rotated counterclockwise by an angle θ from the north direction, which is the direction toward the target position P, is a direction between the first direction and the second direction, the display control unit 112 determines that the target position P is included in the display image 301b. On the other hand, if the direction rotated counterclockwise by an angle θ from the north direction is not a direction between the first direction and the second direction, the display control unit 112 determines that the target position P is not included in the display image 301b.
[0098] More specifically, the display control unit 112 converts the angle θ into the coordinates (x a , y a ) and the coordinates of the target position P (x p , y p ) is calculated using the following formula based on
[0099] The display control unit 112 determines whether the calculated angle θ is equal to the angle φ 1 or more and the above angle φ 2 If the calculated angle θ is less than the angle φ 1 Less than or equal to the above angle φ 2 If it is greater than , it is determined that the target position P is not included in the image 301b.
[0100] The above formula is based on the coordinates (x a , y a ) to the coordinates of the target position P (x p , y p ) is derived as a direction rotated counterclockwise by an angle θ from the north direction. However, the coordinates (xa , y a ) to the coordinates of the target position P (x p , y p The above formula may be modified to express the direction toward the north direction in the blueprint 200 as a clockwise or counterclockwise angle from a direction other than the north direction in the blueprint 200.
[0101] Next, a description will be given of the processing of the information processing system 1. Fig. 8 is a flowchart showing the processing of the information processing system 1. This flowchart is triggered by the instruction receiving unit 111 detecting input of an instruction to select a blueprint, the display control unit 112 displaying the blueprint 200 selected by the selection instruction on the display 23 of the information terminal 20, and then the instruction receiving unit 111 detecting input of an instruction to specify the date and time of photography.
[0102] 2 , the display control unit 112 displays a plurality of photography location icons 201 indicating a plurality of photography locations A at the photography date and time specified by the designation instruction detected by the instruction receiving unit 111, superimposed on the blueprint 200. The display control unit 112 also displays a trajectory 203 of the movement of the photographer during photography, superimposed on the blueprint 200. When a second image is linked to a position within a predetermined range of any one of the photography locations A indicated by the plurality of photography location icons 201, the display control unit 112 displays a position icon 202 indicating the position P to which the second image is linked, superimposed on the blueprint 200.
[0103] Next, in step S11, the user selects the first image capturing location icon 201a indicating the first image capturing location Aa, and the instruction receiving unit 111 detects input of an instruction to select the first image capturing location Aa.
[0104] Next, in step S12, the display control unit 112 reads out the first image 301 taken at the first photographing location Aa from the image information storage unit 122, and extracts an image 301a at a predetermined angle of view φ ( FIG. 7 ) from the read out first image 301. For example, as shown in FIG. 3 , the display control unit 112 displays the design plan 200 with the photographing location icon 201 and the like superimposed on it in the design plan display field 310 of the display screen 300, and displays the extracted image 301a in the detailed image display field 320 of the display screen 300.
[0105] Next, in step S13, the display control unit 112 determines whether the second image 302 is linked to a position within a predetermined range of the first image capturing point Aa. If it is determined that the second image 302 is linked (YES in step S13), the process proceeds to step S14. If it is determined that the second image 302 is not linked (NO in step S13), the process returns to step S11.
[0106] In step S14, the display control unit 112 determines whether the position to which the second image 302 is linked, that is, the target position P which is the shooting point of the second image 302, is included in the display image displayed in the detailed image display field 320. If it is determined that the target position P is included in the display image (YES in step S14), the processing proceeds to step S15. If it is determined that the target position P is not included in the display image (NO in step S14), the processing proceeds to step S16.
[0107] In step S15, the display control unit 112 displays an icon 324 representing the second image 302 at a target position P included in the display image, as shown in Fig. 5, for example. When the processing of step S15 ends, the processing returns to step S11.
[0108] In step S16, the display control unit 112 determines whether the target position P is on the left or right side of the display image displayed in the detailed image display field 320. Specifically, if the distance from the center of the display image to the target position P to the left is shorter than the distance from the center of the display image to the target position P to the right, the display control unit 112 determines that the target position P is on the left side of the display image. Conversely, if the distance from the center of the display image to the target position P to the right is shorter than the distance from the center of the display image to the target position P to the left, the display control unit 112 determines that the target position P is on the right side of the display image.
[0109] In step S16, if it is determined that the target position P is on the left side of the displayed image (left side in step S16), the process proceeds to step S17. If it is determined that the target position P is on the right side of the displayed image (right side in step S16), the process proceeds to step S18.
[0110] 4, the display control unit 112 displays an icon 322 representing the second image on the left side of the display image 301a, closer to the target position P than the center of the display image 301a. When the process of step S17 ends, the process returns to step S11.
[0111] In step S18, the display control unit 112 displays an icon representing the second image on the right side of the display image, closer to the target position P than the center of the image. When the process of step S18 ends, the process returns to step S11.
[0112] As described above, according to the above embodiment, when selection of the first photographing location icon 201a is detected, the first image 301 photographed at the first photographing location Aa is displayed on the display 23, and when the second image 302 is linked to a position within a predetermined range of the first photographing location Aa, the icons 322 and 324 indicating the second image 302 are displayed on the first image 301. This makes it possible to check whether or not there is a related second image 302 around the first photographing location Aa, which is the photographing location of the first image 301 being displayed, without increasing the number of processing steps.
[0113] The present disclosure can employ the following modifications.
[0114] (1) In step S15 ( FIG. 8 ), the display control unit 112 may further include an image indicating the shooting direction of the second image 302 in the information indicating the second image 302 to be displayed at the target position P in the display image. In this case, it is possible to easily grasp not only the target position P to which the second image 302 is associated, but also the shooting direction of the second image 302 at the target position P.
[0115] 9 is a diagram showing a display example of an image 327 indicating the shooting direction of the second image 302. Specifically, as shown in FIG. 9 , when the target position P is included in the display image 301b displayed in the detailed image display field 320, the display control unit 112 may display an icon 324a indicating the second image 302 and an image 327 indicating the shooting direction of the second image 302 at the target position P.
[0116] 9 illustrates an example in which the display control unit 112 further superimposes auxiliary lines 326 on the display image 301b displayed in the detailed image display field 320 to provide a stereoscopic view of the display image 301b, but the auxiliary lines 326 do not necessarily have to be displayed. Also, in FIG. 9 , the icon 324a representing the second image 302 includes auxiliary lines indicating the east-west and north-south directions to more clearly indicate the shooting direction of the second image 302. However, the same icon as the icon 322 representing the second image 302 shown in FIG. 5 but without the auxiliary lines may be used as the icon representing the second image 302. Similarly to the icon 324 representing the second image, the appearance of the icon 324a representing the second image may differ depending on whether the second image is an omnidirectional image or a two-dimensional image.
[0117] This modified example can be realized, for example, as follows: Figures 10 and 11 are explanatory diagrams of a display method for an image 327 indicating the shooting direction of the second image 302. Figure 10 is a diagram in which a vector Vd indicating the shooting direction of the second image 302 and a vector Vc indicating the direction of the center of the angle of view of the displayed image 301b are added to Figure 7.
[0118] 10 , the display control unit 112 refers to the meta information of the second image 302 stored in the image information storage unit 122, and acquires the angle λ (hereinafter referred to as the first angle) that the shooting direction (vector Vd) of the second image 302 makes counterclockwise from the north direction. The display control unit 112 then acquires the angle φ that the first direction makes counterclockwise from the north direction. 1 and the angle φ that the second direction makes counterclockwise from the north direction 2 is used to calculate the angle (hereinafter, second angle) (φ 1 +φ 2 ) / 2.
[0119] Then, the display control unit 112 superimposes and displays the icon 324a representing the second image 302 on the display image 301b so that the center Q (the intersection of the auxiliary line 328 indicating the east-west direction and the auxiliary line 329 indicating the north-south direction) of the icon 324a representing the second image 302 is located on the target position P, as shown in Figure 11.
[0120] Next, the display control unit 112 calculates the angle from the first angle λ to the second angle (φ 1 +φ 2 ) / 2 is subtracted from the angle λ-(φ 1 +φ 2 ) / 2 is calculated as the angle (hereinafter referred to as the third angle) used to display an image 327 indicating the shooting direction of the second image 302.
[0121] Then, the display control unit 112 calculates a third angle λ-(φ) counterclockwise from a line that indicates the target position P and that has the center Q of the icon 324a as the base. 1 +φ 2 An image of an arrow pointing in a direction rotated by 2 / 2 is displayed superimposed on the icon 324a as an image 327 indicating the shooting direction of the second image 302.
[0122] (2) Fig. 12 is a flowchart showing a modified example of the processing of the information processing system 1. The processing of the information processing system 1 shown in Fig. 8 may be modified as shown in Fig. 12.
[0123] Specifically, if it is determined in step S13 that the second image 302 is linked to a position within a predetermined range with respect to the first image capturing point Aa, the process proceeds to step S21.
[0124] In step S21, the display control unit 112 identifies the positions of pixels of the second image 302 in the first image 301 by pattern matching.
[0125] Next, in step S22, the display control unit 112 determines whether the pixel position identified in step S21 (hereinafter, the specific pixel position) is included in the display image displayed in the detailed image display field 320. If it is determined that the specific pixel position is included in the display image (YES in step S22), the process proceeds to step S19. If it is determined that the specific pixel position is not included in the display image (NO in step S22), the process proceeds to step S23.
[0126] In step S19, the display control unit 112 displays an icon 324 representing the second image 302 at the specific pixel position.
[0127] In step S23, the display control unit 112 determines whether the specific pixel position is on the left or right side of the display image displayed in the detailed image display field 320. Specifically, if the distance from the center of the display image to the left of the specific pixel position is shorter than the distance from the center of the display image to the right of the specific pixel position, the display control unit 112 determines that the specific pixel position is on the left side of the display image. Conversely, if the distance from the center of the display image to the right of the specific pixel position is shorter than the distance from the center of the display image to the left of the specific pixel position, the display control unit 112 determines that the specific pixel position is on the right side of the display image.
[0128] In step S23, if it is determined that the specific pixel position is on the left side of the displayed image (left side in step S23), the processing proceeds to step S17, and if it is determined that the specific pixel position is on the right side of the displayed image (right side in step S23), the processing proceeds to step S18.
[0129] According to this modification, it is possible to appropriately grasp the positional relationship between the display image of the first image 301 displayed on the display 23 and the position of the pixel to which the second image 302 is linked. In particular, when the first image 301 is configured as an omnidirectional image, it is possible to appropriately grasp the positional relationship in the elevation angle direction between the display image and the second image 302. Therefore, it is possible to appropriately superimpose and display the icon 324 representing the second image 302 on the specific pixel position to which the second image 302 is linked, taking the elevation angle direction into consideration.
[0130] (3) When displaying the first image 301 taken at the first photographing point Aa in the detailed image display field 320, the display control unit 112 may further determine whether the first image 301 includes a second photographing point different from the first photographing point Aa among the multiple photographing points A indicated by the multiple photographing point icons 201 displayed in the design plan display field 310. This determination may be realized, for example, by processing similar to that of step S14 ( FIG. 8 ).
[0131] If it is determined that the second photographing location is included, the display control unit 112 may perform processing similar to that of step S15 ( FIG. 8 ) to display information indicating the image photographed at the second photographing location at a position corresponding to the second photographing location in the first image 301 displayed in the detailed image display field 320, in a manner different from the information indicating the second image 302, such as the icons 322, 324, and 324a indicating the second image 302. The information indicating the image photographed at the second photographing location may be constituted, for example, by an icon indicating the direction from the second photographing location to a photographing location adjacent to the second photographing location.
[0132] The present disclosure is useful in the technical field of remotely managing the progress of construction work at a construction site.
Claims
1. An information processing method in a computer, comprising: displaying a bird's-eye view image on a display of a terminal device with multiple shooting location icons superimposed thereon, each of which indicates a plurality of shooting location icons; and, when selection of a first shooting location icon, which is one of the plurality of shooting location icons, is detected, displaying a first image taken at the first shooting location indicated by the first shooting location icon on the display; wherein displaying the first image includes, when a second image different from the plurality of images taken at the plurality of shooting locations is linked to a position within a predetermined range of the first shooting location, displaying information indicating the second image on the first image.
2. The information processing method according to claim 1, wherein the second image is an image taken at a different date and time from the plurality of images.
3. The information processing method according to claim 1 or 2, wherein the information representing the second image includes an icon representing the second image.
4. The information processing method of claim 1, wherein the first image is composed of an omnidirectional image, and displaying information indicating the second image includes, when a display image, which is an image of the first image that is displayed on the display, does not include a target position to which the second image is linked, displaying information indicating the second image on a side of the display image closer to the target position than a center of the display image.
5. The information processing method of claim 1, wherein the first image is composed of an omnidirectional image, and displaying information indicating the second image includes, when a display image, which is an image of the first image displayed on the display, includes a target position to which the second image is linked, displaying information indicating the second image at the target position in the display image.
6. The information processing method according to claim 5, wherein the information indicating the second image includes an image indicating the shooting direction of the second image.
7. An information processing method according to any one of claims 4 to 6, wherein displaying information indicating the second image includes identifying a position of a pixel of the second image in the first image by pattern matching, and identifying the position of the pixel as the target position.
8. The information processing method according to claim 1, further comprising: when a selection of information showing the second image is detected, displaying the second image on the display in place of the first image.
9. The information processing method according to claim 1, wherein the information indicating the second image differs depending on whether the second image is constituted by an omnidirectional image or a two-dimensional image.
10. The information processing method of claim 1, further comprising, when the image displayed on the display includes a second shooting location different from the first shooting location among the multiple shooting locations, displaying information indicating the image taken at the second shooting location in a manner different from the information indicating the second image.
11. The information processing method of claim 1, wherein displaying the bird's-eye image includes: if the second image is linked to a position within a predetermined range of any one of the multiple shooting locations, further superimposing a position icon indicating the position to which the second image is linked on the bird's-eye image; and further includes: if selection of the position icon is detected, displaying on the display the second image linked to the position indicated by the position icon.
12. An information processing device including a processor that executes the following steps: displaying a bird's-eye view image on a display of a terminal device with multiple shooting location icons superimposed thereon, each of which indicates a multiple shooting location; and, when detecting selection of a first shooting location icon, which is one of the multiple shooting location icons, displaying a first image taken at the first shooting location indicated by the first shooting location icon on the display; wherein displaying the first image includes, when a second image different from the multiple images taken at the multiple shooting locations is linked to a position within a predetermined range of the first shooting location, displaying information indicating the second image on the first image.
13. An information processing program that causes a computer to execute the following steps: displaying a bird's-eye view image on a display of a terminal device with multiple shooting location icons superimposed thereon, indicating multiple shooting location icons; and, when selection of a first shooting location icon, which is one of the multiple shooting location icons, displaying a first image taken at the first shooting location indicated by the first shooting location icon, on the display, when selection of the first shooting location icon is detected, wherein displaying the first image includes, when a second image different from the multiple images taken at the multiple shooting locations is linked to a position within a predetermined range of the first shooting location, displaying information indicating the second image on the first image.
Citation Information
Patent Citations
Information processing apparatus, information processing system, control method, information processing method, and program thereof
JP2015046937A
Image information generation device, method and program
JP2022012444A
System and method for comparative display of 3D tours
JP2022105568A
Electronic device and method of controlling electronic device
US20180157252A1
Information processing device and method, and program
WO2021075279A1