Information processing method, information processing device, and information processing program

Abstract

An information processing method includes: displaying a photographic image of a given space and an aerial view corresponding to the given space in a display of an information terminal; accepting selection of any two points in the aerial view or the photographic image; and displaying a distance between the two points in the photographic image corresponding to the two selected points in the aerial view, a distance between the two points in the aerial view corresponding to the two selected points in the photographic image, or the distance between the two selected points in the photographic image.

Description

Technical Field

[0001] This disclosure relates to techniques for displaying images. Background Technology

[0002] For example, in the technology of Patent Document 1, the following technology is disclosed: when a drag operation is performed in the drawing information, such as dragging straight from a desired point to another point in a straight line, the distance information representing the straight-line distance between these points is displayed overlappingly in the drawing information.

[0003] However, in the aforementioned existing technology, the desired distance between two points is displayed on the image, but the desired distance between two points within the photographic image is not indicated to the user. Furthermore, the accuracy of distances in the depth direction is low, requiring further improvement. Additionally, confirming the distance between two points increases the computer's processing steps, raising concerns about increased computer load.

[0004] Prior art literature

[0005] Patent documents

[0006] Patent Document 1: Japanese Patent Application Publication No. 2022-051601 Summary of the Invention

[0007] This disclosure is made to solve the above-mentioned problems, and its purpose is to provide a technology that can accurately indicate the distance between two points in a photographic image to the user, can reduce the computer processing steps required to confirm the distance between two points, and can reduce the computer's burden.

[0008] The information processing method disclosed herein is executed by a computer and includes: displaying a photographic image of a given space and a bird's-eye view corresponding to the given space on a display of an information terminal; accepting the selection of any two points in the bird's-eye view or the photographic image; and displaying the distance between the two points in the photographic image corresponding to the two points selected in the bird's-eye view, displaying the distance between the two points in the bird's-eye view corresponding to the two points selected in the photographic image, or displaying the distance between the two points selected in the photographic image.

[0009] According to this disclosure, the desired distance between two points within a photographic image can be accurately indicated to the user. Furthermore, the computer processing steps required to confirm the distance between two points can be reduced, thus lessening the burden on the computer. Attached Figure Description

[0010] Figure 1 This is a diagram showing the overall structure of the information processing system in this embodiment.

[0011] Figure 2A This is an example of a design drawing screen that maps multiple shooting location icons in this embodiment.

[0012] Figure 2B This is an example of a design drawing screen that maps a shooting location icon in this embodiment.

[0013] Figure 3 This figure shows an example of a photographic image displayed on the screen when a shooting location icon is selected in this embodiment.

[0014] Figure 4 This is a diagram showing a comparison display of photographic images and design drawings in this embodiment.

[0015] Figure 5 This is a diagram showing a comparison display screen in this embodiment where the distance between two points is displayed within a photographic image.

[0016] Figure 6 This is a flowchart illustrating an example of the distance display processing of the server in this embodiment.

[0017] Figure 7 This is a comparison display screen in a modified example 1 of this embodiment, showing the distance between two points within a photographic image.

[0018] Figure 8 This is a flowchart illustrating an example of the distance display processing of the server in Variation 1 of this embodiment.

[0019] Figure 9 This is a diagram showing a comparison display screen in a modified example 2 of this embodiment, in which the distance between two points is displayed in a photographic image.

[0020] Figure 10 This is a flowchart illustrating an example of the distance display processing of the server in Variation 2 of this embodiment. Detailed Implementation

[0021] (The understanding that forms the basis of this disclosure)

[0022] The following user interface is being developed: on a two-dimensional design drawing of a construction site, multiple location icons representing actual photographic locations are displayed. When a location icon is selected, an image taken at that location is displayed. This allows construction site managers to monitor the construction site's condition without physically visiting the site.

[0023] Here, there exists a user's desire to confirm the distance between two desired points within a photographic image taken at the shooting location, either during or after the shooting process.

[0024] However, in the aforementioned existing technology, the desired distance between two points is displayed on the image, but the desired distance between two points within the photographic image is not presented to the user. Furthermore, it is difficult to accurately read the distance information in the depth direction from the image. Therefore, in the existing technology, it is difficult for the user to simultaneously observe a photographic image taken at the shooting location and accurately confirm the desired distance between two points within the photographic image. Moreover, confirming the distance between two points increases the computer's processing steps, raising concerns about increased computer load.

[0025] To address the above issues, the following technology has been disclosed.

[0026] (1) The information processing method involved in one aspect of this disclosure is executed by a computer, the information processing method comprising: displaying a photographic image of a given space and a bird's-eye view corresponding to the given space on the display of an information terminal; accepting the selection of any two points in the bird's-eye view or the photographic image; and displaying the distance between two points in the photographic image corresponding to the two points selected in the bird's-eye view, displaying the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image, or displaying the distance between the two points selected in the photographic image.

[0027] According to this structure, the distance between two points in the photographic image corresponding to two points selected in the bird's-eye view is displayed within the photographic image. Alternatively, the distance between two points in the bird's-eye view corresponding to two points selected in the photographic image is displayed within the bird's-eye view. Alternatively, the distance between two points selected in the photographic image is displayed within the photographic image. Therefore, the desired distance between two points in the photographic image can be accurately presented to the user. Furthermore, the distance can be accurately presented in both the X and Y directions, including depth (Y direction). Moreover, since the desired distance between two points in the photographic image is presented to the user, the computer processing steps required to confirm the distance between two points can be reduced, thus alleviating the computer's burden.

[0028] (2) In the information processing method described in (1) above, the acceptance may include: accepting the selection of any two points in the bird's-eye view, and the display of the distance includes: calculating the distance between the two points selected in the bird's-eye view, and displaying the calculated distance as the distance between the two points in the photographic image.

[0029] Based on this structure, since the distance between two points on the bird's-eye view is calculated, the correct distance can be determined. Furthermore, since the calculated distance is displayed as the distance between two points within the photographic image, the user can be prompted with the correct distance between the desired two points within the photographic image.

[0030] (3) In the information processing method described in (1) above, the acceptance may include: accepting the selection of any two points in the photographic image, and the display of the distance includes: calculating the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image, and displaying the calculated distance in the bird's-eye view.

[0031] Based on this structure, since the distance between two points on the bird's-eye view corresponding to the two selected points on the photographic image is calculated, the correct distance can be determined. Furthermore, since the calculated distance is displayed within the bird's-eye view, the correct distance between the desired two points within the photographic image can be indicated to the user.

[0032] (4) In the information processing method described in (1) above, the acceptance may include: accepting the selection of any two points in the photographic image, and the display of the distance includes: calculating the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image, and displaying the calculated distance in the photographic image.

[0033] Based on this structure, since the distance between two points on the bird's-eye view corresponding to the two selected points on the photographic image is calculated, the correct distance can be determined. Furthermore, since the calculated distance is displayed within the photographic image, the user can be prompted with the correct distance between the desired two points within the photographic image.

[0034] (5) In any of the information processing methods described in (1) to (4) above, the photographic image may also be composed of an all-around image.

[0035] According to this structure, since photographic images of the surrounding area of ​​the shooting location can be obtained by changing the direction of the line of sight, the condition of a given space can be confirmed in more detail.

[0036] (6) In the information processing method described in (5) above, the display of the photographic image and the bird's-eye view may also include: rotating the bird's-eye view so that the viewing direction in the bird's-eye view is aligned with the top of the bird's-eye view when the viewing direction of the photographic image is changed. Furthermore, the information processing method described in (5) above may also include: displaying arrows or triangles or other graphics indicating the viewing direction in the bird's-eye view to clearly indicate the viewing direction on the bird's-eye view.

[0037] Based on this structure, users can confirm the line of sight of a photographic image on a bird's-eye view.

[0038] (7) In any of the information processing methods described in (1) to (6) above, the display of the photographic image and the bird's-eye view may include: displaying one of a plurality of photographic images taken in succession, and the display of the photographic image and the bird's-eye view may also include: displaying a switching icon, the switching icon being used to switch from the displayed one photographic image to a photographic image taken before the one photographic image or a photographic image taken after the one photographic image, and the display of the distance includes: when the switching icon is selected, switching to a photographic image taken before the one photographic image or a photographic image taken after the one photographic image, and displaying the distance in the switched photographic image.

[0039] According to this structure, even when switching to a photograph taken before or after one photograph, the desired distance between two points within the switched photograph can be indicated to the user.

[0040] (8) In any of the information processing methods described in (1) to (7) above, the bird's-eye view may be composed of a two-dimensional plan view of the given space, and the acceptance includes: accepting the selection of any two points in the horizontal direction of the two-dimensional plan view.

[0041] Based on this structure, the distance between two points in the desired horizontal direction within a photographic image can be accurately indicated to the user.

[0042] (9) In any of the information processing methods described in (1) to (7) above, the bird's-eye view may be composed of a three-dimensional simulation image of the given space or a two-dimensional side view of the given space, and the acceptance includes: accepting the selection of any two points in the vertical direction of the three-dimensional simulation image or the two-dimensional side view.

[0043] Based on this structure, the distance between two points in the desired vertical direction within a photographic image can be accurately indicated to the user.

[0044] Furthermore, this disclosure can be implemented not only as an information processing method that performs the characteristic processing described above, but also as an information processing apparatus having a structure corresponding to the characteristic processing performed by the information processing method. Furthermore, it can be implemented as a computer program that causes a computer to execute the characteristic processing included in such an information processing method. Therefore, the following other embodiments can also achieve the same effect as the information processing method described above.

[0045] (10) The information processing apparatus according to another aspect of this disclosure includes a processor that performs the following processing: displaying a photographic image of a given space and a bird's-eye view corresponding to the given space on the display of an information terminal; accepting the selection of any two points in the bird's-eye view or the photographic image; displaying the distance between two points in the photographic image corresponding to the two points selected in the bird's-eye view; displaying the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image; or displaying the distance between the two points selected in the photographic image.

[0046] (11) The information processing program involved in another aspect of this disclosure enables a computer to perform the following functions: displaying a photographic image of a given space and a bird's-eye view corresponding to the given space on the display of an information terminal; accepting the selection of any two points in the bird's-eye view or the photographic image; displaying the distance between two points in the photographic image corresponding to the two points selected in the bird's-eye view; displaying the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image; or displaying the distance between the two points selected in the photographic image.

[0047] (12) Another aspect of this disclosure involves a non-transitory computer-readable recording medium that records the information processing program described in (11) above.

[0048] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Furthermore, the embodiments described below represent specific examples of the present disclosure. The numerical values, shapes, constituent elements, steps, and order of steps shown in the following embodiments are examples and are not intended to limit the present disclosure. Furthermore, constituent elements in the following embodiments that are not described as constituent elements of independent technical solutions representing the highest-level concept are described as arbitrary constituent elements. Moreover, various elements can be combined in all embodiments.

[0049] (Implementation Method)

[0050] Figure 1 This is a diagram showing the overall structure of the information processing system 1 in this embodiment.

[0051] Information processing system 1 is a system that displays a photographic image of a given space and a bird's-eye view corresponding to the given space on the display 23 of information terminal 20, and accepts the selection of any two points in the bird's-eye view, displaying the distance between the two points in the photographic image corresponding to the two selected points in the bird's-eye view within the photographic image. Information processing system 1 includes: server 10, information terminal 20, imaging device 30, and communication device 40.

[0052] Server 10 is an example of an information processing device and a computer. Server 10, information terminal 20, and communication device 40 are communicatively connected to each other via a network NT. An example of a network NT is the Internet. Server 10 is, for example, a cloud server consisting of one or more computers. However, this is just one example; server 10 can also be composed of an edge server or installed on information terminal 20. The way server 10 is installed on information terminal 20 is an example of the way information terminal 20 is composed of an information processing device.

[0053] Information terminal 20 is held by a user. The user is, for example, the manager of a given space captured by the camera device 30. The given space is, for example, a construction site. However, this is just one example; the given space could also be a construction site, factory, shop, or office, etc. Information terminal 20 can be a portable computer, such as a smartphone or tablet, or a fixed computer. Information terminal 20 displays images on display 23 under the control of server 10. Figure 1 In the example, one information terminal 20 is shown, but multiple information terminals can be connected to the server 10 via the network NT. The information terminal 20 includes: a communication unit 21, a processor 22, a display 23, and an operation unit 24.

[0054] The communication unit 21 is a communication interface that connects the information terminal 20 to the network NT. The communication unit 21 sends instruction signals, representing various instructions received by the operation unit 24 from the user, to the server 10. The communication unit 21 receives display data from the server 10 for displaying various display screens.

[0055] The processor 22, for example, is a central processing unit (CPU) that displays the display screen represented by the display data received by the communication unit 21 on the display screen 23.

[0056] The display 23 is composed of various display devices such as liquid crystal displays or organic EL (Electro-Luminescence) displays, and displays various display screens under the control of the processor 22.

[0057] The operation unit 24 may consist of, for example, a keyboard, a touch panel, and a mouse, and accepts various instructions input by the user.

[0058] The communication device 40, for example, is a portable information terminal such as a smartphone or tablet computer, which connects the imaging device 30 to the network NT. The communication device 40 and the imaging device 30 are communicatively connected to each other via a near-field wireless communication path such as Bluetooth (registered trademark).

[0059] The shooting device 30 is, for example, a wide-angle camera that captures images at a given frame rate. A wide-angle camera, also known as a 360-degree camera, is a camera capable of acquiring images from all 360 degrees. The shooting device 30 is, for example, a portable shooting device held by a person. The person being shot may be, for example, a construction worker or a site supervisor. The shooting device 30 can be used while being held by the subject or attached to the person's body (e.g., head). Alternatively, the shooting device 30 may also be a conventional camera.

[0060] The photographer moves within the construction site while simultaneously filming using the filming device 30. At the starting point of the filming, the photographer points the filming device 30 northward and presses the filming button to begin shooting. Upon reaching the ending point, the photographer presses the filming button again to end the filming. When filming concludes, the filming device 30 transmits the series of images captured to the communication device 40.

[0061] The image includes the date and time of capture. The date and time of capture are obtained, for example, by a clock provided with the capturing device 30. Here, since the capturing device 30 captures images at a given frame rate (e.g., 10 frames per second), the capture location is defined in units of frame periods. However, this results in a large amount of data, so the capture location can also be defined every given time interval (e.g., 1 second, 5 seconds, or 10 seconds, etc.).

[0062] The communication device 40 receives multiple images transmitted by the imaging device 30. Furthermore, the communication device 40 displays a design drawing of the construction site and accepts the photographer's designation of the start and end points of the imaging session on the design drawing.

[0063] The start and end points of the shooting are determined by the photographer inputting instructions specifying their location on a site design drawing displayed on the monitor of the communication device 40. The design drawing screen includes a two-dimensional coordinate axis. Therefore, the start and end points of the shooting are defined by two-dimensional coordinate values. These start and end points are used by the server 10 to determine the location of each shooting location and the shooting direction of each image.

[0064] The communication device 40 sends capture information, including multiple captured images, to the server 10 via the network NT. Capture information is generated each time a capture action is performed. A single capture action refers to a series of actions taken by the operator holding the capture device 30 at the construction site, from the start of capture to the end of capture. Multiple images are captured through a single capture action. The capture information includes the multiple captured images and metadata for each image. The metadata includes a capture ID, a capture date and time, and a design drawing ID. The capture ID is an identifier used to identify the capture action. The capture date and time is the date and time the image was captured. The design drawing ID is an identifier used to identify the design drawing corresponding to a given space.

[0065] Server 10 includes a processor 11, a memory 12, and a communication unit 13. The processor 11 may be, for example, a central processing unit (CPU). The processor 11 includes an acquisition unit 111, a selection and reception unit 112, and a display control unit 113. The acquisition unit 111, the selection and reception unit 112, and the display control unit 113 can be implemented by the processor 11 executing an information processing program, or they may be constructed using dedicated hardware circuitry such as an ASIC. The information processing program may also be recorded on a non-transitory computer-readable recording medium.

[0066] Communication unit 13 is the communication interface connecting server 10 to network NT. Communication unit 13 receives image capture information sent by communication device 40. Communication unit 13 receives instruction signals from information terminal 20 indicating various instructions received from the user. Communication unit 13 sends display data for displaying various display screens to information terminal 20.

[0067] The memory 12 is composed of a non-volatile, rewritable storage device such as a hard disk drive or a solid-state drive. The memory 12 includes a design information storage unit 121 and an image information storage unit 122.

[0068] Design drawing information storage unit 121 stores design drawing information. Design drawing information is image information representing a design drawing of a given space. A correspondence is established between the design drawing information and the design drawing ID used to identify the design drawing. A design drawing is an example of a bird's-eye view. A design drawing is a drawing representing the design of a building site, and can also be a two-dimensional plan, blueprint, map, or perspective view of the building site. A bird's-eye view can also be called an aerial view; it can be a view viewed from above or a view observed from a high vantage point.

[0069] In addition, design drawings can also be three-dimensional simulation images of a given space or two-dimensional side views of a given space. A three-dimensional simulation image is a 3D CAD image obtained by rendering 3D CAD (Computer-Aided Design) information, or a BIM image obtained by rendering BIM (Building Information Modeling) information. For example, in the case of a construction site, an image obtained by rendering the BIM information of a completed building based on a given shooting direction is used as a three-dimensional simulation image. A two-dimensional plan view is a view of the construction site from above, and a two-dimensional side view is a view of the construction site from the side.

[0070] The acquisition unit 111 uses Visual SLAM (Simultaneous Localization and Mapping) technology to determine the location of each of the multiple images based on the shooting start location, shooting end location, and multiple images contained in the shooting information received by the communication unit 13. The location of the shooting location is represented by two-dimensional coordinate values ​​on the design drawing. Furthermore, the acquisition unit 111 also uses Visual SLAM technology to determine the shooting direction of each of the multiple images. The shooting direction of each image is represented, for example, by a three-dimensional polar coordinate vector.

[0071] Image information storage unit 122 stores image information. Image information is information that establishes a correspondence between multiple photographic images captured at multiple shooting locations and the metadata of each photographic image. Image information is generated whenever the aforementioned shooting information is received. The metadata includes: shooting ID, shooting date and time, shooting direction, shooting location, and design drawing ID. The shooting direction is the shooting direction of the shooting device 30 that captured the image. The shooting location is the location information (two-dimensional coordinate values) indicating the location where the image was captured.

[0072] Furthermore, the communication unit 13 receives an instruction from the information terminal 20 to specify the shooting date and time. The operation unit 24 of the information terminal 20 accepts the user's selection of the shooting date and time, and the communication unit 21 sends the instruction to specify the shooting date and time selected by the user to the server 10. The instruction to specify the shooting date and time includes a shooting ID.

[0073] The acquisition unit 111 acquires from the design drawing information storage unit 121 the design drawing corresponding to the design drawing ID contained in the instruction for displaying the design drawing received by the communication unit 13. Furthermore, the acquisition unit 111 acquires from the image information storage unit 122 multiple shooting locations corresponding to the shooting ID contained in the instruction for specifying the shooting date and time received by the communication unit 13.

[0074] The display control unit 113 displays the design drawing corresponding to the given space on the display 23 of the information terminal 20. The display control unit 113 displays the design drawing acquired by the acquisition unit 111 on the display 23 of the information terminal 20. The display control unit 113 sends the display data of the design drawing to the information terminal 20 via the communication unit 13. The communication unit 21 of the information terminal 20 receives the display data sent by the server 10. The display 23 displays the design drawing received by the communication unit 21.

[0075] The display control unit 113 displays multiple shooting location icons representing multiple shooting locations acquired by the acquisition unit 111 in the design drawing. Each shooting location icon corresponds to a multiple photographic image captured at the multiple shooting locations.

[0076] Figure 2A This diagram illustrates an example of a design drawing screen 201 in this embodiment, which maps multiple shooting location icons 221. The design drawing screen 201 displays a design drawing 211 for a given space. Multiple shooting location icons 221 are displayed overlapping in the design drawing screen 201.

[0077] Shooting location icon 221 is an icon representing a shooting location. Shooting location icon 221 corresponds to an image taken at that location. In this example, shooting location icon 221 consists of a circular image of a given size. The multiple shooting location icons 221 shown here correspond to multiple shooting locations belonging to a single shooting action. From the front-end shooting location icon 221 ( Figure 2A From the shooting location icon in the lower right corner to the shooting location icon 221 at the end ( Figure 2A The route taken by the top-left shooting location icon indicates the path the photographer traversed during the shooting action.

[0078] The imaging device 30 captures images at a given frame rate. In this case, the number of multiple images is represented by the frame rate. Shooting time (in seconds) is indicated. Figure 2A In the image, multiple shooting location icons 221 are displayed overlapping each other along the path the photographer moved along.

[0079] The operation unit 24 accepts a user selection of one of the multiple shooting location icons 221. The user points the mouse pointer at one of the multiple shooting location icons 221 and clicks the left mouse button. Alternatively, the user touches one of the multiple shooting location icons 221. Figure 2A In the example, one of the multiple shooting location icons 221 was selected as shooting location icon 222.

[0080] When one of the multiple shooting location icons 221 is selected, the display control unit 113 reads the photographic image corresponding to the selected shooting location icon from the image information storage unit 122 and displays the read photographic image on the display 23.

[0081] In addition, Figure 2A In the middle, multiple shooting location icons 221 are displayed overlappingly, but it is also possible to display only one shooting location icon that shows the pre-selected points required for data acquisition.

[0082] Figure 2B This diagram illustrates an example of a design drawing screen 201B in this embodiment, which maps a shooting location icon 221B. The design drawing screen 201B displays a design drawing 211 for a given space. A shooting location icon 221B is overlaid on the design drawing screen 201B. The shooting location icon 221B displayed here corresponds to one shooting location.

[0083] The operation unit 24 accepts a selection of a shooting location icon 221B by the user. The user points the mouse pointer at a shooting location icon 221B and clicks the left mouse button. Alternatively, the user touches a shooting location icon 221B.

[0084] When a shooting location icon 221B is selected, the display control unit 113 reads the photographic image corresponding to the selected shooting location icon 221B from the image information storage unit 122 and displays the read photographic image on the display 23.

[0085] Figure 3 This figure shows an example of the photographic image screen 202 displayed on the display 23 when the shooting location icon 222 is selected in this embodiment.

[0086] The photographic image screen 202 displays a photographic image 212 taken at the location corresponding to the shooting location icon 222. The display control unit 113 displays one of the multiple photographic images taken consecutively. Here, the display control unit 113 displays a rectangular photographic image, cropped from the omnidirectional image and corresponding to the viewing direction, on the monitor 23. The photographic image screen 202 includes: a date bar 231, a comparison display button 232, a design drawing display bar 233, and a walk-through indicator button 234.

[0087] Date field 231 displays the date and time of shooting the photograph 212. Comparison display button 232 is used to compare the photograph 212 with the design drawing 211. Design drawing display field 233... Figure 2A The design drawing shown is displayed in a scaled-down view (201).

[0088] The display control unit 113 displays a roaming indicator button 234, which is used to switch from one displayed photographic image to a photographic image taken before or after the first photographic image. The roaming indicator button 234 is an example of a toggle icon.

[0089] The roaming indicator button 234 is used to switch the captured image 212 to a captured image taken one month after the original date and time. Alternatively, the user can also switch the captured image 212 to a captured image taken one month before the original date and time. In this case, the display control unit 113, according to the user's instruction, causes the display 23 to display the roaming indicator button 234 in the opposite direction to the roaming indicator button 234. If the user has input an instruction to select the reversed roaming indicator button 234, the captured image taken one month before the original date and time will be displayed.

[0090] With the photographic image 212 and the design drawing 211 arranged on the display 23, the user presses the comparison display button 232. When the comparison display button 232 is pressed, the display 23 shows... Figure 4 The comparison display shown is screen 203.

[0091] Figure 4 This is a diagram showing a comparison display screen 203 that displays photographic images and design drawings in this embodiment. The comparison display screen 203 is displayed on the display 23 upon receiving a selection instruction from the comparison display button 232.

[0092] The display control unit 113 displays a photographic image 212 of a given space and a design drawing (bird's-eye view) 211 corresponding to the given space on the display 23 of the information terminal 20. Specifically, the operation unit 24 of the information terminal 20 receives a comparison display instruction for arranging the photographic image and the design drawing, and the communication unit 21 sends the comparison display instruction to the server 10. The communication unit 13 receives the comparison display instruction for arranging the photographic image and the design drawing from the information terminal 20. When the communication unit 13 receives the comparison display instruction for arranging the photographic image and the design drawing, the display control unit 113 arranges and displays the photographic image 212 and the design drawing 211.

[0093] The comparison display screen 203 includes a first area 241 and a second area 242, which are divided into two parts, left and right. The first area 241 displays the photographic image 212, and the second area 242 displays the design drawing 211.

[0094] The comparison display screen 203 includes a date bar 231, a roaming indicator button 234, and a comparison end button 235.

[0095] After the display of photographic image 212 and design drawing 211 has ended, the user presses the comparison end button 235. Upon pressing the comparison end button 235, the display 23 stops. Figure 4 The comparison display shown is shown in screen 203.

[0096] When the comparison end button 235 is pressed, the display control unit 113 returns the display screen 23 from the comparison display screen 203 to the photographic image screen 202. That is, the operation unit 24 of the information terminal 20 receives a comparison end instruction to end the display of the photographic image and design drawing, and the communication unit 21 sends the comparison end instruction to the server 10. The communication unit 13 receives the comparison end instruction to end the display of the photographic image and design drawing from the information terminal 20. Upon receiving the comparison end instruction to end the display of the photographic image and design drawing, the display control unit 113 displays only the photographic image 212.

[0097] The photographic image is a full-view image. Therefore, the display control unit 113 can also accept operations that change the viewing direction of the photographic image 212. When the user inputs an operation to change the viewing direction of the photographic image 212 using the operation unit 24, the display control unit 113 changes the viewing direction of the photographic image 212 according to the amount and direction of the operation. For example, the user hovers the mouse pointer over the photographic image 212 and moves the mouse while clicking the left mouse button (drag operation). Or, the user moves their finger while touching the photographic image 212 (slide operation). Thus, the viewing direction of the photographic image 212 is changed.

[0098] Furthermore, when the viewing direction of the photographic image 212 is changed, the display control unit 113 rotates the design drawing 211 so that the viewing direction in the design drawing 211 is aligned with the top of the design drawing 211. Therefore, since the viewing direction of the photographic image 212 is aligned with the top of the design drawing 211, the user can easily identify the viewing direction in the design drawing 211.

[0099] Furthermore, in this embodiment, the display control unit 113 may also display an arrow icon indicating the viewing direction of the photographic image 212 in the design drawing 211. If the viewing direction of the photographic image 212 is changed, the display control unit 113 may also rotate the arrow icon so that the viewing direction in the design drawing 211 matches the direction indicated by the arrow icon. In this case, the display control unit 113 does not rotate the design drawing 211, but rotates the arrow icon. Therefore, since the viewing direction of the photographic image 212 matches the direction indicated by the arrow icon displayed on the design drawing 211, the user can easily identify the viewing direction in the design drawing 211.

[0100] Furthermore, the display control unit 113 can also accept operations to zoom in or out of the photographic image 212. When the user inputs an operation to zoom in or out of the photographic image 212 using the operation unit 24, the display control unit 113 zooms in or out of the photographic image 212 according to the amount of the operation. For example, the user presses the zoom-in or zoom-out button displayed on the photographic image 212. Alternatively, the user spreads (pull-out operation) or pinches (pinch-out operation) their fingers while touching the photographic image 212. As a result, the photographic image 212 is zoomed in or out.

[0101] The selection receiving unit 112 accepts any two points selected by the user from the design drawing or photographic image.

[0102] Figure 5 This is a diagram showing a comparison display screen 203 in this embodiment, which displays the distance between two points in a photographic image.

[0103] In this embodiment, the selection receiving unit 112 accepts selections made by the user of any two points in the design drawing 211. The user uses the operation unit 24 to specify two points in the design drawing 211 where the desired distance interval is defined. The user moves the mouse pointer to the starting point and ending point of the distance interval on the design drawing 211, respectively, and clicks the left mouse button. Alternatively, the user can move the mouse pointer to the starting point of the distance interval on the design drawing 211 and click the left mouse button, then move the mouse pointer to the ending point while the left mouse button is clicked and release the left mouse button.

[0104] The display control unit 113 displays an arrow icon 301 on the design drawing 211 connecting the two points received by the selection receiving unit 112.

[0105] The display control unit 113 displays the distance between the two points in the photographic image 212 corresponding to the two points selected in the design drawing 211. The display control unit 113 calculates the distance between the two points selected in the design drawing 211 and displays the calculated distance as the distance between the two points in the photographic image 212. The design drawing 211 includes grid lines 251 representing the actual dimensions of a given space. Therefore, the display control unit 113 can accurately calculate the distance between the two points selected in the design drawing 211.

[0106] Design drawing 211 consists of a two-dimensional plan view of a given space. Therefore, the selection receiving unit 112 accepts the selection of any two points in the horizontal direction from the two-dimensional plan view. The display control unit 113 calculates the distance between the two selected points in the horizontal direction in design drawing 211 and displays the calculated distance as the distance between the two points in the horizontal direction within the photographic image 212. Here, the horizontal direction includes both the X and Y directions. Furthermore, the selection of two points can also be canceled by reselecting, etc.

[0107] Furthermore, the display control unit 113 extracts feature points from the photographic image 212 to identify structures such as columns, walls, and doors within the photographic image 212. Moreover, based on the positions of the structures within the photographic image 212 and the positions of the structures on the design drawing 211, the display control unit 113 determines the starting and ending points on the photographic image 212 that correspond to the starting and ending points on the design drawing 211.

[0108] The display control unit 113 displays the distance 311 between two points near the arrow icon 301. Furthermore, the selection receiving unit 112 can accept multiple selections of two points spaced apart, and the display control unit 113 can calculate the distances between multiple selections of two points spaced apart.

[0109] exist Figure 5 In the design drawing 211, multiple arrow icons 301, 302, and 303 corresponding to multiple intervals are displayed, and multiple distances 311, 312, and 313 are displayed near the multiple arrow icons 301, 302, and 303. The multiple arrow icons 301, 302, and 303 can be displayed in different ways or with different colors. Similarly, the multiple distances 311, 312, and 313 can also be displayed in different ways or with different colors. For example, arrow icon 301 and distance 311 could be displayed in red, arrow icon 302 and distance 312 in blue, and arrow icon 303 and distance 313 in green.

[0110] Furthermore, the display control unit 113 displays the distance 311 between the two points on the design drawing 211, but this disclosure is not particularly limited to this. The display control unit 113 may also not display the distance 311 between the two points on the design drawing 211, but only display the arrow icon 301 connecting the two points on the design drawing 211.

[0111] Furthermore, the display control unit 113 displays an arrow icon 321 on the photographic image 212 that connects to the two points on the design drawing 211 received by the selection receiving unit 112, and displays the distance 331 between the two points near the arrow icon 321. Additionally, when the selection receiving unit 112 receives selections of multiple intervals of two points, the display control unit 113 can also display the distances of the multiple intervals within the photographic image 212 corresponding to the multiple intervals selected in the design drawing 211.

[0112] exist Figure 5 In the photographic image 212, multiple arrow icons 321, 322, and 323 corresponding to multiple intervals are displayed, and multiple distances 331, 332, and 333 are displayed near the multiple arrow icons 321, 322, and 323. The multiple arrow icons 321, 322, and 323 can be displayed in different ways or with different colors. Similarly, the multiple distances 331, 332, and 333 can be displayed in different ways or with different colors. For example, arrow icon 321 and distance 331 could be displayed in red, arrow icon 322 and distance 332 in blue, and arrow icon 323 and distance 333 in green.

[0113] In addition, the display control unit 113 can also switch to a photographic image taken before or after one photographic image when the roaming indicator button 234 (switch icon) is selected, and display the distance in the switched photographic image.

[0114] In addition, arrow icons 301, 302, 303, 321, 322, and 323 are shapes with arrows at both ends, but this disclosure is not particularly limited to this. Arrow icons 301, 302, 303, 321, 322, and 323 can also be straight lines without arrows at both ends.

[0115] Next, the distance display processing of server 10 in this embodiment will be described.

[0116] Figure 6 This is a flowchart illustrating an example of the distance display processing of server 10 in this embodiment.

[0117] First, in step S1, the display control unit 113 displays the design drawing corresponding to the given space on the display 23 of the information terminal 20.

[0118] Furthermore, the communication unit 13 receives an instruction from the information terminal 20 to display a design drawing. In this case, a menu screen for selecting a design drawing is displayed on the display 23 of the information terminal 20, and the operation unit 24 receives an instruction from the user to select a design drawing from the menu screen. The input instruction is sent to the server 10 via the network NT and received by the communication unit 13. The instruction for displaying the design drawing includes a design drawing ID. The acquisition unit 111 retrieves the design drawing corresponding to the design drawing ID included in the instruction for displaying the design drawing received by the communication unit 13 from the design drawing information stored in the design drawing information storage unit 121. The display control unit 113 sends the display data of the design drawing to the information terminal 20 via the communication unit 13, thereby displaying the design drawing on the display 23 of the information terminal 20.

[0119] Furthermore, the design drawing includes multiple shooting location icons. Additionally, the operation unit 24 can also accept instructions from a user to select a desired shooting date and time. The acquisition unit 111 can also acquire multiple shooting locations corresponding to the selected shooting date and time from the image information stored in the image information storage unit 122. The display control unit 113 can also display multiple shooting location icons representing the acquired shooting locations on the design drawing.

[0120] Next, in step S2, the display control unit 113 determines the shooting location from multiple shooting locations based on the instructions received by the communication unit 13. For example... Figure 2A As shown, when the information terminal 20 receives a selection instruction from the shooting location icon, it sends the selection instruction to the server 10. This selection instruction includes the shooting ID and the shooting date and time. The display control unit 113 receives this selection instruction through the communication unit 13 to detect that a shooting location icon has been selected. The display control unit 113 uses the shooting ID and shooting date and time contained in the selection instruction received by the communication unit 13 as keywords to determine the shooting location.

[0121] Next, in step S3, the display control unit 113 displays the photographic image captured at the determined shooting location. Specifically, the display control unit 113 uses the communication unit 13 to send the display data of the photographic image to the information terminal 20. In the information terminal 20, the processor 22 displays the display data received by the communication unit 21 on the display 23. Thus, the image is displayed on the display 23. Figure 3 The photographic image shown is frame 202.

[0122] Next, in step S4, the communication unit 13 receives a comparison display instruction from the information terminal 20 for arranging and displaying the photographic image and the design drawing. The comparison display instruction is input by pressing the comparison display button 232 displayed on the photographic image screen 202. The processor 22 uses the communication unit 21 to send the comparison display instruction to the server 10.

[0123] Next, in step S5, the display control unit 113 arranges and displays the photographic image and the design drawing. Specifically, the display control unit 113 uses the communication unit 13 to send display data of the photographic image and the design drawing to the information terminal 20. In the information terminal 20, the processor 22 displays the display data received by the communication unit 21 on the display 23. Thus, the image is displayed on the display 23. Figure 4 The comparison display shown is screen 203.

[0124] Next, in step S6, the display control unit 113 accepts operations on the photographed image. Here, the display control unit 113 accepts operations to change the viewing direction of the photographed image, or to zoom in or out of the photographed image. When the viewing direction of the photographed image is changed, the display control unit 113 displays a rectangular image corresponding to the changed viewing direction within the 360-degree view as the photographed image on the display 23. Furthermore, when the photographed image is zoomed in or out, the display control unit 113 zooms in or out of the currently displayed photographed image.

[0125] Next, in step S7, the display control unit 113 rotates the design drawing according to the change in the viewing direction of the photographic image. Here, the display control unit 113 rotates the design drawing when the viewing direction of the photographic image changes, so that the viewing direction in the design drawing is aligned with the top of the design drawing.

[0126] Next, in step S8, the selection receiving unit 112 accepts the user's selection of the starting point and ending point in the design drawing. The operation unit 24 of the information terminal 20 accepts the user's input of the starting point and ending point of the distance interval to be measured in the design drawing. The processor 22 uses the communication unit 21 to send the position information representing the coordinates of the starting point and ending point on the input design drawing to the server 10. The position information sent from the information terminal 20 is received by the communication unit 13 and input to the display control unit 113. Thus, the display control unit 113 accepts the selection of the starting point and ending point in the design drawing.

[0127] Next, in step S9, the display control unit 113 calculates the distance between the starting point and the ending point on the design drawing.

[0128] Next, in step S10, the display control unit 113 displays an arrow icon connecting the starting point and the ending point on the design drawing, and displays the distance between the starting point and the ending point near the arrow icon.

[0129] Next, in step S11, the display control unit 113 determines the positions of the start and end points in the photographic image corresponding to the positions of the start and end points on the design drawing. For example, the display control unit 113 extracts feature points within the photographic image to identify pillars and doors within the photographic image. Furthermore, the display control unit 113 acquires the shooting location and viewing direction of the photographic image within the design drawing, and identifies pillars and doors existing along the viewing direction from the shooting location within the design drawing. Then, using the identified positions of pillars and doors in the photographic image, the identified positions of pillars and doors in the design drawing, and the positions of the start and end points in the design drawing, the display control unit 113 determines the positions of the start and end points in the photographic image corresponding to the positions of the start and end points in the design drawing.

[0130] Next, in step S12, the display control unit 113 displays an arrow icon connecting the starting point and the ending point on the photographed image, and displays the distance between the starting point and the ending point near the arrow icon. Thus, the display 23 shows... Figure 5 The comparison display shown is screen 203.

[0131] Next, in step S13, the communication unit 13 determines whether it has received a comparison end instruction from the information terminal 20 to end the display of the photographed image and the design drawing. The comparison end instruction is input by pressing the comparison end button 235 displayed on the comparison display screen 203. The processor 22 uses the communication unit 21 to send the comparison end instruction to the server 10.

[0132] Here, if it is determined that a comparison end instruction has been received (Yes in step S13), the process returns to step S3, and the display control unit 113 displays only the photographic image. Alternatively, if it is determined that a comparison end instruction has been received, the process may also return to step S1, and the display control unit 113 displays only the design drawing.

[0133] On the other hand, if it is determined that no comparison end instruction has been received (No in step S13), the process returns to step S6, and the display control unit 113 accepts the operation on the photographed image.

[0134] In this way, the distance between the two points in the photographic image corresponding to the two points selected in the design drawing is displayed in the photographic image. Therefore, the desired distance between the two points in the photographic image can be accurately presented to the user. Furthermore, the distance can be accurately presented in both the X and Y directions, including depth (Y direction). Moreover, since the desired distance between the two points in the photographic image is presented to the user, the computer processing steps required to confirm the distance between the two points can be reduced, thus lessening the computer's burden. Furthermore, since the distance between the two points on the design drawing is calculated, the correct distance can be calculated. Furthermore, since the calculated distance is displayed as the distance between the two points in the photographic image, the correct desired distance between the two points in the photographic image can be presented to the user. Regarding the display of the distance, it can be displayed on both the design drawing and the photographic image as described, or it can be displayed on either the design drawing or the photographic image, or other display methods can be used.

[0135] Furthermore, in this embodiment, the display control unit 113 displays multiple shooting location icons on the design drawing, representing multiple shooting locations taken consecutively; however, this disclosure is not particularly limited to this. The display control unit 113 may also display a single shooting location icon on the design drawing, representing a single shooting location taken individually. Alternatively, the display control unit 113 may also display multiple shooting location icons on the design drawing, representing multiple shooting locations taken individually.

[0136] Furthermore, in this embodiment, the design drawing may also consist of a three-dimensional simulation image of a given space or a two-dimensional side view of a given space. In this case, the selection receiving unit 112 may also accept the selection of any two points in the vertical direction from the three-dimensional simulation image or the two-dimensional side view. The display control unit 113 may also calculate the distance between the two points selected in the vertical direction in the design drawing and display the calculated distance as the distance between the two points in the vertical direction in the photographic image.

[0137] (Variation Example 1)

[0138] In the above-described embodiment, any two points in the design drawing (bird's-eye view) are selected, and the distance between the two points in the photographic image corresponding to the two selected points in the design drawing (bird's-eye view) is displayed in the photographic image. In contrast, in a variation of this embodiment, any two points in the photographic image are selected, and the distance between the two points in the design drawing (bird's-eye view) corresponding to the two selected points in the photographic image is displayed in the design drawing (bird's-eye view).

[0139] In this variation 1 of the embodiment, the same symbols are used for the same constituent elements as in the embodiment described above, and the descriptions are omitted. Furthermore, in this variation 1 of the embodiment, block diagrams are also used. Figure 1A block diagram.

[0140] In a variation of this embodiment, the selection receiving unit 112 accepts selections made by the user of any two points in the photographic image 212. The user uses the operation unit 24 to specify two points in the photographic image 212 where the desired distance interval is defined. The user moves the mouse pointer to the starting and ending points of the distance interval on the photographic image 212, respectively, and clicks the left mouse button. Alternatively, the user can move the mouse pointer to the starting point of the distance interval on the photographic image 212 and click the left mouse button, then move the mouse pointer to the ending point while the left mouse button is clicked and release the left mouse button.

[0141] Figure 7 This is a diagram showing a comparison display screen 203A in a modified example 1 of this embodiment, in which the distance between two points is displayed in a photographic image.

[0142] The display control unit 113 displays the distance between two points in the design drawing 211 (bird's-eye view) corresponding to the two points selected in the photographic image 212. The display control unit 113 calculates the distance between the two points in the design drawing 211 (bird's-eye view) corresponding to the two points selected in the photographic image 212, and displays the calculated distance in the design drawing 211 (bird's-eye view).

[0143] exist Figure 7 In the photographic image 212, multiple arrow icons 321, 322, and 323, corresponding to multiple intervals, are displayed. These multiple arrow icons 321, 322, and 323 can be displayed in different ways or with different colors. For example, arrow icon 321 could be displayed in red, arrow icon 322 in blue, and arrow icon 323 in green.

[0144] exist Figure 7 In the design drawing 211, multiple arrow icons 301, 302, and 303 corresponding to multiple intervals are displayed, and multiple distances 311, 312, and 313 are displayed near the multiple arrow icons 301, 302, and 303. The multiple arrow icons 301, 302, and 303 can be displayed in different ways or with different colors. Similarly, the multiple distances 311, 312, and 313 can also be displayed in different ways or with different colors. For example, arrow icon 301 and distance 311 could be displayed in red, arrow icon 302 and distance 312 in blue, and arrow icon 303 and distance 313 in green.

[0145] Furthermore, in a variation 1 of this embodiment, the display control unit 113 displays arrow icons 321, 322, and 323 connecting the starting point and the ending point on the photographic image 212, but does not display distances near the arrow icons 321, 322, and 323 on the photographic image 212.

[0146] Next, the distance display processing of server 10 in Variation 1 of this embodiment will be described.

[0147] Figure 8 This is a flowchart illustrating an example of the distance display processing of server 10 in Variation 1 of this embodiment.

[0148] Furthermore, due to the processing of steps S21 to S27 and Figure 6 The processes in steps S1 to S7 are the same, so the explanation is omitted.

[0149] Next, in step S28, the selection receiving unit 112 accepts the user's selection of the start point and end point in the photographic image. The operation unit 24 of the information terminal 20 accepts the user's input of the start point and end point of the distance interval to be measured in the photographic image. The processor 22 uses the communication unit 21 to send the position information representing the coordinates of the start point and end point on the input photographic image to the server 10. The position information sent from the information terminal 20 is received by the communication unit 13 and input to the display control unit 113. Thus, the display control unit 113 accepts the selection of the start point and end point in the photographic image.

[0150] Next, in step S29, the display control unit 113 displays arrow icons connecting the starting point and the ending point on the photographed image.

[0151] Next, in step S30, the display control unit 113 determines the positions of the starting and ending points on the design drawing that correspond to the positions of the starting and ending points on the photographic image. For example, the display control unit 113 extracts feature points within the photographic image to identify pillars and doors within the photographic image. Furthermore, the display control unit 113 acquires the shooting location and viewing direction of the photographic image within the design drawing, and identifies pillars and doors existing along the viewing direction from the shooting location within the design drawing. Then, using the identified positions of pillars and doors in the photographic image, the identified positions of pillars and doors in the design drawing, and the positions of the starting and ending points in the photographic image, the display control unit 113 determines the positions of the starting and ending points on the design drawing that correspond to the positions of the starting and ending points in the photographic image.

[0152] Next, in step S31, the display control unit 113 calculates the distance between the starting point and the ending point on the design drawing.

[0153] Next, in step S32, the display control unit 113 displays an arrow icon connecting the starting point and the ending point on the design drawing, and displays the distance between the starting point and the ending point near the arrow icon. Thus, the display 23 shows... Figure 7 The comparison display shown is screen 203A.

[0154] Processing in step S33 and Figure 6 The process of step S13 shown is the same, so the explanation is omitted.

[0155] In this way, the distance between the two points in the design drawing corresponding to the two points selected in the photographic image is displayed in the bird's-eye view. Therefore, the desired distance between the two points in the photographic image can be accurately indicated to the user. Furthermore, the distance can be accurately indicated in both the X and Y directions, including depth (Y direction). Moreover, since the distance between the two points in the design drawing corresponding to the two selected points in the photographic image is calculated, the correct distance can be calculated. Furthermore, since the calculated distance is displayed in the design drawing, the correct distance between the desired two points in the photographic image can be indicated to the user. The distance can be displayed on both the design drawing and the photographic image, or on either the design drawing or the photographic image, or other display methods can be used.

[0156] (Variation Example 2)

[0157] In the above-described embodiment, any two points in the design drawing (bird's-eye view) are selected, and the distance between the two points in the photographic image corresponding to the two selected points in the design drawing (bird's-eye view) is displayed in the photographic image. In contrast, in a variation of this embodiment, any two points in the photographic image are selected, and the distance between the two selected points in the photographic image is displayed in the photographic image.

[0158] In this modified embodiment 2, the same symbols are used for the same constituent elements as in the above-described embodiment, and descriptions are omitted. Furthermore, in this modified embodiment 2, block diagrams are also used. Figure 1 A block diagram.

[0159] In Variation 2 of this embodiment, the selection receiving unit 112 accepts selections made by the user of any two points in the photographic image 212. The user uses the operation unit 24 to specify two points in the photographic image 212 where the desired distance interval is defined. The user moves the mouse pointer to the start and end points of the distance interval on the photographic image 212, respectively, and clicks the left mouse button. Alternatively, the user can move the mouse pointer to the start point of the distance interval on the photographic image 212 and click the left mouse button, then move the mouse pointer to the end point while the left mouse button is clicked and release the left mouse button.

[0160] Figure 9 This is a diagram showing a comparison display screen 203B in a modified example 2 of this embodiment, in which the distance between two points is displayed in a photographic image.

[0161] The display control unit 113 displays the distance between two selected points in the photographic image 212. The display control unit 113 calculates the distance between two points in the design drawing 211 (bird's-eye view) corresponding to the two selected points in the photographic image 212, and displays the calculated distance in the photographic image 212.

[0162] exist Figure 9 In the photographic image 212, multiple arrow icons 321, 322, and 323 corresponding to multiple intervals are displayed, and multiple distances 331, 332, and 333 are displayed near the multiple arrow icons 321, 322, and 323. The multiple arrow icons 321, 322, and 323 can be displayed in different ways or with different colors. Similarly, the multiple distances 331, 332, and 333 can be displayed in different ways or with different colors. For example, arrow icon 321 and distance 331 could be displayed in red, arrow icon 322 and distance 332 in blue, and arrow icon 323 and distance 333 in green.

[0163] exist Figure 9 In the design drawing 211, multiple arrow icons 301, 302, and 303, corresponding to multiple intervals, are displayed. These multiple arrow icons 301, 302, and 303 can be displayed in different ways or with different colors. For example, arrow icon 301 could be displayed in red, arrow icon 302 in blue, and arrow icon 303 in green.

[0164] Furthermore, in a modified example 2 of this embodiment, the display control unit 113 displays arrow icons 301, 302, and 303 connecting the starting point and the ending point on the design drawing 211, but does not display the distance near the arrow icons 301, 302, and 303 on the design drawing 211.

[0165] Next, the distance display processing of server 10 in variant example 2 of this embodiment will be described.

[0166] Figure 10 This is a flowchart illustrating an example of the distance display processing of server 10 in Variation 2 of this embodiment.

[0167] Furthermore, due to the processing of steps S41 to S47 and Figure 6The processes of steps S1 to S7 are the same, so their descriptions are omitted. Furthermore, since the processes of steps S48 to S51 are the same... Figure 8 The processes in steps S28 to S31 are the same, so the explanation is omitted.

[0168] Furthermore, after the processing in step S50, the display control unit 113 can also display arrow icons connecting the starting point and the ending point on the design drawing.

[0169] Next, in step S52, the display control unit 113 displays the distance between the starting point and the ending point near the arrow icon displayed on the photographic image. As a result, the display 23 shows... Figure 9 The comparison display shown is screen 203B.

[0170] Furthermore, due to the processing in step S53 and Figure 6 The process of step S13 shown is the same, so the explanation is omitted.

[0171] In this way, the distance between the two selected points in the photographed image is displayed within the photographed image. Therefore, the desired distance between the two points within the photographed image can be accurately indicated to the user. Furthermore, the distance can be accurately indicated in both the X and Y directions, including depth (Y direction). Moreover, since the distance between the two points on the design drawing corresponding to the two selected points in the photographed image is calculated, the correct distance can be calculated. Furthermore, since the calculated distance is displayed within the photographed image, the correct distance between the desired two points within the photographed image can be indicated to the user. Regarding the display of the distance, it can be displayed on both the design drawing and the photographed image, or on either the design drawing or the photographed image, or other display methods can be used.

[0172] In addition, the functions of the apparatus involved in the embodiments of this disclosure can also be implemented by executing programs through a processor such as a CPU.

[0173] Furthermore, all the figures used above are illustrative for the purpose of specifically illustrating this disclosure, and this disclosure is not limited to the illustrative figures.

[0174] Furthermore, the order in which the steps shown in the flowchart above are executed is illustrative for the purpose of specifically illustrating this disclosure, and any other order may be used to achieve the same effect. Additionally, some of the above steps may be executed simultaneously (in parallel) with other steps.

[0175] Industrial availability

[0176] The technology disclosed herein can provide a user with high-precision indication of the distance between two desired points within a photographic image, and is therefore useful as a technology for identifying distances or dimensions at a scene during or after shooting.

Claims

1. An information processing method, executed by a computer, comprising: The information terminal's display shows a photographic image of a given space and a bird's-eye view corresponding to the given space. Accept the selection of any two points in the bird's-eye view or the photographic image; and The distance between two points in the photographic image corresponding to the two points selected in the bird's-eye view is displayed in the photographic image, or the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image is displayed in the bird's-eye view, or the distance between two points selected in the photographic image is displayed in the photographic image.

2. The information processing method according to claim 1, wherein, The acceptance includes: accepting the selection of any two points in the bird's-eye view. The distance display includes: calculating the distance between the two points selected in the bird's-eye view, and displaying the calculated distance as the distance between the two points in the photographic image.

3. The information processing method according to claim 1, wherein, The acceptance includes: accepting the selection of any two points in the photographic image. The distance display includes: calculating the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image, and displaying the calculated distance in the bird's-eye view.

4. The information processing method according to claim 1, wherein, The acceptance includes: accepting the selection of any two points in the photographic image. The distance display includes: calculating the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image, and displaying the calculated distance in the photographic image.

5. The information processing method according to any one of claims 1 to 4, wherein, The photographic images consist of omnidirectional images.

6. The information processing method according to claim 5, wherein, The display of the photographic image and the bird's-eye view includes: rotating the bird's-eye view so that the line of sight in the bird's-eye view is aligned with the top of the bird's-eye view when the line of sight in the photographic image is changed.

7. The information processing method according to any one of claims 1 to 4, wherein, The display of the photographic images and the bird's-eye view includes: displaying one of a series of photographic images taken consecutively. The display of the photographic images and the bird's-eye view further includes: displaying a switching icon, the switching icon being used to switch from the displayed one photographic image to a photographic image taken before or after the one photographic image. The distance display includes: when the toggle icon is selected, switching to a photographic image taken before or after the first photographic image, and displaying the distance within the switched photographic image.

8. The information processing method according to any one of claims 1 to 4, wherein, The bird's-eye view consists of a two-dimensional plan view of the given space. The acceptance includes: accepting the selection of any two points in the horizontal direction of the two-dimensional planar diagram.

9. The information processing method according to any one of claims 1 to 4, wherein, The bird's-eye view consists of a three-dimensional simulation image of the given space or a two-dimensional side view of the given space. The acceptance includes: accepting the selection of any two points in the vertical direction of the three-dimensional simulation image or the two-dimensional side view.

10. An information processing device, comprising a processor, The processor performs the following processing: The information terminal's display shows a photographic image of a given space and a bird's-eye view corresponding to that space. Accept the selection of any two points from the bird's-eye view or the photographic image. The distance between two points in the photographic image corresponding to the two points selected in the bird's-eye view is displayed in the photographic image, or the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image is displayed in the bird's-eye view, or the distance between two points selected in the photographic image is displayed in the photographic image.

11. An information processing program that enables a computer to perform the following functions: The information terminal's display shows a photographic image of a given space and a bird's-eye view corresponding to that space. Accept the selection of any two points from the bird's-eye view or the photographic image. The distance between two points in the photographic image corresponding to the two points selected in the bird's-eye view is displayed in the photographic image, or the distance between two points in the bird's-eye view corresponding to the two points selected in the photographic image is displayed in the bird's-eye view, or the distance between two points selected in the photographic image is displayed in the photographic image.

Images